Jul 31 09:41:52 user nova-compute[71113]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Jul 31 09:41:55 user nova-compute[71113]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=71113) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 31 09:41:55 user nova-compute[71113]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=71113) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 31 09:41:55 user nova-compute[71113]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=71113) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 31 09:41:55 user nova-compute[71113]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Jul 31 09:41:55 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:41:55 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:41:55 user nova-compute[71113]: INFO nova.virt.driver [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] Loading compute driver 'libvirt.LibvirtDriver'
Jul 31 09:41:56 user nova-compute[71113]: INFO nova.compute.provider_config [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] Acquiring lock "singleton_lock" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] Acquired lock "singleton_lock" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] Releasing lock "singleton_lock" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] Full set of CONF: {{(pid=71113) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] ******************************************************************************** {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] Configuration options gathered from: {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] ================================================================================ {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] allow_resize_to_same_host      = True {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] arq_binding_timeout            = 300 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] backdoor_port                  = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] backdoor_socket                = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] block_device_allocate_retries  = 300 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] block_device_allocate_retries_interval = 5 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cert                           = self.pem {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] compute_monitors               = [] {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] config_dir                     = [] {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] config_drive_format            = iso9660 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] config_source                  = [] {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] console_host                   = user {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] control_exchange               = nova {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cpu_allocation_ratio           = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] daemon                         = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] debug                          = True {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] default_access_ip_network_name = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] default_availability_zone      = nova {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] default_ephemeral_format       = ext4 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] default_schedule_zone          = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] disk_allocation_ratio          = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] enable_new_services            = True {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] enabled_apis                   = ['osapi_compute'] {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] enabled_ssl_apis               = [] {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] flat_injected                  = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] force_config_drive             = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] force_raw_images               = True {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] graceful_shutdown_timeout      = 5 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] heal_instance_info_cache_interval = 60 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] host                           = user {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] instance_build_timeout         = 0 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] instance_delete_interval       = 300 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] instance_format                = [instance: %(uuid)s]  {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] instance_name_template         = instance-%08x {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] instance_usage_audit           = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] instance_usage_audit_period    = month {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] internal_service_availability_zone = internal {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] key                            = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] live_migration_retry_count     = 30 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] log_config_append              = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] log_dir                        = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] log_file                       = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] log_options                    = True {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] log_rotate_interval            = 1 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] log_rotate_interval_type       = days {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] log_rotation_type              = none {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] long_rpc_timeout               = 1800 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] max_concurrent_builds          = 10 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] max_concurrent_live_migrations = 1 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] max_concurrent_snapshots       = 5 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] max_local_block_devices        = 3 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] max_logfile_count              = 30 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] max_logfile_size_mb            = 200 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] maximum_instance_delete_attempts = 5 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] metadata_listen                = 0.0.0.0 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] metadata_listen_port           = 8775 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] metadata_workers               = 3 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] migrate_max_retries            = -1 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] mkisofs_cmd                    = genisoimage {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] my_ip                          = 10.0.0.210 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] network_allocate_retries       = 0 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] osapi_compute_listen_port      = 8774 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] osapi_compute_unique_server_name_scope =  {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] osapi_compute_workers          = 3 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] password_length                = 12 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] periodic_enable                = True {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] periodic_fuzzy_delay           = 60 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] pointer_model                  = ps2mouse {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] preallocate_images             = none {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] publish_errors                 = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] pybasedir                      = /opt/stack/nova {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] ram_allocation_ratio           = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] rate_limit_burst               = 0 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] rate_limit_except_level        = CRITICAL {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] rate_limit_interval            = 0 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] reboot_timeout                 = 0 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] reclaim_instance_interval      = 0 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] record                         = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] reimage_timeout_per_gb         = 60 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] report_interval                = 10 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] rescue_timeout                 = 0 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] reserved_host_cpus             = 0 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] reserved_host_disk_mb          = 0 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] reserved_host_memory_mb        = 512 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] reserved_huge_pages            = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] resize_confirm_window          = 0 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] resize_fs_using_block_device   = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] resume_guests_state_on_host_boot = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] rpc_response_timeout           = 60 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] run_external_periodic_tasks    = True {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] running_deleted_instance_action = reap {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] running_deleted_instance_poll_interval = 1800 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] running_deleted_instance_timeout = 0 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] scheduler_instance_sync_interval = 120 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] service_down_time              = 60 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] servicegroup_driver            = db {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] shelved_offload_time           = 0 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] shelved_poll_interval          = 3600 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] shutdown_timeout               = 0 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] source_is_ipv6                 = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] ssl_only                       = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] state_path                     = /opt/stack/data/nova {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] sync_power_state_interval      = 600 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] sync_power_state_pool_size     = 1000 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] syslog_log_facility            = LOG_USER {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] tempdir                        = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] timeout_nbd                    = 10 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] transport_url                  = **** {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] update_resources_interval      = 0 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] use_cow_images                 = True {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] use_eventlog                   = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] use_journal                    = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] use_json                       = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] use_rootwrap_daemon            = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] use_stderr                     = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] use_syslog                     = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vcpu_pin_set                   = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vif_plugging_is_fatal          = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vif_plugging_timeout           = 0 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] virt_mkfs                      = [] {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] volume_usage_poll_interval     = 0 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] watch_log_file                 = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] web                            = /usr/share/spice-html5 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_concurrency.disable_process_locking = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] api.auth_strategy              = keystone {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] api.compute_link_prefix        = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] api.dhcp_domain                = novalocal {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] api.enable_instance_password   = True {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] api.glance_link_prefix         = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] api.instance_list_per_project_cells = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] api.list_records_by_skipping_down_cells = True {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] api.local_metadata_per_cell    = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] api.max_limit                  = 1000 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] api.metadata_cache_expiration  = 15 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] api.neutron_default_tenant_id  = default {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] api.use_forwarded_for          = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] api.use_neutron_default_nets   = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] api.vendordata_dynamic_targets = [] {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] api.vendordata_jsonfile_path   = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cache.backend                  = dogpile.cache.memcached {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cache.backend_argument         = **** {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cache.config_prefix            = cache.oslo {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cache.dead_timeout             = 60.0 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cache.debug_cache_backend      = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cache.enable_retry_client      = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cache.enable_socket_keepalive  = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cache.enabled                  = True {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cache.expiration_time          = 600 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cache.hashclient_retry_attempts = 2 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cache.memcache_dead_retry      = 300 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cache.memcache_password        =  {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cache.memcache_pool_maxsize    = 10 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cache.memcache_sasl_enabled    = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cache.memcache_username        =  {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cache.proxies                  = [] {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cache.retry_attempts           = 2 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cache.retry_delay              = 0.0 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cache.socket_keepalive_count   = 1 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cache.socket_keepalive_idle    = 1 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cache.socket_keepalive_interval = 1 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cache.tls_allowed_ciphers      = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cache.tls_cafile               = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cache.tls_certfile             = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cache.tls_enabled              = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cache.tls_keyfile              = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cinder.auth_section            = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cinder.auth_type               = password {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cinder.cafile                  = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cinder.certfile                = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cinder.collect_timing          = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cinder.cross_az_attach         = True {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cinder.debug                   = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cinder.endpoint_template       = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cinder.http_retries            = 3 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cinder.insecure                = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cinder.keyfile                 = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cinder.os_region_name          = RegionOne {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cinder.split_loggers           = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cinder.timeout                 = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] compute.cpu_dedicated_set      = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] compute.cpu_shared_set         = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] compute.image_type_exclude_list = [] {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] compute.max_concurrent_disk_ops = 0 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] compute.max_disk_devices_to_attach = -1 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] compute.resource_provider_association_refresh = 300 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] compute.shutdown_retry_interval = 10 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] conductor.workers              = 3 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] console.allowed_origins        = [] {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] console.ssl_ciphers            = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] console.ssl_minimum_version    = default {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] consoleauth.token_ttl          = 600 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cyborg.cafile                  = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cyborg.certfile                = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cyborg.collect_timing          = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cyborg.connect_retries         = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cyborg.connect_retry_delay     = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cyborg.endpoint_override       = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cyborg.insecure                = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cyborg.keyfile                 = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cyborg.max_version             = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cyborg.min_version             = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cyborg.region_name             = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cyborg.service_name            = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cyborg.service_type            = accelerator {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cyborg.split_loggers           = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cyborg.status_code_retries     = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cyborg.status_code_retry_delay = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cyborg.timeout                 = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] cyborg.version                 = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] database.backend               = sqlalchemy {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] database.connection            = **** {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] database.connection_debug      = 0 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] database.connection_parameters =  {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] database.connection_recycle_time = 3600 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] database.connection_trace      = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] database.db_inc_retry_interval = True {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] database.db_max_retries        = 20 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] database.db_max_retry_interval = 10 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] database.db_retry_interval     = 1 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] database.max_overflow          = 50 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] database.max_pool_size         = 5 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] database.max_retries           = 10 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] database.mysql_enable_ndb      = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] database.mysql_wsrep_sync_wait = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] database.pool_timeout          = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] database.retry_interval        = 10 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] database.slave_connection      = **** {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] database.sqlite_synchronous    = True {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] api_database.backend           = sqlalchemy {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] api_database.connection        = **** {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] api_database.connection_debug  = 0 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] api_database.connection_parameters =  {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] api_database.connection_recycle_time = 3600 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] api_database.connection_trace  = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] api_database.db_inc_retry_interval = True {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] api_database.db_max_retries    = 20 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] api_database.db_max_retry_interval = 10 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] api_database.db_retry_interval = 1 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] api_database.max_overflow      = 50 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] api_database.max_pool_size     = 5 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] api_database.max_retries       = 10 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] api_database.mysql_enable_ndb  = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] api_database.pool_timeout      = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] api_database.retry_interval    = 10 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] api_database.slave_connection  = **** {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] api_database.sqlite_synchronous = True {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] devices.enabled_mdev_types     = [] {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] ephemeral_storage_encryption.enabled = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] glance.api_servers             = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] glance.cafile                  = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] glance.certfile                = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] glance.collect_timing          = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] glance.connect_retries         = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] glance.connect_retry_delay     = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] glance.debug                   = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] glance.default_trusted_certificate_ids = [] {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] glance.enable_certificate_validation = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] glance.enable_rbd_download     = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] glance.endpoint_override       = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] glance.insecure                = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] glance.keyfile                 = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] glance.max_version             = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] glance.min_version             = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] glance.num_retries             = 3 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] glance.rbd_ceph_conf           =  {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] glance.rbd_connect_timeout     = 5 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] glance.rbd_pool                =  {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] glance.rbd_user                =  {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] glance.region_name             = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] glance.service_name            = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] glance.service_type            = image {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] glance.split_loggers           = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] glance.status_code_retries     = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] glance.status_code_retry_delay = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] glance.timeout                 = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] glance.verify_glance_signatures = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] glance.version                 = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] guestfs.debug                  = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] hyperv.config_drive_cdrom      = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] hyperv.config_drive_inject_password = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] hyperv.enable_instance_metrics_collection = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] hyperv.enable_remotefx         = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] hyperv.instances_path_share    =  {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] hyperv.iscsi_initiator_list    = [] {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] hyperv.limit_cpu_features      = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] hyperv.power_state_check_timeframe = 60 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] hyperv.use_multipath_io        = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] hyperv.volume_attach_retry_count = 10 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] hyperv.vswitch_name            = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] mks.enabled                    = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] image_cache.manager_interval   = 2400 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] image_cache.precache_concurrency = 1 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] image_cache.remove_unused_base_images = True {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] image_cache.subdirectory_name  = _base {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] ironic.api_max_retries         = 60 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] ironic.api_retry_interval      = 2 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] ironic.auth_section            = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] ironic.auth_type               = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] ironic.cafile                  = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] ironic.certfile                = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] ironic.collect_timing          = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] ironic.connect_retries         = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] ironic.connect_retry_delay     = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] ironic.endpoint_override       = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] ironic.insecure                = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] ironic.keyfile                 = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] ironic.max_version             = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] ironic.min_version             = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] ironic.partition_key           = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] ironic.peer_list               = [] {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] ironic.region_name             = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] ironic.serial_console_state_timeout = 10 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] ironic.service_name            = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] ironic.service_type            = baremetal {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] ironic.split_loggers           = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] ironic.status_code_retries     = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] ironic.status_code_retry_delay = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] ironic.timeout                 = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] ironic.version                 = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] key_manager.fixed_key          = **** {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] barbican.barbican_api_version  = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] barbican.barbican_endpoint     = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] barbican.barbican_endpoint_type = public {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] barbican.barbican_region_name  = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] barbican.cafile                = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] barbican.certfile              = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] barbican.collect_timing        = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] barbican.insecure              = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] barbican.keyfile               = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] barbican.number_of_retries     = 60 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] barbican.retry_delay           = 1 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] barbican.send_service_user_token = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] barbican.split_loggers         = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] barbican.timeout               = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] barbican.verify_ssl            = True {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] barbican.verify_ssl_path       = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] barbican_service_user.auth_section = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] barbican_service_user.auth_type = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] barbican_service_user.cafile   = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] barbican_service_user.certfile = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] barbican_service_user.collect_timing = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] barbican_service_user.insecure = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] barbican_service_user.keyfile  = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] barbican_service_user.split_loggers = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] barbican_service_user.timeout  = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vault.approle_role_id          = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vault.approle_secret_id        = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vault.cafile                   = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vault.certfile                 = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vault.collect_timing           = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vault.insecure                 = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vault.keyfile                  = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vault.kv_mountpoint            = secret {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vault.kv_version               = 2 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vault.namespace                = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vault.root_token_id            = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vault.split_loggers            = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vault.ssl_ca_crt_file          = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vault.timeout                  = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vault.use_ssl                  = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] keystone.cafile                = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] keystone.certfile              = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] keystone.collect_timing        = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] keystone.connect_retries       = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] keystone.connect_retry_delay   = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] keystone.endpoint_override     = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] keystone.insecure              = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] keystone.keyfile               = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] keystone.max_version           = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] keystone.min_version           = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] keystone.region_name           = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] keystone.service_name          = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] keystone.service_type          = identity {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] keystone.split_loggers         = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] keystone.status_code_retries   = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] keystone.status_code_retry_delay = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] keystone.timeout               = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] keystone.version               = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.connection_uri         =  {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.cpu_mode               = custom {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: WARNING oslo_config.cfg [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.cpu_power_governor_high = performance {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.cpu_power_governor_low = powersave {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.cpu_power_management   = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.device_detach_attempts = 8 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.device_detach_timeout  = 20 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.disk_cachemodes        = [] {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.disk_prefix            = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.enabled_perf_events    = [] {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.file_backed_memory     = 0 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.gid_maps               = [] {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.hw_disk_discard        = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.hw_machine_type        = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.images_rbd_glance_store_name =  {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.images_rbd_pool        = rbd {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.images_type            = default {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.images_volume_group    = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.inject_key             = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.inject_partition       = -2 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.inject_password        = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.iscsi_iface            = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.iser_use_multipath     = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.live_migration_bandwidth = 0 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.live_migration_downtime = 500 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.live_migration_inbound_addr = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.live_migration_permit_post_copy = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.live_migration_scheme  = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.live_migration_timeout_action = abort {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.live_migration_tunnelled = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: WARNING oslo_config.cfg [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Jul 31 09:41:56 user nova-compute[71113]: live_migration_uri is deprecated for removal in favor of two other options that
Jul 31 09:41:56 user nova-compute[71113]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Jul 31 09:41:56 user nova-compute[71113]: and ``live_migration_inbound_addr`` respectively.
Jul 31 09:41:56 user nova-compute[71113]: ).  Its value may be silently ignored in the future.
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.live_migration_with_native_tls = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.max_queues             = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.nfs_mount_options      = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.num_memory_encrypted_guests = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.num_pcie_ports         = 0 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.pmem_namespaces        = [] {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.quobyte_client_cfg     = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.rbd_secret_uuid        = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.rbd_user               = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.remote_filesystem_transport = ssh {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.rescue_image_id        = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.rescue_kernel_id       = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.rescue_ramdisk_id      = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.rx_queue_size          = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.smbfs_mount_options    =  {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.snapshot_compression   = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.snapshot_image_format  = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.sparse_logical_volumes = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.swtpm_enabled          = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.swtpm_group            = tss {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.swtpm_user             = tss {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.sysinfo_serial         = unique {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.tb_cache_size          = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.tx_queue_size          = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.uid_maps               = [] {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.use_virtio_for_bridges = True {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.virt_type              = kvm {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.volume_clear           = zero {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.volume_clear_size      = 0 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.volume_use_multipath   = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.vzstorage_cache_path   = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.vzstorage_mount_user   = stack {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] neutron.auth_section           = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] neutron.auth_type              = password {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] neutron.cafile                 = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] neutron.certfile               = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] neutron.collect_timing         = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] neutron.connect_retries        = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] neutron.connect_retry_delay    = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] neutron.default_floating_pool  = public {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] neutron.endpoint_override      = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] neutron.extension_sync_interval = 600 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] neutron.http_retries           = 3 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] neutron.insecure               = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] neutron.keyfile                = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] neutron.max_version            = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] neutron.min_version            = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] neutron.ovs_bridge             = br-int {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] neutron.physnets               = [] {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] neutron.region_name            = RegionOne {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] neutron.service_metadata_proxy = True {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] neutron.service_name           = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] neutron.service_type           = network {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] neutron.split_loggers          = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] neutron.status_code_retries    = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] neutron.status_code_retry_delay = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] neutron.timeout                = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] neutron.version                = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] notifications.bdms_in_notifications = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] notifications.default_level    = INFO {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] notifications.notification_format = unversioned {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] notifications.notify_on_state_change = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] pci.alias                      = [] {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] pci.device_spec                = [] {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] pci.report_in_placement        = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] placement.auth_section         = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] placement.auth_type            = password {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] placement.cafile               = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] placement.certfile             = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] placement.collect_timing       = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] placement.connect_retries      = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] placement.connect_retry_delay  = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] placement.default_domain_id    = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] placement.default_domain_name  = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] placement.domain_id            = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] placement.domain_name          = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] placement.endpoint_override    = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] placement.insecure             = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] placement.keyfile              = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] placement.max_version          = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] placement.min_version          = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] placement.password             = **** {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] placement.project_domain_id    = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] placement.project_domain_name  = Default {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] placement.project_id           = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] placement.project_name         = service {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] placement.region_name          = RegionOne {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] placement.service_name         = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] placement.service_type         = placement {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] placement.split_loggers        = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] placement.status_code_retries  = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] placement.status_code_retry_delay = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] placement.system_scope         = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] placement.timeout              = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] placement.trust_id             = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] placement.user_domain_id       = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] placement.user_domain_name     = Default {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] placement.user_id              = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] placement.username             = placement {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] placement.version              = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] quota.cores                    = 20 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] quota.count_usage_from_placement = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] quota.injected_file_content_bytes = 10240 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] quota.injected_file_path_length = 255 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] quota.injected_files           = 5 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] quota.instances                = 10 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] quota.key_pairs                = 100 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] quota.metadata_items           = 128 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] quota.ram                      = 51200 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] quota.recheck_quota            = True {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] quota.server_group_members     = 10 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] quota.server_groups            = 10 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] rdp.enabled                    = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] scheduler.image_metadata_prefilter = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] scheduler.max_attempts         = 3 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] scheduler.max_placement_results = 1000 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] scheduler.query_placement_for_availability_zone = True {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] scheduler.query_placement_for_image_type_support = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] scheduler.workers              = 3 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] filter_scheduler.host_subset_size = 1 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] filter_scheduler.isolated_hosts = [] {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] filter_scheduler.isolated_images = [] {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] filter_scheduler.pci_in_placement = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] filter_scheduler.track_instance_changes = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] metrics.required               = True {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] metrics.weight_multiplier      = 1.0 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] metrics.weight_setting         = [] {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] serial_console.enabled         = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] serial_console.port_range      = 10000:20000 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] serial_console.serialproxy_port = 6083 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] service_user.auth_section      = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] service_user.auth_type         = password {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] service_user.cafile            = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] service_user.certfile          = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] service_user.collect_timing    = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] service_user.insecure          = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] service_user.keyfile           = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] service_user.send_service_user_token = True {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] service_user.split_loggers     = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] service_user.timeout           = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] spice.agent_enabled            = True {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] spice.enabled                  = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] spice.html5proxy_port          = 6082 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] spice.image_compression        = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] spice.jpeg_compression         = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] spice.playback_compression     = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] spice.server_listen            = 127.0.0.1 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] spice.streaming_mode           = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] spice.zlib_compression         = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] upgrade_levels.baseapi         = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] upgrade_levels.cert            = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] upgrade_levels.compute         = auto {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] upgrade_levels.conductor       = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] upgrade_levels.scheduler       = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vendordata_dynamic_auth.auth_section = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vendordata_dynamic_auth.auth_type = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vendordata_dynamic_auth.cafile = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vendordata_dynamic_auth.certfile = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vendordata_dynamic_auth.insecure = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vendordata_dynamic_auth.keyfile = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vendordata_dynamic_auth.timeout = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vmware.api_retry_count         = 10 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vmware.ca_file                 = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vmware.cache_prefix            = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vmware.cluster_name            = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vmware.connection_pool_size    = 10 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vmware.console_delay_seconds   = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vmware.datastore_regex         = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vmware.host_ip                 = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vmware.host_password           = **** {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vmware.host_port               = 443 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vmware.host_username           = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vmware.insecure                = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vmware.integration_bridge      = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vmware.maximum_objects         = 100 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vmware.pbm_default_policy      = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vmware.pbm_enabled             = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vmware.pbm_wsdl_location       = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vmware.serial_port_proxy_uri   = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vmware.serial_port_service_uri = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vmware.task_poll_interval      = 0.5 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vmware.use_linked_clone        = True {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vmware.vnc_keymap              = en-us {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vmware.vnc_port                = 5900 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vmware.vnc_port_total          = 10000 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vnc.auth_schemes               = ['none'] {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vnc.enabled                    = True {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vnc.novncproxy_port            = 6080 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vnc.server_listen              = 0.0.0.0 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vnc.vencrypt_ca_certs          = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vnc.vencrypt_client_cert       = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vnc.vencrypt_client_key        = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] workarounds.disable_rootwrap   = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] workarounds.enable_numa_live_migration = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] workarounds.libvirt_disable_apic = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] wsgi.client_socket_timeout     = 900 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] wsgi.default_pool_size         = 1000 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] wsgi.keep_alive                = True {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] wsgi.max_header_line           = 16384 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] wsgi.ssl_ca_file               = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] wsgi.ssl_cert_file             = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] wsgi.ssl_key_file              = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] wsgi.tcp_keepidle              = 600 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] zvm.ca_file                    = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] zvm.cloud_connector_url        = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] zvm.reachable_timeout          = 300 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_policy.enforce_new_defaults = True {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_policy.enforce_scope      = True {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_policy.policy_default_rule = default {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_policy.policy_file        = policy.yaml {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] profiler.connection_string     = messaging:// {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] profiler.enabled               = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] profiler.es_doc_type           = notification {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] profiler.es_scroll_size        = 10000 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] profiler.es_scroll_time        = 2m {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] profiler.filter_error_trace    = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] profiler.hmac_keys             = **** {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] profiler.sentinel_service_name = mymaster {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] profiler.socket_timeout        = 0.1 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] profiler.trace_requests        = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] profiler.trace_sqlalchemy      = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] profiler_jaeger.process_tags   = {} {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] profiler_jaeger.service_name_prefix = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] profiler_otlp.service_name_prefix = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] remote_debug.host              = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] remote_debug.port              = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_messaging_rabbit.ssl      = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_messaging_notifications.retry = -1 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_messaging_notifications.transport_url = **** {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_limit.auth_section        = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_limit.auth_type           = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_limit.cafile              = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_limit.certfile            = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_limit.collect_timing      = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_limit.connect_retries     = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_limit.connect_retry_delay = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_limit.endpoint_id         = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_limit.endpoint_override   = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_limit.insecure            = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_limit.keyfile             = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_limit.max_version         = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_limit.min_version         = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_limit.region_name         = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_limit.service_name        = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_limit.service_type        = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_limit.split_loggers       = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_limit.status_code_retries = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_limit.status_code_retry_delay = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_limit.timeout             = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_limit.valid_interfaces    = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_limit.version             = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_reports.file_event_handler = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] oslo_reports.log_dir           = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vif_plug_ovs_privileged.group  = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] vif_plug_ovs_privileged.user   = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] os_vif_linux_bridge.flat_interface = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] os_vif_ovs.isolate_vif         = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] os_vif_ovs.per_port_bridge     = False {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] os_brick.lock_path             = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] privsep_osbrick.capabilities   = [21] {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] privsep_osbrick.group          = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] privsep_osbrick.helper_command = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] privsep_osbrick.user           = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] nova_sys_admin.group           = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] nova_sys_admin.helper_command  = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] nova_sys_admin.user            = None {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG oslo_service.service [None req-0da2f125-12bf-488a-a021-6c5037fb5a46 None None] ******************************************************************************** {{(pid=71113) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Jul 31 09:41:56 user nova-compute[71113]: INFO nova.service [-] Starting compute node (version 0.0.0)
Jul 31 09:41:56 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Starting native event thread {{(pid=71113) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Starting green dispatch thread {{(pid=71113) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Starting connection event dispatch thread {{(pid=71113) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Connecting to libvirt: qemu:///system {{(pid=71113) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f7912dc37c0> {{(pid=71113) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Jul 31 09:41:56 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f7912dc37c0> {{(pid=71113) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Jul 31 09:41:56 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Connection event '1' reason 'None'
Jul 31 09:41:56 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Jul 31 09:41:56 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.mount [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Initialising _HostMountState generation 0 {{(pid=71113) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Jul 31 09:42:03 user nova-compute[71113]: INFO nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Libvirt host capabilities <capabilities>
Jul 31 09:42:03 user nova-compute[71113]:   <host>
Jul 31 09:42:03 user nova-compute[71113]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Jul 31 09:42:03 user nova-compute[71113]:     <cpu>
Jul 31 09:42:03 user nova-compute[71113]:       <arch>x86_64</arch>
Jul 31 09:42:03 user nova-compute[71113]:       <model>IvyBridge-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <vendor>Intel</vendor>
Jul 31 09:42:03 user nova-compute[71113]:       <microcode version='1070'/>
Jul 31 09:42:03 user nova-compute[71113]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Jul 31 09:42:03 user nova-compute[71113]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature name='ss'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature name='vmx'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature name='pcid'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature name='osxsave'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature name='hypervisor'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature name='arat'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature name='tsc_adjust'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature name='md-clear'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature name='stibp'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature name='arch-capabilities'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature name='ssbd'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature name='invtsc'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature name='rsba'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature name='skip-l1dfl-vmentry'/>
Jul 31 09:42:03 user nova-compute[71113]:       <pages unit='KiB' size='4'/>
Jul 31 09:42:03 user nova-compute[71113]:       <pages unit='KiB' size='2048'/>
Jul 31 09:42:03 user nova-compute[71113]:     </cpu>
Jul 31 09:42:03 user nova-compute[71113]:     <power_management>
Jul 31 09:42:03 user nova-compute[71113]:       <suspend_mem/>
Jul 31 09:42:03 user nova-compute[71113]:       <suspend_disk/>
Jul 31 09:42:03 user nova-compute[71113]:       <suspend_hybrid/>
Jul 31 09:42:03 user nova-compute[71113]:     </power_management>
Jul 31 09:42:03 user nova-compute[71113]:     <iommu support='no'/>
Jul 31 09:42:03 user nova-compute[71113]:     <migration_features>
Jul 31 09:42:03 user nova-compute[71113]:       <live/>
Jul 31 09:42:03 user nova-compute[71113]:       <uri_transports>
Jul 31 09:42:03 user nova-compute[71113]:         <uri_transport>tcp</uri_transport>
Jul 31 09:42:03 user nova-compute[71113]:         <uri_transport>rdma</uri_transport>
Jul 31 09:42:03 user nova-compute[71113]:       </uri_transports>
Jul 31 09:42:03 user nova-compute[71113]:     </migration_features>
Jul 31 09:42:03 user nova-compute[71113]:     <topology>
Jul 31 09:42:03 user nova-compute[71113]:       <cells num='2'>
Jul 31 09:42:03 user nova-compute[71113]:         <cell id='0'>
Jul 31 09:42:03 user nova-compute[71113]:           <memory unit='KiB'>8140616</memory>
Jul 31 09:42:03 user nova-compute[71113]:           <pages unit='KiB' size='4'>2035154</pages>
Jul 31 09:42:03 user nova-compute[71113]:           <pages unit='KiB' size='2048'>0</pages>
Jul 31 09:42:03 user nova-compute[71113]:           <distances>
Jul 31 09:42:03 user nova-compute[71113]:             <sibling id='0' value='10'/>
Jul 31 09:42:03 user nova-compute[71113]:             <sibling id='1' value='20'/>
Jul 31 09:42:03 user nova-compute[71113]:           </distances>
Jul 31 09:42:03 user nova-compute[71113]:           <cpus num='6'>
Jul 31 09:42:03 user nova-compute[71113]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Jul 31 09:42:03 user nova-compute[71113]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Jul 31 09:42:03 user nova-compute[71113]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Jul 31 09:42:03 user nova-compute[71113]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Jul 31 09:42:03 user nova-compute[71113]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Jul 31 09:42:03 user nova-compute[71113]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Jul 31 09:42:03 user nova-compute[71113]:           </cpus>
Jul 31 09:42:03 user nova-compute[71113]:         </cell>
Jul 31 09:42:03 user nova-compute[71113]:         <cell id='1'>
Jul 31 09:42:03 user nova-compute[71113]:           <memory unit='KiB'>8255100</memory>
Jul 31 09:42:03 user nova-compute[71113]:           <pages unit='KiB' size='4'>2063775</pages>
Jul 31 09:42:03 user nova-compute[71113]:           <pages unit='KiB' size='2048'>0</pages>
Jul 31 09:42:03 user nova-compute[71113]:           <distances>
Jul 31 09:42:03 user nova-compute[71113]:             <sibling id='0' value='20'/>
Jul 31 09:42:03 user nova-compute[71113]:             <sibling id='1' value='10'/>
Jul 31 09:42:03 user nova-compute[71113]:           </distances>
Jul 31 09:42:03 user nova-compute[71113]:           <cpus num='6'>
Jul 31 09:42:03 user nova-compute[71113]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Jul 31 09:42:03 user nova-compute[71113]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Jul 31 09:42:03 user nova-compute[71113]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Jul 31 09:42:03 user nova-compute[71113]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Jul 31 09:42:03 user nova-compute[71113]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Jul 31 09:42:03 user nova-compute[71113]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Jul 31 09:42:03 user nova-compute[71113]:           </cpus>
Jul 31 09:42:03 user nova-compute[71113]:         </cell>
Jul 31 09:42:03 user nova-compute[71113]:       </cells>
Jul 31 09:42:03 user nova-compute[71113]:     </topology>
Jul 31 09:42:03 user nova-compute[71113]:     <cache>
Jul 31 09:42:03 user nova-compute[71113]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Jul 31 09:42:03 user nova-compute[71113]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Jul 31 09:42:03 user nova-compute[71113]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Jul 31 09:42:03 user nova-compute[71113]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Jul 31 09:42:03 user nova-compute[71113]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Jul 31 09:42:03 user nova-compute[71113]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Jul 31 09:42:03 user nova-compute[71113]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Jul 31 09:42:03 user nova-compute[71113]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Jul 31 09:42:03 user nova-compute[71113]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Jul 31 09:42:03 user nova-compute[71113]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Jul 31 09:42:03 user nova-compute[71113]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Jul 31 09:42:03 user nova-compute[71113]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Jul 31 09:42:03 user nova-compute[71113]:     </cache>
Jul 31 09:42:03 user nova-compute[71113]:     <secmodel>
Jul 31 09:42:03 user nova-compute[71113]:       <model>apparmor</model>
Jul 31 09:42:03 user nova-compute[71113]:       <doi>0</doi>
Jul 31 09:42:03 user nova-compute[71113]:     </secmodel>
Jul 31 09:42:03 user nova-compute[71113]:     <secmodel>
Jul 31 09:42:03 user nova-compute[71113]:       <model>dac</model>
Jul 31 09:42:03 user nova-compute[71113]:       <doi>0</doi>
Jul 31 09:42:03 user nova-compute[71113]:       <baselabel type='kvm'>+64055:+108</baselabel>
Jul 31 09:42:03 user nova-compute[71113]:       <baselabel type='qemu'>+64055:+108</baselabel>
Jul 31 09:42:03 user nova-compute[71113]:     </secmodel>
Jul 31 09:42:03 user nova-compute[71113]:   </host>
Jul 31 09:42:03 user nova-compute[71113]:   <guest>
Jul 31 09:42:03 user nova-compute[71113]:     <os_type>hvm</os_type>
Jul 31 09:42:03 user nova-compute[71113]:     <arch name='alpha'>
Jul 31 09:42:03 user nova-compute[71113]:       <wordsize>64</wordsize>
Jul 31 09:42:03 user nova-compute[71113]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='4'>clipper</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <domain type='qemu'/>
Jul 31 09:42:03 user nova-compute[71113]:     </arch>
Jul 31 09:42:03 user nova-compute[71113]:     <features>
Jul 31 09:42:03 user nova-compute[71113]:       <cpuselection/>
Jul 31 09:42:03 user nova-compute[71113]:       <deviceboot/>
Jul 31 09:42:03 user nova-compute[71113]:       <disksnapshot default='on' toggle='no'/>
Jul 31 09:42:03 user nova-compute[71113]:     </features>
Jul 31 09:42:03 user nova-compute[71113]:   </guest>
Jul 31 09:42:03 user nova-compute[71113]:   <guest>
Jul 31 09:42:03 user nova-compute[71113]:     <os_type>hvm</os_type>
Jul 31 09:42:03 user nova-compute[71113]:     <arch name='armv6l'>
Jul 31 09:42:03 user nova-compute[71113]:       <wordsize>32</wordsize>
Jul 31 09:42:03 user nova-compute[71113]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>integratorcp</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>borzoi</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>spitz</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2'>nuri</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2'>musca-b1</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>versatileab</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>kzm</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2'>musca-a</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2'>smdkc210</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>sx1</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>z2</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>tosa</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='4'>sabrelite</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>realview-eb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>n810</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>n800</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>versatilepb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>terrier</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>mainstone</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='4'>midway</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>musicpal</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>microbit</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>cubieboard</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>verdex</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>netduino2</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='4'>raspi2b</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>cheetah</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='4'>highbank</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>akita</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>connex</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>collie</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>raspi0</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <domain type='qemu'/>
Jul 31 09:42:03 user nova-compute[71113]:     </arch>
Jul 31 09:42:03 user nova-compute[71113]:     <features>
Jul 31 09:42:03 user nova-compute[71113]:       <cpuselection/>
Jul 31 09:42:03 user nova-compute[71113]:       <deviceboot/>
Jul 31 09:42:03 user nova-compute[71113]:       <disksnapshot default='on' toggle='no'/>
Jul 31 09:42:03 user nova-compute[71113]:     </features>
Jul 31 09:42:03 user nova-compute[71113]:   </guest>
Jul 31 09:42:03 user nova-compute[71113]:   <guest>
Jul 31 09:42:03 user nova-compute[71113]:     <os_type>hvm</os_type>
Jul 31 09:42:03 user nova-compute[71113]:     <arch name='armv7l'>
Jul 31 09:42:03 user nova-compute[71113]:       <wordsize>32</wordsize>
Jul 31 09:42:03 user nova-compute[71113]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>integratorcp</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>borzoi</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>spitz</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2'>nuri</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2'>musca-b1</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>versatileab</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>kzm</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2'>musca-a</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2'>smdkc210</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>sx1</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>z2</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>tosa</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='4'>sabrelite</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>realview-eb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>n810</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>n800</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>versatilepb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>terrier</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>mainstone</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='4'>midway</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>musicpal</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>microbit</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>cubieboard</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>verdex</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>netduino2</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='4'>raspi2b</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>cheetah</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='4'>highbank</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>akita</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>connex</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>collie</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>raspi0</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <domain type='qemu'/>
Jul 31 09:42:03 user nova-compute[71113]:     </arch>
Jul 31 09:42:03 user nova-compute[71113]:     <features>
Jul 31 09:42:03 user nova-compute[71113]:       <cpuselection/>
Jul 31 09:42:03 user nova-compute[71113]:       <deviceboot/>
Jul 31 09:42:03 user nova-compute[71113]:       <disksnapshot default='on' toggle='no'/>
Jul 31 09:42:03 user nova-compute[71113]:     </features>
Jul 31 09:42:03 user nova-compute[71113]:   </guest>
Jul 31 09:42:03 user nova-compute[71113]:   <guest>
Jul 31 09:42:03 user nova-compute[71113]:     <os_type>hvm</os_type>
Jul 31 09:42:03 user nova-compute[71113]:     <arch name='aarch64'>
Jul 31 09:42:03 user nova-compute[71113]:       <wordsize>64</wordsize>
Jul 31 09:42:03 user nova-compute[71113]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>integratorcp</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>borzoi</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>spitz</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2'>nuri</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2'>musca-b1</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>versatileab</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>kzm</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2'>musca-a</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2'>smdkc210</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>sx1</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>z2</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>tosa</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='4'>sabrelite</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>realview-eb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='512'>sbsa-ref</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>n810</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>n800</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>versatilepb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>terrier</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>mainstone</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='4'>midway</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>musicpal</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>microbit</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='4'>raspi3ap</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>cubieboard</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>verdex</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>netduino2</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='4'>raspi3b</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='4'>raspi2b</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>cheetah</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='4'>highbank</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>akita</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>connex</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>collie</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>raspi0</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <domain type='qemu'/>
Jul 31 09:42:03 user nova-compute[71113]:     </arch>
Jul 31 09:42:03 user nova-compute[71113]:     <features>
Jul 31 09:42:03 user nova-compute[71113]:       <acpi default='on' toggle='yes'/>
Jul 31 09:42:03 user nova-compute[71113]:       <cpuselection/>
Jul 31 09:42:03 user nova-compute[71113]:       <deviceboot/>
Jul 31 09:42:03 user nova-compute[71113]:       <disksnapshot default='on' toggle='no'/>
Jul 31 09:42:03 user nova-compute[71113]:     </features>
Jul 31 09:42:03 user nova-compute[71113]:   </guest>
Jul 31 09:42:03 user nova-compute[71113]:   <guest>
Jul 31 09:42:03 user nova-compute[71113]:     <os_type>hvm</os_type>
Jul 31 09:42:03 user nova-compute[71113]:     <arch name='cris'>
Jul 31 09:42:03 user nova-compute[71113]:       <wordsize>32</wordsize>
Jul 31 09:42:03 user nova-compute[71113]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>axis-dev88</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <domain type='qemu'/>
Jul 31 09:42:03 user nova-compute[71113]:     </arch>
Jul 31 09:42:03 user nova-compute[71113]:     <features>
Jul 31 09:42:03 user nova-compute[71113]:       <cpuselection/>
Jul 31 09:42:03 user nova-compute[71113]:       <deviceboot/>
Jul 31 09:42:03 user nova-compute[71113]:       <disksnapshot default='on' toggle='no'/>
Jul 31 09:42:03 user nova-compute[71113]:     </features>
Jul 31 09:42:03 user nova-compute[71113]:   </guest>
Jul 31 09:42:03 user nova-compute[71113]:   <guest>
Jul 31 09:42:03 user nova-compute[71113]:     <os_type>hvm</os_type>
Jul 31 09:42:03 user nova-compute[71113]:     <arch name='i686'>
Jul 31 09:42:03 user nova-compute[71113]:       <wordsize>32</wordsize>
Jul 31 09:42:03 user nova-compute[71113]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-artful</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>x-remote</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>isapc</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-disco</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-impish</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-focal</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>microvm</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <domain type='qemu'/>
Jul 31 09:42:03 user nova-compute[71113]:       <domain type='kvm'/>
Jul 31 09:42:03 user nova-compute[71113]:     </arch>
Jul 31 09:42:03 user nova-compute[71113]:     <features>
Jul 31 09:42:03 user nova-compute[71113]:       <pae/>
Jul 31 09:42:03 user nova-compute[71113]:       <nonpae/>
Jul 31 09:42:03 user nova-compute[71113]:       <acpi default='on' toggle='yes'/>
Jul 31 09:42:03 user nova-compute[71113]:       <apic default='on' toggle='no'/>
Jul 31 09:42:03 user nova-compute[71113]:       <cpuselection/>
Jul 31 09:42:03 user nova-compute[71113]:       <deviceboot/>
Jul 31 09:42:03 user nova-compute[71113]:       <disksnapshot default='on' toggle='no'/>
Jul 31 09:42:03 user nova-compute[71113]:     </features>
Jul 31 09:42:03 user nova-compute[71113]:   </guest>
Jul 31 09:42:03 user nova-compute[71113]:   <guest>
Jul 31 09:42:03 user nova-compute[71113]:     <os_type>hvm</os_type>
Jul 31 09:42:03 user nova-compute[71113]:     <arch name='m68k'>
Jul 31 09:42:03 user nova-compute[71113]:       <wordsize>32</wordsize>
Jul 31 09:42:03 user nova-compute[71113]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>mcf5208evb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>an5206</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>virt-6.0</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>q800</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>virt-6.2</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>next-cube</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>virt-6.1</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <domain type='qemu'/>
Jul 31 09:42:03 user nova-compute[71113]:     </arch>
Jul 31 09:42:03 user nova-compute[71113]:     <features>
Jul 31 09:42:03 user nova-compute[71113]:       <cpuselection/>
Jul 31 09:42:03 user nova-compute[71113]:       <deviceboot/>
Jul 31 09:42:03 user nova-compute[71113]:       <disksnapshot default='on' toggle='no'/>
Jul 31 09:42:03 user nova-compute[71113]:     </features>
Jul 31 09:42:03 user nova-compute[71113]:   </guest>
Jul 31 09:42:03 user nova-compute[71113]:   <guest>
Jul 31 09:42:03 user nova-compute[71113]:     <os_type>hvm</os_type>
Jul 31 09:42:03 user nova-compute[71113]:     <arch name='microblaze'>
Jul 31 09:42:03 user nova-compute[71113]:       <wordsize>32</wordsize>
Jul 31 09:42:03 user nova-compute[71113]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>petalogix-ml605</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <domain type='qemu'/>
Jul 31 09:42:03 user nova-compute[71113]:     </arch>
Jul 31 09:42:03 user nova-compute[71113]:     <features>
Jul 31 09:42:03 user nova-compute[71113]:       <cpuselection/>
Jul 31 09:42:03 user nova-compute[71113]:       <deviceboot/>
Jul 31 09:42:03 user nova-compute[71113]:       <disksnapshot default='on' toggle='no'/>
Jul 31 09:42:03 user nova-compute[71113]:     </features>
Jul 31 09:42:03 user nova-compute[71113]:   </guest>
Jul 31 09:42:03 user nova-compute[71113]:   <guest>
Jul 31 09:42:03 user nova-compute[71113]:     <os_type>hvm</os_type>
Jul 31 09:42:03 user nova-compute[71113]:     <arch name='microblazeel'>
Jul 31 09:42:03 user nova-compute[71113]:       <wordsize>32</wordsize>
Jul 31 09:42:03 user nova-compute[71113]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>petalogix-ml605</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <domain type='qemu'/>
Jul 31 09:42:03 user nova-compute[71113]:     </arch>
Jul 31 09:42:03 user nova-compute[71113]:     <features>
Jul 31 09:42:03 user nova-compute[71113]:       <cpuselection/>
Jul 31 09:42:03 user nova-compute[71113]:       <deviceboot/>
Jul 31 09:42:03 user nova-compute[71113]:       <disksnapshot default='on' toggle='no'/>
Jul 31 09:42:03 user nova-compute[71113]:     </features>
Jul 31 09:42:03 user nova-compute[71113]:   </guest>
Jul 31 09:42:03 user nova-compute[71113]:   <guest>
Jul 31 09:42:03 user nova-compute[71113]:     <os_type>hvm</os_type>
Jul 31 09:42:03 user nova-compute[71113]:     <arch name='mips'>
Jul 31 09:42:03 user nova-compute[71113]:       <wordsize>32</wordsize>
Jul 31 09:42:03 user nova-compute[71113]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='16'>malta</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>mipssim</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <domain type='qemu'/>
Jul 31 09:42:03 user nova-compute[71113]:     </arch>
Jul 31 09:42:03 user nova-compute[71113]:     <features>
Jul 31 09:42:03 user nova-compute[71113]:       <cpuselection/>
Jul 31 09:42:03 user nova-compute[71113]:       <deviceboot/>
Jul 31 09:42:03 user nova-compute[71113]:       <disksnapshot default='on' toggle='no'/>
Jul 31 09:42:03 user nova-compute[71113]:     </features>
Jul 31 09:42:03 user nova-compute[71113]:   </guest>
Jul 31 09:42:03 user nova-compute[71113]:   <guest>
Jul 31 09:42:03 user nova-compute[71113]:     <os_type>hvm</os_type>
Jul 31 09:42:03 user nova-compute[71113]:     <arch name='mipsel'>
Jul 31 09:42:03 user nova-compute[71113]:       <wordsize>32</wordsize>
Jul 31 09:42:03 user nova-compute[71113]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='16'>malta</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>mipssim</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <domain type='qemu'/>
Jul 31 09:42:03 user nova-compute[71113]:     </arch>
Jul 31 09:42:03 user nova-compute[71113]:     <features>
Jul 31 09:42:03 user nova-compute[71113]:       <cpuselection/>
Jul 31 09:42:03 user nova-compute[71113]:       <deviceboot/>
Jul 31 09:42:03 user nova-compute[71113]:       <disksnapshot default='on' toggle='no'/>
Jul 31 09:42:03 user nova-compute[71113]:     </features>
Jul 31 09:42:03 user nova-compute[71113]:   </guest>
Jul 31 09:42:03 user nova-compute[71113]:   <guest>
Jul 31 09:42:03 user nova-compute[71113]:     <os_type>hvm</os_type>
Jul 31 09:42:03 user nova-compute[71113]:     <arch name='mips64'>
Jul 31 09:42:03 user nova-compute[71113]:       <wordsize>64</wordsize>
Jul 31 09:42:03 user nova-compute[71113]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='16'>malta</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>mipssim</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>pica61</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>magnum</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <domain type='qemu'/>
Jul 31 09:42:03 user nova-compute[71113]:     </arch>
Jul 31 09:42:03 user nova-compute[71113]:     <features>
Jul 31 09:42:03 user nova-compute[71113]:       <cpuselection/>
Jul 31 09:42:03 user nova-compute[71113]:       <deviceboot/>
Jul 31 09:42:03 user nova-compute[71113]:       <disksnapshot default='on' toggle='no'/>
Jul 31 09:42:03 user nova-compute[71113]:     </features>
Jul 31 09:42:03 user nova-compute[71113]:   </guest>
Jul 31 09:42:03 user nova-compute[71113]:   <guest>
Jul 31 09:42:03 user nova-compute[71113]:     <os_type>hvm</os_type>
Jul 31 09:42:03 user nova-compute[71113]:     <arch name='mips64el'>
Jul 31 09:42:03 user nova-compute[71113]:       <wordsize>64</wordsize>
Jul 31 09:42:03 user nova-compute[71113]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='16'>malta</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='16'>loongson3-virt</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>mipssim</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>pica61</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>magnum</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='16'>boston</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>fuloong2e</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <domain type='qemu'/>
Jul 31 09:42:03 user nova-compute[71113]:     </arch>
Jul 31 09:42:03 user nova-compute[71113]:     <features>
Jul 31 09:42:03 user nova-compute[71113]:       <cpuselection/>
Jul 31 09:42:03 user nova-compute[71113]:       <deviceboot/>
Jul 31 09:42:03 user nova-compute[71113]:       <disksnapshot default='on' toggle='no'/>
Jul 31 09:42:03 user nova-compute[71113]:     </features>
Jul 31 09:42:03 user nova-compute[71113]:   </guest>
Jul 31 09:42:03 user nova-compute[71113]:   <guest>
Jul 31 09:42:03 user nova-compute[71113]:     <os_type>hvm</os_type>
Jul 31 09:42:03 user nova-compute[71113]:     <arch name='ppc'>
Jul 31 09:42:03 user nova-compute[71113]:       <wordsize>32</wordsize>
Jul 31 09:42:03 user nova-compute[71113]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>g3beige</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>mac99</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='32'>ppce500</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>pegasos2</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>sam460ex</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>bamboo</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>40p</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>ref405ep</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>taihu</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <domain type='qemu'/>
Jul 31 09:42:03 user nova-compute[71113]:     </arch>
Jul 31 09:42:03 user nova-compute[71113]:     <features>
Jul 31 09:42:03 user nova-compute[71113]:       <cpuselection/>
Jul 31 09:42:03 user nova-compute[71113]:       <deviceboot/>
Jul 31 09:42:03 user nova-compute[71113]:       <disksnapshot default='on' toggle='no'/>
Jul 31 09:42:03 user nova-compute[71113]:     </features>
Jul 31 09:42:03 user nova-compute[71113]:   </guest>
Jul 31 09:42:03 user nova-compute[71113]:   <guest>
Jul 31 09:42:03 user nova-compute[71113]:     <os_type>hvm</os_type>
Jul 31 09:42:03 user nova-compute[71113]:     <arch name='ppc64'>
Jul 31 09:42:03 user nova-compute[71113]:       <wordsize>64</wordsize>
Jul 31 09:42:03 user nova-compute[71113]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2048'>powernv9</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>taihu</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2048'>powernv10</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='32'>ppce500</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>40p</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>pegasos2</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>bamboo</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>g3beige</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>mac99</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>sam460ex</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>ref405ep</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2048'>powernv8</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <domain type='qemu'/>
Jul 31 09:42:03 user nova-compute[71113]:     </arch>
Jul 31 09:42:03 user nova-compute[71113]:     <features>
Jul 31 09:42:03 user nova-compute[71113]:       <cpuselection/>
Jul 31 09:42:03 user nova-compute[71113]:       <deviceboot/>
Jul 31 09:42:03 user nova-compute[71113]:       <disksnapshot default='on' toggle='no'/>
Jul 31 09:42:03 user nova-compute[71113]:     </features>
Jul 31 09:42:03 user nova-compute[71113]:   </guest>
Jul 31 09:42:03 user nova-compute[71113]:   <guest>
Jul 31 09:42:03 user nova-compute[71113]:     <os_type>hvm</os_type>
Jul 31 09:42:03 user nova-compute[71113]:     <arch name='ppc64le'>
Jul 31 09:42:03 user nova-compute[71113]:       <wordsize>64</wordsize>
Jul 31 09:42:03 user nova-compute[71113]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2048'>powernv9</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>taihu</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2048'>powernv10</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='32'>ppce500</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>40p</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>pegasos2</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>bamboo</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>g3beige</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>mac99</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>sam460ex</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>ref405ep</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2048'>powernv8</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <domain type='qemu'/>
Jul 31 09:42:03 user nova-compute[71113]:     </arch>
Jul 31 09:42:03 user nova-compute[71113]:     <features>
Jul 31 09:42:03 user nova-compute[71113]:       <cpuselection/>
Jul 31 09:42:03 user nova-compute[71113]:       <deviceboot/>
Jul 31 09:42:03 user nova-compute[71113]:       <disksnapshot default='on' toggle='no'/>
Jul 31 09:42:03 user nova-compute[71113]:     </features>
Jul 31 09:42:03 user nova-compute[71113]:   </guest>
Jul 31 09:42:03 user nova-compute[71113]:   <guest>
Jul 31 09:42:03 user nova-compute[71113]:     <os_type>hvm</os_type>
Jul 31 09:42:03 user nova-compute[71113]:     <arch name='riscv32'>
Jul 31 09:42:03 user nova-compute[71113]:       <wordsize>32</wordsize>
Jul 31 09:42:03 user nova-compute[71113]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='8'>spike</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>opentitan</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='5'>sifive_u</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>sifive_e</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='8'>virt</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <domain type='qemu'/>
Jul 31 09:42:03 user nova-compute[71113]:     </arch>
Jul 31 09:42:03 user nova-compute[71113]:     <features>
Jul 31 09:42:03 user nova-compute[71113]:       <cpuselection/>
Jul 31 09:42:03 user nova-compute[71113]:       <deviceboot/>
Jul 31 09:42:03 user nova-compute[71113]:       <disksnapshot default='on' toggle='no'/>
Jul 31 09:42:03 user nova-compute[71113]:     </features>
Jul 31 09:42:03 user nova-compute[71113]:   </guest>
Jul 31 09:42:03 user nova-compute[71113]:   <guest>
Jul 31 09:42:03 user nova-compute[71113]:     <os_type>hvm</os_type>
Jul 31 09:42:03 user nova-compute[71113]:     <arch name='riscv64'>
Jul 31 09:42:03 user nova-compute[71113]:       <wordsize>64</wordsize>
Jul 31 09:42:03 user nova-compute[71113]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='8'>spike</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='5'>sifive_u</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>shakti_c</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>sifive_e</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='8'>virt</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <domain type='qemu'/>
Jul 31 09:42:03 user nova-compute[71113]:     </arch>
Jul 31 09:42:03 user nova-compute[71113]:     <features>
Jul 31 09:42:03 user nova-compute[71113]:       <cpuselection/>
Jul 31 09:42:03 user nova-compute[71113]:       <deviceboot/>
Jul 31 09:42:03 user nova-compute[71113]:       <disksnapshot default='on' toggle='no'/>
Jul 31 09:42:03 user nova-compute[71113]:     </features>
Jul 31 09:42:03 user nova-compute[71113]:   </guest>
Jul 31 09:42:03 user nova-compute[71113]:   <guest>
Jul 31 09:42:03 user nova-compute[71113]:     <os_type>hvm</os_type>
Jul 31 09:42:03 user nova-compute[71113]:     <arch name='s390x'>
Jul 31 09:42:03 user nova-compute[71113]:       <wordsize>64</wordsize>
Jul 31 09:42:03 user nova-compute[71113]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <domain type='qemu'/>
Jul 31 09:42:03 user nova-compute[71113]:     </arch>
Jul 31 09:42:03 user nova-compute[71113]:     <features>
Jul 31 09:42:03 user nova-compute[71113]:       <cpuselection/>
Jul 31 09:42:03 user nova-compute[71113]:       <deviceboot/>
Jul 31 09:42:03 user nova-compute[71113]:       <disksnapshot default='on' toggle='no'/>
Jul 31 09:42:03 user nova-compute[71113]:     </features>
Jul 31 09:42:03 user nova-compute[71113]:   </guest>
Jul 31 09:42:03 user nova-compute[71113]:   <guest>
Jul 31 09:42:03 user nova-compute[71113]:     <os_type>hvm</os_type>
Jul 31 09:42:03 user nova-compute[71113]:     <arch name='sh4'>
Jul 31 09:42:03 user nova-compute[71113]:       <wordsize>32</wordsize>
Jul 31 09:42:03 user nova-compute[71113]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>shix</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>r2d</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <domain type='qemu'/>
Jul 31 09:42:03 user nova-compute[71113]:     </arch>
Jul 31 09:42:03 user nova-compute[71113]:     <features>
Jul 31 09:42:03 user nova-compute[71113]:       <cpuselection/>
Jul 31 09:42:03 user nova-compute[71113]:       <deviceboot/>
Jul 31 09:42:03 user nova-compute[71113]:       <disksnapshot default='on' toggle='no'/>
Jul 31 09:42:03 user nova-compute[71113]:     </features>
Jul 31 09:42:03 user nova-compute[71113]:   </guest>
Jul 31 09:42:03 user nova-compute[71113]:   <guest>
Jul 31 09:42:03 user nova-compute[71113]:     <os_type>hvm</os_type>
Jul 31 09:42:03 user nova-compute[71113]:     <arch name='sh4eb'>
Jul 31 09:42:03 user nova-compute[71113]:       <wordsize>64</wordsize>
Jul 31 09:42:03 user nova-compute[71113]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>shix</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>r2d</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <domain type='qemu'/>
Jul 31 09:42:03 user nova-compute[71113]:     </arch>
Jul 31 09:42:03 user nova-compute[71113]:     <features>
Jul 31 09:42:03 user nova-compute[71113]:       <cpuselection/>
Jul 31 09:42:03 user nova-compute[71113]:       <deviceboot/>
Jul 31 09:42:03 user nova-compute[71113]:       <disksnapshot default='on' toggle='no'/>
Jul 31 09:42:03 user nova-compute[71113]:     </features>
Jul 31 09:42:03 user nova-compute[71113]:   </guest>
Jul 31 09:42:03 user nova-compute[71113]:   <guest>
Jul 31 09:42:03 user nova-compute[71113]:     <os_type>hvm</os_type>
Jul 31 09:42:03 user nova-compute[71113]:     <arch name='sparc'>
Jul 31 09:42:03 user nova-compute[71113]:       <wordsize>32</wordsize>
Jul 31 09:42:03 user nova-compute[71113]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>SS-5</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='4'>SS-20</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>LX</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>SPARCClassic</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>leon3_generic</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>SPARCbook</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>SS-4</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='4'>SS-600MP</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='4'>SS-10</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>Voyager</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <domain type='qemu'/>
Jul 31 09:42:03 user nova-compute[71113]:     </arch>
Jul 31 09:42:03 user nova-compute[71113]:     <features>
Jul 31 09:42:03 user nova-compute[71113]:       <cpuselection/>
Jul 31 09:42:03 user nova-compute[71113]:       <deviceboot/>
Jul 31 09:42:03 user nova-compute[71113]:       <disksnapshot default='on' toggle='no'/>
Jul 31 09:42:03 user nova-compute[71113]:     </features>
Jul 31 09:42:03 user nova-compute[71113]:   </guest>
Jul 31 09:42:03 user nova-compute[71113]:   <guest>
Jul 31 09:42:03 user nova-compute[71113]:     <os_type>hvm</os_type>
Jul 31 09:42:03 user nova-compute[71113]:     <arch name='sparc64'>
Jul 31 09:42:03 user nova-compute[71113]:       <wordsize>64</wordsize>
Jul 31 09:42:03 user nova-compute[71113]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>sun4u</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>niagara</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>sun4v</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <domain type='qemu'/>
Jul 31 09:42:03 user nova-compute[71113]:     </arch>
Jul 31 09:42:03 user nova-compute[71113]:     <features>
Jul 31 09:42:03 user nova-compute[71113]:       <cpuselection/>
Jul 31 09:42:03 user nova-compute[71113]:       <deviceboot/>
Jul 31 09:42:03 user nova-compute[71113]:       <disksnapshot default='on' toggle='no'/>
Jul 31 09:42:03 user nova-compute[71113]:     </features>
Jul 31 09:42:03 user nova-compute[71113]:   </guest>
Jul 31 09:42:03 user nova-compute[71113]:   <guest>
Jul 31 09:42:03 user nova-compute[71113]:     <os_type>hvm</os_type>
Jul 31 09:42:03 user nova-compute[71113]:     <arch name='x86_64'>
Jul 31 09:42:03 user nova-compute[71113]:       <wordsize>64</wordsize>
Jul 31 09:42:03 user nova-compute[71113]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-artful</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>x-remote</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='1'>isapc</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-disco</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-impish</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-focal</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>microvm</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <domain type='qemu'/>
Jul 31 09:42:03 user nova-compute[71113]:       <domain type='kvm'/>
Jul 31 09:42:03 user nova-compute[71113]:     </arch>
Jul 31 09:42:03 user nova-compute[71113]:     <features>
Jul 31 09:42:03 user nova-compute[71113]:       <acpi default='on' toggle='yes'/>
Jul 31 09:42:03 user nova-compute[71113]:       <apic default='on' toggle='no'/>
Jul 31 09:42:03 user nova-compute[71113]:       <cpuselection/>
Jul 31 09:42:03 user nova-compute[71113]:       <deviceboot/>
Jul 31 09:42:03 user nova-compute[71113]:       <disksnapshot default='on' toggle='no'/>
Jul 31 09:42:03 user nova-compute[71113]:     </features>
Jul 31 09:42:03 user nova-compute[71113]:   </guest>
Jul 31 09:42:03 user nova-compute[71113]:   <guest>
Jul 31 09:42:03 user nova-compute[71113]:     <os_type>hvm</os_type>
Jul 31 09:42:03 user nova-compute[71113]:     <arch name='xtensa'>
Jul 31 09:42:03 user nova-compute[71113]:       <wordsize>32</wordsize>
Jul 31 09:42:03 user nova-compute[71113]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='4'>sim</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='32'>kc705</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='32'>ml605</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='32'>ml605-nommu</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='32'>virt</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='32'>lx60-nommu</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='32'>lx200</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='32'>lx200-nommu</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='32'>lx60</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='32'>kc705-nommu</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <domain type='qemu'/>
Jul 31 09:42:03 user nova-compute[71113]:     </arch>
Jul 31 09:42:03 user nova-compute[71113]:     <features>
Jul 31 09:42:03 user nova-compute[71113]:       <cpuselection/>
Jul 31 09:42:03 user nova-compute[71113]:       <deviceboot/>
Jul 31 09:42:03 user nova-compute[71113]:       <disksnapshot default='on' toggle='no'/>
Jul 31 09:42:03 user nova-compute[71113]:     </features>
Jul 31 09:42:03 user nova-compute[71113]:   </guest>
Jul 31 09:42:03 user nova-compute[71113]:   <guest>
Jul 31 09:42:03 user nova-compute[71113]:     <os_type>hvm</os_type>
Jul 31 09:42:03 user nova-compute[71113]:     <arch name='xtensaeb'>
Jul 31 09:42:03 user nova-compute[71113]:       <wordsize>32</wordsize>
Jul 31 09:42:03 user nova-compute[71113]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='4'>sim</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='32'>kc705</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='32'>ml605</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='32'>ml605-nommu</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='32'>virt</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='32'>lx60-nommu</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='32'>lx200</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='32'>lx200-nommu</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='32'>lx60</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <machine maxCpus='32'>kc705-nommu</machine>
Jul 31 09:42:03 user nova-compute[71113]:       <domain type='qemu'/>
Jul 31 09:42:03 user nova-compute[71113]:     </arch>
Jul 31 09:42:03 user nova-compute[71113]:     <features>
Jul 31 09:42:03 user nova-compute[71113]:       <cpuselection/>
Jul 31 09:42:03 user nova-compute[71113]:       <deviceboot/>
Jul 31 09:42:03 user nova-compute[71113]:       <disksnapshot default='on' toggle='no'/>
Jul 31 09:42:03 user nova-compute[71113]:     </features>
Jul 31 09:42:03 user nova-compute[71113]:   </guest>
Jul 31 09:42:03 user nova-compute[71113]: </capabilities>
Jul 31 09:42:03 user nova-compute[71113]: 
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=71113) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=71113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=71113) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=71113) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=71113) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=71113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=71113) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=71113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'ubuntu-q35', 'pc', 'q35'} {{(pid=71113) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Jul 31 09:42:03 user nova-compute[71113]: <domainCapabilities>
Jul 31 09:42:03 user nova-compute[71113]:   <path>/usr/bin/qemu-system-i386</path>
Jul 31 09:42:03 user nova-compute[71113]:   <domain>kvm</domain>
Jul 31 09:42:03 user nova-compute[71113]:   <machine>pc-i440fx-jammy</machine>
Jul 31 09:42:03 user nova-compute[71113]:   <arch>i686</arch>
Jul 31 09:42:03 user nova-compute[71113]:   <vcpu max='255'/>
Jul 31 09:42:03 user nova-compute[71113]:   <iothreads supported='yes'/>
Jul 31 09:42:03 user nova-compute[71113]:   <os supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:     <enum name='firmware'/>
Jul 31 09:42:03 user nova-compute[71113]:     <loader supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 31 09:42:03 user nova-compute[71113]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 31 09:42:03 user nova-compute[71113]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 31 09:42:03 user nova-compute[71113]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 31 09:42:03 user nova-compute[71113]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='type'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>rom</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>pflash</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='readonly'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>yes</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>no</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='secure'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>no</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </loader>
Jul 31 09:42:03 user nova-compute[71113]:   </os>
Jul 31 09:42:03 user nova-compute[71113]:   <cpu>
Jul 31 09:42:03 user nova-compute[71113]:     <mode name='host-passthrough' supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='hostPassthroughMigratable'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>off</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </mode>
Jul 31 09:42:03 user nova-compute[71113]:     <mode name='maximum' supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='maximumMigratable'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>on</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>off</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </mode>
Jul 31 09:42:03 user nova-compute[71113]:     <mode name='host-model' supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <vendor>Intel</vendor>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='ss'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='vmx'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='pcid'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='hypervisor'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='arat'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='tsc_adjust'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='umip'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='md-clear'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='stibp'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='arch-capabilities'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='ssbd'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='ibpb'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='ibrs'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='amd-stibp'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='amd-ssbd'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='disable' name='erms'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='disable' name='xsaveopt'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='disable' name='lm'/>
Jul 31 09:42:03 user nova-compute[71113]:     </mode>
Jul 31 09:42:03 user nova-compute[71113]:     <mode name='custom' supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>qemu64</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>qemu32</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>phenom</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>pentium3</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>pentium2</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>pentium</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>n270</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>kvm64</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>kvm32</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>coreduo</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>core2duo</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>athlon</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Westmere-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Westmere</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Snowridge</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Skylake-Server</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Skylake-Client</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>SandyBridge</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Penryn</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Opteron_G5</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Opteron_G4</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Opteron_G3</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Opteron_G2</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Opteron_G1</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Nehalem-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Nehalem</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>IvyBridge</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Icelake-Server</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Haswell-noTSX</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Haswell-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Haswell</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>EPYC-Rome</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>EPYC-Milan</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>EPYC-IBPB</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>EPYC</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Dhyana</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Cooperlake</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Conroe</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Cascadelake-Server</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Broadwell-noTSX</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Broadwell-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Broadwell</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>486</model>
Jul 31 09:42:03 user nova-compute[71113]:     </mode>
Jul 31 09:42:03 user nova-compute[71113]:   </cpu>
Jul 31 09:42:03 user nova-compute[71113]:   <memoryBacking supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:     <enum name='sourceType'>
Jul 31 09:42:03 user nova-compute[71113]:       <value>file</value>
Jul 31 09:42:03 user nova-compute[71113]:       <value>anonymous</value>
Jul 31 09:42:03 user nova-compute[71113]:       <value>memfd</value>
Jul 31 09:42:03 user nova-compute[71113]:     </enum>
Jul 31 09:42:03 user nova-compute[71113]:   </memoryBacking>
Jul 31 09:42:03 user nova-compute[71113]:   <devices>
Jul 31 09:42:03 user nova-compute[71113]:     <disk supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='diskDevice'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>disk</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>cdrom</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>floppy</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>lun</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='bus'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>ide</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>fdc</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>scsi</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>usb</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>sata</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='model'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio-transitional</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio-non-transitional</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </disk>
Jul 31 09:42:03 user nova-compute[71113]:     <graphics supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='type'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>sdl</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>vnc</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>spice</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>egl-headless</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </graphics>
Jul 31 09:42:03 user nova-compute[71113]:     <video supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='modelType'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>vga</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>cirrus</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>vmvga</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>qxl</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>none</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>bochs</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>ramfb</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </video>
Jul 31 09:42:03 user nova-compute[71113]:     <hostdev supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='mode'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>subsystem</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='startupPolicy'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>default</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>mandatory</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>requisite</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>optional</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='subsysType'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>usb</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>pci</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>scsi</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='capsType'/>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='pciBackend'/>
Jul 31 09:42:03 user nova-compute[71113]:     </hostdev>
Jul 31 09:42:03 user nova-compute[71113]:     <rng supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='model'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio-transitional</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio-non-transitional</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='backendModel'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>random</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>egd</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>builtin</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </rng>
Jul 31 09:42:03 user nova-compute[71113]:     <filesystem supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='driverType'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>path</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>handle</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtiofs</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </filesystem>
Jul 31 09:42:03 user nova-compute[71113]:     <tpm supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='model'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>tpm-tis</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>tpm-crb</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='backendModel'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>passthrough</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>emulator</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </tpm>
Jul 31 09:42:03 user nova-compute[71113]:   </devices>
Jul 31 09:42:03 user nova-compute[71113]:   <features>
Jul 31 09:42:03 user nova-compute[71113]:     <gic supported='no'/>
Jul 31 09:42:03 user nova-compute[71113]:     <vmcoreinfo supported='yes'/>
Jul 31 09:42:03 user nova-compute[71113]:     <genid supported='yes'/>
Jul 31 09:42:03 user nova-compute[71113]:     <backingStoreInput supported='yes'/>
Jul 31 09:42:03 user nova-compute[71113]:     <backup supported='yes'/>
Jul 31 09:42:03 user nova-compute[71113]:     <sev supported='no'/>
Jul 31 09:42:03 user nova-compute[71113]:   </features>
Jul 31 09:42:03 user nova-compute[71113]: </domainCapabilities>
Jul 31 09:42:03 user nova-compute[71113]:  {{(pid=71113) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Jul 31 09:42:03 user nova-compute[71113]: <domainCapabilities>
Jul 31 09:42:03 user nova-compute[71113]:   <path>/usr/bin/qemu-system-i386</path>
Jul 31 09:42:03 user nova-compute[71113]:   <domain>kvm</domain>
Jul 31 09:42:03 user nova-compute[71113]:   <machine>pc-q35-jammy</machine>
Jul 31 09:42:03 user nova-compute[71113]:   <arch>i686</arch>
Jul 31 09:42:03 user nova-compute[71113]:   <vcpu max='288'/>
Jul 31 09:42:03 user nova-compute[71113]:   <iothreads supported='yes'/>
Jul 31 09:42:03 user nova-compute[71113]:   <os supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:     <enum name='firmware'/>
Jul 31 09:42:03 user nova-compute[71113]:     <loader supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 31 09:42:03 user nova-compute[71113]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 31 09:42:03 user nova-compute[71113]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 31 09:42:03 user nova-compute[71113]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 31 09:42:03 user nova-compute[71113]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='type'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>rom</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>pflash</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='readonly'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>yes</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>no</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='secure'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>no</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </loader>
Jul 31 09:42:03 user nova-compute[71113]:   </os>
Jul 31 09:42:03 user nova-compute[71113]:   <cpu>
Jul 31 09:42:03 user nova-compute[71113]:     <mode name='host-passthrough' supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='hostPassthroughMigratable'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>off</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </mode>
Jul 31 09:42:03 user nova-compute[71113]:     <mode name='maximum' supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='maximumMigratable'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>on</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>off</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </mode>
Jul 31 09:42:03 user nova-compute[71113]:     <mode name='host-model' supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <vendor>Intel</vendor>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='ss'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='vmx'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='pcid'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='hypervisor'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='arat'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='tsc_adjust'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='umip'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='md-clear'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='stibp'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='arch-capabilities'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='ssbd'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='ibpb'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='ibrs'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='amd-stibp'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='amd-ssbd'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='disable' name='erms'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='disable' name='xsaveopt'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='disable' name='lm'/>
Jul 31 09:42:03 user nova-compute[71113]:     </mode>
Jul 31 09:42:03 user nova-compute[71113]:     <mode name='custom' supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>qemu64</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>qemu32</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>phenom</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>pentium3</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>pentium2</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>pentium</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>n270</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>kvm64</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>kvm32</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>coreduo</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>core2duo</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>athlon</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Westmere-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Westmere</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Snowridge</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Skylake-Server</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Skylake-Client</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>SandyBridge</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Penryn</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Opteron_G5</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Opteron_G4</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Opteron_G3</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Opteron_G2</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Opteron_G1</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Nehalem-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Nehalem</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>IvyBridge</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Icelake-Server</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Haswell-noTSX</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Haswell-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Haswell</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>EPYC-Rome</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>EPYC-Milan</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>EPYC-IBPB</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>EPYC</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Dhyana</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Cooperlake</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Conroe</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Cascadelake-Server</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Broadwell-noTSX</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Broadwell-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Broadwell</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>486</model>
Jul 31 09:42:03 user nova-compute[71113]:     </mode>
Jul 31 09:42:03 user nova-compute[71113]:   </cpu>
Jul 31 09:42:03 user nova-compute[71113]:   <memoryBacking supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:     <enum name='sourceType'>
Jul 31 09:42:03 user nova-compute[71113]:       <value>file</value>
Jul 31 09:42:03 user nova-compute[71113]:       <value>anonymous</value>
Jul 31 09:42:03 user nova-compute[71113]:       <value>memfd</value>
Jul 31 09:42:03 user nova-compute[71113]:     </enum>
Jul 31 09:42:03 user nova-compute[71113]:   </memoryBacking>
Jul 31 09:42:03 user nova-compute[71113]:   <devices>
Jul 31 09:42:03 user nova-compute[71113]:     <disk supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='diskDevice'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>disk</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>cdrom</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>floppy</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>lun</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='bus'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>fdc</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>scsi</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>usb</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>sata</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='model'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio-transitional</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio-non-transitional</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </disk>
Jul 31 09:42:03 user nova-compute[71113]:     <graphics supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='type'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>sdl</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>vnc</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>spice</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>egl-headless</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </graphics>
Jul 31 09:42:03 user nova-compute[71113]:     <video supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='modelType'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>vga</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>cirrus</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>vmvga</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>qxl</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>none</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>bochs</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>ramfb</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </video>
Jul 31 09:42:03 user nova-compute[71113]:     <hostdev supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='mode'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>subsystem</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='startupPolicy'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>default</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>mandatory</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>requisite</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>optional</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='subsysType'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>usb</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>pci</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>scsi</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='capsType'/>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='pciBackend'/>
Jul 31 09:42:03 user nova-compute[71113]:     </hostdev>
Jul 31 09:42:03 user nova-compute[71113]:     <rng supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='model'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio-transitional</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio-non-transitional</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='backendModel'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>random</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>egd</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>builtin</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </rng>
Jul 31 09:42:03 user nova-compute[71113]:     <filesystem supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='driverType'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>path</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>handle</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtiofs</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </filesystem>
Jul 31 09:42:03 user nova-compute[71113]:     <tpm supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='model'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>tpm-tis</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>tpm-crb</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='backendModel'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>passthrough</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>emulator</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </tpm>
Jul 31 09:42:03 user nova-compute[71113]:   </devices>
Jul 31 09:42:03 user nova-compute[71113]:   <features>
Jul 31 09:42:03 user nova-compute[71113]:     <gic supported='no'/>
Jul 31 09:42:03 user nova-compute[71113]:     <vmcoreinfo supported='yes'/>
Jul 31 09:42:03 user nova-compute[71113]:     <genid supported='yes'/>
Jul 31 09:42:03 user nova-compute[71113]:     <backingStoreInput supported='yes'/>
Jul 31 09:42:03 user nova-compute[71113]:     <backup supported='yes'/>
Jul 31 09:42:03 user nova-compute[71113]:     <sev supported='no'/>
Jul 31 09:42:03 user nova-compute[71113]:   </features>
Jul 31 09:42:03 user nova-compute[71113]: </domainCapabilities>
Jul 31 09:42:03 user nova-compute[71113]:  {{(pid=71113) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Jul 31 09:42:03 user nova-compute[71113]: <domainCapabilities>
Jul 31 09:42:03 user nova-compute[71113]:   <path>/usr/bin/qemu-system-i386</path>
Jul 31 09:42:03 user nova-compute[71113]:   <domain>kvm</domain>
Jul 31 09:42:03 user nova-compute[71113]:   <machine>pc-i440fx-6.2</machine>
Jul 31 09:42:03 user nova-compute[71113]:   <arch>i686</arch>
Jul 31 09:42:03 user nova-compute[71113]:   <vcpu max='255'/>
Jul 31 09:42:03 user nova-compute[71113]:   <iothreads supported='yes'/>
Jul 31 09:42:03 user nova-compute[71113]:   <os supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:     <enum name='firmware'/>
Jul 31 09:42:03 user nova-compute[71113]:     <loader supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 31 09:42:03 user nova-compute[71113]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 31 09:42:03 user nova-compute[71113]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 31 09:42:03 user nova-compute[71113]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 31 09:42:03 user nova-compute[71113]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='type'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>rom</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>pflash</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='readonly'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>yes</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>no</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='secure'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>no</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </loader>
Jul 31 09:42:03 user nova-compute[71113]:   </os>
Jul 31 09:42:03 user nova-compute[71113]:   <cpu>
Jul 31 09:42:03 user nova-compute[71113]:     <mode name='host-passthrough' supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='hostPassthroughMigratable'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>off</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </mode>
Jul 31 09:42:03 user nova-compute[71113]:     <mode name='maximum' supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='maximumMigratable'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>on</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>off</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </mode>
Jul 31 09:42:03 user nova-compute[71113]:     <mode name='host-model' supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <vendor>Intel</vendor>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='ss'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='vmx'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='pcid'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='hypervisor'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='arat'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='tsc_adjust'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='umip'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='md-clear'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='stibp'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='arch-capabilities'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='ssbd'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='ibpb'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='ibrs'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='amd-stibp'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='amd-ssbd'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='disable' name='erms'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='disable' name='xsaveopt'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='disable' name='lm'/>
Jul 31 09:42:03 user nova-compute[71113]:     </mode>
Jul 31 09:42:03 user nova-compute[71113]:     <mode name='custom' supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>qemu64</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>qemu32</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>phenom</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>pentium3</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>pentium2</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>pentium</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>n270</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>kvm64</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>kvm32</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>coreduo</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>core2duo</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>athlon</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Westmere-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Westmere</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Snowridge</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Skylake-Server</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Skylake-Client</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>SandyBridge</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Penryn</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Opteron_G5</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Opteron_G4</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Opteron_G3</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Opteron_G2</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Opteron_G1</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Nehalem-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Nehalem</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>IvyBridge</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Icelake-Server</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Haswell-noTSX</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Haswell-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Haswell</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>EPYC-Rome</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>EPYC-Milan</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>EPYC-IBPB</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>EPYC</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Dhyana</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Cooperlake</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Conroe</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Cascadelake-Server</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Broadwell-noTSX</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Broadwell-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Broadwell</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>486</model>
Jul 31 09:42:03 user nova-compute[71113]:     </mode>
Jul 31 09:42:03 user nova-compute[71113]:   </cpu>
Jul 31 09:42:03 user nova-compute[71113]:   <memoryBacking supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:     <enum name='sourceType'>
Jul 31 09:42:03 user nova-compute[71113]:       <value>file</value>
Jul 31 09:42:03 user nova-compute[71113]:       <value>anonymous</value>
Jul 31 09:42:03 user nova-compute[71113]:       <value>memfd</value>
Jul 31 09:42:03 user nova-compute[71113]:     </enum>
Jul 31 09:42:03 user nova-compute[71113]:   </memoryBacking>
Jul 31 09:42:03 user nova-compute[71113]:   <devices>
Jul 31 09:42:03 user nova-compute[71113]:     <disk supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='diskDevice'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>disk</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>cdrom</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>floppy</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>lun</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='bus'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>ide</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>fdc</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>scsi</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>usb</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>sata</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='model'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio-transitional</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio-non-transitional</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </disk>
Jul 31 09:42:03 user nova-compute[71113]:     <graphics supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='type'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>sdl</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>vnc</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>spice</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>egl-headless</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </graphics>
Jul 31 09:42:03 user nova-compute[71113]:     <video supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='modelType'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>vga</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>cirrus</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>vmvga</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>qxl</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>none</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>bochs</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>ramfb</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </video>
Jul 31 09:42:03 user nova-compute[71113]:     <hostdev supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='mode'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>subsystem</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='startupPolicy'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>default</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>mandatory</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>requisite</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>optional</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='subsysType'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>usb</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>pci</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>scsi</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='capsType'/>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='pciBackend'/>
Jul 31 09:42:03 user nova-compute[71113]:     </hostdev>
Jul 31 09:42:03 user nova-compute[71113]:     <rng supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='model'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio-transitional</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio-non-transitional</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='backendModel'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>random</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>egd</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>builtin</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </rng>
Jul 31 09:42:03 user nova-compute[71113]:     <filesystem supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='driverType'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>path</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>handle</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtiofs</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </filesystem>
Jul 31 09:42:03 user nova-compute[71113]:     <tpm supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='model'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>tpm-tis</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>tpm-crb</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='backendModel'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>passthrough</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>emulator</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </tpm>
Jul 31 09:42:03 user nova-compute[71113]:   </devices>
Jul 31 09:42:03 user nova-compute[71113]:   <features>
Jul 31 09:42:03 user nova-compute[71113]:     <gic supported='no'/>
Jul 31 09:42:03 user nova-compute[71113]:     <vmcoreinfo supported='yes'/>
Jul 31 09:42:03 user nova-compute[71113]:     <genid supported='yes'/>
Jul 31 09:42:03 user nova-compute[71113]:     <backingStoreInput supported='yes'/>
Jul 31 09:42:03 user nova-compute[71113]:     <backup supported='yes'/>
Jul 31 09:42:03 user nova-compute[71113]:     <sev supported='no'/>
Jul 31 09:42:03 user nova-compute[71113]:   </features>
Jul 31 09:42:03 user nova-compute[71113]: </domainCapabilities>
Jul 31 09:42:03 user nova-compute[71113]:  {{(pid=71113) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Jul 31 09:42:03 user nova-compute[71113]: <domainCapabilities>
Jul 31 09:42:03 user nova-compute[71113]:   <path>/usr/bin/qemu-system-i386</path>
Jul 31 09:42:03 user nova-compute[71113]:   <domain>kvm</domain>
Jul 31 09:42:03 user nova-compute[71113]:   <machine>pc-q35-6.2</machine>
Jul 31 09:42:03 user nova-compute[71113]:   <arch>i686</arch>
Jul 31 09:42:03 user nova-compute[71113]:   <vcpu max='288'/>
Jul 31 09:42:03 user nova-compute[71113]:   <iothreads supported='yes'/>
Jul 31 09:42:03 user nova-compute[71113]:   <os supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:     <enum name='firmware'/>
Jul 31 09:42:03 user nova-compute[71113]:     <loader supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 31 09:42:03 user nova-compute[71113]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 31 09:42:03 user nova-compute[71113]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 31 09:42:03 user nova-compute[71113]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 31 09:42:03 user nova-compute[71113]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='type'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>rom</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>pflash</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='readonly'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>yes</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>no</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='secure'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>no</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </loader>
Jul 31 09:42:03 user nova-compute[71113]:   </os>
Jul 31 09:42:03 user nova-compute[71113]:   <cpu>
Jul 31 09:42:03 user nova-compute[71113]:     <mode name='host-passthrough' supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='hostPassthroughMigratable'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>off</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </mode>
Jul 31 09:42:03 user nova-compute[71113]:     <mode name='maximum' supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='maximumMigratable'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>on</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>off</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </mode>
Jul 31 09:42:03 user nova-compute[71113]:     <mode name='host-model' supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <vendor>Intel</vendor>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='ss'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='vmx'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='pcid'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='hypervisor'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='arat'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='tsc_adjust'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='umip'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='md-clear'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='stibp'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='arch-capabilities'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='ssbd'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='ibpb'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='ibrs'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='amd-stibp'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='amd-ssbd'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='disable' name='erms'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='disable' name='xsaveopt'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='disable' name='lm'/>
Jul 31 09:42:03 user nova-compute[71113]:     </mode>
Jul 31 09:42:03 user nova-compute[71113]:     <mode name='custom' supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>qemu64</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>qemu32</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>phenom</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>pentium3</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>pentium2</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>pentium</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>n270</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>kvm64</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>kvm32</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>coreduo</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>core2duo</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>athlon</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Westmere-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Westmere</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Snowridge</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Skylake-Server</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Skylake-Client</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>SandyBridge</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Penryn</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Opteron_G5</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Opteron_G4</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Opteron_G3</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Opteron_G2</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Opteron_G1</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Nehalem-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Nehalem</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>IvyBridge</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Icelake-Server</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Haswell-noTSX</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Haswell-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Haswell</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>EPYC-Rome</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>EPYC-Milan</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>EPYC-IBPB</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>EPYC</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Dhyana</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Cooperlake</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Conroe</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Cascadelake-Server</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Broadwell-noTSX</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Broadwell-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Broadwell</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>486</model>
Jul 31 09:42:03 user nova-compute[71113]:     </mode>
Jul 31 09:42:03 user nova-compute[71113]:   </cpu>
Jul 31 09:42:03 user nova-compute[71113]:   <memoryBacking supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:     <enum name='sourceType'>
Jul 31 09:42:03 user nova-compute[71113]:       <value>file</value>
Jul 31 09:42:03 user nova-compute[71113]:       <value>anonymous</value>
Jul 31 09:42:03 user nova-compute[71113]:       <value>memfd</value>
Jul 31 09:42:03 user nova-compute[71113]:     </enum>
Jul 31 09:42:03 user nova-compute[71113]:   </memoryBacking>
Jul 31 09:42:03 user nova-compute[71113]:   <devices>
Jul 31 09:42:03 user nova-compute[71113]:     <disk supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='diskDevice'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>disk</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>cdrom</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>floppy</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>lun</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='bus'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>fdc</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>scsi</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>usb</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>sata</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='model'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio-transitional</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio-non-transitional</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </disk>
Jul 31 09:42:03 user nova-compute[71113]:     <graphics supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='type'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>sdl</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>vnc</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>spice</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>egl-headless</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </graphics>
Jul 31 09:42:03 user nova-compute[71113]:     <video supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='modelType'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>vga</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>cirrus</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>vmvga</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>qxl</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>none</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>bochs</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>ramfb</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </video>
Jul 31 09:42:03 user nova-compute[71113]:     <hostdev supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='mode'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>subsystem</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='startupPolicy'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>default</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>mandatory</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>requisite</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>optional</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='subsysType'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>usb</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>pci</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>scsi</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='capsType'/>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='pciBackend'/>
Jul 31 09:42:03 user nova-compute[71113]:     </hostdev>
Jul 31 09:42:03 user nova-compute[71113]:     <rng supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='model'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio-transitional</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio-non-transitional</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='backendModel'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>random</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>egd</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>builtin</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </rng>
Jul 31 09:42:03 user nova-compute[71113]:     <filesystem supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='driverType'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>path</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>handle</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtiofs</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </filesystem>
Jul 31 09:42:03 user nova-compute[71113]:     <tpm supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='model'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>tpm-tis</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>tpm-crb</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='backendModel'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>passthrough</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>emulator</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </tpm>
Jul 31 09:42:03 user nova-compute[71113]:   </devices>
Jul 31 09:42:03 user nova-compute[71113]:   <features>
Jul 31 09:42:03 user nova-compute[71113]:     <gic supported='no'/>
Jul 31 09:42:03 user nova-compute[71113]:     <vmcoreinfo supported='yes'/>
Jul 31 09:42:03 user nova-compute[71113]:     <genid supported='yes'/>
Jul 31 09:42:03 user nova-compute[71113]:     <backingStoreInput supported='yes'/>
Jul 31 09:42:03 user nova-compute[71113]:     <backup supported='yes'/>
Jul 31 09:42:03 user nova-compute[71113]:     <sev supported='no'/>
Jul 31 09:42:03 user nova-compute[71113]:   </features>
Jul 31 09:42:03 user nova-compute[71113]: </domainCapabilities>
Jul 31 09:42:03 user nova-compute[71113]:  {{(pid=71113) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=71113) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=71113) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=71113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=71113) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=71113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=71113) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=71113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=71113) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=71113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=71113) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=71113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=71113) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=71113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=71113) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=71113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=71113) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=71113) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=71113) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=71113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=71113) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=71113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=71113) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=71113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=71113) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=71113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=71113) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=71113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=71113) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=71113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=71113) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=71113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'ubuntu-q35', 'pc', 'q35'} {{(pid=71113) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Jul 31 09:42:03 user nova-compute[71113]: <domainCapabilities>
Jul 31 09:42:03 user nova-compute[71113]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 31 09:42:03 user nova-compute[71113]:   <domain>kvm</domain>
Jul 31 09:42:03 user nova-compute[71113]:   <machine>pc-i440fx-jammy</machine>
Jul 31 09:42:03 user nova-compute[71113]:   <arch>x86_64</arch>
Jul 31 09:42:03 user nova-compute[71113]:   <vcpu max='255'/>
Jul 31 09:42:03 user nova-compute[71113]:   <iothreads supported='yes'/>
Jul 31 09:42:03 user nova-compute[71113]:   <os supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:     <enum name='firmware'>
Jul 31 09:42:03 user nova-compute[71113]:       <value>efi</value>
Jul 31 09:42:03 user nova-compute[71113]:     </enum>
Jul 31 09:42:03 user nova-compute[71113]:     <loader supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='type'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>rom</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>pflash</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='readonly'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>yes</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>no</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='secure'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>no</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </loader>
Jul 31 09:42:03 user nova-compute[71113]:   </os>
Jul 31 09:42:03 user nova-compute[71113]:   <cpu>
Jul 31 09:42:03 user nova-compute[71113]:     <mode name='host-passthrough' supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='hostPassthroughMigratable'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>on</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>off</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </mode>
Jul 31 09:42:03 user nova-compute[71113]:     <mode name='maximum' supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='maximumMigratable'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>on</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>off</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </mode>
Jul 31 09:42:03 user nova-compute[71113]:     <mode name='host-model' supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <vendor>Intel</vendor>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='ss'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='vmx'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='pcid'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='hypervisor'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='arat'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='tsc_adjust'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='umip'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='md-clear'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='stibp'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='arch-capabilities'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='ssbd'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='invtsc'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='ibpb'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='ibrs'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='amd-stibp'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='amd-ssbd'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='rsba'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='pschange-mc-no'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='disable' name='erms'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='disable' name='xsaveopt'/>
Jul 31 09:42:03 user nova-compute[71113]:     </mode>
Jul 31 09:42:03 user nova-compute[71113]:     <mode name='custom' supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>qemu64</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>qemu32</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>phenom</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>pentium3</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>pentium2</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>pentium</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>n270</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>kvm64</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>kvm32</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>coreduo</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>core2duo</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>athlon</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>Westmere-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>Westmere</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Snowridge</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Skylake-Server</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Skylake-Client</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>SandyBridge</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>Penryn</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Opteron_G5</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Opteron_G4</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Opteron_G3</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Opteron_G2</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>Opteron_G1</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>Nehalem</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>IvyBridge</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Icelake-Server</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Haswell-noTSX</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Haswell-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Haswell</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>EPYC-Rome</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>EPYC-Milan</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>EPYC-IBPB</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>EPYC</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Dhyana</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Cooperlake</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>Conroe</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Cascadelake-Server</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Broadwell-noTSX</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Broadwell-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Broadwell</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>486</model>
Jul 31 09:42:03 user nova-compute[71113]:     </mode>
Jul 31 09:42:03 user nova-compute[71113]:   </cpu>
Jul 31 09:42:03 user nova-compute[71113]:   <memoryBacking supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:     <enum name='sourceType'>
Jul 31 09:42:03 user nova-compute[71113]:       <value>file</value>
Jul 31 09:42:03 user nova-compute[71113]:       <value>anonymous</value>
Jul 31 09:42:03 user nova-compute[71113]:       <value>memfd</value>
Jul 31 09:42:03 user nova-compute[71113]:     </enum>
Jul 31 09:42:03 user nova-compute[71113]:   </memoryBacking>
Jul 31 09:42:03 user nova-compute[71113]:   <devices>
Jul 31 09:42:03 user nova-compute[71113]:     <disk supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='diskDevice'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>disk</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>cdrom</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>floppy</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>lun</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='bus'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>ide</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>fdc</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>scsi</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>usb</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>sata</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='model'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio-transitional</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio-non-transitional</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </disk>
Jul 31 09:42:03 user nova-compute[71113]:     <graphics supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='type'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>sdl</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>vnc</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>spice</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>egl-headless</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </graphics>
Jul 31 09:42:03 user nova-compute[71113]:     <video supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='modelType'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>vga</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>cirrus</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>vmvga</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>qxl</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>none</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>bochs</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>ramfb</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </video>
Jul 31 09:42:03 user nova-compute[71113]:     <hostdev supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='mode'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>subsystem</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='startupPolicy'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>default</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>mandatory</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>requisite</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>optional</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='subsysType'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>usb</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>pci</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>scsi</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='capsType'/>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='pciBackend'/>
Jul 31 09:42:03 user nova-compute[71113]:     </hostdev>
Jul 31 09:42:03 user nova-compute[71113]:     <rng supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='model'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio-transitional</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio-non-transitional</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='backendModel'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>random</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>egd</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>builtin</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </rng>
Jul 31 09:42:03 user nova-compute[71113]:     <filesystem supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='driverType'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>path</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>handle</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtiofs</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </filesystem>
Jul 31 09:42:03 user nova-compute[71113]:     <tpm supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='model'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>tpm-tis</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>tpm-crb</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='backendModel'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>passthrough</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>emulator</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </tpm>
Jul 31 09:42:03 user nova-compute[71113]:   </devices>
Jul 31 09:42:03 user nova-compute[71113]:   <features>
Jul 31 09:42:03 user nova-compute[71113]:     <gic supported='no'/>
Jul 31 09:42:03 user nova-compute[71113]:     <vmcoreinfo supported='yes'/>
Jul 31 09:42:03 user nova-compute[71113]:     <genid supported='yes'/>
Jul 31 09:42:03 user nova-compute[71113]:     <backingStoreInput supported='yes'/>
Jul 31 09:42:03 user nova-compute[71113]:     <backup supported='yes'/>
Jul 31 09:42:03 user nova-compute[71113]:     <sev supported='no'/>
Jul 31 09:42:03 user nova-compute[71113]:   </features>
Jul 31 09:42:03 user nova-compute[71113]: </domainCapabilities>
Jul 31 09:42:03 user nova-compute[71113]:  {{(pid=71113) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Jul 31 09:42:03 user nova-compute[71113]: <domainCapabilities>
Jul 31 09:42:03 user nova-compute[71113]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 31 09:42:03 user nova-compute[71113]:   <domain>kvm</domain>
Jul 31 09:42:03 user nova-compute[71113]:   <machine>pc-q35-jammy</machine>
Jul 31 09:42:03 user nova-compute[71113]:   <arch>x86_64</arch>
Jul 31 09:42:03 user nova-compute[71113]:   <vcpu max='288'/>
Jul 31 09:42:03 user nova-compute[71113]:   <iothreads supported='yes'/>
Jul 31 09:42:03 user nova-compute[71113]:   <os supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:     <enum name='firmware'>
Jul 31 09:42:03 user nova-compute[71113]:       <value>efi</value>
Jul 31 09:42:03 user nova-compute[71113]:     </enum>
Jul 31 09:42:03 user nova-compute[71113]:     <loader supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Jul 31 09:42:03 user nova-compute[71113]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Jul 31 09:42:03 user nova-compute[71113]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='type'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>rom</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>pflash</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='readonly'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>yes</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>no</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='secure'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>yes</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>no</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </loader>
Jul 31 09:42:03 user nova-compute[71113]:   </os>
Jul 31 09:42:03 user nova-compute[71113]:   <cpu>
Jul 31 09:42:03 user nova-compute[71113]:     <mode name='host-passthrough' supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='hostPassthroughMigratable'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>on</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>off</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </mode>
Jul 31 09:42:03 user nova-compute[71113]:     <mode name='maximum' supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='maximumMigratable'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>on</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>off</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </mode>
Jul 31 09:42:03 user nova-compute[71113]:     <mode name='host-model' supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <vendor>Intel</vendor>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='ss'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='vmx'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='pcid'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='hypervisor'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='arat'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='tsc_adjust'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='umip'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='md-clear'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='stibp'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='arch-capabilities'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='ssbd'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='invtsc'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='ibpb'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='ibrs'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='amd-stibp'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='amd-ssbd'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='rsba'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='pschange-mc-no'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='disable' name='erms'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='disable' name='xsaveopt'/>
Jul 31 09:42:03 user nova-compute[71113]:     </mode>
Jul 31 09:42:03 user nova-compute[71113]:     <mode name='custom' supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>qemu64</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>qemu32</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>phenom</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>pentium3</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>pentium2</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>pentium</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>n270</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>kvm64</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>kvm32</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>coreduo</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>core2duo</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>athlon</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>Westmere-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>Westmere</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Snowridge</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Skylake-Server</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Skylake-Client</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>SandyBridge</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>Penryn</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Opteron_G5</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Opteron_G4</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Opteron_G3</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Opteron_G2</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>Opteron_G1</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>Nehalem</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>IvyBridge</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Icelake-Server</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Haswell-noTSX</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Haswell-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Haswell</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>EPYC-Rome</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>EPYC-Milan</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>EPYC-IBPB</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>EPYC</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Dhyana</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Cooperlake</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>Conroe</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Cascadelake-Server</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Broadwell-noTSX</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Broadwell-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Broadwell</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>486</model>
Jul 31 09:42:03 user nova-compute[71113]:     </mode>
Jul 31 09:42:03 user nova-compute[71113]:   </cpu>
Jul 31 09:42:03 user nova-compute[71113]:   <memoryBacking supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:     <enum name='sourceType'>
Jul 31 09:42:03 user nova-compute[71113]:       <value>file</value>
Jul 31 09:42:03 user nova-compute[71113]:       <value>anonymous</value>
Jul 31 09:42:03 user nova-compute[71113]:       <value>memfd</value>
Jul 31 09:42:03 user nova-compute[71113]:     </enum>
Jul 31 09:42:03 user nova-compute[71113]:   </memoryBacking>
Jul 31 09:42:03 user nova-compute[71113]:   <devices>
Jul 31 09:42:03 user nova-compute[71113]:     <disk supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='diskDevice'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>disk</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>cdrom</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>floppy</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>lun</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='bus'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>fdc</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>scsi</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>usb</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>sata</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='model'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio-transitional</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio-non-transitional</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </disk>
Jul 31 09:42:03 user nova-compute[71113]:     <graphics supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='type'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>sdl</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>vnc</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>spice</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>egl-headless</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </graphics>
Jul 31 09:42:03 user nova-compute[71113]:     <video supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='modelType'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>vga</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>cirrus</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>vmvga</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>qxl</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>none</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>bochs</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>ramfb</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </video>
Jul 31 09:42:03 user nova-compute[71113]:     <hostdev supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='mode'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>subsystem</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='startupPolicy'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>default</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>mandatory</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>requisite</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>optional</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='subsysType'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>usb</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>pci</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>scsi</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='capsType'/>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='pciBackend'/>
Jul 31 09:42:03 user nova-compute[71113]:     </hostdev>
Jul 31 09:42:03 user nova-compute[71113]:     <rng supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='model'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio-transitional</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio-non-transitional</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='backendModel'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>random</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>egd</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>builtin</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </rng>
Jul 31 09:42:03 user nova-compute[71113]:     <filesystem supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='driverType'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>path</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>handle</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtiofs</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </filesystem>
Jul 31 09:42:03 user nova-compute[71113]:     <tpm supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='model'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>tpm-tis</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>tpm-crb</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='backendModel'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>passthrough</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>emulator</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </tpm>
Jul 31 09:42:03 user nova-compute[71113]:   </devices>
Jul 31 09:42:03 user nova-compute[71113]:   <features>
Jul 31 09:42:03 user nova-compute[71113]:     <gic supported='no'/>
Jul 31 09:42:03 user nova-compute[71113]:     <vmcoreinfo supported='yes'/>
Jul 31 09:42:03 user nova-compute[71113]:     <genid supported='yes'/>
Jul 31 09:42:03 user nova-compute[71113]:     <backingStoreInput supported='yes'/>
Jul 31 09:42:03 user nova-compute[71113]:     <backup supported='yes'/>
Jul 31 09:42:03 user nova-compute[71113]:     <sev supported='no'/>
Jul 31 09:42:03 user nova-compute[71113]:   </features>
Jul 31 09:42:03 user nova-compute[71113]: </domainCapabilities>
Jul 31 09:42:03 user nova-compute[71113]:  {{(pid=71113) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Jul 31 09:42:03 user nova-compute[71113]: <domainCapabilities>
Jul 31 09:42:03 user nova-compute[71113]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 31 09:42:03 user nova-compute[71113]:   <domain>kvm</domain>
Jul 31 09:42:03 user nova-compute[71113]:   <machine>pc-i440fx-6.2</machine>
Jul 31 09:42:03 user nova-compute[71113]:   <arch>x86_64</arch>
Jul 31 09:42:03 user nova-compute[71113]:   <vcpu max='255'/>
Jul 31 09:42:03 user nova-compute[71113]:   <iothreads supported='yes'/>
Jul 31 09:42:03 user nova-compute[71113]:   <os supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:     <enum name='firmware'>
Jul 31 09:42:03 user nova-compute[71113]:       <value>efi</value>
Jul 31 09:42:03 user nova-compute[71113]:     </enum>
Jul 31 09:42:03 user nova-compute[71113]:     <loader supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='type'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>rom</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>pflash</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='readonly'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>yes</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>no</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='secure'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>no</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </loader>
Jul 31 09:42:03 user nova-compute[71113]:   </os>
Jul 31 09:42:03 user nova-compute[71113]:   <cpu>
Jul 31 09:42:03 user nova-compute[71113]:     <mode name='host-passthrough' supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='hostPassthroughMigratable'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>on</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>off</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </mode>
Jul 31 09:42:03 user nova-compute[71113]:     <mode name='maximum' supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='maximumMigratable'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>on</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>off</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </mode>
Jul 31 09:42:03 user nova-compute[71113]:     <mode name='host-model' supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <vendor>Intel</vendor>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='ss'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='vmx'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='pcid'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='hypervisor'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='arat'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='tsc_adjust'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='umip'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='md-clear'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='stibp'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='arch-capabilities'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='ssbd'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='invtsc'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='ibpb'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='ibrs'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='amd-stibp'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='amd-ssbd'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='rsba'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='pschange-mc-no'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='disable' name='erms'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='disable' name='xsaveopt'/>
Jul 31 09:42:03 user nova-compute[71113]:     </mode>
Jul 31 09:42:03 user nova-compute[71113]:     <mode name='custom' supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>qemu64</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>qemu32</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>phenom</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>pentium3</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>pentium2</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>pentium</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>n270</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>kvm64</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>kvm32</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>coreduo</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>core2duo</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>athlon</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>Westmere-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>Westmere</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Snowridge</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Skylake-Server</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Skylake-Client</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>SandyBridge</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>Penryn</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Opteron_G5</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Opteron_G4</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Opteron_G3</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Opteron_G2</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>Opteron_G1</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>Nehalem</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>IvyBridge</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Icelake-Server</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Haswell-noTSX</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Haswell-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Haswell</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>EPYC-Rome</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>EPYC-Milan</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>EPYC-IBPB</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>EPYC</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Dhyana</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Cooperlake</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>Conroe</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Cascadelake-Server</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Broadwell-noTSX</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Broadwell-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Broadwell</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>486</model>
Jul 31 09:42:03 user nova-compute[71113]:     </mode>
Jul 31 09:42:03 user nova-compute[71113]:   </cpu>
Jul 31 09:42:03 user nova-compute[71113]:   <memoryBacking supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:     <enum name='sourceType'>
Jul 31 09:42:03 user nova-compute[71113]:       <value>file</value>
Jul 31 09:42:03 user nova-compute[71113]:       <value>anonymous</value>
Jul 31 09:42:03 user nova-compute[71113]:       <value>memfd</value>
Jul 31 09:42:03 user nova-compute[71113]:     </enum>
Jul 31 09:42:03 user nova-compute[71113]:   </memoryBacking>
Jul 31 09:42:03 user nova-compute[71113]:   <devices>
Jul 31 09:42:03 user nova-compute[71113]:     <disk supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='diskDevice'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>disk</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>cdrom</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>floppy</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>lun</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='bus'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>ide</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>fdc</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>scsi</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>usb</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>sata</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='model'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio-transitional</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio-non-transitional</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </disk>
Jul 31 09:42:03 user nova-compute[71113]:     <graphics supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='type'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>sdl</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>vnc</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>spice</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>egl-headless</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </graphics>
Jul 31 09:42:03 user nova-compute[71113]:     <video supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='modelType'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>vga</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>cirrus</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>vmvga</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>qxl</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>none</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>bochs</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>ramfb</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </video>
Jul 31 09:42:03 user nova-compute[71113]:     <hostdev supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='mode'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>subsystem</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='startupPolicy'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>default</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>mandatory</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>requisite</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>optional</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='subsysType'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>usb</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>pci</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>scsi</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='capsType'/>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='pciBackend'/>
Jul 31 09:42:03 user nova-compute[71113]:     </hostdev>
Jul 31 09:42:03 user nova-compute[71113]:     <rng supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='model'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio-transitional</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio-non-transitional</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='backendModel'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>random</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>egd</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>builtin</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </rng>
Jul 31 09:42:03 user nova-compute[71113]:     <filesystem supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='driverType'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>path</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>handle</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtiofs</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </filesystem>
Jul 31 09:42:03 user nova-compute[71113]:     <tpm supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='model'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>tpm-tis</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>tpm-crb</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='backendModel'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>passthrough</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>emulator</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </tpm>
Jul 31 09:42:03 user nova-compute[71113]:   </devices>
Jul 31 09:42:03 user nova-compute[71113]:   <features>
Jul 31 09:42:03 user nova-compute[71113]:     <gic supported='no'/>
Jul 31 09:42:03 user nova-compute[71113]:     <vmcoreinfo supported='yes'/>
Jul 31 09:42:03 user nova-compute[71113]:     <genid supported='yes'/>
Jul 31 09:42:03 user nova-compute[71113]:     <backingStoreInput supported='yes'/>
Jul 31 09:42:03 user nova-compute[71113]:     <backup supported='yes'/>
Jul 31 09:42:03 user nova-compute[71113]:     <sev supported='no'/>
Jul 31 09:42:03 user nova-compute[71113]:   </features>
Jul 31 09:42:03 user nova-compute[71113]: </domainCapabilities>
Jul 31 09:42:03 user nova-compute[71113]:  {{(pid=71113) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Jul 31 09:42:03 user nova-compute[71113]: <domainCapabilities>
Jul 31 09:42:03 user nova-compute[71113]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 31 09:42:03 user nova-compute[71113]:   <domain>kvm</domain>
Jul 31 09:42:03 user nova-compute[71113]:   <machine>pc-q35-6.2</machine>
Jul 31 09:42:03 user nova-compute[71113]:   <arch>x86_64</arch>
Jul 31 09:42:03 user nova-compute[71113]:   <vcpu max='288'/>
Jul 31 09:42:03 user nova-compute[71113]:   <iothreads supported='yes'/>
Jul 31 09:42:03 user nova-compute[71113]:   <os supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:     <enum name='firmware'>
Jul 31 09:42:03 user nova-compute[71113]:       <value>efi</value>
Jul 31 09:42:03 user nova-compute[71113]:     </enum>
Jul 31 09:42:03 user nova-compute[71113]:     <loader supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Jul 31 09:42:03 user nova-compute[71113]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Jul 31 09:42:03 user nova-compute[71113]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='type'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>rom</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>pflash</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='readonly'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>yes</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>no</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='secure'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>yes</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>no</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </loader>
Jul 31 09:42:03 user nova-compute[71113]:   </os>
Jul 31 09:42:03 user nova-compute[71113]:   <cpu>
Jul 31 09:42:03 user nova-compute[71113]:     <mode name='host-passthrough' supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='hostPassthroughMigratable'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>on</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>off</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </mode>
Jul 31 09:42:03 user nova-compute[71113]:     <mode name='maximum' supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='maximumMigratable'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>on</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>off</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </mode>
Jul 31 09:42:03 user nova-compute[71113]:     <mode name='host-model' supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <vendor>Intel</vendor>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='ss'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='vmx'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='pcid'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='hypervisor'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='arat'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='tsc_adjust'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='umip'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='md-clear'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='stibp'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='arch-capabilities'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='ssbd'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='invtsc'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='ibpb'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='ibrs'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='amd-stibp'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='amd-ssbd'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='rsba'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='require' name='pschange-mc-no'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='disable' name='erms'/>
Jul 31 09:42:03 user nova-compute[71113]:       <feature policy='disable' name='xsaveopt'/>
Jul 31 09:42:03 user nova-compute[71113]:     </mode>
Jul 31 09:42:03 user nova-compute[71113]:     <mode name='custom' supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>qemu64</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>qemu32</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>phenom</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>pentium3</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>pentium2</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>pentium</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>n270</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>kvm64</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>kvm32</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>coreduo</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>core2duo</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>athlon</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>Westmere-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>Westmere</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Snowridge</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Skylake-Server</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Skylake-Client</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>SandyBridge</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>Penryn</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Opteron_G5</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Opteron_G4</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Opteron_G3</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Opteron_G2</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>Opteron_G1</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>Nehalem</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>IvyBridge</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Icelake-Server</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Haswell-noTSX</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Haswell-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Haswell</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>EPYC-Rome</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>EPYC-Milan</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>EPYC-IBPB</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>EPYC</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Dhyana</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Cooperlake</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>Conroe</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Cascadelake-Server</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Broadwell-noTSX</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Broadwell-IBRS</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='no'>Broadwell</model>
Jul 31 09:42:03 user nova-compute[71113]:       <model usable='yes'>486</model>
Jul 31 09:42:03 user nova-compute[71113]:     </mode>
Jul 31 09:42:03 user nova-compute[71113]:   </cpu>
Jul 31 09:42:03 user nova-compute[71113]:   <memoryBacking supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:     <enum name='sourceType'>
Jul 31 09:42:03 user nova-compute[71113]:       <value>file</value>
Jul 31 09:42:03 user nova-compute[71113]:       <value>anonymous</value>
Jul 31 09:42:03 user nova-compute[71113]:       <value>memfd</value>
Jul 31 09:42:03 user nova-compute[71113]:     </enum>
Jul 31 09:42:03 user nova-compute[71113]:   </memoryBacking>
Jul 31 09:42:03 user nova-compute[71113]:   <devices>
Jul 31 09:42:03 user nova-compute[71113]:     <disk supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='diskDevice'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>disk</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>cdrom</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>floppy</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>lun</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='bus'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>fdc</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>scsi</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>usb</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>sata</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='model'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio-transitional</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio-non-transitional</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </disk>
Jul 31 09:42:03 user nova-compute[71113]:     <graphics supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='type'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>sdl</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>vnc</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>spice</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>egl-headless</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </graphics>
Jul 31 09:42:03 user nova-compute[71113]:     <video supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='modelType'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>vga</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>cirrus</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>vmvga</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>qxl</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>none</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>bochs</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>ramfb</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </video>
Jul 31 09:42:03 user nova-compute[71113]:     <hostdev supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='mode'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>subsystem</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='startupPolicy'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>default</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>mandatory</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>requisite</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>optional</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='subsysType'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>usb</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>pci</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>scsi</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='capsType'/>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='pciBackend'/>
Jul 31 09:42:03 user nova-compute[71113]:     </hostdev>
Jul 31 09:42:03 user nova-compute[71113]:     <rng supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='model'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio-transitional</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtio-non-transitional</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='backendModel'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>random</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>egd</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>builtin</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </rng>
Jul 31 09:42:03 user nova-compute[71113]:     <filesystem supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='driverType'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>path</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>handle</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>virtiofs</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </filesystem>
Jul 31 09:42:03 user nova-compute[71113]:     <tpm supported='yes'>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='model'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>tpm-tis</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>tpm-crb</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:       <enum name='backendModel'>
Jul 31 09:42:03 user nova-compute[71113]:         <value>passthrough</value>
Jul 31 09:42:03 user nova-compute[71113]:         <value>emulator</value>
Jul 31 09:42:03 user nova-compute[71113]:       </enum>
Jul 31 09:42:03 user nova-compute[71113]:     </tpm>
Jul 31 09:42:03 user nova-compute[71113]:   </devices>
Jul 31 09:42:03 user nova-compute[71113]:   <features>
Jul 31 09:42:03 user nova-compute[71113]:     <gic supported='no'/>
Jul 31 09:42:03 user nova-compute[71113]:     <vmcoreinfo supported='yes'/>
Jul 31 09:42:03 user nova-compute[71113]:     <genid supported='yes'/>
Jul 31 09:42:03 user nova-compute[71113]:     <backingStoreInput supported='yes'/>
Jul 31 09:42:03 user nova-compute[71113]:     <backup supported='yes'/>
Jul 31 09:42:03 user nova-compute[71113]:     <sev supported='no'/>
Jul 31 09:42:03 user nova-compute[71113]:   </features>
Jul 31 09:42:03 user nova-compute[71113]: </domainCapabilities>
Jul 31 09:42:03 user nova-compute[71113]:  {{(pid=71113) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=71113) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=71113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=71113) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=71113) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Checking secure boot support for host arch (x86_64) {{(pid=71113) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Checking secure boot support for host arch (x86_64) {{(pid=71113) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Checking secure boot support for host arch (x86_64) {{(pid=71113) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Jul 31 09:42:03 user nova-compute[71113]: INFO nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Secure Boot support detected
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] cpu compare xml: <cpu match="exact">
Jul 31 09:42:03 user nova-compute[71113]:   <model>Nehalem</model>
Jul 31 09:42:03 user nova-compute[71113]: </cpu>
Jul 31 09:42:03 user nova-compute[71113]:  {{(pid=71113) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Jul 31 09:42:03 user nova-compute[71113]: INFO nova.virt.node [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Generated node identity fb2d3ce5-7d6f-484d-a45c-524f3c40ea05
Jul 31 09:42:03 user nova-compute[71113]: INFO nova.virt.node [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Wrote node identity fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 to /opt/stack/data/nova/compute_id
Jul 31 09:42:03 user nova-compute[71113]: WARNING nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Compute nodes ['fb2d3ce5-7d6f-484d-a45c-524f3c40ea05'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Jul 31 09:42:03 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Jul 31 09:42:03 user nova-compute[71113]: WARNING nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Jul 31 09:42:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:42:03 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 09:42:04 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:42:04 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:42:04 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Hypervisor/Node resource view: name=user free_ram=10907MB free_disk=26.30959701538086GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 09:42:04 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:42:04 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:42:04 user nova-compute[71113]: WARNING nova.compute.resource_tracker [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] No compute node record for user:fb2d3ce5-7d6f-484d-a45c-524f3c40ea05: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 could not be found.
Jul 31 09:42:04 user nova-compute[71113]: INFO nova.compute.resource_tracker [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Compute node record created for user:user with uuid: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05
Jul 31 09:42:04 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 09:42:04 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 09:42:04 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [req-e0018594-21e4-4510-b372-a2e7731b5697] Created resource provider record via placement API for resource provider with UUID fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 and name user.
Jul 31 09:42:04 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=71113) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Jul 31 09:42:04 user nova-compute[71113]: INFO nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] kernel doesn't support AMD SEV
Jul 31 09:42:04 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Updating inventory in ProviderTree for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 31 09:42:04 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 09:42:04 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Libvirt baseline CPU <cpu>
Jul 31 09:42:04 user nova-compute[71113]:   <arch>x86_64</arch>
Jul 31 09:42:04 user nova-compute[71113]:   <model>Nehalem</model>
Jul 31 09:42:04 user nova-compute[71113]:   <vendor>Intel</vendor>
Jul 31 09:42:04 user nova-compute[71113]:   <topology sockets="6" cores="1" threads="1"/>
Jul 31 09:42:04 user nova-compute[71113]: </cpu>
Jul 31 09:42:04 user nova-compute[71113]:  {{(pid=71113) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Jul 31 09:42:04 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Updated inventory for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Jul 31 09:42:04 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Updating resource provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 generation from 0 to 1 during operation: update_inventory {{(pid=71113) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Jul 31 09:42:04 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Updating inventory in ProviderTree for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 31 09:42:04 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Updating resource provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 generation from 1 to 2 during operation: update_traits {{(pid=71113) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Jul 31 09:42:04 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 09:42:04 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.601s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:42:04 user nova-compute[71113]: DEBUG nova.service [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Creating RPC server for service compute {{(pid=71113) start /opt/stack/nova/nova/service.py:182}}
Jul 31 09:42:04 user nova-compute[71113]: DEBUG nova.service [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Join ServiceGroup membership for this service compute {{(pid=71113) start /opt/stack/nova/nova/service.py:199}}
Jul 31 09:42:04 user nova-compute[71113]: DEBUG nova.servicegroup.drivers.db [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=71113) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Jul 31 09:42:27 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:42:27 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:42:55 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:42:55 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:42:55 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 09:42:55 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Rebuilding the list of instances to heal {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 09:42:55 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Didn't find any instances for network info cache update. {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 09:42:55 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:42:55 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:42:55 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:42:55 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:42:55 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:42:55 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:42:55 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 09:42:55 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:42:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:42:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:42:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:42:55 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 09:42:56 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:42:56 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:42:56 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=10287MB free_disk=26.21358871459961GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 09:42:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:42:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:42:56 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 09:42:56 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 09:42:56 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:42:56 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:42:56 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 09:42:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.145s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:43:56 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:43:56 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:43:56 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:43:56 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:43:56 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 09:43:56 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:43:56 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:43:57 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:43:57 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:43:57 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 09:43:57 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Rebuilding the list of instances to heal {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 09:43:57 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Didn't find any instances for network info cache update. {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 09:43:57 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:43:57 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:43:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:43:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:43:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:43:57 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 09:43:58 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:43:58 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:43:58 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=10255MB free_disk=26.25817108154297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 09:43:58 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:43:58 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:43:58 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 09:43:58 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 09:43:58 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:43:58 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:43:58 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 09:43:58 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.123s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:44:56 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:44:56 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:44:56 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:44:56 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:44:56 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 09:44:57 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:44:57 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 09:44:57 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Rebuilding the list of instances to heal {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 09:44:57 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Didn't find any instances for network info cache update. {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 09:44:57 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:44:57 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:44:57 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:44:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:44:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:44:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:44:57 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 09:44:58 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:44:58 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:44:58 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=10232MB free_disk=26.03256607055664GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 09:44:58 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:44:58 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:44:58 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 09:44:58 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 09:44:58 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:44:58 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:44:58 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 09:44:58 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.175s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:45:00 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:45:56 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:45:56 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:45:56 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:45:56 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:45:57 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:45:57 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:45:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:45:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:45:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:45:57 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 09:45:58 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:45:58 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:45:58 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=9518MB free_disk=26.054885864257812GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 09:45:58 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:45:58 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:45:58 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 09:45:58 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 09:45:58 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:45:58 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:45:58 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 09:45:58 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.211s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:45:59 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:45:59 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 09:45:59 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Rebuilding the list of instances to heal {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 09:45:59 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Didn't find any instances for network info cache update. {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 09:45:59 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:45:59 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:45:59 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 09:46:00 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:46:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Acquiring lock "530ee025-6faf-4497-aee9-dab145920012" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Lock "530ee025-6faf-4497-aee9-dab145920012" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:03 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] [instance: 530ee025-6faf-4497-aee9-dab145920012] Starting instance... {{(pid=71113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 09:46:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:03 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 09:46:03 user nova-compute[71113]: INFO nova.compute.claims [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] [instance: 530ee025-6faf-4497-aee9-dab145920012] Claim successful on node user
Jul 31 09:46:04 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:46:04 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:46:04 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.305s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:46:04 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] [instance: 530ee025-6faf-4497-aee9-dab145920012] Start building networks asynchronously for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 09:46:04 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] [instance: 530ee025-6faf-4497-aee9-dab145920012] Allocating IP information in the background. {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 09:46:04 user nova-compute[71113]: DEBUG nova.network.neutron [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] [instance: 530ee025-6faf-4497-aee9-dab145920012] allocate_for_instance() {{(pid=71113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 09:46:04 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] [instance: 530ee025-6faf-4497-aee9-dab145920012] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 09:46:04 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] [instance: 530ee025-6faf-4497-aee9-dab145920012] Start building block device mappings for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 09:46:04 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] [instance: 530ee025-6faf-4497-aee9-dab145920012] Start spawning the instance on the hypervisor. {{(pid=71113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 09:46:04 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] [instance: 530ee025-6faf-4497-aee9-dab145920012] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 09:46:04 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] [instance: 530ee025-6faf-4497-aee9-dab145920012] Creating image(s)
Jul 31 09:46:04 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Acquiring lock "/opt/stack/data/nova/instances/530ee025-6faf-4497-aee9-dab145920012/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:04 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Lock "/opt/stack/data/nova/instances/530ee025-6faf-4497-aee9-dab145920012/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:04 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Lock "/opt/stack/data/nova/instances/530ee025-6faf-4497-aee9-dab145920012/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:46:04 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Acquiring lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:04 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:04 user nova-compute[71113]: DEBUG nova.policy [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd4f6a7b1d69b4c04ba6fbb821b720450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e8d767c71014105a4a343be6bf71dd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71113) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 09:46:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9.part --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:46:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9.part --force-share --output=json" returned: 0 in 0.143s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:46:05 user nova-compute[71113]: DEBUG nova.virt.images [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] 078646fe-b504-41ed-a147-61072e903e51 was qcow2, converting to raw {{(pid=71113) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 31 09:46:05 user nova-compute[71113]: DEBUG nova.privsep.utils [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71113) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 09:46:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9.part /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9.converted {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:46:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9.part /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9.converted" returned: 0 in 0.162s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:46:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9.converted --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:46:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9.converted --force-share --output=json" returned: 0 in 0.206s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:46:05 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.339s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:46:05 user nova-compute[71113]: INFO oslo.privsep.daemon [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp0gg1f4wf/privsep.sock']
Jul 31 09:46:05 user sudo[80245]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp0gg1f4wf/privsep.sock
Jul 31 09:46:05 user sudo[80245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 31 09:46:06 user nova-compute[71113]: DEBUG nova.network.neutron [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] [instance: 530ee025-6faf-4497-aee9-dab145920012] Successfully created port: 87156da3-0a08-44a2-a914-c69566bf1b5a {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 09:46:07 user sudo[80245]: pam_unix(sudo:session): session closed for user root
Jul 31 09:46:07 user nova-compute[71113]: INFO oslo.privsep.daemon [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Spawned new privsep daemon via rootwrap
Jul 31 09:46:07 user nova-compute[71113]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 31 09:46:07 user nova-compute[71113]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 31 09:46:07 user nova-compute[71113]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jul 31 09:46:07 user nova-compute[71113]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80249
Jul 31 09:46:07 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:46:07 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.148s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:46:07 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Acquiring lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:07 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:07 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:46:08 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.128s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:46:08 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/530ee025-6faf-4497-aee9-dab145920012/disk 1073741824 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:46:08 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/530ee025-6faf-4497-aee9-dab145920012/disk 1073741824" returned: 0 in 0.043s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:46:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.176s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:46:08 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:46:08 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.160s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:46:08 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Checking if we can resize image /opt/stack/data/nova/instances/530ee025-6faf-4497-aee9-dab145920012/disk. size=1073741824 {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 09:46:08 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530ee025-6faf-4497-aee9-dab145920012/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:46:08 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530ee025-6faf-4497-aee9-dab145920012/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:46:08 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Cannot resize image /opt/stack/data/nova/instances/530ee025-6faf-4497-aee9-dab145920012/disk to a smaller size. {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 09:46:08 user nova-compute[71113]: DEBUG nova.objects.instance [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Lazy-loading 'migration_context' on Instance uuid 530ee025-6faf-4497-aee9-dab145920012 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:46:08 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] [instance: 530ee025-6faf-4497-aee9-dab145920012] Created local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 09:46:08 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] [instance: 530ee025-6faf-4497-aee9-dab145920012] Ensure instance console log exists: /opt/stack/data/nova/instances/530ee025-6faf-4497-aee9-dab145920012/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 09:46:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:46:08 user nova-compute[71113]: DEBUG nova.network.neutron [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] [instance: 530ee025-6faf-4497-aee9-dab145920012] Successfully updated port: 87156da3-0a08-44a2-a914-c69566bf1b5a {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 09:46:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Acquiring lock "refresh_cache-530ee025-6faf-4497-aee9-dab145920012" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:46:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Acquired lock "refresh_cache-530ee025-6faf-4497-aee9-dab145920012" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:46:08 user nova-compute[71113]: DEBUG nova.network.neutron [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] [instance: 530ee025-6faf-4497-aee9-dab145920012] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 09:46:08 user nova-compute[71113]: DEBUG nova.network.neutron [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] [instance: 530ee025-6faf-4497-aee9-dab145920012] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 09:46:09 user nova-compute[71113]: DEBUG nova.compute.manager [req-9d262fdc-14f4-433c-8442-0d55a48b0aba req-530bca7b-aa47-4a50-a198-4031a59deb78 service nova] [instance: 530ee025-6faf-4497-aee9-dab145920012] Received event network-changed-87156da3-0a08-44a2-a914-c69566bf1b5a {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:46:09 user nova-compute[71113]: DEBUG nova.compute.manager [req-9d262fdc-14f4-433c-8442-0d55a48b0aba req-530bca7b-aa47-4a50-a198-4031a59deb78 service nova] [instance: 530ee025-6faf-4497-aee9-dab145920012] Refreshing instance network info cache due to event network-changed-87156da3-0a08-44a2-a914-c69566bf1b5a. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:46:09 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9d262fdc-14f4-433c-8442-0d55a48b0aba req-530bca7b-aa47-4a50-a198-4031a59deb78 service nova] Acquiring lock "refresh_cache-530ee025-6faf-4497-aee9-dab145920012" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:46:09 user nova-compute[71113]: DEBUG nova.network.neutron [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] [instance: 530ee025-6faf-4497-aee9-dab145920012] Updating instance_info_cache with network_info: [{"id": "87156da3-0a08-44a2-a914-c69566bf1b5a", "address": "fa:16:3e:b3:98:c6", "network": {"id": "e63260c7-ffb2-4928-bff0-4d8fba378b2b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1431475840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e8d767c71014105a4a343be6bf71dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87156da3-0a", "ovs_interfaceid": "87156da3-0a08-44a2-a914-c69566bf1b5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:46:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Releasing lock "refresh_cache-530ee025-6faf-4497-aee9-dab145920012" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:46:10 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] [instance: 530ee025-6faf-4497-aee9-dab145920012] Instance network_info: |[{"id": "87156da3-0a08-44a2-a914-c69566bf1b5a", "address": "fa:16:3e:b3:98:c6", "network": {"id": "e63260c7-ffb2-4928-bff0-4d8fba378b2b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1431475840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e8d767c71014105a4a343be6bf71dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87156da3-0a", "ovs_interfaceid": "87156da3-0a08-44a2-a914-c69566bf1b5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 09:46:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9d262fdc-14f4-433c-8442-0d55a48b0aba req-530bca7b-aa47-4a50-a198-4031a59deb78 service nova] Acquired lock "refresh_cache-530ee025-6faf-4497-aee9-dab145920012" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:46:10 user nova-compute[71113]: DEBUG nova.network.neutron [req-9d262fdc-14f4-433c-8442-0d55a48b0aba req-530bca7b-aa47-4a50-a198-4031a59deb78 service nova] [instance: 530ee025-6faf-4497-aee9-dab145920012] Refreshing network info cache for port 87156da3-0a08-44a2-a914-c69566bf1b5a {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:46:10 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] [instance: 530ee025-6faf-4497-aee9-dab145920012] Start _get_guest_xml network_info=[{"id": "87156da3-0a08-44a2-a914-c69566bf1b5a", "address": "fa:16:3e:b3:98:c6", "network": {"id": "e63260c7-ffb2-4928-bff0-4d8fba378b2b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1431475840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e8d767c71014105a4a343be6bf71dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87156da3-0a", "ovs_interfaceid": "87156da3-0a08-44a2-a914-c69566bf1b5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'image_id': '078646fe-b504-41ed-a147-61072e903e51'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 09:46:10 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:46:10 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:46:10 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 09:46:10 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 09:46:10 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 09:46:10 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 09:46:10 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 09:46:10 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 09:46:10 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 09:46:10 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 09:46:10 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 09:46:10 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 09:46:10 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 09:46:10 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 09:46:10 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 09:46:10 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 09:46:10 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 09:46:10 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 09:46:10 user nova-compute[71113]: DEBUG nova.privsep.utils [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71113) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 09:46:10 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:46:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1015016307',display_name='tempest-DeleteServersTestJSON-server-1015016307',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1015016307',id=1,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e8d767c71014105a4a343be6bf71dd4',ramdisk_id='',reservation_id='r-cw09hi00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-715920358',owner_user_name='tempest-DeleteServersTestJSON-715920358-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:46:04Z,user_data=None,user_id='d4f6a7b1d69b4c04ba6fbb821b720450',uuid=530ee025-6faf-4497-aee9-dab145920012,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87156da3-0a08-44a2-a914-c69566bf1b5a", "address": "fa:16:3e:b3:98:c6", "network": {"id": "e63260c7-ffb2-4928-bff0-4d8fba378b2b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1431475840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e8d767c71014105a4a343be6bf71dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87156da3-0a", "ovs_interfaceid": "87156da3-0a08-44a2-a914-c69566bf1b5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 09:46:10 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Converting VIF {"id": "87156da3-0a08-44a2-a914-c69566bf1b5a", "address": "fa:16:3e:b3:98:c6", "network": {"id": "e63260c7-ffb2-4928-bff0-4d8fba378b2b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1431475840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e8d767c71014105a4a343be6bf71dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87156da3-0a", "ovs_interfaceid": "87156da3-0a08-44a2-a914-c69566bf1b5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:46:10 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:98:c6,bridge_name='br-int',has_traffic_filtering=True,id=87156da3-0a08-44a2-a914-c69566bf1b5a,network=Network(e63260c7-ffb2-4928-bff0-4d8fba378b2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87156da3-0a') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:46:10 user nova-compute[71113]: DEBUG nova.objects.instance [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Lazy-loading 'pci_devices' on Instance uuid 530ee025-6faf-4497-aee9-dab145920012 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:46:10 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] [instance: 530ee025-6faf-4497-aee9-dab145920012] End _get_guest_xml xml=<domain type="kvm">
Jul 31 09:46:10 user nova-compute[71113]:   <uuid>530ee025-6faf-4497-aee9-dab145920012</uuid>
Jul 31 09:46:10 user nova-compute[71113]:   <name>instance-00000001</name>
Jul 31 09:46:10 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 09:46:10 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 09:46:10 user nova-compute[71113]:   <metadata>
Jul 31 09:46:10 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 09:46:10 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 09:46:10 user nova-compute[71113]:       <nova:name>tempest-DeleteServersTestJSON-server-1015016307</nova:name>
Jul 31 09:46:10 user nova-compute[71113]:       <nova:creationTime>2023-07-31 09:46:10</nova:creationTime>
Jul 31 09:46:10 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 09:46:10 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 09:46:10 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 09:46:10 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 09:46:10 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 09:46:10 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 09:46:10 user nova-compute[71113]:       </nova:flavor>
Jul 31 09:46:10 user nova-compute[71113]:       <nova:owner>
Jul 31 09:46:10 user nova-compute[71113]:         <nova:user uuid="d4f6a7b1d69b4c04ba6fbb821b720450">tempest-DeleteServersTestJSON-715920358-project-member</nova:user>
Jul 31 09:46:10 user nova-compute[71113]:         <nova:project uuid="3e8d767c71014105a4a343be6bf71dd4">tempest-DeleteServersTestJSON-715920358</nova:project>
Jul 31 09:46:10 user nova-compute[71113]:       </nova:owner>
Jul 31 09:46:10 user nova-compute[71113]:       <nova:root type="image" uuid="078646fe-b504-41ed-a147-61072e903e51"/>
Jul 31 09:46:10 user nova-compute[71113]:       <nova:ports>
Jul 31 09:46:10 user nova-compute[71113]:         <nova:port uuid="87156da3-0a08-44a2-a914-c69566bf1b5a">
Jul 31 09:46:10 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 31 09:46:10 user nova-compute[71113]:         </nova:port>
Jul 31 09:46:10 user nova-compute[71113]:       </nova:ports>
Jul 31 09:46:10 user nova-compute[71113]:     </nova:instance>
Jul 31 09:46:10 user nova-compute[71113]:   </metadata>
Jul 31 09:46:10 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 09:46:10 user nova-compute[71113]:     <system>
Jul 31 09:46:10 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 09:46:10 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 09:46:10 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 09:46:10 user nova-compute[71113]:       <entry name="serial">530ee025-6faf-4497-aee9-dab145920012</entry>
Jul 31 09:46:10 user nova-compute[71113]:       <entry name="uuid">530ee025-6faf-4497-aee9-dab145920012</entry>
Jul 31 09:46:10 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 09:46:10 user nova-compute[71113]:     </system>
Jul 31 09:46:10 user nova-compute[71113]:   </sysinfo>
Jul 31 09:46:10 user nova-compute[71113]:   <os>
Jul 31 09:46:10 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 09:46:10 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 09:46:10 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 09:46:10 user nova-compute[71113]:   </os>
Jul 31 09:46:10 user nova-compute[71113]:   <features>
Jul 31 09:46:10 user nova-compute[71113]:     <acpi/>
Jul 31 09:46:10 user nova-compute[71113]:     <apic/>
Jul 31 09:46:10 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 09:46:10 user nova-compute[71113]:   </features>
Jul 31 09:46:10 user nova-compute[71113]:   <clock offset="utc">
Jul 31 09:46:10 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 09:46:10 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 09:46:10 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 09:46:10 user nova-compute[71113]:   </clock>
Jul 31 09:46:10 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 09:46:10 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 09:46:10 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 09:46:10 user nova-compute[71113]:   </cpu>
Jul 31 09:46:10 user nova-compute[71113]:   <devices>
Jul 31 09:46:10 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 09:46:10 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 09:46:10 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/530ee025-6faf-4497-aee9-dab145920012/disk"/>
Jul 31 09:46:10 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 09:46:10 user nova-compute[71113]:     </disk>
Jul 31 09:46:10 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 09:46:10 user nova-compute[71113]:       <mac address="fa:16:3e:b3:98:c6"/>
Jul 31 09:46:10 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:46:10 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 09:46:10 user nova-compute[71113]:       <target dev="tap87156da3-0a"/>
Jul 31 09:46:10 user nova-compute[71113]:     </interface>
Jul 31 09:46:10 user nova-compute[71113]:     <serial type="pty">
Jul 31 09:46:10 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/530ee025-6faf-4497-aee9-dab145920012/console.log" append="off"/>
Jul 31 09:46:10 user nova-compute[71113]:     </serial>
Jul 31 09:46:10 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 09:46:10 user nova-compute[71113]:     <video>
Jul 31 09:46:10 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:46:10 user nova-compute[71113]:     </video>
Jul 31 09:46:10 user nova-compute[71113]:     <rng model="virtio">
Jul 31 09:46:10 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 09:46:10 user nova-compute[71113]:     </rng>
Jul 31 09:46:10 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 09:46:10 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 09:46:10 user nova-compute[71113]:       <stats period="10"/>
Jul 31 09:46:10 user nova-compute[71113]:     </memballoon>
Jul 31 09:46:10 user nova-compute[71113]:   </devices>
Jul 31 09:46:10 user nova-compute[71113]: </domain>
Jul 31 09:46:10 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 09:46:10 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:46:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1015016307',display_name='tempest-DeleteServersTestJSON-server-1015016307',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1015016307',id=1,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e8d767c71014105a4a343be6bf71dd4',ramdisk_id='',reservation_id='r-cw09hi00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-715920358',owner_user_name='tempest-DeleteServersTestJSON-715920358-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:46:04Z,user_data=None,user_id='d4f6a7b1d69b4c04ba6fbb821b720450',uuid=530ee025-6faf-4497-aee9-dab145920012,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87156da3-0a08-44a2-a914-c69566bf1b5a", "address": "fa:16:3e:b3:98:c6", "network": {"id": "e63260c7-ffb2-4928-bff0-4d8fba378b2b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1431475840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e8d767c71014105a4a343be6bf71dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87156da3-0a", "ovs_interfaceid": "87156da3-0a08-44a2-a914-c69566bf1b5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 09:46:10 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Converting VIF {"id": "87156da3-0a08-44a2-a914-c69566bf1b5a", "address": "fa:16:3e:b3:98:c6", "network": {"id": "e63260c7-ffb2-4928-bff0-4d8fba378b2b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1431475840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e8d767c71014105a4a343be6bf71dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87156da3-0a", "ovs_interfaceid": "87156da3-0a08-44a2-a914-c69566bf1b5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:46:10 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:98:c6,bridge_name='br-int',has_traffic_filtering=True,id=87156da3-0a08-44a2-a914-c69566bf1b5a,network=Network(e63260c7-ffb2-4928-bff0-4d8fba378b2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87156da3-0a') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:46:10 user nova-compute[71113]: DEBUG os_vif [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:98:c6,bridge_name='br-int',has_traffic_filtering=True,id=87156da3-0a08-44a2-a914-c69566bf1b5a,network=Network(e63260c7-ffb2-4928-bff0-4d8fba378b2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87156da3-0a') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 09:46:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Created schema index Interface.name {{(pid=71113) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 31 09:46:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Created schema index Port.name {{(pid=71113) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 31 09:46:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Created schema index Bridge.name {{(pid=71113) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 31 09:46:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 09:46:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] [POLLOUT] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 09:46:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:46:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 09:46:10 user nova-compute[71113]: INFO oslo.privsep.daemon [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpzal9nls3/privsep.sock']
Jul 31 09:46:10 user sudo[80268]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpzal9nls3/privsep.sock
Jul 31 09:46:10 user sudo[80268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 31 09:46:11 user nova-compute[71113]: DEBUG nova.network.neutron [req-9d262fdc-14f4-433c-8442-0d55a48b0aba req-530bca7b-aa47-4a50-a198-4031a59deb78 service nova] [instance: 530ee025-6faf-4497-aee9-dab145920012] Updated VIF entry in instance network info cache for port 87156da3-0a08-44a2-a914-c69566bf1b5a. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:46:11 user nova-compute[71113]: DEBUG nova.network.neutron [req-9d262fdc-14f4-433c-8442-0d55a48b0aba req-530bca7b-aa47-4a50-a198-4031a59deb78 service nova] [instance: 530ee025-6faf-4497-aee9-dab145920012] Updating instance_info_cache with network_info: [{"id": "87156da3-0a08-44a2-a914-c69566bf1b5a", "address": "fa:16:3e:b3:98:c6", "network": {"id": "e63260c7-ffb2-4928-bff0-4d8fba378b2b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1431475840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e8d767c71014105a4a343be6bf71dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87156da3-0a", "ovs_interfaceid": "87156da3-0a08-44a2-a914-c69566bf1b5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:46:11 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9d262fdc-14f4-433c-8442-0d55a48b0aba req-530bca7b-aa47-4a50-a198-4031a59deb78 service nova] Releasing lock "refresh_cache-530ee025-6faf-4497-aee9-dab145920012" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:46:12 user sudo[80268]: pam_unix(sudo:session): session closed for user root
Jul 31 09:46:12 user nova-compute[71113]: INFO oslo.privsep.daemon [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Spawned new privsep daemon via rootwrap
Jul 31 09:46:12 user nova-compute[71113]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 31 09:46:12 user nova-compute[71113]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 31 09:46:12 user nova-compute[71113]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Jul 31 09:46:12 user nova-compute[71113]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80273
Jul 31 09:46:13 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:13 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap87156da3-0a, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:46:13 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap87156da3-0a, col_values=(('external_ids', {'iface-id': '87156da3-0a08-44a2-a914-c69566bf1b5a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:98:c6', 'vm-uuid': '530ee025-6faf-4497-aee9-dab145920012'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:46:13 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:46:13 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:13 user nova-compute[71113]: INFO os_vif [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:98:c6,bridge_name='br-int',has_traffic_filtering=True,id=87156da3-0a08-44a2-a914-c69566bf1b5a,network=Network(e63260c7-ffb2-4928-bff0-4d8fba378b2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87156da3-0a')
Jul 31 09:46:13 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:46:13 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] No VIF found with MAC fa:16:3e:b3:98:c6, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 09:46:13 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:13 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:15 user nova-compute[71113]: DEBUG nova.compute.manager [req-5f335d10-868c-43b8-af6a-73eceeb7b435 req-b916d8c4-be20-47c3-8451-c193ba08ded4 service nova] [instance: 530ee025-6faf-4497-aee9-dab145920012] Received event network-vif-plugged-87156da3-0a08-44a2-a914-c69566bf1b5a {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:46:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-5f335d10-868c-43b8-af6a-73eceeb7b435 req-b916d8c4-be20-47c3-8451-c193ba08ded4 service nova] Acquiring lock "530ee025-6faf-4497-aee9-dab145920012-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-5f335d10-868c-43b8-af6a-73eceeb7b435 req-b916d8c4-be20-47c3-8451-c193ba08ded4 service nova] Lock "530ee025-6faf-4497-aee9-dab145920012-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-5f335d10-868c-43b8-af6a-73eceeb7b435 req-b916d8c4-be20-47c3-8451-c193ba08ded4 service nova] Lock "530ee025-6faf-4497-aee9-dab145920012-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:46:15 user nova-compute[71113]: DEBUG nova.compute.manager [req-5f335d10-868c-43b8-af6a-73eceeb7b435 req-b916d8c4-be20-47c3-8451-c193ba08ded4 service nova] [instance: 530ee025-6faf-4497-aee9-dab145920012] No waiting events found dispatching network-vif-plugged-87156da3-0a08-44a2-a914-c69566bf1b5a {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:46:15 user nova-compute[71113]: WARNING nova.compute.manager [req-5f335d10-868c-43b8-af6a-73eceeb7b435 req-b916d8c4-be20-47c3-8451-c193ba08ded4 service nova] [instance: 530ee025-6faf-4497-aee9-dab145920012] Received unexpected event network-vif-plugged-87156da3-0a08-44a2-a914-c69566bf1b5a for instance with vm_state building and task_state spawning.
Jul 31 09:46:16 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690796776.401059, 530ee025-6faf-4497-aee9-dab145920012 => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:46:16 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 530ee025-6faf-4497-aee9-dab145920012] VM Resumed (Lifecycle Event)
Jul 31 09:46:16 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] [instance: 530ee025-6faf-4497-aee9-dab145920012] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 09:46:16 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] [instance: 530ee025-6faf-4497-aee9-dab145920012] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 09:46:16 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 530ee025-6faf-4497-aee9-dab145920012] Instance spawned successfully.
Jul 31 09:46:16 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] [instance: 530ee025-6faf-4497-aee9-dab145920012] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 09:46:16 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 530ee025-6faf-4497-aee9-dab145920012] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:46:16 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 530ee025-6faf-4497-aee9-dab145920012] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:46:16 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] [instance: 530ee025-6faf-4497-aee9-dab145920012] Found default for hw_cdrom_bus of ide {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:46:16 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] [instance: 530ee025-6faf-4497-aee9-dab145920012] Found default for hw_disk_bus of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:46:16 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] [instance: 530ee025-6faf-4497-aee9-dab145920012] Found default for hw_input_bus of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:46:16 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] [instance: 530ee025-6faf-4497-aee9-dab145920012] Found default for hw_pointer_model of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:46:16 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] [instance: 530ee025-6faf-4497-aee9-dab145920012] Found default for hw_video_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:46:16 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] [instance: 530ee025-6faf-4497-aee9-dab145920012] Found default for hw_vif_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:46:16 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 530ee025-6faf-4497-aee9-dab145920012] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:46:16 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690796776.4014208, 530ee025-6faf-4497-aee9-dab145920012 => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:46:16 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 530ee025-6faf-4497-aee9-dab145920012] VM Started (Lifecycle Event)
Jul 31 09:46:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:16 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 530ee025-6faf-4497-aee9-dab145920012] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:46:16 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 530ee025-6faf-4497-aee9-dab145920012] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:46:16 user nova-compute[71113]: INFO nova.compute.manager [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] [instance: 530ee025-6faf-4497-aee9-dab145920012] Took 12.19 seconds to spawn the instance on the hypervisor.
Jul 31 09:46:16 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] [instance: 530ee025-6faf-4497-aee9-dab145920012] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:46:16 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 530ee025-6faf-4497-aee9-dab145920012] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:46:16 user nova-compute[71113]: INFO nova.compute.manager [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] [instance: 530ee025-6faf-4497-aee9-dab145920012] Took 13.08 seconds to build instance.
Jul 31 09:46:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ba7371a6-85bb-4d9a-8fb3-9096634bb3b5 tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Lock "530ee025-6faf-4497-aee9-dab145920012" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.320s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:46:18 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:18 user nova-compute[71113]: DEBUG nova.compute.manager [req-54880830-1b73-4b93-8269-dca025ac5f47 req-66074207-0e2d-4885-b154-525a3787b98b service nova] [instance: 530ee025-6faf-4497-aee9-dab145920012] Received event network-vif-plugged-87156da3-0a08-44a2-a914-c69566bf1b5a {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:46:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-54880830-1b73-4b93-8269-dca025ac5f47 req-66074207-0e2d-4885-b154-525a3787b98b service nova] Acquiring lock "530ee025-6faf-4497-aee9-dab145920012-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-54880830-1b73-4b93-8269-dca025ac5f47 req-66074207-0e2d-4885-b154-525a3787b98b service nova] Lock "530ee025-6faf-4497-aee9-dab145920012-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-54880830-1b73-4b93-8269-dca025ac5f47 req-66074207-0e2d-4885-b154-525a3787b98b service nova] Lock "530ee025-6faf-4497-aee9-dab145920012-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:46:18 user nova-compute[71113]: DEBUG nova.compute.manager [req-54880830-1b73-4b93-8269-dca025ac5f47 req-66074207-0e2d-4885-b154-525a3787b98b service nova] [instance: 530ee025-6faf-4497-aee9-dab145920012] No waiting events found dispatching network-vif-plugged-87156da3-0a08-44a2-a914-c69566bf1b5a {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:46:18 user nova-compute[71113]: WARNING nova.compute.manager [req-54880830-1b73-4b93-8269-dca025ac5f47 req-66074207-0e2d-4885-b154-525a3787b98b service nova] [instance: 530ee025-6faf-4497-aee9-dab145920012] Received unexpected event network-vif-plugged-87156da3-0a08-44a2-a914-c69566bf1b5a for instance with vm_state active and task_state None.
Jul 31 09:46:18 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Acquiring lock "0ea0401b-26c2-4655-956b-1bc000debd53" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "0ea0401b-26c2-4655-956b-1bc000debd53" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:19 user nova-compute[71113]: DEBUG nova.compute.manager [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Starting instance... {{(pid=71113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 09:46:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Acquiring lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:19 user nova-compute[71113]: DEBUG nova.compute.manager [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Starting instance... {{(pid=71113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 09:46:19 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 09:46:19 user nova-compute[71113]: INFO nova.compute.claims [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Claim successful on node user
Jul 31 09:46:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Acquiring lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:19 user nova-compute[71113]: DEBUG nova.compute.manager [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Starting instance... {{(pid=71113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 09:46:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:19 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:46:19 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:46:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.576s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:46:19 user nova-compute[71113]: DEBUG nova.compute.manager [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Start building networks asynchronously for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 09:46:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.322s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:19 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 09:46:19 user nova-compute[71113]: INFO nova.compute.claims [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Claim successful on node user
Jul 31 09:46:20 user nova-compute[71113]: DEBUG nova.compute.manager [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Allocating IP information in the background. {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 09:46:20 user nova-compute[71113]: DEBUG nova.network.neutron [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] allocate_for_instance() {{(pid=71113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 09:46:20 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 09:46:20 user nova-compute[71113]: DEBUG nova.compute.manager [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Start building block device mappings for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 09:46:20 user nova-compute[71113]: DEBUG nova.policy [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7029dd8d775d4c14bb349b72b1171d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a5479fd014325b8790a80b2405d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71113) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 09:46:20 user nova-compute[71113]: DEBUG nova.compute.manager [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Start spawning the instance on the hypervisor. {{(pid=71113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 09:46:20 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 09:46:20 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Creating image(s)
Jul 31 09:46:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Acquiring lock "/opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "/opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.005s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "/opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:46:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:46:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:20 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:46:20 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:46:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.566s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:46:20 user nova-compute[71113]: DEBUG nova.compute.manager [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Start building networks asynchronously for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 09:46:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.793s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:20 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 09:46:20 user nova-compute[71113]: INFO nova.compute.claims [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Claim successful on node user
Jul 31 09:46:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.208s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:46:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Acquiring lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:46:20 user nova-compute[71113]: DEBUG nova.compute.manager [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Allocating IP information in the background. {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 09:46:20 user nova-compute[71113]: DEBUG nova.network.neutron [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] allocate_for_instance() {{(pid=71113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 09:46:20 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 09:46:20 user nova-compute[71113]: DEBUG nova.compute.manager [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Start building block device mappings for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 09:46:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.196s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:46:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk 1073741824 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:46:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk 1073741824" returned: 0 in 0.082s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:46:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:46:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:46:20 user nova-compute[71113]: DEBUG nova.policy [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0b5f449e8b1948cf914daef537aea164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5bb5c0790e54702b881dc5e45641be8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71113) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 09:46:20 user nova-compute[71113]: DEBUG nova.compute.manager [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Start spawning the instance on the hypervisor. {{(pid=71113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 09:46:20 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 09:46:20 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Creating image(s)
Jul 31 09:46:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Acquiring lock "/opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lock "/opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lock "/opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:46:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:46:21 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:46:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.212s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:46:21 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk. size=1073741824 {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 09:46:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:46:21 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:46:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.674s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:46:21 user nova-compute[71113]: DEBUG nova.compute.manager [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Start building networks asynchronously for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 09:46:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.230s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:46:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Acquiring lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:46:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:46:21 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Cannot resize image /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk to a smaller size. {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 09:46:21 user nova-compute[71113]: DEBUG nova.objects.instance [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lazy-loading 'migration_context' on Instance uuid 0ea0401b-26c2-4655-956b-1bc000debd53 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:46:21 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Created local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 09:46:21 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Ensure instance console log exists: /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 09:46:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:46:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:21 user nova-compute[71113]: DEBUG nova.compute.manager [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Allocating IP information in the background. {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 09:46:21 user nova-compute[71113]: DEBUG nova.network.neutron [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] allocate_for_instance() {{(pid=71113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 09:46:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.245s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:46:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk 1073741824 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:46:21 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 09:46:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk 1073741824" returned: 0 in 0.086s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:46:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.335s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:46:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:46:21 user nova-compute[71113]: DEBUG nova.compute.manager [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Start building block device mappings for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 09:46:21 user nova-compute[71113]: DEBUG nova.policy [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '07e8e7f9b62d452a88a29f333177c9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae93d4fff5e4990bd9fe78e71d6d2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71113) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 09:46:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.185s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:46:21 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Checking if we can resize image /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk. size=1073741824 {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 09:46:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:46:21 user nova-compute[71113]: DEBUG nova.compute.manager [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Start spawning the instance on the hypervisor. {{(pid=71113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 09:46:21 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 09:46:21 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Creating image(s)
Jul 31 09:46:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Acquiring lock "/opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "/opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "/opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:46:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:46:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:46:21 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Cannot resize image /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk to a smaller size. {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 09:46:21 user nova-compute[71113]: DEBUG nova.objects.instance [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lazy-loading 'migration_context' on Instance uuid efa311a0-fe2e-4c0f-af66-09c3eb38fbf1 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:46:21 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Created local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 09:46:21 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Ensure instance console log exists: /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 09:46:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:46:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.257s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:46:22 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Acquiring lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:22 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:46:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.186s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:46:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk 1073741824 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:46:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk 1073741824" returned: 0 in 0.084s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:46:22 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:46:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:46:22 user nova-compute[71113]: DEBUG nova.network.neutron [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Successfully created port: 5408a169-bdde-42da-be35-24006f474bc6 {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 09:46:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.212s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:46:22 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk. size=1073741824 {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 09:46:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:46:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:46:22 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Cannot resize image /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk to a smaller size. {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 09:46:22 user nova-compute[71113]: DEBUG nova.objects.instance [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lazy-loading 'migration_context' on Instance uuid 1112a49d-27bd-4fc8-bae6-ec1decbb47db {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:46:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Created local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 09:46:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Ensure instance console log exists: /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 09:46:22 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:22 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:22 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:46:23 user nova-compute[71113]: DEBUG nova.network.neutron [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Successfully created port: 647f984e-a9e3-4e49-9877-75ad4826e467 {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 09:46:23 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:23 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:23 user nova-compute[71113]: DEBUG nova.network.neutron [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Successfully created port: 39b5a493-47bd-4599-9a9f-bb80c93fb332 {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 09:46:24 user nova-compute[71113]: DEBUG nova.network.neutron [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Successfully updated port: 647f984e-a9e3-4e49-9877-75ad4826e467 {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 09:46:24 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Acquiring lock "refresh_cache-1112a49d-27bd-4fc8-bae6-ec1decbb47db" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:46:24 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Acquired lock "refresh_cache-1112a49d-27bd-4fc8-bae6-ec1decbb47db" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:46:24 user nova-compute[71113]: DEBUG nova.network.neutron [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 09:46:24 user nova-compute[71113]: DEBUG nova.compute.manager [req-0b5dfc23-897e-4b8c-a244-2d28731e6e1a req-95cde5a7-b158-49eb-b8a5-b4651ac26bf4 service nova] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Received event network-changed-647f984e-a9e3-4e49-9877-75ad4826e467 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:46:24 user nova-compute[71113]: DEBUG nova.compute.manager [req-0b5dfc23-897e-4b8c-a244-2d28731e6e1a req-95cde5a7-b158-49eb-b8a5-b4651ac26bf4 service nova] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Refreshing instance network info cache due to event network-changed-647f984e-a9e3-4e49-9877-75ad4826e467. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:46:24 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-0b5dfc23-897e-4b8c-a244-2d28731e6e1a req-95cde5a7-b158-49eb-b8a5-b4651ac26bf4 service nova] Acquiring lock "refresh_cache-1112a49d-27bd-4fc8-bae6-ec1decbb47db" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:46:24 user nova-compute[71113]: DEBUG nova.network.neutron [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 09:46:25 user nova-compute[71113]: DEBUG nova.network.neutron [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Successfully updated port: 5408a169-bdde-42da-be35-24006f474bc6 {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 09:46:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Acquiring lock "refresh_cache-0ea0401b-26c2-4655-956b-1bc000debd53" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:46:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Acquired lock "refresh_cache-0ea0401b-26c2-4655-956b-1bc000debd53" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:46:25 user nova-compute[71113]: DEBUG nova.network.neutron [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 09:46:25 user nova-compute[71113]: DEBUG nova.network.neutron [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Updating instance_info_cache with network_info: [{"id": "647f984e-a9e3-4e49-9877-75ad4826e467", "address": "fa:16:3e:72:e2:f2", "network": {"id": "26352e29-fc15-48ac-be14-8af7a0c80219", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866093358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bae93d4fff5e4990bd9fe78e71d6d2d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647f984e-a9", "ovs_interfaceid": "647f984e-a9e3-4e49-9877-75ad4826e467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:46:25 user nova-compute[71113]: DEBUG nova.compute.manager [req-68e49559-9f3d-4965-a16b-0f5ce6fb6d08 req-efef76cc-67b4-4e36-9c47-60a7c546d9b1 service nova] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Received event network-changed-5408a169-bdde-42da-be35-24006f474bc6 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:46:25 user nova-compute[71113]: DEBUG nova.compute.manager [req-68e49559-9f3d-4965-a16b-0f5ce6fb6d08 req-efef76cc-67b4-4e36-9c47-60a7c546d9b1 service nova] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Refreshing instance network info cache due to event network-changed-5408a169-bdde-42da-be35-24006f474bc6. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:46:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-68e49559-9f3d-4965-a16b-0f5ce6fb6d08 req-efef76cc-67b4-4e36-9c47-60a7c546d9b1 service nova] Acquiring lock "refresh_cache-0ea0401b-26c2-4655-956b-1bc000debd53" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:46:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Releasing lock "refresh_cache-1112a49d-27bd-4fc8-bae6-ec1decbb47db" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:46:25 user nova-compute[71113]: DEBUG nova.compute.manager [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Instance network_info: |[{"id": "647f984e-a9e3-4e49-9877-75ad4826e467", "address": "fa:16:3e:72:e2:f2", "network": {"id": "26352e29-fc15-48ac-be14-8af7a0c80219", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866093358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bae93d4fff5e4990bd9fe78e71d6d2d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647f984e-a9", "ovs_interfaceid": "647f984e-a9e3-4e49-9877-75ad4826e467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 09:46:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-0b5dfc23-897e-4b8c-a244-2d28731e6e1a req-95cde5a7-b158-49eb-b8a5-b4651ac26bf4 service nova] Acquired lock "refresh_cache-1112a49d-27bd-4fc8-bae6-ec1decbb47db" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:46:25 user nova-compute[71113]: DEBUG nova.network.neutron [req-0b5dfc23-897e-4b8c-a244-2d28731e6e1a req-95cde5a7-b158-49eb-b8a5-b4651ac26bf4 service nova] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Refreshing network info cache for port 647f984e-a9e3-4e49-9877-75ad4826e467 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:46:25 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Start _get_guest_xml network_info=[{"id": "647f984e-a9e3-4e49-9877-75ad4826e467", "address": "fa:16:3e:72:e2:f2", "network": {"id": "26352e29-fc15-48ac-be14-8af7a0c80219", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866093358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bae93d4fff5e4990bd9fe78e71d6d2d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647f984e-a9", "ovs_interfaceid": "647f984e-a9e3-4e49-9877-75ad4826e467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'image_id': '078646fe-b504-41ed-a147-61072e903e51'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 09:46:25 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:46:25 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:46:25 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 09:46:25 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 09:46:25 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 09:46:25 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 09:46:25 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 09:46:25 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 09:46:25 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 09:46:25 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 09:46:25 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 09:46:25 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 09:46:25 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 09:46:25 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 09:46:25 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 09:46:25 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 09:46:25 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 09:46:25 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 09:46:25 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:46:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-945276604',display_name='tempest-AttachVolumeTestJSON-server-945276604',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-945276604',id=4,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrh1mBzVZxlJvQ7fNDAygLsv+THMZUpGRA7FK4egW/8+4V1WnWdx5N/BO7+Js/uDb74ZnuQwIBHV28KCkKnxQdjKa1wMXR+/Fwf+zqW2yRjgeNcXtlxa12OdQcYhwsVfQ==',key_name='tempest-keypair-1526222779',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bae93d4fff5e4990bd9fe78e71d6d2d2',ramdisk_id='',reservation_id='r-l6z5atk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1230374483',owner_user_name='tempest-AttachVolumeTestJSON-1230374483-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:46:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07e8e7f9b62d452a88a29f333177c9d2',uuid=1112a49d-27bd-4fc8-bae6-ec1decbb47db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "647f984e-a9e3-4e49-9877-75ad4826e467", "address": "fa:16:3e:72:e2:f2", "network": {"id": "26352e29-fc15-48ac-be14-8af7a0c80219", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866093358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bae93d4fff5e4990bd9fe78e71d6d2d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647f984e-a9", "ovs_interfaceid": "647f984e-a9e3-4e49-9877-75ad4826e467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 09:46:25 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Converting VIF {"id": "647f984e-a9e3-4e49-9877-75ad4826e467", "address": "fa:16:3e:72:e2:f2", "network": {"id": "26352e29-fc15-48ac-be14-8af7a0c80219", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866093358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bae93d4fff5e4990bd9fe78e71d6d2d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647f984e-a9", "ovs_interfaceid": "647f984e-a9e3-4e49-9877-75ad4826e467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:46:25 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:e2:f2,bridge_name='br-int',has_traffic_filtering=True,id=647f984e-a9e3-4e49-9877-75ad4826e467,network=Network(26352e29-fc15-48ac-be14-8af7a0c80219),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap647f984e-a9') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:46:25 user nova-compute[71113]: DEBUG nova.objects.instance [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lazy-loading 'pci_devices' on Instance uuid 1112a49d-27bd-4fc8-bae6-ec1decbb47db {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:46:25 user nova-compute[71113]: DEBUG nova.network.neutron [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 09:46:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Acquiring lock "caac13d2-ceb3-4fee-84ad-5376c1c2cc23" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Lock "caac13d2-ceb3-4fee-84ad-5376c1c2cc23" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:25 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] End _get_guest_xml xml=<domain type="kvm">
Jul 31 09:46:25 user nova-compute[71113]:   <uuid>1112a49d-27bd-4fc8-bae6-ec1decbb47db</uuid>
Jul 31 09:46:25 user nova-compute[71113]:   <name>instance-00000004</name>
Jul 31 09:46:25 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 09:46:25 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 09:46:25 user nova-compute[71113]:   <metadata>
Jul 31 09:46:25 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 09:46:25 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 09:46:25 user nova-compute[71113]:       <nova:name>tempest-AttachVolumeTestJSON-server-945276604</nova:name>
Jul 31 09:46:25 user nova-compute[71113]:       <nova:creationTime>2023-07-31 09:46:25</nova:creationTime>
Jul 31 09:46:25 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 09:46:25 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 09:46:25 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 09:46:25 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 09:46:25 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 09:46:25 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 09:46:25 user nova-compute[71113]:       </nova:flavor>
Jul 31 09:46:25 user nova-compute[71113]:       <nova:owner>
Jul 31 09:46:25 user nova-compute[71113]:         <nova:user uuid="07e8e7f9b62d452a88a29f333177c9d2">tempest-AttachVolumeTestJSON-1230374483-project-member</nova:user>
Jul 31 09:46:25 user nova-compute[71113]:         <nova:project uuid="bae93d4fff5e4990bd9fe78e71d6d2d2">tempest-AttachVolumeTestJSON-1230374483</nova:project>
Jul 31 09:46:25 user nova-compute[71113]:       </nova:owner>
Jul 31 09:46:25 user nova-compute[71113]:       <nova:root type="image" uuid="078646fe-b504-41ed-a147-61072e903e51"/>
Jul 31 09:46:25 user nova-compute[71113]:       <nova:ports>
Jul 31 09:46:25 user nova-compute[71113]:         <nova:port uuid="647f984e-a9e3-4e49-9877-75ad4826e467">
Jul 31 09:46:25 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 31 09:46:25 user nova-compute[71113]:         </nova:port>
Jul 31 09:46:25 user nova-compute[71113]:       </nova:ports>
Jul 31 09:46:25 user nova-compute[71113]:     </nova:instance>
Jul 31 09:46:25 user nova-compute[71113]:   </metadata>
Jul 31 09:46:25 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 09:46:25 user nova-compute[71113]:     <system>
Jul 31 09:46:25 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 09:46:25 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 09:46:25 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 09:46:25 user nova-compute[71113]:       <entry name="serial">1112a49d-27bd-4fc8-bae6-ec1decbb47db</entry>
Jul 31 09:46:25 user nova-compute[71113]:       <entry name="uuid">1112a49d-27bd-4fc8-bae6-ec1decbb47db</entry>
Jul 31 09:46:25 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 09:46:25 user nova-compute[71113]:     </system>
Jul 31 09:46:25 user nova-compute[71113]:   </sysinfo>
Jul 31 09:46:25 user nova-compute[71113]:   <os>
Jul 31 09:46:25 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 09:46:25 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 09:46:25 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 09:46:25 user nova-compute[71113]:   </os>
Jul 31 09:46:25 user nova-compute[71113]:   <features>
Jul 31 09:46:25 user nova-compute[71113]:     <acpi/>
Jul 31 09:46:25 user nova-compute[71113]:     <apic/>
Jul 31 09:46:25 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 09:46:25 user nova-compute[71113]:   </features>
Jul 31 09:46:25 user nova-compute[71113]:   <clock offset="utc">
Jul 31 09:46:25 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 09:46:25 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 09:46:25 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 09:46:25 user nova-compute[71113]:   </clock>
Jul 31 09:46:25 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 09:46:25 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 09:46:25 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 09:46:25 user nova-compute[71113]:   </cpu>
Jul 31 09:46:25 user nova-compute[71113]:   <devices>
Jul 31 09:46:25 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 09:46:25 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 09:46:25 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk"/>
Jul 31 09:46:25 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 09:46:25 user nova-compute[71113]:     </disk>
Jul 31 09:46:25 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 09:46:25 user nova-compute[71113]:       <mac address="fa:16:3e:72:e2:f2"/>
Jul 31 09:46:25 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:46:25 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 09:46:25 user nova-compute[71113]:       <target dev="tap647f984e-a9"/>
Jul 31 09:46:25 user nova-compute[71113]:     </interface>
Jul 31 09:46:25 user nova-compute[71113]:     <serial type="pty">
Jul 31 09:46:25 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/console.log" append="off"/>
Jul 31 09:46:25 user nova-compute[71113]:     </serial>
Jul 31 09:46:25 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 09:46:25 user nova-compute[71113]:     <video>
Jul 31 09:46:25 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:46:25 user nova-compute[71113]:     </video>
Jul 31 09:46:25 user nova-compute[71113]:     <rng model="virtio">
Jul 31 09:46:25 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 09:46:25 user nova-compute[71113]:     </rng>
Jul 31 09:46:25 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 09:46:25 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 09:46:25 user nova-compute[71113]:       <stats period="10"/>
Jul 31 09:46:25 user nova-compute[71113]:     </memballoon>
Jul 31 09:46:25 user nova-compute[71113]:   </devices>
Jul 31 09:46:25 user nova-compute[71113]: </domain>
Jul 31 09:46:25 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 09:46:25 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:46:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-945276604',display_name='tempest-AttachVolumeTestJSON-server-945276604',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-945276604',id=4,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrh1mBzVZxlJvQ7fNDAygLsv+THMZUpGRA7FK4egW/8+4V1WnWdx5N/BO7+Js/uDb74ZnuQwIBHV28KCkKnxQdjKa1wMXR+/Fwf+zqW2yRjgeNcXtlxa12OdQcYhwsVfQ==',key_name='tempest-keypair-1526222779',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bae93d4fff5e4990bd9fe78e71d6d2d2',ramdisk_id='',reservation_id='r-l6z5atk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1230374483',owner_user_name='tempest-AttachVolumeTestJSON-1230374483-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:46:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07e8e7f9b62d452a88a29f333177c9d2',uuid=1112a49d-27bd-4fc8-bae6-ec1decbb47db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "647f984e-a9e3-4e49-9877-75ad4826e467", "address": "fa:16:3e:72:e2:f2", "network": {"id": "26352e29-fc15-48ac-be14-8af7a0c80219", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866093358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bae93d4fff5e4990bd9fe78e71d6d2d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647f984e-a9", "ovs_interfaceid": "647f984e-a9e3-4e49-9877-75ad4826e467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 09:46:25 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Converting VIF {"id": "647f984e-a9e3-4e49-9877-75ad4826e467", "address": "fa:16:3e:72:e2:f2", "network": {"id": "26352e29-fc15-48ac-be14-8af7a0c80219", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866093358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bae93d4fff5e4990bd9fe78e71d6d2d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647f984e-a9", "ovs_interfaceid": "647f984e-a9e3-4e49-9877-75ad4826e467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:46:25 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:e2:f2,bridge_name='br-int',has_traffic_filtering=True,id=647f984e-a9e3-4e49-9877-75ad4826e467,network=Network(26352e29-fc15-48ac-be14-8af7a0c80219),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap647f984e-a9') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:46:25 user nova-compute[71113]: DEBUG os_vif [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:e2:f2,bridge_name='br-int',has_traffic_filtering=True,id=647f984e-a9e3-4e49-9877-75ad4826e467,network=Network(26352e29-fc15-48ac-be14-8af7a0c80219),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap647f984e-a9') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 09:46:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:46:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 09:46:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap647f984e-a9, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:46:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap647f984e-a9, col_values=(('external_ids', {'iface-id': '647f984e-a9e3-4e49-9877-75ad4826e467', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:e2:f2', 'vm-uuid': '1112a49d-27bd-4fc8-bae6-ec1decbb47db'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:46:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:25 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Starting instance... {{(pid=71113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 09:46:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:25 user nova-compute[71113]: INFO os_vif [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:e2:f2,bridge_name='br-int',has_traffic_filtering=True,id=647f984e-a9e3-4e49-9877-75ad4826e467,network=Network(26352e29-fc15-48ac-be14-8af7a0c80219),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap647f984e-a9')
Jul 31 09:46:25 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:46:25 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] No VIF found with MAC fa:16:3e:72:e2:f2, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 09:46:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:25 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 09:46:25 user nova-compute[71113]: INFO nova.compute.claims [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Claim successful on node user
Jul 31 09:46:26 user nova-compute[71113]: DEBUG nova.network.neutron [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Updating instance_info_cache with network_info: [{"id": "5408a169-bdde-42da-be35-24006f474bc6", "address": "fa:16:3e:77:a3:62", "network": {"id": "cc84435f-b983-425d-bad0-36039e592e25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1662840158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f7a5479fd014325b8790a80b2405d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5408a169-bd", "ovs_interfaceid": "5408a169-bdde-42da-be35-24006f474bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG nova.network.neutron [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Successfully updated port: 39b5a493-47bd-4599-9a9f-bb80c93fb332 {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Releasing lock "refresh_cache-0ea0401b-26c2-4655-956b-1bc000debd53" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG nova.compute.manager [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Instance network_info: |[{"id": "5408a169-bdde-42da-be35-24006f474bc6", "address": "fa:16:3e:77:a3:62", "network": {"id": "cc84435f-b983-425d-bad0-36039e592e25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1662840158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f7a5479fd014325b8790a80b2405d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5408a169-bd", "ovs_interfaceid": "5408a169-bdde-42da-be35-24006f474bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-68e49559-9f3d-4965-a16b-0f5ce6fb6d08 req-efef76cc-67b4-4e36-9c47-60a7c546d9b1 service nova] Acquired lock "refresh_cache-0ea0401b-26c2-4655-956b-1bc000debd53" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG nova.network.neutron [req-68e49559-9f3d-4965-a16b-0f5ce6fb6d08 req-efef76cc-67b4-4e36-9c47-60a7c546d9b1 service nova] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Refreshing network info cache for port 5408a169-bdde-42da-be35-24006f474bc6 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Start _get_guest_xml network_info=[{"id": "5408a169-bdde-42da-be35-24006f474bc6", "address": "fa:16:3e:77:a3:62", "network": {"id": "cc84435f-b983-425d-bad0-36039e592e25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1662840158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f7a5479fd014325b8790a80b2405d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5408a169-bd", "ovs_interfaceid": "5408a169-bdde-42da-be35-24006f474bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'image_id': '078646fe-b504-41ed-a147-61072e903e51'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 09:46:26 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:46:26 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:46:26 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Acquiring lock "refresh_cache-efa311a0-fe2e-4c0f-af66-09c3eb38fbf1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Acquired lock "refresh_cache-efa311a0-fe2e-4c0f-af66-09c3eb38fbf1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG nova.network.neutron [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:46:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-554499227',display_name='tempest-ServerActionsTestOtherA-server-554499227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-554499227',id=2,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5EE1xUvLRoodLjDMpmYpiUOpJ4L9wfbpJsZ+HUVFxXJGKbpzcG8jQIKPQ0cQElq3F/Fhyr7R6+c9C8jzz21FzCpd/o9T+iI7W2nanWOzhB0iUhT1vp4Ko8/FdZGlABXg==',key_name='tempest-keypair-58057469',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f7a5479fd014325b8790a80b2405d1d',ramdisk_id='',reservation_id='r-119yz4q0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2065923437',owner_user_name='tempest-ServerActionsTestOtherA-2065923437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:46:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7029dd8d775d4c14bb349b72b1171d5f',uuid=0ea0401b-26c2-4655-956b-1bc000debd53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5408a169-bdde-42da-be35-24006f474bc6", "address": "fa:16:3e:77:a3:62", "network": {"id": "cc84435f-b983-425d-bad0-36039e592e25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1662840158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f7a5479fd014325b8790a80b2405d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5408a169-bd", "ovs_interfaceid": "5408a169-bdde-42da-be35-24006f474bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Converting VIF {"id": "5408a169-bdde-42da-be35-24006f474bc6", "address": "fa:16:3e:77:a3:62", "network": {"id": "cc84435f-b983-425d-bad0-36039e592e25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1662840158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f7a5479fd014325b8790a80b2405d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5408a169-bd", "ovs_interfaceid": "5408a169-bdde-42da-be35-24006f474bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:a3:62,bridge_name='br-int',has_traffic_filtering=True,id=5408a169-bdde-42da-be35-24006f474bc6,network=Network(cc84435f-b983-425d-bad0-36039e592e25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5408a169-bd') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG nova.objects.instance [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ea0401b-26c2-4655-956b-1bc000debd53 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG nova.network.neutron [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] End _get_guest_xml xml=<domain type="kvm">
Jul 31 09:46:26 user nova-compute[71113]:   <uuid>0ea0401b-26c2-4655-956b-1bc000debd53</uuid>
Jul 31 09:46:26 user nova-compute[71113]:   <name>instance-00000002</name>
Jul 31 09:46:26 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 09:46:26 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 09:46:26 user nova-compute[71113]:   <metadata>
Jul 31 09:46:26 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 09:46:26 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 09:46:26 user nova-compute[71113]:       <nova:name>tempest-ServerActionsTestOtherA-server-554499227</nova:name>
Jul 31 09:46:26 user nova-compute[71113]:       <nova:creationTime>2023-07-31 09:46:26</nova:creationTime>
Jul 31 09:46:26 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 09:46:26 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 09:46:26 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 09:46:26 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 09:46:26 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 09:46:26 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 09:46:26 user nova-compute[71113]:       </nova:flavor>
Jul 31 09:46:26 user nova-compute[71113]:       <nova:owner>
Jul 31 09:46:26 user nova-compute[71113]:         <nova:user uuid="7029dd8d775d4c14bb349b72b1171d5f">tempest-ServerActionsTestOtherA-2065923437-project-member</nova:user>
Jul 31 09:46:26 user nova-compute[71113]:         <nova:project uuid="9f7a5479fd014325b8790a80b2405d1d">tempest-ServerActionsTestOtherA-2065923437</nova:project>
Jul 31 09:46:26 user nova-compute[71113]:       </nova:owner>
Jul 31 09:46:26 user nova-compute[71113]:       <nova:root type="image" uuid="078646fe-b504-41ed-a147-61072e903e51"/>
Jul 31 09:46:26 user nova-compute[71113]:       <nova:ports>
Jul 31 09:46:26 user nova-compute[71113]:         <nova:port uuid="5408a169-bdde-42da-be35-24006f474bc6">
Jul 31 09:46:26 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 31 09:46:26 user nova-compute[71113]:         </nova:port>
Jul 31 09:46:26 user nova-compute[71113]:       </nova:ports>
Jul 31 09:46:26 user nova-compute[71113]:     </nova:instance>
Jul 31 09:46:26 user nova-compute[71113]:   </metadata>
Jul 31 09:46:26 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 09:46:26 user nova-compute[71113]:     <system>
Jul 31 09:46:26 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 09:46:26 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 09:46:26 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 09:46:26 user nova-compute[71113]:       <entry name="serial">0ea0401b-26c2-4655-956b-1bc000debd53</entry>
Jul 31 09:46:26 user nova-compute[71113]:       <entry name="uuid">0ea0401b-26c2-4655-956b-1bc000debd53</entry>
Jul 31 09:46:26 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 09:46:26 user nova-compute[71113]:     </system>
Jul 31 09:46:26 user nova-compute[71113]:   </sysinfo>
Jul 31 09:46:26 user nova-compute[71113]:   <os>
Jul 31 09:46:26 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 09:46:26 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 09:46:26 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 09:46:26 user nova-compute[71113]:   </os>
Jul 31 09:46:26 user nova-compute[71113]:   <features>
Jul 31 09:46:26 user nova-compute[71113]:     <acpi/>
Jul 31 09:46:26 user nova-compute[71113]:     <apic/>
Jul 31 09:46:26 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 09:46:26 user nova-compute[71113]:   </features>
Jul 31 09:46:26 user nova-compute[71113]:   <clock offset="utc">
Jul 31 09:46:26 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 09:46:26 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 09:46:26 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 09:46:26 user nova-compute[71113]:   </clock>
Jul 31 09:46:26 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 09:46:26 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 09:46:26 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 09:46:26 user nova-compute[71113]:   </cpu>
Jul 31 09:46:26 user nova-compute[71113]:   <devices>
Jul 31 09:46:26 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 09:46:26 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 09:46:26 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk"/>
Jul 31 09:46:26 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 09:46:26 user nova-compute[71113]:     </disk>
Jul 31 09:46:26 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 09:46:26 user nova-compute[71113]:       <mac address="fa:16:3e:77:a3:62"/>
Jul 31 09:46:26 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:46:26 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 09:46:26 user nova-compute[71113]:       <target dev="tap5408a169-bd"/>
Jul 31 09:46:26 user nova-compute[71113]:     </interface>
Jul 31 09:46:26 user nova-compute[71113]:     <serial type="pty">
Jul 31 09:46:26 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/console.log" append="off"/>
Jul 31 09:46:26 user nova-compute[71113]:     </serial>
Jul 31 09:46:26 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 09:46:26 user nova-compute[71113]:     <video>
Jul 31 09:46:26 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:46:26 user nova-compute[71113]:     </video>
Jul 31 09:46:26 user nova-compute[71113]:     <rng model="virtio">
Jul 31 09:46:26 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 09:46:26 user nova-compute[71113]:     </rng>
Jul 31 09:46:26 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 09:46:26 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 09:46:26 user nova-compute[71113]:       <stats period="10"/>
Jul 31 09:46:26 user nova-compute[71113]:     </memballoon>
Jul 31 09:46:26 user nova-compute[71113]:   </devices>
Jul 31 09:46:26 user nova-compute[71113]: </domain>
Jul 31 09:46:26 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:46:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-554499227',display_name='tempest-ServerActionsTestOtherA-server-554499227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-554499227',id=2,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5EE1xUvLRoodLjDMpmYpiUOpJ4L9wfbpJsZ+HUVFxXJGKbpzcG8jQIKPQ0cQElq3F/Fhyr7R6+c9C8jzz21FzCpd/o9T+iI7W2nanWOzhB0iUhT1vp4Ko8/FdZGlABXg==',key_name='tempest-keypair-58057469',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f7a5479fd014325b8790a80b2405d1d',ramdisk_id='',reservation_id='r-119yz4q0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2065923437',owner_user_name='tempest-ServerActionsTestOtherA-2065923437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:46:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7029dd8d775d4c14bb349b72b1171d5f',uuid=0ea0401b-26c2-4655-956b-1bc000debd53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5408a169-bdde-42da-be35-24006f474bc6", "address": "fa:16:3e:77:a3:62", "network": {"id": "cc84435f-b983-425d-bad0-36039e592e25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1662840158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f7a5479fd014325b8790a80b2405d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5408a169-bd", "ovs_interfaceid": "5408a169-bdde-42da-be35-24006f474bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Converting VIF {"id": "5408a169-bdde-42da-be35-24006f474bc6", "address": "fa:16:3e:77:a3:62", "network": {"id": "cc84435f-b983-425d-bad0-36039e592e25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1662840158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f7a5479fd014325b8790a80b2405d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5408a169-bd", "ovs_interfaceid": "5408a169-bdde-42da-be35-24006f474bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:a3:62,bridge_name='br-int',has_traffic_filtering=True,id=5408a169-bdde-42da-be35-24006f474bc6,network=Network(cc84435f-b983-425d-bad0-36039e592e25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5408a169-bd') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG os_vif [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:a3:62,bridge_name='br-int',has_traffic_filtering=True,id=5408a169-bdde-42da-be35-24006f474bc6,network=Network(cc84435f-b983-425d-bad0-36039e592e25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5408a169-bd') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5408a169-bd, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5408a169-bd, col_values=(('external_ids', {'iface-id': '5408a169-bdde-42da-be35-24006f474bc6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:a3:62', 'vm-uuid': '0ea0401b-26c2-4655-956b-1bc000debd53'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.805s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Start building networks asynchronously for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:26 user nova-compute[71113]: INFO os_vif [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:a3:62,bridge_name='br-int',has_traffic_filtering=True,id=5408a169-bdde-42da-be35-24006f474bc6,network=Network(cc84435f-b983-425d-bad0-36039e592e25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5408a169-bd')
Jul 31 09:46:26 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Allocating IP information in the background. {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG nova.network.neutron [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] allocate_for_instance() {{(pid=71113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 09:46:26 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 09:46:26 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] No VIF found with MAC fa:16:3e:77:a3:62, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Start building block device mappings for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG nova.policy [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '68ed00ac1dba433fb6ff7281a066d55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025b7e2f3e894690b9cade6b6df70a22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71113) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG nova.network.neutron [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Updating instance_info_cache with network_info: [{"id": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "address": "fa:16:3e:16:bb:aa", "network": {"id": "4f2ea02a-9b26-4f2a-af23-39c060703ff3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-725518740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5bb5c0790e54702b881dc5e45641be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b5a493-47", "ovs_interfaceid": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Start spawning the instance on the hypervisor. {{(pid=71113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 09:46:26 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Creating image(s)
Jul 31 09:46:26 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Acquiring lock "/opt/stack/data/nova/instances/caac13d2-ceb3-4fee-84ad-5376c1c2cc23/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Lock "/opt/stack/data/nova/instances/caac13d2-ceb3-4fee-84ad-5376c1c2cc23/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Lock "/opt/stack/data/nova/instances/caac13d2-ceb3-4fee-84ad-5376c1c2cc23/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Releasing lock "refresh_cache-efa311a0-fe2e-4c0f-af66-09c3eb38fbf1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG nova.compute.manager [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Instance network_info: |[{"id": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "address": "fa:16:3e:16:bb:aa", "network": {"id": "4f2ea02a-9b26-4f2a-af23-39c060703ff3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-725518740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5bb5c0790e54702b881dc5e45641be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b5a493-47", "ovs_interfaceid": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 09:46:26 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Start _get_guest_xml network_info=[{"id": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "address": "fa:16:3e:16:bb:aa", "network": {"id": "4f2ea02a-9b26-4f2a-af23-39c060703ff3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-725518740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5bb5c0790e54702b881dc5e45641be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b5a493-47", "ovs_interfaceid": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'image_id': '078646fe-b504-41ed-a147-61072e903e51'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 09:46:27 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:46:27 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:46:27 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:46:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1025510923',display_name='tempest-ServerActionsTestOtherB-server-1025510923',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1025510923',id=3,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJo+xi4tu0GGLLf+2/4AMwJN8W9HV5KOFul5csHl5tHCHdJymtchsdGYmiKLfCyzN953/rO7ubVJnctaNhLzLpYKjY5Z2Nn1cEvYAzU5x1ZT5edLumoNfJjhx0wRkZgiEQ==',key_name='tempest-keypair-947034726',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5bb5c0790e54702b881dc5e45641be8',ramdisk_id='',reservation_id='r-o5vysyfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1778056817',owner_user_name='tempest-ServerActionsTestOtherB-1778056817-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:46:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b5f449e8b1948cf914daef537aea164',uuid=efa311a0-fe2e-4c0f-af66-09c3eb38fbf1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "address": "fa:16:3e:16:bb:aa", "network": {"id": "4f2ea02a-9b26-4f2a-af23-39c060703ff3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-725518740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5bb5c0790e54702b881dc5e45641be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b5a493-47", "ovs_interfaceid": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Converting VIF {"id": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "address": "fa:16:3e:16:bb:aa", "network": {"id": "4f2ea02a-9b26-4f2a-af23-39c060703ff3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-725518740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5bb5c0790e54702b881dc5e45641be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b5a493-47", "ovs_interfaceid": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:bb:aa,bridge_name='br-int',has_traffic_filtering=True,id=39b5a493-47bd-4599-9a9f-bb80c93fb332,network=Network(4f2ea02a-9b26-4f2a-af23-39c060703ff3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39b5a493-47') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG nova.objects.instance [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lazy-loading 'pci_devices' on Instance uuid efa311a0-fe2e-4c0f-af66-09c3eb38fbf1 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.172s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Acquiring lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] End _get_guest_xml xml=<domain type="kvm">
Jul 31 09:46:27 user nova-compute[71113]:   <uuid>efa311a0-fe2e-4c0f-af66-09c3eb38fbf1</uuid>
Jul 31 09:46:27 user nova-compute[71113]:   <name>instance-00000003</name>
Jul 31 09:46:27 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 09:46:27 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 09:46:27 user nova-compute[71113]:   <metadata>
Jul 31 09:46:27 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 09:46:27 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 09:46:27 user nova-compute[71113]:       <nova:name>tempest-ServerActionsTestOtherB-server-1025510923</nova:name>
Jul 31 09:46:27 user nova-compute[71113]:       <nova:creationTime>2023-07-31 09:46:27</nova:creationTime>
Jul 31 09:46:27 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 09:46:27 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 09:46:27 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 09:46:27 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 09:46:27 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 09:46:27 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 09:46:27 user nova-compute[71113]:       </nova:flavor>
Jul 31 09:46:27 user nova-compute[71113]:       <nova:owner>
Jul 31 09:46:27 user nova-compute[71113]:         <nova:user uuid="0b5f449e8b1948cf914daef537aea164">tempest-ServerActionsTestOtherB-1778056817-project-member</nova:user>
Jul 31 09:46:27 user nova-compute[71113]:         <nova:project uuid="a5bb5c0790e54702b881dc5e45641be8">tempest-ServerActionsTestOtherB-1778056817</nova:project>
Jul 31 09:46:27 user nova-compute[71113]:       </nova:owner>
Jul 31 09:46:27 user nova-compute[71113]:       <nova:root type="image" uuid="078646fe-b504-41ed-a147-61072e903e51"/>
Jul 31 09:46:27 user nova-compute[71113]:       <nova:ports>
Jul 31 09:46:27 user nova-compute[71113]:         <nova:port uuid="39b5a493-47bd-4599-9a9f-bb80c93fb332">
Jul 31 09:46:27 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 31 09:46:27 user nova-compute[71113]:         </nova:port>
Jul 31 09:46:27 user nova-compute[71113]:       </nova:ports>
Jul 31 09:46:27 user nova-compute[71113]:     </nova:instance>
Jul 31 09:46:27 user nova-compute[71113]:   </metadata>
Jul 31 09:46:27 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 09:46:27 user nova-compute[71113]:     <system>
Jul 31 09:46:27 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 09:46:27 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 09:46:27 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 09:46:27 user nova-compute[71113]:       <entry name="serial">efa311a0-fe2e-4c0f-af66-09c3eb38fbf1</entry>
Jul 31 09:46:27 user nova-compute[71113]:       <entry name="uuid">efa311a0-fe2e-4c0f-af66-09c3eb38fbf1</entry>
Jul 31 09:46:27 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 09:46:27 user nova-compute[71113]:     </system>
Jul 31 09:46:27 user nova-compute[71113]:   </sysinfo>
Jul 31 09:46:27 user nova-compute[71113]:   <os>
Jul 31 09:46:27 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 09:46:27 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 09:46:27 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 09:46:27 user nova-compute[71113]:   </os>
Jul 31 09:46:27 user nova-compute[71113]:   <features>
Jul 31 09:46:27 user nova-compute[71113]:     <acpi/>
Jul 31 09:46:27 user nova-compute[71113]:     <apic/>
Jul 31 09:46:27 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 09:46:27 user nova-compute[71113]:   </features>
Jul 31 09:46:27 user nova-compute[71113]:   <clock offset="utc">
Jul 31 09:46:27 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 09:46:27 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 09:46:27 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 09:46:27 user nova-compute[71113]:   </clock>
Jul 31 09:46:27 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 09:46:27 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 09:46:27 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 09:46:27 user nova-compute[71113]:   </cpu>
Jul 31 09:46:27 user nova-compute[71113]:   <devices>
Jul 31 09:46:27 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 09:46:27 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 09:46:27 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk"/>
Jul 31 09:46:27 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 09:46:27 user nova-compute[71113]:     </disk>
Jul 31 09:46:27 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 09:46:27 user nova-compute[71113]:       <mac address="fa:16:3e:16:bb:aa"/>
Jul 31 09:46:27 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:46:27 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 09:46:27 user nova-compute[71113]:       <target dev="tap39b5a493-47"/>
Jul 31 09:46:27 user nova-compute[71113]:     </interface>
Jul 31 09:46:27 user nova-compute[71113]:     <serial type="pty">
Jul 31 09:46:27 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/console.log" append="off"/>
Jul 31 09:46:27 user nova-compute[71113]:     </serial>
Jul 31 09:46:27 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 09:46:27 user nova-compute[71113]:     <video>
Jul 31 09:46:27 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:46:27 user nova-compute[71113]:     </video>
Jul 31 09:46:27 user nova-compute[71113]:     <rng model="virtio">
Jul 31 09:46:27 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 09:46:27 user nova-compute[71113]:     </rng>
Jul 31 09:46:27 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 09:46:27 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 09:46:27 user nova-compute[71113]:       <stats period="10"/>
Jul 31 09:46:27 user nova-compute[71113]:     </memballoon>
Jul 31 09:46:27 user nova-compute[71113]:   </devices>
Jul 31 09:46:27 user nova-compute[71113]: </domain>
Jul 31 09:46:27 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:46:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1025510923',display_name='tempest-ServerActionsTestOtherB-server-1025510923',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1025510923',id=3,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJo+xi4tu0GGLLf+2/4AMwJN8W9HV5KOFul5csHl5tHCHdJymtchsdGYmiKLfCyzN953/rO7ubVJnctaNhLzLpYKjY5Z2Nn1cEvYAzU5x1ZT5edLumoNfJjhx0wRkZgiEQ==',key_name='tempest-keypair-947034726',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5bb5c0790e54702b881dc5e45641be8',ramdisk_id='',reservation_id='r-o5vysyfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1778056817',owner_user_name='tempest-ServerActionsTestOtherB-1778056817-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:46:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b5f449e8b1948cf914daef537aea164',uuid=efa311a0-fe2e-4c0f-af66-09c3eb38fbf1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "address": "fa:16:3e:16:bb:aa", "network": {"id": "4f2ea02a-9b26-4f2a-af23-39c060703ff3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-725518740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5bb5c0790e54702b881dc5e45641be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b5a493-47", "ovs_interfaceid": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Converting VIF {"id": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "address": "fa:16:3e:16:bb:aa", "network": {"id": "4f2ea02a-9b26-4f2a-af23-39c060703ff3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-725518740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5bb5c0790e54702b881dc5e45641be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b5a493-47", "ovs_interfaceid": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:bb:aa,bridge_name='br-int',has_traffic_filtering=True,id=39b5a493-47bd-4599-9a9f-bb80c93fb332,network=Network(4f2ea02a-9b26-4f2a-af23-39c060703ff3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39b5a493-47') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG os_vif [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:bb:aa,bridge_name='br-int',has_traffic_filtering=True,id=39b5a493-47bd-4599-9a9f-bb80c93fb332,network=Network(4f2ea02a-9b26-4f2a-af23-39c060703ff3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39b5a493-47') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap39b5a493-47, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap39b5a493-47, col_values=(('external_ids', {'iface-id': '39b5a493-47bd-4599-9a9f-bb80c93fb332', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:bb:aa', 'vm-uuid': 'efa311a0-fe2e-4c0f-af66-09c3eb38fbf1'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:27 user nova-compute[71113]: INFO os_vif [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:bb:aa,bridge_name='br-int',has_traffic_filtering=True,id=39b5a493-47bd-4599-9a9f-bb80c93fb332,network=Network(4f2ea02a-9b26-4f2a-af23-39c060703ff3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39b5a493-47')
Jul 31 09:46:27 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.185s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/caac13d2-ceb3-4fee-84ad-5376c1c2cc23/disk 1073741824 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] No VIF found with MAC fa:16:3e:16:bb:aa, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/caac13d2-ceb3-4fee-84ad-5376c1c2cc23/disk 1073741824" returned: 0 in 0.090s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG nova.network.neutron [req-0b5dfc23-897e-4b8c-a244-2d28731e6e1a req-95cde5a7-b158-49eb-b8a5-b4651ac26bf4 service nova] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Updated VIF entry in instance network info cache for port 647f984e-a9e3-4e49-9877-75ad4826e467. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG nova.network.neutron [req-0b5dfc23-897e-4b8c-a244-2d28731e6e1a req-95cde5a7-b158-49eb-b8a5-b4651ac26bf4 service nova] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Updating instance_info_cache with network_info: [{"id": "647f984e-a9e3-4e49-9877-75ad4826e467", "address": "fa:16:3e:72:e2:f2", "network": {"id": "26352e29-fc15-48ac-be14-8af7a0c80219", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866093358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bae93d4fff5e4990bd9fe78e71d6d2d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647f984e-a9", "ovs_interfaceid": "647f984e-a9e3-4e49-9877-75ad4826e467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-0b5dfc23-897e-4b8c-a244-2d28731e6e1a req-95cde5a7-b158-49eb-b8a5-b4651ac26bf4 service nova] Releasing lock "refresh_cache-1112a49d-27bd-4fc8-bae6-ec1decbb47db" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG nova.compute.manager [req-306a1b69-b458-4ab2-becb-381e3ec09d5a req-ef189ac1-5732-4c4c-8358-9b9aeee5fb98 service nova] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Received event network-changed-39b5a493-47bd-4599-9a9f-bb80c93fb332 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG nova.compute.manager [req-306a1b69-b458-4ab2-becb-381e3ec09d5a req-ef189ac1-5732-4c4c-8358-9b9aeee5fb98 service nova] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Refreshing instance network info cache due to event network-changed-39b5a493-47bd-4599-9a9f-bb80c93fb332. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-306a1b69-b458-4ab2-becb-381e3ec09d5a req-ef189ac1-5732-4c4c-8358-9b9aeee5fb98 service nova] Acquiring lock "refresh_cache-efa311a0-fe2e-4c0f-af66-09c3eb38fbf1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-306a1b69-b458-4ab2-becb-381e3ec09d5a req-ef189ac1-5732-4c4c-8358-9b9aeee5fb98 service nova] Acquired lock "refresh_cache-efa311a0-fe2e-4c0f-af66-09c3eb38fbf1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG nova.network.neutron [req-306a1b69-b458-4ab2-becb-381e3ec09d5a req-ef189ac1-5732-4c4c-8358-9b9aeee5fb98 service nova] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Refreshing network info cache for port 39b5a493-47bd-4599-9a9f-bb80c93fb332 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.213s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Checking if we can resize image /opt/stack/data/nova/instances/caac13d2-ceb3-4fee-84ad-5376c1c2cc23/disk. size=1073741824 {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caac13d2-ceb3-4fee-84ad-5376c1c2cc23/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caac13d2-ceb3-4fee-84ad-5376c1c2cc23/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Cannot resize image /opt/stack/data/nova/instances/caac13d2-ceb3-4fee-84ad-5376c1c2cc23/disk to a smaller size. {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG nova.objects.instance [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Lazy-loading 'migration_context' on Instance uuid caac13d2-ceb3-4fee-84ad-5376c1c2cc23 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Created local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Ensure instance console log exists: /opt/stack/data/nova/instances/caac13d2-ceb3-4fee-84ad-5376c1c2cc23/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:46:28 user nova-compute[71113]: DEBUG nova.network.neutron [req-68e49559-9f3d-4965-a16b-0f5ce6fb6d08 req-efef76cc-67b4-4e36-9c47-60a7c546d9b1 service nova] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Updated VIF entry in instance network info cache for port 5408a169-bdde-42da-be35-24006f474bc6. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:46:28 user nova-compute[71113]: DEBUG nova.network.neutron [req-68e49559-9f3d-4965-a16b-0f5ce6fb6d08 req-efef76cc-67b4-4e36-9c47-60a7c546d9b1 service nova] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Updating instance_info_cache with network_info: [{"id": "5408a169-bdde-42da-be35-24006f474bc6", "address": "fa:16:3e:77:a3:62", "network": {"id": "cc84435f-b983-425d-bad0-36039e592e25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1662840158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f7a5479fd014325b8790a80b2405d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5408a169-bd", "ovs_interfaceid": "5408a169-bdde-42da-be35-24006f474bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:46:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-68e49559-9f3d-4965-a16b-0f5ce6fb6d08 req-efef76cc-67b4-4e36-9c47-60a7c546d9b1 service nova] Releasing lock "refresh_cache-0ea0401b-26c2-4655-956b-1bc000debd53" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:46:28 user nova-compute[71113]: DEBUG nova.network.neutron [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Successfully created port: 1bdc8450-11f3-4a96-b68b-42f57ed9dcd9 {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 09:46:28 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:28 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:28 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:28 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:28 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:28 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:28 user nova-compute[71113]: DEBUG nova.network.neutron [req-306a1b69-b458-4ab2-becb-381e3ec09d5a req-ef189ac1-5732-4c4c-8358-9b9aeee5fb98 service nova] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Updated VIF entry in instance network info cache for port 39b5a493-47bd-4599-9a9f-bb80c93fb332. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:46:28 user nova-compute[71113]: DEBUG nova.network.neutron [req-306a1b69-b458-4ab2-becb-381e3ec09d5a req-ef189ac1-5732-4c4c-8358-9b9aeee5fb98 service nova] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Updating instance_info_cache with network_info: [{"id": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "address": "fa:16:3e:16:bb:aa", "network": {"id": "4f2ea02a-9b26-4f2a-af23-39c060703ff3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-725518740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5bb5c0790e54702b881dc5e45641be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b5a493-47", "ovs_interfaceid": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:46:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-306a1b69-b458-4ab2-becb-381e3ec09d5a req-ef189ac1-5732-4c4c-8358-9b9aeee5fb98 service nova] Releasing lock "refresh_cache-efa311a0-fe2e-4c0f-af66-09c3eb38fbf1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:46:29 user nova-compute[71113]: DEBUG nova.compute.manager [req-0209e6f1-66d9-44dd-8326-a2a2f023b5c6 req-28b4410a-0616-48a9-b373-86a691a4b905 service nova] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Received event network-vif-plugged-647f984e-a9e3-4e49-9877-75ad4826e467 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:46:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-0209e6f1-66d9-44dd-8326-a2a2f023b5c6 req-28b4410a-0616-48a9-b373-86a691a4b905 service nova] Acquiring lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-0209e6f1-66d9-44dd-8326-a2a2f023b5c6 req-28b4410a-0616-48a9-b373-86a691a4b905 service nova] Lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-0209e6f1-66d9-44dd-8326-a2a2f023b5c6 req-28b4410a-0616-48a9-b373-86a691a4b905 service nova] Lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:46:29 user nova-compute[71113]: DEBUG nova.compute.manager [req-0209e6f1-66d9-44dd-8326-a2a2f023b5c6 req-28b4410a-0616-48a9-b373-86a691a4b905 service nova] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] No waiting events found dispatching network-vif-plugged-647f984e-a9e3-4e49-9877-75ad4826e467 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:46:29 user nova-compute[71113]: WARNING nova.compute.manager [req-0209e6f1-66d9-44dd-8326-a2a2f023b5c6 req-28b4410a-0616-48a9-b373-86a691a4b905 service nova] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Received unexpected event network-vif-plugged-647f984e-a9e3-4e49-9877-75ad4826e467 for instance with vm_state building and task_state spawning.
Jul 31 09:46:29 user nova-compute[71113]: DEBUG nova.compute.manager [req-0209e6f1-66d9-44dd-8326-a2a2f023b5c6 req-28b4410a-0616-48a9-b373-86a691a4b905 service nova] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Received event network-vif-plugged-647f984e-a9e3-4e49-9877-75ad4826e467 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:46:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-0209e6f1-66d9-44dd-8326-a2a2f023b5c6 req-28b4410a-0616-48a9-b373-86a691a4b905 service nova] Acquiring lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-0209e6f1-66d9-44dd-8326-a2a2f023b5c6 req-28b4410a-0616-48a9-b373-86a691a4b905 service nova] Lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-0209e6f1-66d9-44dd-8326-a2a2f023b5c6 req-28b4410a-0616-48a9-b373-86a691a4b905 service nova] Lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:46:29 user nova-compute[71113]: DEBUG nova.compute.manager [req-0209e6f1-66d9-44dd-8326-a2a2f023b5c6 req-28b4410a-0616-48a9-b373-86a691a4b905 service nova] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] No waiting events found dispatching network-vif-plugged-647f984e-a9e3-4e49-9877-75ad4826e467 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:46:29 user nova-compute[71113]: WARNING nova.compute.manager [req-0209e6f1-66d9-44dd-8326-a2a2f023b5c6 req-28b4410a-0616-48a9-b373-86a691a4b905 service nova] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Received unexpected event network-vif-plugged-647f984e-a9e3-4e49-9877-75ad4826e467 for instance with vm_state building and task_state spawning.
Jul 31 09:46:29 user nova-compute[71113]: DEBUG nova.network.neutron [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Successfully updated port: 1bdc8450-11f3-4a96-b68b-42f57ed9dcd9 {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 09:46:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Acquiring lock "refresh_cache-caac13d2-ceb3-4fee-84ad-5376c1c2cc23" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:46:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Acquired lock "refresh_cache-caac13d2-ceb3-4fee-84ad-5376c1c2cc23" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:46:29 user nova-compute[71113]: DEBUG nova.network.neutron [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 09:46:29 user nova-compute[71113]: DEBUG nova.network.neutron [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 09:46:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:30 user nova-compute[71113]: DEBUG nova.compute.manager [req-a51a8c23-2ea8-4611-8fa9-d8f8b2ccc80b req-7862592f-1a8c-453d-8d2d-354eff983c4a service nova] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Received event network-changed-1bdc8450-11f3-4a96-b68b-42f57ed9dcd9 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:46:30 user nova-compute[71113]: DEBUG nova.compute.manager [req-a51a8c23-2ea8-4611-8fa9-d8f8b2ccc80b req-7862592f-1a8c-453d-8d2d-354eff983c4a service nova] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Refreshing instance network info cache due to event network-changed-1bdc8450-11f3-4a96-b68b-42f57ed9dcd9. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:46:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-a51a8c23-2ea8-4611-8fa9-d8f8b2ccc80b req-7862592f-1a8c-453d-8d2d-354eff983c4a service nova] Acquiring lock "refresh_cache-caac13d2-ceb3-4fee-84ad-5376c1c2cc23" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:46:30 user nova-compute[71113]: DEBUG nova.network.neutron [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Updating instance_info_cache with network_info: [{"id": "1bdc8450-11f3-4a96-b68b-42f57ed9dcd9", "address": "fa:16:3e:e8:e4:f6", "network": {"id": "5f0b75d1-03eb-4e68-85fd-8b27d4fda660", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-726146587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "025b7e2f3e894690b9cade6b6df70a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bdc8450-11", "ovs_interfaceid": "1bdc8450-11f3-4a96-b68b-42f57ed9dcd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:46:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Releasing lock "refresh_cache-caac13d2-ceb3-4fee-84ad-5376c1c2cc23" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:46:30 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Instance network_info: |[{"id": "1bdc8450-11f3-4a96-b68b-42f57ed9dcd9", "address": "fa:16:3e:e8:e4:f6", "network": {"id": "5f0b75d1-03eb-4e68-85fd-8b27d4fda660", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-726146587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "025b7e2f3e894690b9cade6b6df70a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bdc8450-11", "ovs_interfaceid": "1bdc8450-11f3-4a96-b68b-42f57ed9dcd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 09:46:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-a51a8c23-2ea8-4611-8fa9-d8f8b2ccc80b req-7862592f-1a8c-453d-8d2d-354eff983c4a service nova] Acquired lock "refresh_cache-caac13d2-ceb3-4fee-84ad-5376c1c2cc23" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:46:30 user nova-compute[71113]: DEBUG nova.network.neutron [req-a51a8c23-2ea8-4611-8fa9-d8f8b2ccc80b req-7862592f-1a8c-453d-8d2d-354eff983c4a service nova] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Refreshing network info cache for port 1bdc8450-11f3-4a96-b68b-42f57ed9dcd9 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:46:30 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Start _get_guest_xml network_info=[{"id": "1bdc8450-11f3-4a96-b68b-42f57ed9dcd9", "address": "fa:16:3e:e8:e4:f6", "network": {"id": "5f0b75d1-03eb-4e68-85fd-8b27d4fda660", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-726146587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "025b7e2f3e894690b9cade6b6df70a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bdc8450-11", "ovs_interfaceid": "1bdc8450-11f3-4a96-b68b-42f57ed9dcd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'image_id': '078646fe-b504-41ed-a147-61072e903e51'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 09:46:30 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:46:30 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:46:30 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 09:46:30 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 09:46:30 user nova-compute[71113]: DEBUG nova.compute.manager [req-c5f4ea07-860a-4482-9a01-d5121298e1eb req-95d616bf-7a9b-4c06-be32-fe2414603066 service nova] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Received event network-vif-plugged-39b5a493-47bd-4599-9a9f-bb80c93fb332 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:46:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-c5f4ea07-860a-4482-9a01-d5121298e1eb req-95d616bf-7a9b-4c06-be32-fe2414603066 service nova] Acquiring lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-c5f4ea07-860a-4482-9a01-d5121298e1eb req-95d616bf-7a9b-4c06-be32-fe2414603066 service nova] Lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-c5f4ea07-860a-4482-9a01-d5121298e1eb req-95d616bf-7a9b-4c06-be32-fe2414603066 service nova] Lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:46:30 user nova-compute[71113]: DEBUG nova.compute.manager [req-c5f4ea07-860a-4482-9a01-d5121298e1eb req-95d616bf-7a9b-4c06-be32-fe2414603066 service nova] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] No waiting events found dispatching network-vif-plugged-39b5a493-47bd-4599-9a9f-bb80c93fb332 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:46:30 user nova-compute[71113]: WARNING nova.compute.manager [req-c5f4ea07-860a-4482-9a01-d5121298e1eb req-95d616bf-7a9b-4c06-be32-fe2414603066 service nova] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Received unexpected event network-vif-plugged-39b5a493-47bd-4599-9a9f-bb80c93fb332 for instance with vm_state building and task_state spawning.
Jul 31 09:46:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:30 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 09:46:30 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 09:46:30 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 09:46:30 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 09:46:30 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 09:46:30 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 09:46:30 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 09:46:30 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 09:46:30 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 09:46:30 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 09:46:30 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 09:46:30 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 09:46:30 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 09:46:30 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 09:46:30 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:46:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1246119485',display_name='tempest-VolumesAdminNegativeTest-server-1246119485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1246119485',id=5,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRPU+UVMxguq84ZclnMSN6OFgSwuPRxZNzy8sP8H/G/zX+FmPi3UpCLaw767Fts2a+Bu/j42JVCAvYpYN/ef+PK/q8CgWblEF2VVltWmSwIYvS/5SQ1SRglT2zKQGOOSw==',key_name='tempest-keypair-1677162007',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='025b7e2f3e894690b9cade6b6df70a22',ramdisk_id='',reservation_id='r-74qmrd4e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-553928296',owner_user_name='tempest-VolumesAdminNegativeTest-553928296-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:46:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68ed00ac1dba433fb6ff7281a066d55f',uuid=caac13d2-ceb3-4fee-84ad-5376c1c2cc23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1bdc8450-11f3-4a96-b68b-42f57ed9dcd9", "address": "fa:16:3e:e8:e4:f6", "network": {"id": "5f0b75d1-03eb-4e68-85fd-8b27d4fda660", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-726146587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "025b7e2f3e894690b9cade6b6df70a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bdc8450-11", "ovs_interfaceid": "1bdc8450-11f3-4a96-b68b-42f57ed9dcd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 09:46:30 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Converting VIF {"id": "1bdc8450-11f3-4a96-b68b-42f57ed9dcd9", "address": "fa:16:3e:e8:e4:f6", "network": {"id": "5f0b75d1-03eb-4e68-85fd-8b27d4fda660", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-726146587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "025b7e2f3e894690b9cade6b6df70a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bdc8450-11", "ovs_interfaceid": "1bdc8450-11f3-4a96-b68b-42f57ed9dcd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:46:30 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:e4:f6,bridge_name='br-int',has_traffic_filtering=True,id=1bdc8450-11f3-4a96-b68b-42f57ed9dcd9,network=Network(5f0b75d1-03eb-4e68-85fd-8b27d4fda660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bdc8450-11') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:46:30 user nova-compute[71113]: DEBUG nova.objects.instance [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Lazy-loading 'pci_devices' on Instance uuid caac13d2-ceb3-4fee-84ad-5376c1c2cc23 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:46:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:30 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] End _get_guest_xml xml=<domain type="kvm">
Jul 31 09:46:30 user nova-compute[71113]:   <uuid>caac13d2-ceb3-4fee-84ad-5376c1c2cc23</uuid>
Jul 31 09:46:30 user nova-compute[71113]:   <name>instance-00000005</name>
Jul 31 09:46:30 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 09:46:30 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 09:46:30 user nova-compute[71113]:   <metadata>
Jul 31 09:46:30 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 09:46:30 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 09:46:30 user nova-compute[71113]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1246119485</nova:name>
Jul 31 09:46:30 user nova-compute[71113]:       <nova:creationTime>2023-07-31 09:46:30</nova:creationTime>
Jul 31 09:46:30 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 09:46:30 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 09:46:30 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 09:46:30 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 09:46:30 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 09:46:30 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 09:46:30 user nova-compute[71113]:       </nova:flavor>
Jul 31 09:46:30 user nova-compute[71113]:       <nova:owner>
Jul 31 09:46:30 user nova-compute[71113]:         <nova:user uuid="68ed00ac1dba433fb6ff7281a066d55f">tempest-VolumesAdminNegativeTest-553928296-project-member</nova:user>
Jul 31 09:46:30 user nova-compute[71113]:         <nova:project uuid="025b7e2f3e894690b9cade6b6df70a22">tempest-VolumesAdminNegativeTest-553928296</nova:project>
Jul 31 09:46:30 user nova-compute[71113]:       </nova:owner>
Jul 31 09:46:30 user nova-compute[71113]:       <nova:root type="image" uuid="078646fe-b504-41ed-a147-61072e903e51"/>
Jul 31 09:46:30 user nova-compute[71113]:       <nova:ports>
Jul 31 09:46:30 user nova-compute[71113]:         <nova:port uuid="1bdc8450-11f3-4a96-b68b-42f57ed9dcd9">
Jul 31 09:46:30 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 31 09:46:30 user nova-compute[71113]:         </nova:port>
Jul 31 09:46:30 user nova-compute[71113]:       </nova:ports>
Jul 31 09:46:30 user nova-compute[71113]:     </nova:instance>
Jul 31 09:46:30 user nova-compute[71113]:   </metadata>
Jul 31 09:46:30 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 09:46:30 user nova-compute[71113]:     <system>
Jul 31 09:46:30 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 09:46:30 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 09:46:30 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 09:46:30 user nova-compute[71113]:       <entry name="serial">caac13d2-ceb3-4fee-84ad-5376c1c2cc23</entry>
Jul 31 09:46:30 user nova-compute[71113]:       <entry name="uuid">caac13d2-ceb3-4fee-84ad-5376c1c2cc23</entry>
Jul 31 09:46:30 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 09:46:30 user nova-compute[71113]:     </system>
Jul 31 09:46:30 user nova-compute[71113]:   </sysinfo>
Jul 31 09:46:30 user nova-compute[71113]:   <os>
Jul 31 09:46:30 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 09:46:30 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 09:46:30 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 09:46:30 user nova-compute[71113]:   </os>
Jul 31 09:46:30 user nova-compute[71113]:   <features>
Jul 31 09:46:30 user nova-compute[71113]:     <acpi/>
Jul 31 09:46:30 user nova-compute[71113]:     <apic/>
Jul 31 09:46:30 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 09:46:30 user nova-compute[71113]:   </features>
Jul 31 09:46:30 user nova-compute[71113]:   <clock offset="utc">
Jul 31 09:46:30 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 09:46:30 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 09:46:30 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 09:46:30 user nova-compute[71113]:   </clock>
Jul 31 09:46:30 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 09:46:30 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 09:46:30 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 09:46:30 user nova-compute[71113]:   </cpu>
Jul 31 09:46:30 user nova-compute[71113]:   <devices>
Jul 31 09:46:30 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 09:46:30 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 09:46:30 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/caac13d2-ceb3-4fee-84ad-5376c1c2cc23/disk"/>
Jul 31 09:46:30 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 09:46:30 user nova-compute[71113]:     </disk>
Jul 31 09:46:30 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 09:46:30 user nova-compute[71113]:       <mac address="fa:16:3e:e8:e4:f6"/>
Jul 31 09:46:30 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:46:30 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 09:46:30 user nova-compute[71113]:       <target dev="tap1bdc8450-11"/>
Jul 31 09:46:30 user nova-compute[71113]:     </interface>
Jul 31 09:46:30 user nova-compute[71113]:     <serial type="pty">
Jul 31 09:46:30 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/caac13d2-ceb3-4fee-84ad-5376c1c2cc23/console.log" append="off"/>
Jul 31 09:46:30 user nova-compute[71113]:     </serial>
Jul 31 09:46:30 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 09:46:30 user nova-compute[71113]:     <video>
Jul 31 09:46:30 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:46:30 user nova-compute[71113]:     </video>
Jul 31 09:46:30 user nova-compute[71113]:     <rng model="virtio">
Jul 31 09:46:30 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 09:46:30 user nova-compute[71113]:     </rng>
Jul 31 09:46:30 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 09:46:30 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 09:46:30 user nova-compute[71113]:       <stats period="10"/>
Jul 31 09:46:30 user nova-compute[71113]:     </memballoon>
Jul 31 09:46:30 user nova-compute[71113]:   </devices>
Jul 31 09:46:30 user nova-compute[71113]: </domain>
Jul 31 09:46:30 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 09:46:30 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:46:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1246119485',display_name='tempest-VolumesAdminNegativeTest-server-1246119485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1246119485',id=5,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRPU+UVMxguq84ZclnMSN6OFgSwuPRxZNzy8sP8H/G/zX+FmPi3UpCLaw767Fts2a+Bu/j42JVCAvYpYN/ef+PK/q8CgWblEF2VVltWmSwIYvS/5SQ1SRglT2zKQGOOSw==',key_name='tempest-keypair-1677162007',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='025b7e2f3e894690b9cade6b6df70a22',ramdisk_id='',reservation_id='r-74qmrd4e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-553928296',owner_user_name='tempest-VolumesAdminNegativeTest-553928296-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:46:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68ed00ac1dba433fb6ff7281a066d55f',uuid=caac13d2-ceb3-4fee-84ad-5376c1c2cc23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1bdc8450-11f3-4a96-b68b-42f57ed9dcd9", "address": "fa:16:3e:e8:e4:f6", "network": {"id": "5f0b75d1-03eb-4e68-85fd-8b27d4fda660", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-726146587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "025b7e2f3e894690b9cade6b6df70a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bdc8450-11", "ovs_interfaceid": "1bdc8450-11f3-4a96-b68b-42f57ed9dcd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 09:46:30 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Converting VIF {"id": "1bdc8450-11f3-4a96-b68b-42f57ed9dcd9", "address": "fa:16:3e:e8:e4:f6", "network": {"id": "5f0b75d1-03eb-4e68-85fd-8b27d4fda660", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-726146587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "025b7e2f3e894690b9cade6b6df70a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bdc8450-11", "ovs_interfaceid": "1bdc8450-11f3-4a96-b68b-42f57ed9dcd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:46:30 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:e4:f6,bridge_name='br-int',has_traffic_filtering=True,id=1bdc8450-11f3-4a96-b68b-42f57ed9dcd9,network=Network(5f0b75d1-03eb-4e68-85fd-8b27d4fda660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bdc8450-11') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:46:30 user nova-compute[71113]: DEBUG os_vif [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:e4:f6,bridge_name='br-int',has_traffic_filtering=True,id=1bdc8450-11f3-4a96-b68b-42f57ed9dcd9,network=Network(5f0b75d1-03eb-4e68-85fd-8b27d4fda660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bdc8450-11') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 09:46:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:46:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 09:46:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1bdc8450-11, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:46:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1bdc8450-11, col_values=(('external_ids', {'iface-id': '1bdc8450-11f3-4a96-b68b-42f57ed9dcd9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:e4:f6', 'vm-uuid': 'caac13d2-ceb3-4fee-84ad-5376c1c2cc23'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:46:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:46:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:30 user nova-compute[71113]: INFO os_vif [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:e4:f6,bridge_name='br-int',has_traffic_filtering=True,id=1bdc8450-11f3-4a96-b68b-42f57ed9dcd9,network=Network(5f0b75d1-03eb-4e68-85fd-8b27d4fda660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bdc8450-11')
Jul 31 09:46:30 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:46:30 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] No VIF found with MAC fa:16:3e:e8:e4:f6, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 09:46:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Acquiring lock "b324fed7-5df8-4ca1-9a5a-06eaffd5e101" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Lock "b324fed7-5df8-4ca1-9a5a-06eaffd5e101" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.006s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:30 user nova-compute[71113]: DEBUG nova.compute.manager [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Starting instance... {{(pid=71113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 09:46:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:31 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 09:46:31 user nova-compute[71113]: INFO nova.compute.claims [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Claim successful on node user
Jul 31 09:46:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:31 user nova-compute[71113]: DEBUG nova.network.neutron [req-a51a8c23-2ea8-4611-8fa9-d8f8b2ccc80b req-7862592f-1a8c-453d-8d2d-354eff983c4a service nova] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Updated VIF entry in instance network info cache for port 1bdc8450-11f3-4a96-b68b-42f57ed9dcd9. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:46:31 user nova-compute[71113]: DEBUG nova.network.neutron [req-a51a8c23-2ea8-4611-8fa9-d8f8b2ccc80b req-7862592f-1a8c-453d-8d2d-354eff983c4a service nova] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Updating instance_info_cache with network_info: [{"id": "1bdc8450-11f3-4a96-b68b-42f57ed9dcd9", "address": "fa:16:3e:e8:e4:f6", "network": {"id": "5f0b75d1-03eb-4e68-85fd-8b27d4fda660", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-726146587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "025b7e2f3e894690b9cade6b6df70a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bdc8450-11", "ovs_interfaceid": "1bdc8450-11f3-4a96-b68b-42f57ed9dcd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:46:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-a51a8c23-2ea8-4611-8fa9-d8f8b2ccc80b req-7862592f-1a8c-453d-8d2d-354eff983c4a service nova] Releasing lock "refresh_cache-caac13d2-ceb3-4fee-84ad-5376c1c2cc23" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:46:31 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:46:31 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:46:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.597s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:46:31 user nova-compute[71113]: DEBUG nova.compute.manager [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Start building networks asynchronously for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 09:46:31 user nova-compute[71113]: DEBUG nova.compute.manager [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Allocating IP information in the background. {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 09:46:31 user nova-compute[71113]: DEBUG nova.network.neutron [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] allocate_for_instance() {{(pid=71113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 09:46:31 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 09:46:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Acquiring lock "f84b913d-0794-43a6-90d3-aaf4102f9fb6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Lock "f84b913d-0794-43a6-90d3-aaf4102f9fb6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:31 user nova-compute[71113]: DEBUG nova.compute.manager [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Start building block device mappings for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 09:46:31 user nova-compute[71113]: DEBUG nova.compute.manager [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Starting instance... {{(pid=71113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 09:46:31 user nova-compute[71113]: DEBUG nova.compute.manager [req-dd5d14ff-fe47-47ea-9d7d-0550d8dd6e2a req-9cb60100-9312-47fb-a63b-8bd9c847eb9f service nova] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Received event network-vif-plugged-5408a169-bdde-42da-be35-24006f474bc6 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:46:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-dd5d14ff-fe47-47ea-9d7d-0550d8dd6e2a req-9cb60100-9312-47fb-a63b-8bd9c847eb9f service nova] Acquiring lock "0ea0401b-26c2-4655-956b-1bc000debd53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-dd5d14ff-fe47-47ea-9d7d-0550d8dd6e2a req-9cb60100-9312-47fb-a63b-8bd9c847eb9f service nova] Lock "0ea0401b-26c2-4655-956b-1bc000debd53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-dd5d14ff-fe47-47ea-9d7d-0550d8dd6e2a req-9cb60100-9312-47fb-a63b-8bd9c847eb9f service nova] Lock "0ea0401b-26c2-4655-956b-1bc000debd53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:46:31 user nova-compute[71113]: DEBUG nova.compute.manager [req-dd5d14ff-fe47-47ea-9d7d-0550d8dd6e2a req-9cb60100-9312-47fb-a63b-8bd9c847eb9f service nova] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] No waiting events found dispatching network-vif-plugged-5408a169-bdde-42da-be35-24006f474bc6 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:46:31 user nova-compute[71113]: WARNING nova.compute.manager [req-dd5d14ff-fe47-47ea-9d7d-0550d8dd6e2a req-9cb60100-9312-47fb-a63b-8bd9c847eb9f service nova] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Received unexpected event network-vif-plugged-5408a169-bdde-42da-be35-24006f474bc6 for instance with vm_state building and task_state spawning.
Jul 31 09:46:32 user nova-compute[71113]: DEBUG nova.policy [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b6a9a083ff064d6e89a4de0b9c4dce4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e01569d9e6a4aff974e6dc99141f089', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71113) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 09:46:32 user nova-compute[71113]: DEBUG nova.compute.manager [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Start spawning the instance on the hypervisor. {{(pid=71113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 09:46:32 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 09:46:32 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Creating image(s)
Jul 31 09:46:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Acquiring lock "/opt/stack/data/nova/instances/b324fed7-5df8-4ca1-9a5a-06eaffd5e101/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Lock "/opt/stack/data/nova/instances/b324fed7-5df8-4ca1-9a5a-06eaffd5e101/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Lock "/opt/stack/data/nova/instances/b324fed7-5df8-4ca1-9a5a-06eaffd5e101/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:46:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:46:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:32 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 09:46:32 user nova-compute[71113]: INFO nova.compute.claims [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Claim successful on node user
Jul 31 09:46:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.169s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:46:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Acquiring lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:46:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.151s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:46:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/b324fed7-5df8-4ca1-9a5a-06eaffd5e101/disk 1073741824 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:46:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/b324fed7-5df8-4ca1-9a5a-06eaffd5e101/disk 1073741824" returned: 0 in 0.066s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:46:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:46:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:46:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.144s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:46:32 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b324fed7-5df8-4ca1-9a5a-06eaffd5e101/disk. size=1073741824 {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 09:46:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b324fed7-5df8-4ca1-9a5a-06eaffd5e101/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:46:32 user nova-compute[71113]: DEBUG nova.compute.manager [req-d27531fa-824a-4669-83d9-c24d43eee406 req-a6df3467-eefd-4b1a-a8b5-9226be263a67 service nova] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Received event network-vif-plugged-39b5a493-47bd-4599-9a9f-bb80c93fb332 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:46:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-d27531fa-824a-4669-83d9-c24d43eee406 req-a6df3467-eefd-4b1a-a8b5-9226be263a67 service nova] Acquiring lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-d27531fa-824a-4669-83d9-c24d43eee406 req-a6df3467-eefd-4b1a-a8b5-9226be263a67 service nova] Lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-d27531fa-824a-4669-83d9-c24d43eee406 req-a6df3467-eefd-4b1a-a8b5-9226be263a67 service nova] Lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:46:32 user nova-compute[71113]: DEBUG nova.compute.manager [req-d27531fa-824a-4669-83d9-c24d43eee406 req-a6df3467-eefd-4b1a-a8b5-9226be263a67 service nova] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] No waiting events found dispatching network-vif-plugged-39b5a493-47bd-4599-9a9f-bb80c93fb332 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:46:32 user nova-compute[71113]: WARNING nova.compute.manager [req-d27531fa-824a-4669-83d9-c24d43eee406 req-a6df3467-eefd-4b1a-a8b5-9226be263a67 service nova] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Received unexpected event network-vif-plugged-39b5a493-47bd-4599-9a9f-bb80c93fb332 for instance with vm_state building and task_state spawning.
Jul 31 09:46:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b324fed7-5df8-4ca1-9a5a-06eaffd5e101/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:46:32 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Cannot resize image /opt/stack/data/nova/instances/b324fed7-5df8-4ca1-9a5a-06eaffd5e101/disk to a smaller size. {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 09:46:32 user nova-compute[71113]: DEBUG nova.objects.instance [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Lazy-loading 'migration_context' on Instance uuid b324fed7-5df8-4ca1-9a5a-06eaffd5e101 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:46:32 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Created local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 09:46:32 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Ensure instance console log exists: /opt/stack/data/nova/instances/b324fed7-5df8-4ca1-9a5a-06eaffd5e101/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 09:46:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:46:32 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:46:33 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:46:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.049s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:46:33 user nova-compute[71113]: DEBUG nova.compute.manager [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Start building networks asynchronously for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 09:46:33 user nova-compute[71113]: DEBUG nova.network.neutron [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Successfully created port: 07f33c66-0fa4-4154-a498-d6d42864a9a5 {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 09:46:33 user nova-compute[71113]: DEBUG nova.compute.manager [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Allocating IP information in the background. {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 09:46:33 user nova-compute[71113]: DEBUG nova.network.neutron [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] allocate_for_instance() {{(pid=71113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 09:46:33 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Jul 31 09:46:33 user nova-compute[71113]: DEBUG nova.compute.manager [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Start building block device mappings for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 09:46:33 user nova-compute[71113]: DEBUG nova.policy [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5162014a8315486d8a6c5470c0517e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ede230cc40e449bb8747fe13f655799', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71113) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 09:46:33 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:33 user nova-compute[71113]: DEBUG nova.compute.manager [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Start spawning the instance on the hypervisor. {{(pid=71113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 09:46:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 09:46:33 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Creating image(s)
Jul 31 09:46:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Acquiring lock "/opt/stack/data/nova/instances/f84b913d-0794-43a6-90d3-aaf4102f9fb6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Lock "/opt/stack/data/nova/instances/f84b913d-0794-43a6-90d3-aaf4102f9fb6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Lock "/opt/stack/data/nova/instances/f84b913d-0794-43a6-90d3-aaf4102f9fb6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:46:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Acquiring lock "b67cbc39994203c9b2d8ee63a73aaebb35fe428f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Lock "b67cbc39994203c9b2d8ee63a73aaebb35fe428f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:33 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b67cbc39994203c9b2d8ee63a73aaebb35fe428f.part --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:46:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:34 user nova-compute[71113]: DEBUG nova.compute.manager [req-539f0cb0-59d4-44d3-bed0-3e4c71dc4675 req-5736e4cf-8892-4631-b9d7-12b842198fd8 service nova] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Received event network-vif-plugged-5408a169-bdde-42da-be35-24006f474bc6 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:46:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-539f0cb0-59d4-44d3-bed0-3e4c71dc4675 req-5736e4cf-8892-4631-b9d7-12b842198fd8 service nova] Acquiring lock "0ea0401b-26c2-4655-956b-1bc000debd53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-539f0cb0-59d4-44d3-bed0-3e4c71dc4675 req-5736e4cf-8892-4631-b9d7-12b842198fd8 service nova] Lock "0ea0401b-26c2-4655-956b-1bc000debd53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-539f0cb0-59d4-44d3-bed0-3e4c71dc4675 req-5736e4cf-8892-4631-b9d7-12b842198fd8 service nova] Lock "0ea0401b-26c2-4655-956b-1bc000debd53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:46:34 user nova-compute[71113]: DEBUG nova.compute.manager [req-539f0cb0-59d4-44d3-bed0-3e4c71dc4675 req-5736e4cf-8892-4631-b9d7-12b842198fd8 service nova] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] No waiting events found dispatching network-vif-plugged-5408a169-bdde-42da-be35-24006f474bc6 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:46:34 user nova-compute[71113]: WARNING nova.compute.manager [req-539f0cb0-59d4-44d3-bed0-3e4c71dc4675 req-5736e4cf-8892-4631-b9d7-12b842198fd8 service nova] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Received unexpected event network-vif-plugged-5408a169-bdde-42da-be35-24006f474bc6 for instance with vm_state building and task_state spawning.
Jul 31 09:46:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b67cbc39994203c9b2d8ee63a73aaebb35fe428f.part --force-share --output=json" returned: 0 in 0.179s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:46:34 user nova-compute[71113]: DEBUG nova.virt.images [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] 38906fac-16b8-44e4-a540-da4374fde1c7 was qcow2, converting to raw {{(pid=71113) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 31 09:46:34 user nova-compute[71113]: DEBUG nova.privsep.utils [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71113) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 09:46:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b67cbc39994203c9b2d8ee63a73aaebb35fe428f.part /opt/stack/data/nova/instances/_base/b67cbc39994203c9b2d8ee63a73aaebb35fe428f.converted {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:46:34 user nova-compute[71113]: DEBUG nova.network.neutron [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Successfully updated port: 07f33c66-0fa4-4154-a498-d6d42864a9a5 {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 09:46:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Acquiring lock "refresh_cache-b324fed7-5df8-4ca1-9a5a-06eaffd5e101" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:46:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Acquired lock "refresh_cache-b324fed7-5df8-4ca1-9a5a-06eaffd5e101" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:46:34 user nova-compute[71113]: DEBUG nova.network.neutron [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 09:46:34 user nova-compute[71113]: DEBUG nova.compute.manager [req-11f6bbf0-76b7-4411-8d59-610860ac8442 req-dd94ba77-086c-4d3c-a01e-16363b57ec66 service nova] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Received event network-changed-07f33c66-0fa4-4154-a498-d6d42864a9a5 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:46:34 user nova-compute[71113]: DEBUG nova.compute.manager [req-11f6bbf0-76b7-4411-8d59-610860ac8442 req-dd94ba77-086c-4d3c-a01e-16363b57ec66 service nova] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Refreshing instance network info cache due to event network-changed-07f33c66-0fa4-4154-a498-d6d42864a9a5. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:46:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-11f6bbf0-76b7-4411-8d59-610860ac8442 req-dd94ba77-086c-4d3c-a01e-16363b57ec66 service nova] Acquiring lock "refresh_cache-b324fed7-5df8-4ca1-9a5a-06eaffd5e101" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:46:34 user nova-compute[71113]: DEBUG nova.network.neutron [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 09:46:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b67cbc39994203c9b2d8ee63a73aaebb35fe428f.part /opt/stack/data/nova/instances/_base/b67cbc39994203c9b2d8ee63a73aaebb35fe428f.converted" returned: 0 in 0.387s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:46:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b67cbc39994203c9b2d8ee63a73aaebb35fe428f.converted --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:46:34 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690796794.8495226, 1112a49d-27bd-4fc8-bae6-ec1decbb47db => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:46:34 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] VM Resumed (Lifecycle Event)
Jul 31 09:46:34 user nova-compute[71113]: DEBUG nova.compute.manager [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 09:46:34 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 09:46:34 user nova-compute[71113]: DEBUG nova.compute.manager [req-cc486918-9de8-44bb-9e7b-422918bca11b req-2304edca-1d43-4713-b44d-97c4b8d70448 service nova] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Received event network-vif-plugged-1bdc8450-11f3-4a96-b68b-42f57ed9dcd9 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:46:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-cc486918-9de8-44bb-9e7b-422918bca11b req-2304edca-1d43-4713-b44d-97c4b8d70448 service nova] Acquiring lock "caac13d2-ceb3-4fee-84ad-5376c1c2cc23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-cc486918-9de8-44bb-9e7b-422918bca11b req-2304edca-1d43-4713-b44d-97c4b8d70448 service nova] Lock "caac13d2-ceb3-4fee-84ad-5376c1c2cc23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-cc486918-9de8-44bb-9e7b-422918bca11b req-2304edca-1d43-4713-b44d-97c4b8d70448 service nova] Lock "caac13d2-ceb3-4fee-84ad-5376c1c2cc23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:46:34 user nova-compute[71113]: DEBUG nova.compute.manager [req-cc486918-9de8-44bb-9e7b-422918bca11b req-2304edca-1d43-4713-b44d-97c4b8d70448 service nova] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] No waiting events found dispatching network-vif-plugged-1bdc8450-11f3-4a96-b68b-42f57ed9dcd9 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:46:34 user nova-compute[71113]: WARNING nova.compute.manager [req-cc486918-9de8-44bb-9e7b-422918bca11b req-2304edca-1d43-4713-b44d-97c4b8d70448 service nova] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Received unexpected event network-vif-plugged-1bdc8450-11f3-4a96-b68b-42f57ed9dcd9 for instance with vm_state building and task_state spawning.
Jul 31 09:46:34 user nova-compute[71113]: DEBUG nova.compute.manager [req-cc486918-9de8-44bb-9e7b-422918bca11b req-2304edca-1d43-4713-b44d-97c4b8d70448 service nova] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Received event network-vif-plugged-1bdc8450-11f3-4a96-b68b-42f57ed9dcd9 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:46:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-cc486918-9de8-44bb-9e7b-422918bca11b req-2304edca-1d43-4713-b44d-97c4b8d70448 service nova] Acquiring lock "caac13d2-ceb3-4fee-84ad-5376c1c2cc23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-cc486918-9de8-44bb-9e7b-422918bca11b req-2304edca-1d43-4713-b44d-97c4b8d70448 service nova] Lock "caac13d2-ceb3-4fee-84ad-5376c1c2cc23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-cc486918-9de8-44bb-9e7b-422918bca11b req-2304edca-1d43-4713-b44d-97c4b8d70448 service nova] Lock "caac13d2-ceb3-4fee-84ad-5376c1c2cc23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:46:34 user nova-compute[71113]: DEBUG nova.compute.manager [req-cc486918-9de8-44bb-9e7b-422918bca11b req-2304edca-1d43-4713-b44d-97c4b8d70448 service nova] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] No waiting events found dispatching network-vif-plugged-1bdc8450-11f3-4a96-b68b-42f57ed9dcd9 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:46:34 user nova-compute[71113]: WARNING nova.compute.manager [req-cc486918-9de8-44bb-9e7b-422918bca11b req-2304edca-1d43-4713-b44d-97c4b8d70448 service nova] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Received unexpected event network-vif-plugged-1bdc8450-11f3-4a96-b68b-42f57ed9dcd9 for instance with vm_state building and task_state spawning.
Jul 31 09:46:34 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:46:34 user nova-compute[71113]: DEBUG nova.network.neutron [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Successfully created port: e5c43d23-3cda-4763-af71-7c6fddbf6bd3 {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 09:46:34 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Instance spawned successfully.
Jul 31 09:46:34 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:46:34 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 09:46:34 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:46:34 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690796794.850099, 1112a49d-27bd-4fc8-bae6-ec1decbb47db => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:46:34 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] VM Started (Lifecycle Event)
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Found default for hw_cdrom_bus of ide {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Found default for hw_disk_bus of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Found default for hw_input_bus of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Found default for hw_pointer_model of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Found default for hw_video_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Found default for hw_vif_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b67cbc39994203c9b2d8ee63a73aaebb35fe428f.converted --force-share --output=json" returned: 0 in 0.193s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Lock "b67cbc39994203c9b2d8ee63a73aaebb35fe428f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.289s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b67cbc39994203c9b2d8ee63a73aaebb35fe428f --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:46:35 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:46:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b67cbc39994203c9b2d8ee63a73aaebb35fe428f --force-share --output=json" returned: 0 in 0.164s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Acquiring lock "b67cbc39994203c9b2d8ee63a73aaebb35fe428f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Lock "b67cbc39994203c9b2d8ee63a73aaebb35fe428f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.007s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b67cbc39994203c9b2d8ee63a73aaebb35fe428f --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:46:35 user nova-compute[71113]: INFO nova.compute.manager [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Took 13.43 seconds to spawn the instance on the hypervisor.
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.compute.manager [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690796795.3064983, 0ea0401b-26c2-4655-956b-1bc000debd53 => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:46:35 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] VM Resumed (Lifecycle Event)
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.compute.manager [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:46:35 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Instance spawned successfully.
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b67cbc39994203c9b2d8ee63a73aaebb35fe428f --force-share --output=json" returned: 0 in 0.184s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b67cbc39994203c9b2d8ee63a73aaebb35fe428f,backing_fmt=raw /opt/stack/data/nova/instances/f84b913d-0794-43a6-90d3-aaf4102f9fb6/disk 1073741824 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:46:35 user nova-compute[71113]: INFO nova.compute.manager [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Took 15.85 seconds to build instance.
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Found default for hw_cdrom_bus of ide {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Found default for hw_disk_bus of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Found default for hw_input_bus of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Found default for hw_pointer_model of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Found default for hw_video_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Found default for hw_vif_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b67cbc39994203c9b2d8ee63a73aaebb35fe428f,backing_fmt=raw /opt/stack/data/nova/instances/f84b913d-0794-43a6-90d3-aaf4102f9fb6/disk 1073741824" returned: 0 in 0.121s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Lock "b67cbc39994203c9b2d8ee63a73aaebb35fe428f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.312s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b67cbc39994203c9b2d8ee63a73aaebb35fe428f --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.network.neutron [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Updating instance_info_cache with network_info: [{"id": "07f33c66-0fa4-4154-a498-d6d42864a9a5", "address": "fa:16:3e:14:e4:e5", "network": {"id": "c49991aa-9260-4358-b3e2-309d558b5805", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1291245964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e01569d9e6a4aff974e6dc99141f089", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07f33c66-0f", "ovs_interfaceid": "07f33c66-0fa4-4154-a498-d6d42864a9a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.compute.manager [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-41126d9c-d8ca-4137-ab04-d5acec12f852 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.076s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:46:35 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690796795.320491, 0ea0401b-26c2-4655-956b-1bc000debd53 => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:46:35 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] VM Started (Lifecycle Event)
Jul 31 09:46:35 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Instance spawned successfully.
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Releasing lock "refresh_cache-b324fed7-5df8-4ca1-9a5a-06eaffd5e101" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.compute.manager [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Instance network_info: |[{"id": "07f33c66-0fa4-4154-a498-d6d42864a9a5", "address": "fa:16:3e:14:e4:e5", "network": {"id": "c49991aa-9260-4358-b3e2-309d558b5805", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1291245964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e01569d9e6a4aff974e6dc99141f089", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07f33c66-0f", "ovs_interfaceid": "07f33c66-0fa4-4154-a498-d6d42864a9a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-11f6bbf0-76b7-4411-8d59-610860ac8442 req-dd94ba77-086c-4d3c-a01e-16363b57ec66 service nova] Acquired lock "refresh_cache-b324fed7-5df8-4ca1-9a5a-06eaffd5e101" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.network.neutron [req-11f6bbf0-76b7-4411-8d59-610860ac8442 req-dd94ba77-086c-4d3c-a01e-16363b57ec66 service nova] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Refreshing network info cache for port 07f33c66-0fa4-4154-a498-d6d42864a9a5 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Start _get_guest_xml network_info=[{"id": "07f33c66-0fa4-4154-a498-d6d42864a9a5", "address": "fa:16:3e:14:e4:e5", "network": {"id": "c49991aa-9260-4358-b3e2-309d558b5805", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1291245964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e01569d9e6a4aff974e6dc99141f089", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07f33c66-0f", "ovs_interfaceid": "07f33c66-0fa4-4154-a498-d6d42864a9a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'image_id': '078646fe-b504-41ed-a147-61072e903e51'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b67cbc39994203c9b2d8ee63a73aaebb35fe428f --force-share --output=json" returned: 0 in 0.181s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f84b913d-0794-43a6-90d3-aaf4102f9fb6/disk. size=1073741824 {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f84b913d-0794-43a6-90d3-aaf4102f9fb6/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:35 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690796795.546479, efa311a0-fe2e-4c0f-af66-09c3eb38fbf1 => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:46:35 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] VM Resumed (Lifecycle Event)
Jul 31 09:46:35 user nova-compute[71113]: INFO nova.compute.manager [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Took 15.46 seconds to spawn the instance on the hypervisor.
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.compute.manager [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Found default for hw_cdrom_bus of ide {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Found default for hw_disk_bus of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Found default for hw_input_bus of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Found default for hw_pointer_model of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Found default for hw_video_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Found default for hw_vif_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:46:35 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:46:35 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:46:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1198419998',display_name='tempest-TestVolumeSwap-server-1198419998',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1198419998',id=6,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAD1pBUHVq0pRc6l8mQwSY8P92l3ivm22XPT4xkVrjSMI8DOJX5DbKXbBJnYnhLh14894vtYc5ACy8NqT6qdqyiEcTJtk/yCxi/c0LE+pv3UX3HK5xJNr9JwrljZ9RTTAw==',key_name='tempest-keypair-341060647',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e01569d9e6a4aff974e6dc99141f089',ramdisk_id='',reservation_id='r-0uqr085s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-70920097',owner_user_name='tempest-TestVolumeSwap-70920097-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:46:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b6a9a083ff064d6e89a4de0b9c4dce4f',uuid=b324fed7-5df8-4ca1-9a5a-06eaffd5e101,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07f33c66-0fa4-4154-a498-d6d42864a9a5", "address": "fa:16:3e:14:e4:e5", "network": {"id": "c49991aa-9260-4358-b3e2-309d558b5805", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1291245964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e01569d9e6a4aff974e6dc99141f089", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07f33c66-0f", "ovs_interfaceid": "07f33c66-0fa4-4154-a498-d6d42864a9a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Converting VIF {"id": "07f33c66-0fa4-4154-a498-d6d42864a9a5", "address": "fa:16:3e:14:e4:e5", "network": {"id": "c49991aa-9260-4358-b3e2-309d558b5805", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1291245964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e01569d9e6a4aff974e6dc99141f089", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07f33c66-0f", "ovs_interfaceid": "07f33c66-0fa4-4154-a498-d6d42864a9a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:e4:e5,bridge_name='br-int',has_traffic_filtering=True,id=07f33c66-0fa4-4154-a498-d6d42864a9a5,network=Network(c49991aa-9260-4358-b3e2-309d558b5805),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07f33c66-0f') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.objects.instance [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Lazy-loading 'pci_devices' on Instance uuid b324fed7-5df8-4ca1-9a5a-06eaffd5e101 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:46:35 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690796795.5504284, efa311a0-fe2e-4c0f-af66-09c3eb38fbf1 => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:46:35 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] VM Started (Lifecycle Event)
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 09:46:35 user nova-compute[71113]: INFO nova.compute.manager [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Took 16.67 seconds to build instance.
Jul 31 09:46:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f84b913d-0794-43a6-90d3-aaf4102f9fb6/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:46:35 user nova-compute[71113]: INFO nova.compute.manager [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Took 15.03 seconds to spawn the instance on the hypervisor.
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.compute.manager [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Cannot resize image /opt/stack/data/nova/instances/f84b913d-0794-43a6-90d3-aaf4102f9fb6/disk to a smaller size. {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.objects.instance [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Lazy-loading 'migration_context' on Instance uuid f84b913d-0794-43a6-90d3-aaf4102f9fb6 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Created local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Ensure instance console log exists: /opt/stack/data/nova/instances/f84b913d-0794-43a6-90d3-aaf4102f9fb6/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 09:46:35 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:46:36 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] End _get_guest_xml xml=<domain type="kvm">
Jul 31 09:46:36 user nova-compute[71113]:   <uuid>b324fed7-5df8-4ca1-9a5a-06eaffd5e101</uuid>
Jul 31 09:46:36 user nova-compute[71113]:   <name>instance-00000006</name>
Jul 31 09:46:36 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 09:46:36 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 09:46:36 user nova-compute[71113]:   <metadata>
Jul 31 09:46:36 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 09:46:36 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 09:46:36 user nova-compute[71113]:       <nova:name>tempest-TestVolumeSwap-server-1198419998</nova:name>
Jul 31 09:46:36 user nova-compute[71113]:       <nova:creationTime>2023-07-31 09:46:35</nova:creationTime>
Jul 31 09:46:36 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 09:46:36 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 09:46:36 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 09:46:36 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 09:46:36 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 09:46:36 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 09:46:36 user nova-compute[71113]:       </nova:flavor>
Jul 31 09:46:36 user nova-compute[71113]:       <nova:owner>
Jul 31 09:46:36 user nova-compute[71113]:         <nova:user uuid="b6a9a083ff064d6e89a4de0b9c4dce4f">tempest-TestVolumeSwap-70920097-project-member</nova:user>
Jul 31 09:46:36 user nova-compute[71113]:         <nova:project uuid="9e01569d9e6a4aff974e6dc99141f089">tempest-TestVolumeSwap-70920097</nova:project>
Jul 31 09:46:36 user nova-compute[71113]:       </nova:owner>
Jul 31 09:46:36 user nova-compute[71113]:       <nova:root type="image" uuid="078646fe-b504-41ed-a147-61072e903e51"/>
Jul 31 09:46:36 user nova-compute[71113]:       <nova:ports>
Jul 31 09:46:36 user nova-compute[71113]:         <nova:port uuid="07f33c66-0fa4-4154-a498-d6d42864a9a5">
Jul 31 09:46:36 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 31 09:46:36 user nova-compute[71113]:         </nova:port>
Jul 31 09:46:36 user nova-compute[71113]:       </nova:ports>
Jul 31 09:46:36 user nova-compute[71113]:     </nova:instance>
Jul 31 09:46:36 user nova-compute[71113]:   </metadata>
Jul 31 09:46:36 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 09:46:36 user nova-compute[71113]:     <system>
Jul 31 09:46:36 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 09:46:36 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 09:46:36 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 09:46:36 user nova-compute[71113]:       <entry name="serial">b324fed7-5df8-4ca1-9a5a-06eaffd5e101</entry>
Jul 31 09:46:36 user nova-compute[71113]:       <entry name="uuid">b324fed7-5df8-4ca1-9a5a-06eaffd5e101</entry>
Jul 31 09:46:36 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 09:46:36 user nova-compute[71113]:     </system>
Jul 31 09:46:36 user nova-compute[71113]:   </sysinfo>
Jul 31 09:46:36 user nova-compute[71113]:   <os>
Jul 31 09:46:36 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 09:46:36 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 09:46:36 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 09:46:36 user nova-compute[71113]:   </os>
Jul 31 09:46:36 user nova-compute[71113]:   <features>
Jul 31 09:46:36 user nova-compute[71113]:     <acpi/>
Jul 31 09:46:36 user nova-compute[71113]:     <apic/>
Jul 31 09:46:36 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 09:46:36 user nova-compute[71113]:   </features>
Jul 31 09:46:36 user nova-compute[71113]:   <clock offset="utc">
Jul 31 09:46:36 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 09:46:36 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 09:46:36 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 09:46:36 user nova-compute[71113]:   </clock>
Jul 31 09:46:36 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 09:46:36 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 09:46:36 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 09:46:36 user nova-compute[71113]:   </cpu>
Jul 31 09:46:36 user nova-compute[71113]:   <devices>
Jul 31 09:46:36 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 09:46:36 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 09:46:36 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/b324fed7-5df8-4ca1-9a5a-06eaffd5e101/disk"/>
Jul 31 09:46:36 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 09:46:36 user nova-compute[71113]:     </disk>
Jul 31 09:46:36 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 09:46:36 user nova-compute[71113]:       <mac address="fa:16:3e:14:e4:e5"/>
Jul 31 09:46:36 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:46:36 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 09:46:36 user nova-compute[71113]:       <target dev="tap07f33c66-0f"/>
Jul 31 09:46:36 user nova-compute[71113]:     </interface>
Jul 31 09:46:36 user nova-compute[71113]:     <serial type="pty">
Jul 31 09:46:36 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/b324fed7-5df8-4ca1-9a5a-06eaffd5e101/console.log" append="off"/>
Jul 31 09:46:36 user nova-compute[71113]:     </serial>
Jul 31 09:46:36 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 09:46:36 user nova-compute[71113]:     <video>
Jul 31 09:46:36 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:46:36 user nova-compute[71113]:     </video>
Jul 31 09:46:36 user nova-compute[71113]:     <rng model="virtio">
Jul 31 09:46:36 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 09:46:36 user nova-compute[71113]:     </rng>
Jul 31 09:46:36 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 09:46:36 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 09:46:36 user nova-compute[71113]:       <stats period="10"/>
Jul 31 09:46:36 user nova-compute[71113]:     </memballoon>
Jul 31 09:46:36 user nova-compute[71113]:   </devices>
Jul 31 09:46:36 user nova-compute[71113]: </domain>
Jul 31 09:46:36 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 09:46:36 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:46:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1198419998',display_name='tempest-TestVolumeSwap-server-1198419998',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1198419998',id=6,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAD1pBUHVq0pRc6l8mQwSY8P92l3ivm22XPT4xkVrjSMI8DOJX5DbKXbBJnYnhLh14894vtYc5ACy8NqT6qdqyiEcTJtk/yCxi/c0LE+pv3UX3HK5xJNr9JwrljZ9RTTAw==',key_name='tempest-keypair-341060647',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e01569d9e6a4aff974e6dc99141f089',ramdisk_id='',reservation_id='r-0uqr085s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-70920097',owner_user_name='tempest-TestVolumeSwap-70920097-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:46:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b6a9a083ff064d6e89a4de0b9c4dce4f',uuid=b324fed7-5df8-4ca1-9a5a-06eaffd5e101,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07f33c66-0fa4-4154-a498-d6d42864a9a5", "address": "fa:16:3e:14:e4:e5", "network": {"id": "c49991aa-9260-4358-b3e2-309d558b5805", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1291245964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e01569d9e6a4aff974e6dc99141f089", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07f33c66-0f", "ovs_interfaceid": "07f33c66-0fa4-4154-a498-d6d42864a9a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 09:46:36 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Converting VIF {"id": "07f33c66-0fa4-4154-a498-d6d42864a9a5", "address": "fa:16:3e:14:e4:e5", "network": {"id": "c49991aa-9260-4358-b3e2-309d558b5805", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1291245964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e01569d9e6a4aff974e6dc99141f089", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07f33c66-0f", "ovs_interfaceid": "07f33c66-0fa4-4154-a498-d6d42864a9a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:46:36 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:e4:e5,bridge_name='br-int',has_traffic_filtering=True,id=07f33c66-0fa4-4154-a498-d6d42864a9a5,network=Network(c49991aa-9260-4358-b3e2-309d558b5805),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07f33c66-0f') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:46:36 user nova-compute[71113]: DEBUG os_vif [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:e4:e5,bridge_name='br-int',has_traffic_filtering=True,id=07f33c66-0fa4-4154-a498-d6d42864a9a5,network=Network(c49991aa-9260-4358-b3e2-309d558b5805),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07f33c66-0f') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 09:46:36 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:46:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:46:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 09:46:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap07f33c66-0f, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:46:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap07f33c66-0f, col_values=(('external_ids', {'iface-id': '07f33c66-0fa4-4154-a498-d6d42864a9a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:e4:e5', 'vm-uuid': 'b324fed7-5df8-4ca1-9a5a-06eaffd5e101'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:46:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:46:36 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Instance spawned successfully.
Jul 31 09:46:36 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 09:46:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:36 user nova-compute[71113]: INFO os_vif [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:e4:e5,bridge_name='br-int',has_traffic_filtering=True,id=07f33c66-0fa4-4154-a498-d6d42864a9a5,network=Network(c49991aa-9260-4358-b3e2-309d558b5805),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07f33c66-0f')
Jul 31 09:46:36 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:46:36 user nova-compute[71113]: DEBUG nova.network.neutron [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Successfully updated port: e5c43d23-3cda-4763-af71-7c6fddbf6bd3 {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 09:46:36 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Found default for hw_cdrom_bus of ide {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:46:36 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Found default for hw_disk_bus of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:46:36 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Found default for hw_input_bus of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:46:36 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Found default for hw_pointer_model of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:46:36 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Found default for hw_video_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:46:36 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Found default for hw_vif_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:46:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-74914f0c-56ae-455f-8039-8c1431e0df45 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "0ea0401b-26c2-4655-956b-1bc000debd53" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.974s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:46:36 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:46:36 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690796795.8513565, caac13d2-ceb3-4fee-84ad-5376c1c2cc23 => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:46:36 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] VM Resumed (Lifecycle Event)
Jul 31 09:46:36 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:46:36 user nova-compute[71113]: DEBUG nova.compute.manager [req-4f021ee0-641d-4a59-a5b0-53f7afe1385d req-ec0a3b6e-a52b-4ed2-a266-59cecbd34950 service nova] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Received event network-changed-e5c43d23-3cda-4763-af71-7c6fddbf6bd3 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:46:36 user nova-compute[71113]: DEBUG nova.compute.manager [req-4f021ee0-641d-4a59-a5b0-53f7afe1385d req-ec0a3b6e-a52b-4ed2-a266-59cecbd34950 service nova] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Refreshing instance network info cache due to event network-changed-e5c43d23-3cda-4763-af71-7c6fddbf6bd3. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:46:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-4f021ee0-641d-4a59-a5b0-53f7afe1385d req-ec0a3b6e-a52b-4ed2-a266-59cecbd34950 service nova] Acquiring lock "refresh_cache-f84b913d-0794-43a6-90d3-aaf4102f9fb6" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:46:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-4f021ee0-641d-4a59-a5b0-53f7afe1385d req-ec0a3b6e-a52b-4ed2-a266-59cecbd34950 service nova] Acquired lock "refresh_cache-f84b913d-0794-43a6-90d3-aaf4102f9fb6" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:46:36 user nova-compute[71113]: DEBUG nova.network.neutron [req-4f021ee0-641d-4a59-a5b0-53f7afe1385d req-ec0a3b6e-a52b-4ed2-a266-59cecbd34950 service nova] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Refreshing network info cache for port e5c43d23-3cda-4763-af71-7c6fddbf6bd3 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:46:36 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:46:36 user nova-compute[71113]: INFO nova.compute.manager [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Took 9.37 seconds to spawn the instance on the hypervisor.
Jul 31 09:46:36 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:46:36 user nova-compute[71113]: INFO nova.compute.manager [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Took 16.76 seconds to build instance.
Jul 31 09:46:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Acquiring lock "refresh_cache-f84b913d-0794-43a6-90d3-aaf4102f9fb6" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:46:36 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:46:36 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690796795.8538284, caac13d2-ceb3-4fee-84ad-5376c1c2cc23 => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:46:36 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] VM Started (Lifecycle Event)
Jul 31 09:46:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7a79ba15-8357-4d63-87ad-b207f733e5f5 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:46:36 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:46:36 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:46:36 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] No VIF found with MAC fa:16:3e:14:e4:e5, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 09:46:36 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:46:36 user nova-compute[71113]: DEBUG nova.network.neutron [req-4f021ee0-641d-4a59-a5b0-53f7afe1385d req-ec0a3b6e-a52b-4ed2-a266-59cecbd34950 service nova] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 09:46:36 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:46:36 user nova-compute[71113]: INFO nova.compute.manager [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Took 10.81 seconds to build instance.
Jul 31 09:46:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ac9b5ad3-5e6d-4f2d-a54e-1dfae3453ff0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Lock "caac13d2-ceb3-4fee-84ad-5376c1c2cc23" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.983s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:46:36 user nova-compute[71113]: DEBUG nova.network.neutron [req-11f6bbf0-76b7-4411-8d59-610860ac8442 req-dd94ba77-086c-4d3c-a01e-16363b57ec66 service nova] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Updated VIF entry in instance network info cache for port 07f33c66-0fa4-4154-a498-d6d42864a9a5. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:46:36 user nova-compute[71113]: DEBUG nova.network.neutron [req-11f6bbf0-76b7-4411-8d59-610860ac8442 req-dd94ba77-086c-4d3c-a01e-16363b57ec66 service nova] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Updating instance_info_cache with network_info: [{"id": "07f33c66-0fa4-4154-a498-d6d42864a9a5", "address": "fa:16:3e:14:e4:e5", "network": {"id": "c49991aa-9260-4358-b3e2-309d558b5805", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1291245964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e01569d9e6a4aff974e6dc99141f089", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07f33c66-0f", "ovs_interfaceid": "07f33c66-0fa4-4154-a498-d6d42864a9a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:46:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-11f6bbf0-76b7-4411-8d59-610860ac8442 req-dd94ba77-086c-4d3c-a01e-16363b57ec66 service nova] Releasing lock "refresh_cache-b324fed7-5df8-4ca1-9a5a-06eaffd5e101" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:46:37 user nova-compute[71113]: DEBUG nova.network.neutron [req-4f021ee0-641d-4a59-a5b0-53f7afe1385d req-ec0a3b6e-a52b-4ed2-a266-59cecbd34950 service nova] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:46:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-4f021ee0-641d-4a59-a5b0-53f7afe1385d req-ec0a3b6e-a52b-4ed2-a266-59cecbd34950 service nova] Releasing lock "refresh_cache-f84b913d-0794-43a6-90d3-aaf4102f9fb6" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:46:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Acquired lock "refresh_cache-f84b913d-0794-43a6-90d3-aaf4102f9fb6" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:46:37 user nova-compute[71113]: DEBUG nova.network.neutron [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 09:46:37 user nova-compute[71113]: DEBUG nova.network.neutron [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 09:46:37 user nova-compute[71113]: DEBUG nova.network.neutron [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Updating instance_info_cache with network_info: [{"id": "e5c43d23-3cda-4763-af71-7c6fddbf6bd3", "address": "fa:16:3e:33:5c:af", "network": {"id": "6cd9dded-5835-41d6-9407-1a1f04223da4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-184846099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ede230cc40e449bb8747fe13f655799", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5c43d23-3c", "ovs_interfaceid": "e5c43d23-3cda-4763-af71-7c6fddbf6bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:46:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Releasing lock "refresh_cache-f84b913d-0794-43a6-90d3-aaf4102f9fb6" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:46:37 user nova-compute[71113]: DEBUG nova.compute.manager [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Instance network_info: |[{"id": "e5c43d23-3cda-4763-af71-7c6fddbf6bd3", "address": "fa:16:3e:33:5c:af", "network": {"id": "6cd9dded-5835-41d6-9407-1a1f04223da4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-184846099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ede230cc40e449bb8747fe13f655799", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5c43d23-3c", "ovs_interfaceid": "e5c43d23-3cda-4763-af71-7c6fddbf6bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 09:46:37 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Start _get_guest_xml network_info=[{"id": "e5c43d23-3cda-4763-af71-7c6fddbf6bd3", "address": "fa:16:3e:33:5c:af", "network": {"id": "6cd9dded-5835-41d6-9407-1a1f04223da4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-184846099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ede230cc40e449bb8747fe13f655799", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5c43d23-3c", "ovs_interfaceid": "e5c43d23-3cda-4763-af71-7c6fddbf6bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:46:23Z,direct_url=<?>,disk_format='qcow2',id=38906fac-16b8-44e4-a540-da4374fde1c7,min_disk=0,min_ram=0,name='',owner='7d1987729f5d4e55bb2fb2b4ca65f72c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:46:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'device_name': '/dev/sda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'scsi', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'image_id': '38906fac-16b8-44e4-a540-da4374fde1c7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 09:46:37 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:46:37 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:46:37 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 09:46:37 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 09:46:37 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 09:46:37 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 09:46:37 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 09:46:37 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:46:23Z,direct_url=<?>,disk_format='qcow2',id=38906fac-16b8-44e4-a540-da4374fde1c7,min_disk=0,min_ram=0,name='',owner='7d1987729f5d4e55bb2fb2b4ca65f72c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:46:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 09:46:37 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 09:46:37 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 09:46:37 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 09:46:37 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 09:46:37 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 09:46:37 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 09:46:37 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 09:46:37 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 09:46:37 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 09:46:37 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 09:46:37 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T09:46:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-452633403',display_name='tempest-AttachSCSIVolumeTestJSON-server-452633403',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-452633403',id=7,image_ref='38906fac-16b8-44e4-a540-da4374fde1c7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMBQg/n9Pbq7dZUo+F42N06oBWhBi5QTtfvGne7QkPv6rp1iNW1YP5SQWOjL0PvVVZSPgoAGQ4ycF4Z2gfsfu87iCkngq7+EVNNfaEhYVeyJ9xAOxE3bXPBWDDlWDbCug==',key_name='tempest-keypair-381024059',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ede230cc40e449bb8747fe13f655799',ramdisk_id='',reservation_id='r-s6vz9zvd',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='38906fac-16b8-44e4-a540-da4374fde1c7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-687548171',owner_user_name='tempest-AttachSCSIVolumeTestJSON-687548171-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:46:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5162014a8315486d8a6c5470c0517e00',uuid=f84b913d-0794-43a6-90d3-aaf4102f9fb6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5c43d23-3cda-4763-af71-7c6fddbf6bd3", "address": "fa:16:3e:33:5c:af", "network": {"id": "6cd9dded-5835-41d6-9407-1a1f04223da4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-184846099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ede230cc40e449bb8747fe13f655799", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5c43d23-3c", "ovs_interfaceid": "e5c43d23-3cda-4763-af71-7c6fddbf6bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 09:46:37 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Converting VIF {"id": "e5c43d23-3cda-4763-af71-7c6fddbf6bd3", "address": "fa:16:3e:33:5c:af", "network": {"id": "6cd9dded-5835-41d6-9407-1a1f04223da4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-184846099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ede230cc40e449bb8747fe13f655799", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5c43d23-3c", "ovs_interfaceid": "e5c43d23-3cda-4763-af71-7c6fddbf6bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:46:37 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:5c:af,bridge_name='br-int',has_traffic_filtering=True,id=e5c43d23-3cda-4763-af71-7c6fddbf6bd3,network=Network(6cd9dded-5835-41d6-9407-1a1f04223da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5c43d23-3c') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:46:37 user nova-compute[71113]: DEBUG nova.objects.instance [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Lazy-loading 'pci_devices' on Instance uuid f84b913d-0794-43a6-90d3-aaf4102f9fb6 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:46:37 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] End _get_guest_xml xml=<domain type="kvm">
Jul 31 09:46:37 user nova-compute[71113]:   <uuid>f84b913d-0794-43a6-90d3-aaf4102f9fb6</uuid>
Jul 31 09:46:37 user nova-compute[71113]:   <name>instance-00000007</name>
Jul 31 09:46:37 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 09:46:37 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 09:46:37 user nova-compute[71113]:   <metadata>
Jul 31 09:46:37 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 09:46:37 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 09:46:37 user nova-compute[71113]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-452633403</nova:name>
Jul 31 09:46:37 user nova-compute[71113]:       <nova:creationTime>2023-07-31 09:46:37</nova:creationTime>
Jul 31 09:46:37 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 09:46:37 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 09:46:37 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 09:46:37 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 09:46:37 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 09:46:37 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 09:46:37 user nova-compute[71113]:       </nova:flavor>
Jul 31 09:46:37 user nova-compute[71113]:       <nova:owner>
Jul 31 09:46:37 user nova-compute[71113]:         <nova:user uuid="5162014a8315486d8a6c5470c0517e00">tempest-AttachSCSIVolumeTestJSON-687548171-project-member</nova:user>
Jul 31 09:46:37 user nova-compute[71113]:         <nova:project uuid="5ede230cc40e449bb8747fe13f655799">tempest-AttachSCSIVolumeTestJSON-687548171</nova:project>
Jul 31 09:46:37 user nova-compute[71113]:       </nova:owner>
Jul 31 09:46:37 user nova-compute[71113]:       <nova:root type="image" uuid="38906fac-16b8-44e4-a540-da4374fde1c7"/>
Jul 31 09:46:37 user nova-compute[71113]:       <nova:ports>
Jul 31 09:46:37 user nova-compute[71113]:         <nova:port uuid="e5c43d23-3cda-4763-af71-7c6fddbf6bd3">
Jul 31 09:46:37 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 31 09:46:37 user nova-compute[71113]:         </nova:port>
Jul 31 09:46:37 user nova-compute[71113]:       </nova:ports>
Jul 31 09:46:37 user nova-compute[71113]:     </nova:instance>
Jul 31 09:46:37 user nova-compute[71113]:   </metadata>
Jul 31 09:46:37 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 09:46:37 user nova-compute[71113]:     <system>
Jul 31 09:46:37 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 09:46:37 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 09:46:37 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 09:46:37 user nova-compute[71113]:       <entry name="serial">f84b913d-0794-43a6-90d3-aaf4102f9fb6</entry>
Jul 31 09:46:37 user nova-compute[71113]:       <entry name="uuid">f84b913d-0794-43a6-90d3-aaf4102f9fb6</entry>
Jul 31 09:46:37 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 09:46:37 user nova-compute[71113]:     </system>
Jul 31 09:46:37 user nova-compute[71113]:   </sysinfo>
Jul 31 09:46:37 user nova-compute[71113]:   <os>
Jul 31 09:46:37 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 09:46:37 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 09:46:37 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 09:46:37 user nova-compute[71113]:   </os>
Jul 31 09:46:37 user nova-compute[71113]:   <features>
Jul 31 09:46:37 user nova-compute[71113]:     <acpi/>
Jul 31 09:46:37 user nova-compute[71113]:     <apic/>
Jul 31 09:46:37 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 09:46:37 user nova-compute[71113]:   </features>
Jul 31 09:46:37 user nova-compute[71113]:   <clock offset="utc">
Jul 31 09:46:37 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 09:46:37 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 09:46:37 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 09:46:37 user nova-compute[71113]:   </clock>
Jul 31 09:46:37 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 09:46:37 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 09:46:37 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 09:46:37 user nova-compute[71113]:   </cpu>
Jul 31 09:46:37 user nova-compute[71113]:   <devices>
Jul 31 09:46:37 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 09:46:37 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 09:46:37 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/f84b913d-0794-43a6-90d3-aaf4102f9fb6/disk"/>
Jul 31 09:46:37 user nova-compute[71113]:       <target dev="sda" bus="scsi"/>
Jul 31 09:46:37 user nova-compute[71113]:       <address type="drive" controller="0" unit="0"/>
Jul 31 09:46:37 user nova-compute[71113]:     </disk>
Jul 31 09:46:37 user nova-compute[71113]:     <disk type="file" device="cdrom">
Jul 31 09:46:37 user nova-compute[71113]:       <driver name="qemu" type="raw" cache="none"/>
Jul 31 09:46:37 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/f84b913d-0794-43a6-90d3-aaf4102f9fb6/disk.config"/>
Jul 31 09:46:37 user nova-compute[71113]:       <target dev="sdb" bus="scsi"/>
Jul 31 09:46:37 user nova-compute[71113]:       <address type="drive" controller="0" unit="1"/>
Jul 31 09:46:37 user nova-compute[71113]:     </disk>
Jul 31 09:46:37 user nova-compute[71113]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Jul 31 09:46:37 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 09:46:37 user nova-compute[71113]:       <mac address="fa:16:3e:33:5c:af"/>
Jul 31 09:46:37 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:46:37 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 09:46:37 user nova-compute[71113]:       <target dev="tape5c43d23-3c"/>
Jul 31 09:46:37 user nova-compute[71113]:     </interface>
Jul 31 09:46:37 user nova-compute[71113]:     <serial type="pty">
Jul 31 09:46:37 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/f84b913d-0794-43a6-90d3-aaf4102f9fb6/console.log" append="off"/>
Jul 31 09:46:37 user nova-compute[71113]:     </serial>
Jul 31 09:46:37 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 09:46:37 user nova-compute[71113]:     <video>
Jul 31 09:46:37 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:46:37 user nova-compute[71113]:     </video>
Jul 31 09:46:37 user nova-compute[71113]:     <rng model="virtio">
Jul 31 09:46:37 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 09:46:37 user nova-compute[71113]:     </rng>
Jul 31 09:46:37 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 09:46:37 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 09:46:37 user nova-compute[71113]:       <stats period="10"/>
Jul 31 09:46:37 user nova-compute[71113]:     </memballoon>
Jul 31 09:46:37 user nova-compute[71113]:   </devices>
Jul 31 09:46:37 user nova-compute[71113]: </domain>
Jul 31 09:46:37 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 09:46:37 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T09:46:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-452633403',display_name='tempest-AttachSCSIVolumeTestJSON-server-452633403',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-452633403',id=7,image_ref='38906fac-16b8-44e4-a540-da4374fde1c7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMBQg/n9Pbq7dZUo+F42N06oBWhBi5QTtfvGne7QkPv6rp1iNW1YP5SQWOjL0PvVVZSPgoAGQ4ycF4Z2gfsfu87iCkngq7+EVNNfaEhYVeyJ9xAOxE3bXPBWDDlWDbCug==',key_name='tempest-keypair-381024059',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ede230cc40e449bb8747fe13f655799',ramdisk_id='',reservation_id='r-s6vz9zvd',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='38906fac-16b8-44e4-a540-da4374fde1c7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-687548171',owner_user_name='tempest-AttachSCSIVolumeTestJSON-687548171-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:46:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5162014a8315486d8a6c5470c0517e00',uuid=f84b913d-0794-43a6-90d3-aaf4102f9fb6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5c43d23-3cda-4763-af71-7c6fddbf6bd3", "address": "fa:16:3e:33:5c:af", "network": {"id": "6cd9dded-5835-41d6-9407-1a1f04223da4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-184846099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ede230cc40e449bb8747fe13f655799", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5c43d23-3c", "ovs_interfaceid": "e5c43d23-3cda-4763-af71-7c6fddbf6bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 09:46:37 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Converting VIF {"id": "e5c43d23-3cda-4763-af71-7c6fddbf6bd3", "address": "fa:16:3e:33:5c:af", "network": {"id": "6cd9dded-5835-41d6-9407-1a1f04223da4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-184846099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ede230cc40e449bb8747fe13f655799", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5c43d23-3c", "ovs_interfaceid": "e5c43d23-3cda-4763-af71-7c6fddbf6bd3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:46:37 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:5c:af,bridge_name='br-int',has_traffic_filtering=True,id=e5c43d23-3cda-4763-af71-7c6fddbf6bd3,network=Network(6cd9dded-5835-41d6-9407-1a1f04223da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5c43d23-3c') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:46:37 user nova-compute[71113]: DEBUG os_vif [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:5c:af,bridge_name='br-int',has_traffic_filtering=True,id=e5c43d23-3cda-4763-af71-7c6fddbf6bd3,network=Network(6cd9dded-5835-41d6-9407-1a1f04223da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5c43d23-3c') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 09:46:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:46:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 09:46:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape5c43d23-3c, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:46:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape5c43d23-3c, col_values=(('external_ids', {'iface-id': 'e5c43d23-3cda-4763-af71-7c6fddbf6bd3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:5c:af', 'vm-uuid': 'f84b913d-0794-43a6-90d3-aaf4102f9fb6'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:46:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:46:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:37 user nova-compute[71113]: INFO os_vif [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:5c:af,bridge_name='br-int',has_traffic_filtering=True,id=e5c43d23-3cda-4763-af71-7c6fddbf6bd3,network=Network(6cd9dded-5835-41d6-9407-1a1f04223da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5c43d23-3c')
Jul 31 09:46:38 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] No BDM found with device name sda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:46:38 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:46:38 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] No VIF found with MAC fa:16:3e:33:5c:af, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 09:46:38 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Using config drive
Jul 31 09:46:38 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:38 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:38 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:38 user nova-compute[71113]: DEBUG nova.compute.manager [req-cddcdf71-cc7e-4f3f-ba87-e1425d666f73 req-4dad55ce-9db8-487c-b294-05c26032670f service nova] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Received event network-vif-plugged-07f33c66-0fa4-4154-a498-d6d42864a9a5 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:46:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-cddcdf71-cc7e-4f3f-ba87-e1425d666f73 req-4dad55ce-9db8-487c-b294-05c26032670f service nova] Acquiring lock "b324fed7-5df8-4ca1-9a5a-06eaffd5e101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-cddcdf71-cc7e-4f3f-ba87-e1425d666f73 req-4dad55ce-9db8-487c-b294-05c26032670f service nova] Lock "b324fed7-5df8-4ca1-9a5a-06eaffd5e101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-cddcdf71-cc7e-4f3f-ba87-e1425d666f73 req-4dad55ce-9db8-487c-b294-05c26032670f service nova] Lock "b324fed7-5df8-4ca1-9a5a-06eaffd5e101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:46:38 user nova-compute[71113]: DEBUG nova.compute.manager [req-cddcdf71-cc7e-4f3f-ba87-e1425d666f73 req-4dad55ce-9db8-487c-b294-05c26032670f service nova] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] No waiting events found dispatching network-vif-plugged-07f33c66-0fa4-4154-a498-d6d42864a9a5 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:46:38 user nova-compute[71113]: WARNING nova.compute.manager [req-cddcdf71-cc7e-4f3f-ba87-e1425d666f73 req-4dad55ce-9db8-487c-b294-05c26032670f service nova] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Received unexpected event network-vif-plugged-07f33c66-0fa4-4154-a498-d6d42864a9a5 for instance with vm_state building and task_state spawning.
Jul 31 09:46:39 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Creating config drive at /opt/stack/data/nova/instances/f84b913d-0794-43a6-90d3-aaf4102f9fb6/disk.config
Jul 31 09:46:39 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f84b913d-0794-43a6-90d3-aaf4102f9fb6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp3q2vyett {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:46:39 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f84b913d-0794-43a6-90d3-aaf4102f9fb6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp3q2vyett" returned: 0 in 0.067s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:46:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:41 user nova-compute[71113]: DEBUG nova.compute.manager [req-8d1a4360-86a0-4950-b13f-a66b37505b07 req-f4ae7aa7-601f-499b-8231-dc966a9e4412 service nova] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Received event network-vif-plugged-07f33c66-0fa4-4154-a498-d6d42864a9a5 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:46:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8d1a4360-86a0-4950-b13f-a66b37505b07 req-f4ae7aa7-601f-499b-8231-dc966a9e4412 service nova] Acquiring lock "b324fed7-5df8-4ca1-9a5a-06eaffd5e101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8d1a4360-86a0-4950-b13f-a66b37505b07 req-f4ae7aa7-601f-499b-8231-dc966a9e4412 service nova] Lock "b324fed7-5df8-4ca1-9a5a-06eaffd5e101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8d1a4360-86a0-4950-b13f-a66b37505b07 req-f4ae7aa7-601f-499b-8231-dc966a9e4412 service nova] Lock "b324fed7-5df8-4ca1-9a5a-06eaffd5e101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:46:41 user nova-compute[71113]: DEBUG nova.compute.manager [req-8d1a4360-86a0-4950-b13f-a66b37505b07 req-f4ae7aa7-601f-499b-8231-dc966a9e4412 service nova] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] No waiting events found dispatching network-vif-plugged-07f33c66-0fa4-4154-a498-d6d42864a9a5 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:46:41 user nova-compute[71113]: WARNING nova.compute.manager [req-8d1a4360-86a0-4950-b13f-a66b37505b07 req-f4ae7aa7-601f-499b-8231-dc966a9e4412 service nova] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Received unexpected event network-vif-plugged-07f33c66-0fa4-4154-a498-d6d42864a9a5 for instance with vm_state building and task_state spawning.
Jul 31 09:46:41 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690796801.5384278, b324fed7-5df8-4ca1-9a5a-06eaffd5e101 => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:46:41 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] VM Resumed (Lifecycle Event)
Jul 31 09:46:41 user nova-compute[71113]: DEBUG nova.compute.manager [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 09:46:41 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 09:46:41 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:46:41 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Instance spawned successfully.
Jul 31 09:46:41 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 09:46:41 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:46:41 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:46:41 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690796801.545529, b324fed7-5df8-4ca1-9a5a-06eaffd5e101 => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:46:41 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] VM Started (Lifecycle Event)
Jul 31 09:46:41 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Found default for hw_cdrom_bus of ide {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:46:41 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Found default for hw_disk_bus of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:46:41 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Found default for hw_input_bus of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:46:41 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Found default for hw_pointer_model of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:46:41 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Found default for hw_video_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:46:41 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Found default for hw_vif_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:46:41 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:46:41 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:46:41 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:46:42 user nova-compute[71113]: INFO nova.compute.manager [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Took 9.98 seconds to spawn the instance on the hypervisor.
Jul 31 09:46:42 user nova-compute[71113]: DEBUG nova.compute.manager [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:46:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:42 user nova-compute[71113]: INFO nova.compute.manager [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Took 11.16 seconds to build instance.
Jul 31 09:46:42 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-76e6c5b0-6f7d-4db4-9dcd-7ca33ae0a74e tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Lock "b324fed7-5df8-4ca1-9a5a-06eaffd5e101" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.347s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:46:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:43 user nova-compute[71113]: DEBUG nova.compute.manager [req-b2519bca-d720-438a-bc58-587ffd64dd13 req-0f5cba8c-de1b-4dc8-944b-913530b0786c service nova] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Received event network-vif-plugged-e5c43d23-3cda-4763-af71-7c6fddbf6bd3 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:46:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-b2519bca-d720-438a-bc58-587ffd64dd13 req-0f5cba8c-de1b-4dc8-944b-913530b0786c service nova] Acquiring lock "f84b913d-0794-43a6-90d3-aaf4102f9fb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-b2519bca-d720-438a-bc58-587ffd64dd13 req-0f5cba8c-de1b-4dc8-944b-913530b0786c service nova] Lock "f84b913d-0794-43a6-90d3-aaf4102f9fb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-b2519bca-d720-438a-bc58-587ffd64dd13 req-0f5cba8c-de1b-4dc8-944b-913530b0786c service nova] Lock "f84b913d-0794-43a6-90d3-aaf4102f9fb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:46:43 user nova-compute[71113]: DEBUG nova.compute.manager [req-b2519bca-d720-438a-bc58-587ffd64dd13 req-0f5cba8c-de1b-4dc8-944b-913530b0786c service nova] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] No waiting events found dispatching network-vif-plugged-e5c43d23-3cda-4763-af71-7c6fddbf6bd3 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:46:43 user nova-compute[71113]: WARNING nova.compute.manager [req-b2519bca-d720-438a-bc58-587ffd64dd13 req-0f5cba8c-de1b-4dc8-944b-913530b0786c service nova] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Received unexpected event network-vif-plugged-e5c43d23-3cda-4763-af71-7c6fddbf6bd3 for instance with vm_state building and task_state spawning.
Jul 31 09:46:43 user nova-compute[71113]: DEBUG nova.compute.manager [req-b2519bca-d720-438a-bc58-587ffd64dd13 req-0f5cba8c-de1b-4dc8-944b-913530b0786c service nova] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Received event network-vif-plugged-e5c43d23-3cda-4763-af71-7c6fddbf6bd3 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:46:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-b2519bca-d720-438a-bc58-587ffd64dd13 req-0f5cba8c-de1b-4dc8-944b-913530b0786c service nova] Acquiring lock "f84b913d-0794-43a6-90d3-aaf4102f9fb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-b2519bca-d720-438a-bc58-587ffd64dd13 req-0f5cba8c-de1b-4dc8-944b-913530b0786c service nova] Lock "f84b913d-0794-43a6-90d3-aaf4102f9fb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-b2519bca-d720-438a-bc58-587ffd64dd13 req-0f5cba8c-de1b-4dc8-944b-913530b0786c service nova] Lock "f84b913d-0794-43a6-90d3-aaf4102f9fb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:46:43 user nova-compute[71113]: DEBUG nova.compute.manager [req-b2519bca-d720-438a-bc58-587ffd64dd13 req-0f5cba8c-de1b-4dc8-944b-913530b0786c service nova] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] No waiting events found dispatching network-vif-plugged-e5c43d23-3cda-4763-af71-7c6fddbf6bd3 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:46:43 user nova-compute[71113]: WARNING nova.compute.manager [req-b2519bca-d720-438a-bc58-587ffd64dd13 req-0f5cba8c-de1b-4dc8-944b-913530b0786c service nova] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Received unexpected event network-vif-plugged-e5c43d23-3cda-4763-af71-7c6fddbf6bd3 for instance with vm_state building and task_state spawning.
Jul 31 09:46:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:44 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690796804.831933, f84b913d-0794-43a6-90d3-aaf4102f9fb6 => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:46:44 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] VM Resumed (Lifecycle Event)
Jul 31 09:46:44 user nova-compute[71113]: DEBUG nova.compute.manager [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 09:46:44 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 09:46:44 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Instance spawned successfully.
Jul 31 09:46:44 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 09:46:44 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:46:44 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Found default for hw_input_bus of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:46:44 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Found default for hw_pointer_model of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:46:44 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Found default for hw_video_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:46:44 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Found default for hw_vif_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:46:44 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:46:44 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:46:44 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690796804.832051, f84b913d-0794-43a6-90d3-aaf4102f9fb6 => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:46:44 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] VM Started (Lifecycle Event)
Jul 31 09:46:44 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:46:44 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:46:45 user nova-compute[71113]: INFO nova.compute.manager [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Took 11.31 seconds to spawn the instance on the hypervisor.
Jul 31 09:46:45 user nova-compute[71113]: DEBUG nova.compute.manager [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:46:45 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:46:45 user nova-compute[71113]: INFO nova.compute.manager [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Took 13.19 seconds to build instance.
Jul 31 09:46:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-2c0df524-4f0c-4846-b727-393c7f1aef85 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Lock "f84b913d-0794-43a6-90d3-aaf4102f9fb6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.338s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:46:46 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:48 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:53 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:55 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:46:55 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Cleaning up deleted instances {{(pid=71113) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 31 09:46:55 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] There are 0 instances to clean {{(pid=71113) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 31 09:46:55 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:46:55 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71113) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 31 09:46:55 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:46:56 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:46:56 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:46:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Acquiring lock "b574cfa3-5724-424c-a68e-8e88e6c8c69c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Lock "b574cfa3-5724-424c-a68e-8e88e6c8c69c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:57 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Starting instance... {{(pid=71113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 09:46:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:57 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 09:46:57 user nova-compute[71113]: INFO nova.compute.claims [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Claim successful on node user
Jul 31 09:46:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:58 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:46:58 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:46:58 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.721s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:46:58 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Start building networks asynchronously for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 09:46:58 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Allocating IP information in the background. {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 09:46:58 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] allocate_for_instance() {{(pid=71113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 09:46:58 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 09:46:58 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Start building block device mappings for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 09:46:58 user nova-compute[71113]: DEBUG nova.policy [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '201cdf33fbd74e77877dd1342b33aedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fc8b3757a845ad89068797348d02bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71113) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 09:46:58 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Start spawning the instance on the hypervisor. {{(pid=71113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 09:46:58 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 09:46:58 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Creating image(s)
Jul 31 09:46:58 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Acquiring lock "/opt/stack/data/nova/instances/b574cfa3-5724-424c-a68e-8e88e6c8c69c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:58 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Lock "/opt/stack/data/nova/instances/b574cfa3-5724-424c-a68e-8e88e6c8c69c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:58 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Lock "/opt/stack/data/nova/instances/b574cfa3-5724-424c-a68e-8e88e6c8c69c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:46:58 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:46:58 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.173s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:46:58 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Acquiring lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:58 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:58 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:46:58 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:46:58 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:46:58 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:46:58 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 09:46:58 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.178s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:46:58 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/b574cfa3-5724-424c-a68e-8e88e6c8c69c/disk 1073741824 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:46:58 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:46:58 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/b574cfa3-5724-424c-a68e-8e88e6c8c69c/disk 1073741824" returned: 0 in 0.060s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:46:58 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:46:58 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:46:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.147s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:46:59 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b574cfa3-5724-424c-a68e-8e88e6c8c69c/disk. size=1073741824 {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 09:46:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b574cfa3-5724-424c-a68e-8e88e6c8c69c/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:46:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b574cfa3-5724-424c-a68e-8e88e6c8c69c/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:46:59 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Cannot resize image /opt/stack/data/nova/instances/b574cfa3-5724-424c-a68e-8e88e6c8c69c/disk to a smaller size. {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 09:46:59 user nova-compute[71113]: DEBUG nova.objects.instance [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Lazy-loading 'migration_context' on Instance uuid b574cfa3-5724-424c-a68e-8e88e6c8c69c {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:46:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Created local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 09:46:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Ensure instance console log exists: /opt/stack/data/nova/instances/b574cfa3-5724-424c-a68e-8e88e6c8c69c/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 09:46:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:46:59 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Successfully created port: ddcabffa-42cf-4a5a-8773-821d4e474f66 {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 09:46:59 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:46:59 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:46:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:46:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:46:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:46:59 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 09:46:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:00 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Successfully updated port: ddcabffa-42cf-4a5a-8773-821d4e474f66 {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 09:47:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Acquiring lock "refresh_cache-b574cfa3-5724-424c-a68e-8e88e6c8c69c" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:47:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Acquired lock "refresh_cache-b574cfa3-5724-424c-a68e-8e88e6c8c69c" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:47:00 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 09:47:00 user nova-compute[71113]: DEBUG nova.compute.manager [req-911562fd-a65e-4c33-9c83-3bba189d1a12 req-6ec2270f-4ece-433d-b48d-08bc5ccc2f05 service nova] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Received event network-changed-ddcabffa-42cf-4a5a-8773-821d4e474f66 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:47:00 user nova-compute[71113]: DEBUG nova.compute.manager [req-911562fd-a65e-4c33-9c83-3bba189d1a12 req-6ec2270f-4ece-433d-b48d-08bc5ccc2f05 service nova] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Refreshing instance network info cache due to event network-changed-ddcabffa-42cf-4a5a-8773-821d4e474f66. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:47:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-911562fd-a65e-4c33-9c83-3bba189d1a12 req-6ec2270f-4ece-433d-b48d-08bc5ccc2f05 service nova] Acquiring lock "refresh_cache-b574cfa3-5724-424c-a68e-8e88e6c8c69c" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:47:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:00 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 09:47:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caac13d2-ceb3-4fee-84ad-5376c1c2cc23/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caac13d2-ceb3-4fee-84ad-5376c1c2cc23/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caac13d2-ceb3-4fee-84ad-5376c1c2cc23/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:00 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Updating instance_info_cache with network_info: [{"id": "ddcabffa-42cf-4a5a-8773-821d4e474f66", "address": "fa:16:3e:08:01:23", "network": {"id": "19009bbc-db2c-4a99-aef8-bc8cb7ce0608", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2005545678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fc8b3757a845ad89068797348d02bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddcabffa-42", "ovs_interfaceid": "ddcabffa-42cf-4a5a-8773-821d4e474f66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:47:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caac13d2-ceb3-4fee-84ad-5376c1c2cc23/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b324fed7-5df8-4ca1-9a5a-06eaffd5e101/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Releasing lock "refresh_cache-b574cfa3-5724-424c-a68e-8e88e6c8c69c" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:47:01 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Instance network_info: |[{"id": "ddcabffa-42cf-4a5a-8773-821d4e474f66", "address": "fa:16:3e:08:01:23", "network": {"id": "19009bbc-db2c-4a99-aef8-bc8cb7ce0608", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2005545678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fc8b3757a845ad89068797348d02bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddcabffa-42", "ovs_interfaceid": "ddcabffa-42cf-4a5a-8773-821d4e474f66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 09:47:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-911562fd-a65e-4c33-9c83-3bba189d1a12 req-6ec2270f-4ece-433d-b48d-08bc5ccc2f05 service nova] Acquired lock "refresh_cache-b574cfa3-5724-424c-a68e-8e88e6c8c69c" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:47:01 user nova-compute[71113]: DEBUG nova.network.neutron [req-911562fd-a65e-4c33-9c83-3bba189d1a12 req-6ec2270f-4ece-433d-b48d-08bc5ccc2f05 service nova] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Refreshing network info cache for port ddcabffa-42cf-4a5a-8773-821d4e474f66 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:47:01 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Start _get_guest_xml network_info=[{"id": "ddcabffa-42cf-4a5a-8773-821d4e474f66", "address": "fa:16:3e:08:01:23", "network": {"id": "19009bbc-db2c-4a99-aef8-bc8cb7ce0608", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2005545678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fc8b3757a845ad89068797348d02bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddcabffa-42", "ovs_interfaceid": "ddcabffa-42cf-4a5a-8773-821d4e474f66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'image_id': '078646fe-b504-41ed-a147-61072e903e51'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 09:47:01 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:47:01 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:47:01 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 09:47:01 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 09:47:01 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 09:47:01 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 09:47:01 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 09:47:01 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 09:47:01 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 09:47:01 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 09:47:01 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 09:47:01 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 09:47:01 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 09:47:01 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 09:47:01 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 09:47:01 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 09:47:01 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 09:47:01 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 09:47:01 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:46:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-787725243',display_name='tempest-VolumesActionsTest-instance-787725243',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-787725243',id=8,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3fc8b3757a845ad89068797348d02bd',ramdisk_id='',reservation_id='r-0p1q8s0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1052619025',owner_user_name='tempest-VolumesActionsTest-1052619025-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:46:58Z,user_data=None,user_id='201cdf33fbd74e77877dd1342b33aedc',uuid=b574cfa3-5724-424c-a68e-8e88e6c8c69c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ddcabffa-42cf-4a5a-8773-821d4e474f66", "address": "fa:16:3e:08:01:23", "network": {"id": "19009bbc-db2c-4a99-aef8-bc8cb7ce0608", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2005545678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fc8b3757a845ad89068797348d02bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddcabffa-42", "ovs_interfaceid": "ddcabffa-42cf-4a5a-8773-821d4e474f66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 09:47:01 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Converting VIF {"id": "ddcabffa-42cf-4a5a-8773-821d4e474f66", "address": "fa:16:3e:08:01:23", "network": {"id": "19009bbc-db2c-4a99-aef8-bc8cb7ce0608", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2005545678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fc8b3757a845ad89068797348d02bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddcabffa-42", "ovs_interfaceid": "ddcabffa-42cf-4a5a-8773-821d4e474f66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:47:01 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:01:23,bridge_name='br-int',has_traffic_filtering=True,id=ddcabffa-42cf-4a5a-8773-821d4e474f66,network=Network(19009bbc-db2c-4a99-aef8-bc8cb7ce0608),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddcabffa-42') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:47:01 user nova-compute[71113]: DEBUG nova.objects.instance [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Lazy-loading 'pci_devices' on Instance uuid b574cfa3-5724-424c-a68e-8e88e6c8c69c {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:47:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b324fed7-5df8-4ca1-9a5a-06eaffd5e101/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b324fed7-5df8-4ca1-9a5a-06eaffd5e101/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:01 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] End _get_guest_xml xml=<domain type="kvm">
Jul 31 09:47:01 user nova-compute[71113]:   <uuid>b574cfa3-5724-424c-a68e-8e88e6c8c69c</uuid>
Jul 31 09:47:01 user nova-compute[71113]:   <name>instance-00000008</name>
Jul 31 09:47:01 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 09:47:01 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 09:47:01 user nova-compute[71113]:   <metadata>
Jul 31 09:47:01 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 09:47:01 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 09:47:01 user nova-compute[71113]:       <nova:name>tempest-VolumesActionsTest-instance-787725243</nova:name>
Jul 31 09:47:01 user nova-compute[71113]:       <nova:creationTime>2023-07-31 09:47:01</nova:creationTime>
Jul 31 09:47:01 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 09:47:01 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 09:47:01 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 09:47:01 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 09:47:01 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 09:47:01 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 09:47:01 user nova-compute[71113]:       </nova:flavor>
Jul 31 09:47:01 user nova-compute[71113]:       <nova:owner>
Jul 31 09:47:01 user nova-compute[71113]:         <nova:user uuid="201cdf33fbd74e77877dd1342b33aedc">tempest-VolumesActionsTest-1052619025-project-member</nova:user>
Jul 31 09:47:01 user nova-compute[71113]:         <nova:project uuid="b3fc8b3757a845ad89068797348d02bd">tempest-VolumesActionsTest-1052619025</nova:project>
Jul 31 09:47:01 user nova-compute[71113]:       </nova:owner>
Jul 31 09:47:01 user nova-compute[71113]:       <nova:root type="image" uuid="078646fe-b504-41ed-a147-61072e903e51"/>
Jul 31 09:47:01 user nova-compute[71113]:       <nova:ports>
Jul 31 09:47:01 user nova-compute[71113]:         <nova:port uuid="ddcabffa-42cf-4a5a-8773-821d4e474f66">
Jul 31 09:47:01 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 31 09:47:01 user nova-compute[71113]:         </nova:port>
Jul 31 09:47:01 user nova-compute[71113]:       </nova:ports>
Jul 31 09:47:01 user nova-compute[71113]:     </nova:instance>
Jul 31 09:47:01 user nova-compute[71113]:   </metadata>
Jul 31 09:47:01 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 09:47:01 user nova-compute[71113]:     <system>
Jul 31 09:47:01 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 09:47:01 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 09:47:01 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 09:47:01 user nova-compute[71113]:       <entry name="serial">b574cfa3-5724-424c-a68e-8e88e6c8c69c</entry>
Jul 31 09:47:01 user nova-compute[71113]:       <entry name="uuid">b574cfa3-5724-424c-a68e-8e88e6c8c69c</entry>
Jul 31 09:47:01 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 09:47:01 user nova-compute[71113]:     </system>
Jul 31 09:47:01 user nova-compute[71113]:   </sysinfo>
Jul 31 09:47:01 user nova-compute[71113]:   <os>
Jul 31 09:47:01 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 09:47:01 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 09:47:01 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 09:47:01 user nova-compute[71113]:   </os>
Jul 31 09:47:01 user nova-compute[71113]:   <features>
Jul 31 09:47:01 user nova-compute[71113]:     <acpi/>
Jul 31 09:47:01 user nova-compute[71113]:     <apic/>
Jul 31 09:47:01 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 09:47:01 user nova-compute[71113]:   </features>
Jul 31 09:47:01 user nova-compute[71113]:   <clock offset="utc">
Jul 31 09:47:01 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 09:47:01 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 09:47:01 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 09:47:01 user nova-compute[71113]:   </clock>
Jul 31 09:47:01 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 09:47:01 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 09:47:01 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 09:47:01 user nova-compute[71113]:   </cpu>
Jul 31 09:47:01 user nova-compute[71113]:   <devices>
Jul 31 09:47:01 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 09:47:01 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 09:47:01 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/b574cfa3-5724-424c-a68e-8e88e6c8c69c/disk"/>
Jul 31 09:47:01 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 09:47:01 user nova-compute[71113]:     </disk>
Jul 31 09:47:01 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 09:47:01 user nova-compute[71113]:       <mac address="fa:16:3e:08:01:23"/>
Jul 31 09:47:01 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:47:01 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 09:47:01 user nova-compute[71113]:       <target dev="tapddcabffa-42"/>
Jul 31 09:47:01 user nova-compute[71113]:     </interface>
Jul 31 09:47:01 user nova-compute[71113]:     <serial type="pty">
Jul 31 09:47:01 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/b574cfa3-5724-424c-a68e-8e88e6c8c69c/console.log" append="off"/>
Jul 31 09:47:01 user nova-compute[71113]:     </serial>
Jul 31 09:47:01 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 09:47:01 user nova-compute[71113]:     <video>
Jul 31 09:47:01 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:47:01 user nova-compute[71113]:     </video>
Jul 31 09:47:01 user nova-compute[71113]:     <rng model="virtio">
Jul 31 09:47:01 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 09:47:01 user nova-compute[71113]:     </rng>
Jul 31 09:47:01 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 09:47:01 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 09:47:01 user nova-compute[71113]:       <stats period="10"/>
Jul 31 09:47:01 user nova-compute[71113]:     </memballoon>
Jul 31 09:47:01 user nova-compute[71113]:   </devices>
Jul 31 09:47:01 user nova-compute[71113]: </domain>
Jul 31 09:47:01 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 09:47:01 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:46:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-787725243',display_name='tempest-VolumesActionsTest-instance-787725243',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-787725243',id=8,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3fc8b3757a845ad89068797348d02bd',ramdisk_id='',reservation_id='r-0p1q8s0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1052619025',owner_user_name='tempest-VolumesActionsTest-1052619025-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:46:58Z,user_data=None,user_id='201cdf33fbd74e77877dd1342b33aedc',uuid=b574cfa3-5724-424c-a68e-8e88e6c8c69c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ddcabffa-42cf-4a5a-8773-821d4e474f66", "address": "fa:16:3e:08:01:23", "network": {"id": "19009bbc-db2c-4a99-aef8-bc8cb7ce0608", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2005545678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fc8b3757a845ad89068797348d02bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddcabffa-42", "ovs_interfaceid": "ddcabffa-42cf-4a5a-8773-821d4e474f66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 09:47:01 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Converting VIF {"id": "ddcabffa-42cf-4a5a-8773-821d4e474f66", "address": "fa:16:3e:08:01:23", "network": {"id": "19009bbc-db2c-4a99-aef8-bc8cb7ce0608", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2005545678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fc8b3757a845ad89068797348d02bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddcabffa-42", "ovs_interfaceid": "ddcabffa-42cf-4a5a-8773-821d4e474f66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:47:01 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:01:23,bridge_name='br-int',has_traffic_filtering=True,id=ddcabffa-42cf-4a5a-8773-821d4e474f66,network=Network(19009bbc-db2c-4a99-aef8-bc8cb7ce0608),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddcabffa-42') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:47:01 user nova-compute[71113]: DEBUG os_vif [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:01:23,bridge_name='br-int',has_traffic_filtering=True,id=ddcabffa-42cf-4a5a-8773-821d4e474f66,network=Network(19009bbc-db2c-4a99-aef8-bc8cb7ce0608),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddcabffa-42') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 09:47:01 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:01 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:47:01 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 09:47:01 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:01 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapddcabffa-42, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:47:01 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapddcabffa-42, col_values=(('external_ids', {'iface-id': 'ddcabffa-42cf-4a5a-8773-821d4e474f66', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:01:23', 'vm-uuid': 'b574cfa3-5724-424c-a68e-8e88e6c8c69c'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:47:01 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:01 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:47:01 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:01 user nova-compute[71113]: INFO os_vif [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:01:23,bridge_name='br-int',has_traffic_filtering=True,id=ddcabffa-42cf-4a5a-8773-821d4e474f66,network=Network(19009bbc-db2c-4a99-aef8-bc8cb7ce0608),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddcabffa-42')
Jul 31 09:47:01 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:47:01 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] No VIF found with MAC fa:16:3e:08:01:23, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 09:47:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b324fed7-5df8-4ca1-9a5a-06eaffd5e101/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f84b913d-0794-43a6-90d3-aaf4102f9fb6/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f84b913d-0794-43a6-90d3-aaf4102f9fb6/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f84b913d-0794-43a6-90d3-aaf4102f9fb6/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f84b913d-0794-43a6-90d3-aaf4102f9fb6/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530ee025-6faf-4497-aee9-dab145920012/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:01 user nova-compute[71113]: DEBUG nova.network.neutron [req-911562fd-a65e-4c33-9c83-3bba189d1a12 req-6ec2270f-4ece-433d-b48d-08bc5ccc2f05 service nova] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Updated VIF entry in instance network info cache for port ddcabffa-42cf-4a5a-8773-821d4e474f66. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:47:01 user nova-compute[71113]: DEBUG nova.network.neutron [req-911562fd-a65e-4c33-9c83-3bba189d1a12 req-6ec2270f-4ece-433d-b48d-08bc5ccc2f05 service nova] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Updating instance_info_cache with network_info: [{"id": "ddcabffa-42cf-4a5a-8773-821d4e474f66", "address": "fa:16:3e:08:01:23", "network": {"id": "19009bbc-db2c-4a99-aef8-bc8cb7ce0608", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2005545678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fc8b3757a845ad89068797348d02bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddcabffa-42", "ovs_interfaceid": "ddcabffa-42cf-4a5a-8773-821d4e474f66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:47:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-911562fd-a65e-4c33-9c83-3bba189d1a12 req-6ec2270f-4ece-433d-b48d-08bc5ccc2f05 service nova] Releasing lock "refresh_cache-b574cfa3-5724-424c-a68e-8e88e6c8c69c" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:47:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530ee025-6faf-4497-aee9-dab145920012/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530ee025-6faf-4497-aee9-dab145920012/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530ee025-6faf-4497-aee9-dab145920012/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:06 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:06 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690796825.6733892, b574cfa3-5724-424c-a68e-8e88e6c8c69c => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:47:06 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] VM Resumed (Lifecycle Event)
Jul 31 09:47:06 user nova-compute[71113]: DEBUG nova.compute.manager [req-9c468141-a418-4080-986d-bb49958e2442 req-de0530a4-f9b1-4af9-96f4-8fe06be09122 service nova] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Received event network-vif-plugged-ddcabffa-42cf-4a5a-8773-821d4e474f66 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:47:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9c468141-a418-4080-986d-bb49958e2442 req-de0530a4-f9b1-4af9-96f4-8fe06be09122 service nova] Acquiring lock "b574cfa3-5724-424c-a68e-8e88e6c8c69c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:47:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9c468141-a418-4080-986d-bb49958e2442 req-de0530a4-f9b1-4af9-96f4-8fe06be09122 service nova] Lock "b574cfa3-5724-424c-a68e-8e88e6c8c69c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:47:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9c468141-a418-4080-986d-bb49958e2442 req-de0530a4-f9b1-4af9-96f4-8fe06be09122 service nova] Lock "b574cfa3-5724-424c-a68e-8e88e6c8c69c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:47:06 user nova-compute[71113]: DEBUG nova.compute.manager [req-9c468141-a418-4080-986d-bb49958e2442 req-de0530a4-f9b1-4af9-96f4-8fe06be09122 service nova] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] No waiting events found dispatching network-vif-plugged-ddcabffa-42cf-4a5a-8773-821d4e474f66 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:47:06 user nova-compute[71113]: WARNING nova.compute.manager [req-9c468141-a418-4080-986d-bb49958e2442 req-de0530a4-f9b1-4af9-96f4-8fe06be09122 service nova] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Received unexpected event network-vif-plugged-ddcabffa-42cf-4a5a-8773-821d4e474f66 for instance with vm_state building and task_state spawning.
Jul 31 09:47:06 user nova-compute[71113]: DEBUG nova.compute.manager [req-8bf419f1-2776-4832-98b0-28f4c5d49b2c req-e6f99cb8-9bb9-470e-ada7-d97692e674ec service nova] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Received event network-vif-plugged-ddcabffa-42cf-4a5a-8773-821d4e474f66 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:47:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8bf419f1-2776-4832-98b0-28f4c5d49b2c req-e6f99cb8-9bb9-470e-ada7-d97692e674ec service nova] Acquiring lock "b574cfa3-5724-424c-a68e-8e88e6c8c69c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:47:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8bf419f1-2776-4832-98b0-28f4c5d49b2c req-e6f99cb8-9bb9-470e-ada7-d97692e674ec service nova] Lock "b574cfa3-5724-424c-a68e-8e88e6c8c69c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:47:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8bf419f1-2776-4832-98b0-28f4c5d49b2c req-e6f99cb8-9bb9-470e-ada7-d97692e674ec service nova] Lock "b574cfa3-5724-424c-a68e-8e88e6c8c69c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:47:06 user nova-compute[71113]: DEBUG nova.compute.manager [req-8bf419f1-2776-4832-98b0-28f4c5d49b2c req-e6f99cb8-9bb9-470e-ada7-d97692e674ec service nova] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] No waiting events found dispatching network-vif-plugged-ddcabffa-42cf-4a5a-8773-821d4e474f66 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:47:06 user nova-compute[71113]: WARNING nova.compute.manager [req-8bf419f1-2776-4832-98b0-28f4c5d49b2c req-e6f99cb8-9bb9-470e-ada7-d97692e674ec service nova] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Received unexpected event network-vif-plugged-ddcabffa-42cf-4a5a-8773-821d4e474f66 for instance with vm_state building and task_state spawning.
Jul 31 09:47:06 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 09:47:06 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 09:47:06 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:47:06 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:47:06 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:47:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=7505MB free_disk=25.773937225341797GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 09:47:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:47:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:47:06 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Instance spawned successfully.
Jul 31 09:47:06 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 09:47:06 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:47:06 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Found default for hw_cdrom_bus of ide {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:47:06 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Found default for hw_disk_bus of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:47:06 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Found default for hw_input_bus of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:47:06 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Found default for hw_pointer_model of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:47:06 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Found default for hw_video_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:47:06 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Found default for hw_vif_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:47:06 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:47:06 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690796825.674132, b574cfa3-5724-424c-a68e-8e88e6c8c69c => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:47:06 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] VM Started (Lifecycle Event)
Jul 31 09:47:06 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:06 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:47:06 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:47:06 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:47:06 user nova-compute[71113]: INFO nova.compute.manager [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Took 7.84 seconds to spawn the instance on the hypervisor.
Jul 31 09:47:06 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:47:06 user nova-compute[71113]: INFO nova.compute.manager [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Took 9.01 seconds to build instance.
Jul 31 09:47:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0f35dc8c-f5b9-46e4-b7eb-243c1bdd4790 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Lock "b574cfa3-5724-424c-a68e-8e88e6c8c69c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.146s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:47:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 530ee025-6faf-4497-aee9-dab145920012 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:47:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 0ea0401b-26c2-4655-956b-1bc000debd53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:47:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance efa311a0-fe2e-4c0f-af66-09c3eb38fbf1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:47:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 1112a49d-27bd-4fc8-bae6-ec1decbb47db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:47:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance caac13d2-ceb3-4fee-84ad-5376c1c2cc23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:47:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance b324fed7-5df8-4ca1-9a5a-06eaffd5e101 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:47:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance f84b913d-0794-43a6-90d3-aaf4102f9fb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:47:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance b574cfa3-5724-424c-a68e-8e88e6c8c69c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:47:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 09:47:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 09:47:06 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Refreshing inventories for resource provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 31 09:47:06 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Updating ProviderTree inventory for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 31 09:47:06 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Updating inventory in ProviderTree for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 31 09:47:06 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Refreshing aggregate associations for resource provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05, aggregates: None {{(pid=71113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 31 09:47:06 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Refreshing trait associations for resource provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE2,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS {{(pid=71113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 31 09:47:07 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:47:07 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:47:07 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 09:47:07 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.935s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:47:08 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:47:08 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:47:08 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 09:47:08 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Rebuilding the list of instances to heal {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 09:47:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "refresh_cache-530ee025-6faf-4497-aee9-dab145920012" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:47:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquired lock "refresh_cache-530ee025-6faf-4497-aee9-dab145920012" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:47:08 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 530ee025-6faf-4497-aee9-dab145920012] Forcefully refreshing network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 09:47:08 user nova-compute[71113]: DEBUG nova.objects.instance [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lazy-loading 'info_cache' on Instance uuid 530ee025-6faf-4497-aee9-dab145920012 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:47:08 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:09 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 530ee025-6faf-4497-aee9-dab145920012] Updating instance_info_cache with network_info: [{"id": "87156da3-0a08-44a2-a914-c69566bf1b5a", "address": "fa:16:3e:b3:98:c6", "network": {"id": "e63260c7-ffb2-4928-bff0-4d8fba378b2b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1431475840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e8d767c71014105a4a343be6bf71dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87156da3-0a", "ovs_interfaceid": "87156da3-0a08-44a2-a914-c69566bf1b5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:47:09 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Releasing lock "refresh_cache-530ee025-6faf-4497-aee9-dab145920012" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:47:09 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 530ee025-6faf-4497-aee9-dab145920012] Updated the network info_cache for instance {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 09:47:11 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:13 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:18 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Acquiring lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:47:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:47:19 user nova-compute[71113]: DEBUG nova.compute.manager [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Starting instance... {{(pid=71113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 09:47:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:47:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:47:20 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 09:47:20 user nova-compute[71113]: INFO nova.compute.claims [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Claim successful on node user
Jul 31 09:47:20 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:47:20 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:47:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.518s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:47:20 user nova-compute[71113]: DEBUG nova.compute.manager [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Start building networks asynchronously for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 09:47:20 user nova-compute[71113]: DEBUG nova.compute.manager [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Allocating IP information in the background. {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 09:47:20 user nova-compute[71113]: DEBUG nova.network.neutron [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] allocate_for_instance() {{(pid=71113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 09:47:20 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 09:47:20 user nova-compute[71113]: DEBUG nova.compute.manager [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Start building block device mappings for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 09:47:20 user nova-compute[71113]: INFO nova.virt.block_device [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Booting with volume a69daa37-ae46-4518-bb27-5b57f6e06288 at /dev/vda
Jul 31 09:47:20 user nova-compute[71113]: DEBUG os_brick.utils [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:47:20 user nova-compute[71113]: INFO oslo.privsep.daemon [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpi8mgx1te/privsep.sock']
Jul 31 09:47:20 user sudo[81977]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpi8mgx1te/privsep.sock
Jul 31 09:47:20 user sudo[81977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 31 09:47:20 user nova-compute[71113]: DEBUG nova.policy [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f8f072d506b141dc92dddb9dc6348f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219e950d6a5141ef93bd970e5c1d3805', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71113) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 09:47:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:21 user nova-compute[71113]: DEBUG nova.network.neutron [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Successfully created port: 370dc7b8-8a77-47e4-94b9-ae9be9d1de13 {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 09:47:22 user sudo[81977]: pam_unix(sudo:session): session closed for user root
Jul 31 09:47:22 user nova-compute[71113]: INFO oslo.privsep.daemon [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Spawned new privsep daemon via rootwrap
Jul 31 09:47:22 user nova-compute[71113]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 31 09:47:22 user nova-compute[71113]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 31 09:47:22 user nova-compute[71113]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Jul 31 09:47:22 user nova-compute[71113]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81983
Jul 31 09:47:22 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[259c0b10-4fce-4a23-a0bf-2aa715d3c3df]: (2,) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:47:22 user nova-compute[71113]: DEBUG nova.network.neutron [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Successfully created port: 79461167-7380-4b36-ac54-b58585f55c20 {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 09:47:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:22 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c815cad-4054-4a0f-9ccf-a0b41e172ee8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:47:22 user nova-compute[71113]: WARNING os_brick.initiator.connectors.nvmeof [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Jul 31 09:47:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:22 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1a5df8-033e-4d70-9555-42b10bfcd686]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:47:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:22 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0da0ed-620f-4086-82c6-92de5b79445a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:47:22 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9789b59e-c8db-484a-88c1-8b8bfd7fe679]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:47:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:23 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:47:23 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 09:47:23 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:23 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:47:23 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 09:47:23 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c77589-8047-4e37-bfd3-99c433cb8ce1]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:47:23 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 09:47:23 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 09:47:23 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 09:47:23 user nova-compute[71113]: DEBUG os_brick.utils [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] <== get_connector_properties: return (2144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:47:23 user nova-compute[71113]: DEBUG nova.virt.block_device [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Updating existing volume attachment record: 7d512bb1-2eb1-4222-b0e8-4dc1e06ba989 {{(pid=71113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 09:47:23 user nova-compute[71113]: DEBUG nova.network.neutron [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Successfully created port: dc38d490-4eb0-496c-817d-639264048797 {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 09:47:23 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:24 user nova-compute[71113]: DEBUG nova.network.neutron [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Successfully created port: c60ea5a4-1214-4163-ad18-e7bdf71e4bef {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 09:47:24 user nova-compute[71113]: DEBUG nova.network.neutron [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Successfully created port: f998018e-386d-4444-9712-9eb57b025198 {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 09:47:25 user nova-compute[71113]: DEBUG nova.network.neutron [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Successfully updated port: 370dc7b8-8a77-47e4-94b9-ae9be9d1de13 {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 09:47:25 user nova-compute[71113]: DEBUG nova.compute.manager [req-f4f86330-03d2-4d3d-9fe6-e56bfa01de89 req-dd63a92a-9058-4acc-a690-63de13134669 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received event network-changed-370dc7b8-8a77-47e4-94b9-ae9be9d1de13 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:47:25 user nova-compute[71113]: DEBUG nova.compute.manager [req-f4f86330-03d2-4d3d-9fe6-e56bfa01de89 req-dd63a92a-9058-4acc-a690-63de13134669 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Refreshing instance network info cache due to event network-changed-370dc7b8-8a77-47e4-94b9-ae9be9d1de13. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:47:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f4f86330-03d2-4d3d-9fe6-e56bfa01de89 req-dd63a92a-9058-4acc-a690-63de13134669 service nova] Acquiring lock "refresh_cache-3aaaef96-76f8-4088-a0bc-a1a72e80652e" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:47:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f4f86330-03d2-4d3d-9fe6-e56bfa01de89 req-dd63a92a-9058-4acc-a690-63de13134669 service nova] Acquired lock "refresh_cache-3aaaef96-76f8-4088-a0bc-a1a72e80652e" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:47:25 user nova-compute[71113]: DEBUG nova.network.neutron [req-f4f86330-03d2-4d3d-9fe6-e56bfa01de89 req-dd63a92a-9058-4acc-a690-63de13134669 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Refreshing network info cache for port 370dc7b8-8a77-47e4-94b9-ae9be9d1de13 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:47:25 user nova-compute[71113]: DEBUG nova.network.neutron [req-f4f86330-03d2-4d3d-9fe6-e56bfa01de89 req-dd63a92a-9058-4acc-a690-63de13134669 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 09:47:25 user nova-compute[71113]: DEBUG nova.network.neutron [req-f4f86330-03d2-4d3d-9fe6-e56bfa01de89 req-dd63a92a-9058-4acc-a690-63de13134669 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:47:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f4f86330-03d2-4d3d-9fe6-e56bfa01de89 req-dd63a92a-9058-4acc-a690-63de13134669 service nova] Releasing lock "refresh_cache-3aaaef96-76f8-4088-a0bc-a1a72e80652e" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:47:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:26 user nova-compute[71113]: DEBUG nova.network.neutron [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Successfully updated port: e64b39b1-bdfc-4e38-9520-8bf02c8427a4 {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 09:47:27 user nova-compute[71113]: DEBUG nova.network.neutron [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Successfully updated port: 3a0920cd-a09e-4a83-adcd-098a71e98229 {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 09:47:27 user nova-compute[71113]: DEBUG nova.compute.manager [req-ebdd15d2-902f-45f5-81f7-e305d25f5045 req-350cb09c-3799-4d7a-9e2b-b0a6e3fada83 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received event network-changed-e64b39b1-bdfc-4e38-9520-8bf02c8427a4 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:47:27 user nova-compute[71113]: DEBUG nova.compute.manager [req-ebdd15d2-902f-45f5-81f7-e305d25f5045 req-350cb09c-3799-4d7a-9e2b-b0a6e3fada83 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Refreshing instance network info cache due to event network-changed-e64b39b1-bdfc-4e38-9520-8bf02c8427a4. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:47:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ebdd15d2-902f-45f5-81f7-e305d25f5045 req-350cb09c-3799-4d7a-9e2b-b0a6e3fada83 service nova] Acquiring lock "refresh_cache-3aaaef96-76f8-4088-a0bc-a1a72e80652e" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:47:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ebdd15d2-902f-45f5-81f7-e305d25f5045 req-350cb09c-3799-4d7a-9e2b-b0a6e3fada83 service nova] Acquired lock "refresh_cache-3aaaef96-76f8-4088-a0bc-a1a72e80652e" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:47:27 user nova-compute[71113]: DEBUG nova.network.neutron [req-ebdd15d2-902f-45f5-81f7-e305d25f5045 req-350cb09c-3799-4d7a-9e2b-b0a6e3fada83 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Refreshing network info cache for port e64b39b1-bdfc-4e38-9520-8bf02c8427a4 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:47:27 user nova-compute[71113]: DEBUG nova.network.neutron [req-ebdd15d2-902f-45f5-81f7-e305d25f5045 req-350cb09c-3799-4d7a-9e2b-b0a6e3fada83 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 09:47:27 user nova-compute[71113]: DEBUG nova.network.neutron [req-ebdd15d2-902f-45f5-81f7-e305d25f5045 req-350cb09c-3799-4d7a-9e2b-b0a6e3fada83 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:47:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ebdd15d2-902f-45f5-81f7-e305d25f5045 req-350cb09c-3799-4d7a-9e2b-b0a6e3fada83 service nova] Releasing lock "refresh_cache-3aaaef96-76f8-4088-a0bc-a1a72e80652e" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:47:27 user nova-compute[71113]: DEBUG nova.compute.manager [req-ebdd15d2-902f-45f5-81f7-e305d25f5045 req-350cb09c-3799-4d7a-9e2b-b0a6e3fada83 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received event network-changed-3a0920cd-a09e-4a83-adcd-098a71e98229 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:47:27 user nova-compute[71113]: DEBUG nova.compute.manager [req-ebdd15d2-902f-45f5-81f7-e305d25f5045 req-350cb09c-3799-4d7a-9e2b-b0a6e3fada83 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Refreshing instance network info cache due to event network-changed-3a0920cd-a09e-4a83-adcd-098a71e98229. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:47:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ebdd15d2-902f-45f5-81f7-e305d25f5045 req-350cb09c-3799-4d7a-9e2b-b0a6e3fada83 service nova] Acquiring lock "refresh_cache-3aaaef96-76f8-4088-a0bc-a1a72e80652e" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:47:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ebdd15d2-902f-45f5-81f7-e305d25f5045 req-350cb09c-3799-4d7a-9e2b-b0a6e3fada83 service nova] Acquired lock "refresh_cache-3aaaef96-76f8-4088-a0bc-a1a72e80652e" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:47:27 user nova-compute[71113]: DEBUG nova.network.neutron [req-ebdd15d2-902f-45f5-81f7-e305d25f5045 req-350cb09c-3799-4d7a-9e2b-b0a6e3fada83 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Refreshing network info cache for port 3a0920cd-a09e-4a83-adcd-098a71e98229 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:47:28 user nova-compute[71113]: DEBUG nova.network.neutron [req-ebdd15d2-902f-45f5-81f7-e305d25f5045 req-350cb09c-3799-4d7a-9e2b-b0a6e3fada83 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 09:47:28 user nova-compute[71113]: DEBUG nova.network.neutron [req-ebdd15d2-902f-45f5-81f7-e305d25f5045 req-350cb09c-3799-4d7a-9e2b-b0a6e3fada83 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:47:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ebdd15d2-902f-45f5-81f7-e305d25f5045 req-350cb09c-3799-4d7a-9e2b-b0a6e3fada83 service nova] Releasing lock "refresh_cache-3aaaef96-76f8-4088-a0bc-a1a72e80652e" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:47:28 user nova-compute[71113]: DEBUG nova.network.neutron [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Successfully updated port: 79461167-7380-4b36-ac54-b58585f55c20 {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 09:47:28 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:29 user nova-compute[71113]: DEBUG nova.compute.manager [req-d4d6435d-1bea-418a-8270-9bd2014b5e27 req-165a97e0-4b92-4953-8907-36ac6ba8c482 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received event network-changed-79461167-7380-4b36-ac54-b58585f55c20 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:47:29 user nova-compute[71113]: DEBUG nova.compute.manager [req-d4d6435d-1bea-418a-8270-9bd2014b5e27 req-165a97e0-4b92-4953-8907-36ac6ba8c482 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Refreshing instance network info cache due to event network-changed-79461167-7380-4b36-ac54-b58585f55c20. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:47:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-d4d6435d-1bea-418a-8270-9bd2014b5e27 req-165a97e0-4b92-4953-8907-36ac6ba8c482 service nova] Acquiring lock "refresh_cache-3aaaef96-76f8-4088-a0bc-a1a72e80652e" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:47:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-d4d6435d-1bea-418a-8270-9bd2014b5e27 req-165a97e0-4b92-4953-8907-36ac6ba8c482 service nova] Acquired lock "refresh_cache-3aaaef96-76f8-4088-a0bc-a1a72e80652e" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:47:29 user nova-compute[71113]: DEBUG nova.network.neutron [req-d4d6435d-1bea-418a-8270-9bd2014b5e27 req-165a97e0-4b92-4953-8907-36ac6ba8c482 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Refreshing network info cache for port 79461167-7380-4b36-ac54-b58585f55c20 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:47:29 user nova-compute[71113]: DEBUG nova.network.neutron [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Successfully updated port: dc38d490-4eb0-496c-817d-639264048797 {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 09:47:29 user nova-compute[71113]: DEBUG nova.network.neutron [req-d4d6435d-1bea-418a-8270-9bd2014b5e27 req-165a97e0-4b92-4953-8907-36ac6ba8c482 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 09:47:30 user nova-compute[71113]: DEBUG nova.network.neutron [req-d4d6435d-1bea-418a-8270-9bd2014b5e27 req-165a97e0-4b92-4953-8907-36ac6ba8c482 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:47:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-d4d6435d-1bea-418a-8270-9bd2014b5e27 req-165a97e0-4b92-4953-8907-36ac6ba8c482 service nova] Releasing lock "refresh_cache-3aaaef96-76f8-4088-a0bc-a1a72e80652e" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:47:30 user nova-compute[71113]: DEBUG nova.network.neutron [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Successfully updated port: c60ea5a4-1214-4163-ad18-e7bdf71e4bef {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 09:47:30 user nova-compute[71113]: INFO nova.virt.block_device [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Booting with volume f51b00bb-6a76-4ed9-bb8f-e6c91340b321 at /dev/vdb
Jul 31 09:47:30 user nova-compute[71113]: DEBUG os_brick.utils [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:47:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:30 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a08151-4b57-4690-9ef2-bc20ee2eb1de]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:47:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:30 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc433007-b6f1-4445-ab91-e72b3278c85d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:47:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:31 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:31 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f55a9d-3906-4e85-ba3a-c666e56f8369]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:47:31 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf7e15f-0eb8-44a6-873f-2016e05abe12]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:47:31 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:31 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:47:31 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 09:47:31 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:31 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:47:31 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 09:47:31 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb07b949-a750-4115-b091-74eb0ec2fb85]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:47:31 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 09:47:31 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 09:47:31 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 09:47:31 user nova-compute[71113]: DEBUG os_brick.utils [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:47:31 user nova-compute[71113]: DEBUG nova.virt.block_device [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Updating existing volume attachment record: c4e10620-d277-4713-b172-49871c944c1d {{(pid=71113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 09:47:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:31 user nova-compute[71113]: DEBUG nova.network.neutron [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Successfully updated port: f998018e-386d-4444-9712-9eb57b025198 {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 09:47:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Acquiring lock "refresh_cache-3aaaef96-76f8-4088-a0bc-a1a72e80652e" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:47:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Acquired lock "refresh_cache-3aaaef96-76f8-4088-a0bc-a1a72e80652e" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:47:31 user nova-compute[71113]: DEBUG nova.network.neutron [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 09:47:31 user nova-compute[71113]: DEBUG nova.network.neutron [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 09:47:31 user nova-compute[71113]: DEBUG nova.compute.manager [req-84276ddd-6ad3-4bd0-a7fa-2c1a748bd491 req-fd6e1990-1df5-44ac-8e45-4b9c47e6ac68 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received event network-changed-dc38d490-4eb0-496c-817d-639264048797 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:47:31 user nova-compute[71113]: DEBUG nova.compute.manager [req-84276ddd-6ad3-4bd0-a7fa-2c1a748bd491 req-fd6e1990-1df5-44ac-8e45-4b9c47e6ac68 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Refreshing instance network info cache due to event network-changed-dc38d490-4eb0-496c-817d-639264048797. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:47:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-84276ddd-6ad3-4bd0-a7fa-2c1a748bd491 req-fd6e1990-1df5-44ac-8e45-4b9c47e6ac68 service nova] Acquiring lock "refresh_cache-3aaaef96-76f8-4088-a0bc-a1a72e80652e" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:47:33 user nova-compute[71113]: DEBUG nova.network.neutron [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Updating instance_info_cache with network_info: [{"id": "370dc7b8-8a77-47e4-94b9-ae9be9d1de13", "address": "fa:16:3e:7b:6a:0d", "network": {"id": "9e762abf-a299-49e7-b276-0fa226649bb9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1384573536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap370dc7b8-8a", "ovs_interfaceid": "370dc7b8-8a77-47e4-94b9-ae9be9d1de13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e64b39b1-bdfc-4e38-9520-8bf02c8427a4", "address": "fa:16:3e:0d:7e:fd", "network": {"id": "f7c9bb5d-84df-44c3-a496-20d634727c3c", "bridge": "br-int", "label": "tempest-device-tagging-net1-420856970", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape64b39b1-bd", "ovs_interfaceid": "e64b39b1-bdfc-4e38-9520-8bf02c8427a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3a0920cd-a09e-4a83-adcd-098a71e98229", "address": "fa:16:3e:8b:9b:9f", "network": {"id": "f7c9bb5d-84df-44c3-a496-20d634727c3c", "bridge": "br-int", "label": "tempest-device-tagging-net1-420856970", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a0920cd-a0", "ovs_interfaceid": "3a0920cd-a09e-4a83-adcd-098a71e98229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "79461167-7380-4b36-ac54-b58585f55c20", "address": "fa:16:3e:51:a4:07", "network": {"id": "f7c9bb5d-84df-44c3-a496-20d634727c3c", "bridge": "br-int", "label": "tempest-device-tagging-net1-420856970", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79461167-73", "ovs_interfaceid": "79461167-7380-4b36-ac54-b58585f55c20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dc38d490-4eb0-496c-817d-639264048797", "address": "fa:16:3e:92:54:8b", "network": {"id": "f7c9bb5d-84df-44c3-a496-20d634727c3c", "bridge": "br-int", "label": "tempest-device-tagging-net1-420856970", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc38d490-4e", "ovs_interfaceid": "dc38d490-4eb0-496c-817d-639264048797", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c60ea5a4-1214-4163-ad18-e7bdf71e4bef", "address": "fa:16:3e:ab:70:c1", "network": {"id": "bb2db53e-eed4-44e7-9510-eab184de68f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-411965443", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60ea5a4-12", "ovs_interfaceid": "c60ea5a4-1214-4163-ad18-e7bdf71e4bef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f998018e-386d-4444-9712-9eb57b025198", "address": "fa:16:3e:97:88:64", "network": {"id": "bb2db53e-eed4-44e7-9510-eab184de68f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-411965443", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf998018e-38", "ovs_interfaceid": "f998018e-386d-4444-9712-9eb57b025198", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:47:33 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Releasing lock "refresh_cache-3aaaef96-76f8-4088-a0bc-a1a72e80652e" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:47:33 user nova-compute[71113]: DEBUG nova.compute.manager [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Instance network_info: |[{"id": "370dc7b8-8a77-47e4-94b9-ae9be9d1de13", "address": "fa:16:3e:7b:6a:0d", "network": {"id": "9e762abf-a299-49e7-b276-0fa226649bb9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1384573536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap370dc7b8-8a", "ovs_interfaceid": "370dc7b8-8a77-47e4-94b9-ae9be9d1de13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e64b39b1-bdfc-4e38-9520-8bf02c8427a4", "address": "fa:16:3e:0d:7e:fd", "network": {"id": "f7c9bb5d-84df-44c3-a496-20d634727c3c", "bridge": "br-int", "label": "tempest-device-tagging-net1-420856970", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape64b39b1-bd", "ovs_interfaceid": "e64b39b1-bdfc-4e38-9520-8bf02c8427a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3a0920cd-a09e-4a83-adcd-098a71e98229", "address": "fa:16:3e:8b:9b:9f", "network": {"id": "f7c9bb5d-84df-44c3-a496-20d634727c3c", "bridge": "br-int", "label": "tempest-device-tagging-net1-420856970", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a0920cd-a0", "ovs_interfaceid": "3a0920cd-a09e-4a83-adcd-098a71e98229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "79461167-7380-4b36-ac54-b58585f55c20", "address": "fa:16:3e:51:a4:07", "network": {"id": "f7c9bb5d-84df-44c3-a496-20d634727c3c", "bridge": "br-int", "label": "tempest-device-tagging-net1-420856970", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79461167-73", "ovs_interfaceid": "79461167-7380-4b36-ac54-b58585f55c20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dc38d490-4eb0-496c-817d-639264048797", "address": "fa:16:3e:92:54:8b", "network": {"id": "f7c9bb5d-84df-44c3-a496-20d634727c3c", "bridge": "br-int", "label": "tempest-device-tagging-net1-420856970", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc38d490-4e", "ovs_interfaceid": "dc38d490-4eb0-496c-817d-639264048797", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c60ea5a4-1214-4163-ad18-e7bdf71e4bef", "address": "fa:16:3e:ab:70:c1", "network": {"id": "bb2db53e-eed4-44e7-9510-eab184de68f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-411965443", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60ea5a4-12", "ovs_interfaceid": "c60ea5a4-1214-4163-ad18-e7bdf71e4bef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f998018e-386d-4444-9712-9eb57b025198", "address": "fa:16:3e:97:88:64", "network": {"id": "bb2db53e-eed4-44e7-9510-eab184de68f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-411965443", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf998018e-38", "ovs_interfaceid": "f998018e-386d-4444-9712-9eb57b025198", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 09:47:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-84276ddd-6ad3-4bd0-a7fa-2c1a748bd491 req-fd6e1990-1df5-44ac-8e45-4b9c47e6ac68 service nova] Acquired lock "refresh_cache-3aaaef96-76f8-4088-a0bc-a1a72e80652e" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:47:33 user nova-compute[71113]: DEBUG nova.network.neutron [req-84276ddd-6ad3-4bd0-a7fa-2c1a748bd491 req-fd6e1990-1df5-44ac-8e45-4b9c47e6ac68 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Refreshing network info cache for port dc38d490-4eb0-496c-817d-639264048797 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:47:34 user nova-compute[71113]: DEBUG nova.network.neutron [req-84276ddd-6ad3-4bd0-a7fa-2c1a748bd491 req-fd6e1990-1df5-44ac-8e45-4b9c47e6ac68 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Updated VIF entry in instance network info cache for port dc38d490-4eb0-496c-817d-639264048797. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:47:34 user nova-compute[71113]: DEBUG nova.network.neutron [req-84276ddd-6ad3-4bd0-a7fa-2c1a748bd491 req-fd6e1990-1df5-44ac-8e45-4b9c47e6ac68 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Updating instance_info_cache with network_info: [{"id": "370dc7b8-8a77-47e4-94b9-ae9be9d1de13", "address": "fa:16:3e:7b:6a:0d", "network": {"id": "9e762abf-a299-49e7-b276-0fa226649bb9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1384573536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap370dc7b8-8a", "ovs_interfaceid": "370dc7b8-8a77-47e4-94b9-ae9be9d1de13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e64b39b1-bdfc-4e38-9520-8bf02c8427a4", "address": "fa:16:3e:0d:7e:fd", "network": {"id": "f7c9bb5d-84df-44c3-a496-20d634727c3c", "bridge": "br-int", "label": "tempest-device-tagging-net1-420856970", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape64b39b1-bd", "ovs_interfaceid": "e64b39b1-bdfc-4e38-9520-8bf02c8427a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3a0920cd-a09e-4a83-adcd-098a71e98229", "address": "fa:16:3e:8b:9b:9f", "network": {"id": "f7c9bb5d-84df-44c3-a496-20d634727c3c", "bridge": "br-int", "label": "tempest-device-tagging-net1-420856970", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a0920cd-a0", "ovs_interfaceid": "3a0920cd-a09e-4a83-adcd-098a71e98229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "79461167-7380-4b36-ac54-b58585f55c20", "address": "fa:16:3e:51:a4:07", "network": {"id": "f7c9bb5d-84df-44c3-a496-20d634727c3c", "bridge": "br-int", "label": "tempest-device-tagging-net1-420856970", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79461167-73", "ovs_interfaceid": "79461167-7380-4b36-ac54-b58585f55c20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dc38d490-4eb0-496c-817d-639264048797", "address": "fa:16:3e:92:54:8b", "network": {"id": "f7c9bb5d-84df-44c3-a496-20d634727c3c", "bridge": "br-int", "label": "tempest-device-tagging-net1-420856970", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc38d490-4e", "ovs_interfaceid": "dc38d490-4eb0-496c-817d-639264048797", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c60ea5a4-1214-4163-ad18-e7bdf71e4bef", "address": "fa:16:3e:ab:70:c1", "network": {"id": "bb2db53e-eed4-44e7-9510-eab184de68f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-411965443", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60ea5a4-12", "ovs_interfaceid": "c60ea5a4-1214-4163-ad18-e7bdf71e4bef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f998018e-386d-4444-9712-9eb57b025198", "address": "fa:16:3e:97:88:64", "network": {"id": "bb2db53e-eed4-44e7-9510-eab184de68f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-411965443", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf998018e-38", "ovs_interfaceid": "f998018e-386d-4444-9712-9eb57b025198", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:47:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-84276ddd-6ad3-4bd0-a7fa-2c1a748bd491 req-fd6e1990-1df5-44ac-8e45-4b9c47e6ac68 service nova] Releasing lock "refresh_cache-3aaaef96-76f8-4088-a0bc-a1a72e80652e" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:47:34 user nova-compute[71113]: DEBUG nova.compute.manager [req-84276ddd-6ad3-4bd0-a7fa-2c1a748bd491 req-fd6e1990-1df5-44ac-8e45-4b9c47e6ac68 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received event network-changed-c60ea5a4-1214-4163-ad18-e7bdf71e4bef {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:47:34 user nova-compute[71113]: DEBUG nova.compute.manager [req-84276ddd-6ad3-4bd0-a7fa-2c1a748bd491 req-fd6e1990-1df5-44ac-8e45-4b9c47e6ac68 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Refreshing instance network info cache due to event network-changed-c60ea5a4-1214-4163-ad18-e7bdf71e4bef. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:47:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-84276ddd-6ad3-4bd0-a7fa-2c1a748bd491 req-fd6e1990-1df5-44ac-8e45-4b9c47e6ac68 service nova] Acquiring lock "refresh_cache-3aaaef96-76f8-4088-a0bc-a1a72e80652e" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:47:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-84276ddd-6ad3-4bd0-a7fa-2c1a748bd491 req-fd6e1990-1df5-44ac-8e45-4b9c47e6ac68 service nova] Acquired lock "refresh_cache-3aaaef96-76f8-4088-a0bc-a1a72e80652e" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:47:34 user nova-compute[71113]: DEBUG nova.network.neutron [req-84276ddd-6ad3-4bd0-a7fa-2c1a748bd491 req-fd6e1990-1df5-44ac-8e45-4b9c47e6ac68 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Refreshing network info cache for port c60ea5a4-1214-4163-ad18-e7bdf71e4bef {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:47:34 user nova-compute[71113]: DEBUG nova.network.neutron [req-84276ddd-6ad3-4bd0-a7fa-2c1a748bd491 req-fd6e1990-1df5-44ac-8e45-4b9c47e6ac68 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Updated VIF entry in instance network info cache for port c60ea5a4-1214-4163-ad18-e7bdf71e4bef. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:47:34 user nova-compute[71113]: DEBUG nova.network.neutron [req-84276ddd-6ad3-4bd0-a7fa-2c1a748bd491 req-fd6e1990-1df5-44ac-8e45-4b9c47e6ac68 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Updating instance_info_cache with network_info: [{"id": "370dc7b8-8a77-47e4-94b9-ae9be9d1de13", "address": "fa:16:3e:7b:6a:0d", "network": {"id": "9e762abf-a299-49e7-b276-0fa226649bb9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1384573536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap370dc7b8-8a", "ovs_interfaceid": "370dc7b8-8a77-47e4-94b9-ae9be9d1de13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e64b39b1-bdfc-4e38-9520-8bf02c8427a4", "address": "fa:16:3e:0d:7e:fd", "network": {"id": "f7c9bb5d-84df-44c3-a496-20d634727c3c", "bridge": "br-int", "label": "tempest-device-tagging-net1-420856970", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape64b39b1-bd", "ovs_interfaceid": "e64b39b1-bdfc-4e38-9520-8bf02c8427a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3a0920cd-a09e-4a83-adcd-098a71e98229", "address": "fa:16:3e:8b:9b:9f", "network": {"id": "f7c9bb5d-84df-44c3-a496-20d634727c3c", "bridge": "br-int", "label": "tempest-device-tagging-net1-420856970", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a0920cd-a0", "ovs_interfaceid": "3a0920cd-a09e-4a83-adcd-098a71e98229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "79461167-7380-4b36-ac54-b58585f55c20", "address": "fa:16:3e:51:a4:07", "network": {"id": "f7c9bb5d-84df-44c3-a496-20d634727c3c", "bridge": "br-int", "label": "tempest-device-tagging-net1-420856970", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79461167-73", "ovs_interfaceid": "79461167-7380-4b36-ac54-b58585f55c20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dc38d490-4eb0-496c-817d-639264048797", "address": "fa:16:3e:92:54:8b", "network": {"id": "f7c9bb5d-84df-44c3-a496-20d634727c3c", "bridge": "br-int", "label": "tempest-device-tagging-net1-420856970", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc38d490-4e", "ovs_interfaceid": "dc38d490-4eb0-496c-817d-639264048797", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c60ea5a4-1214-4163-ad18-e7bdf71e4bef", "address": "fa:16:3e:ab:70:c1", "network": {"id": "bb2db53e-eed4-44e7-9510-eab184de68f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-411965443", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60ea5a4-12", "ovs_interfaceid": "c60ea5a4-1214-4163-ad18-e7bdf71e4bef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f998018e-386d-4444-9712-9eb57b025198", "address": "fa:16:3e:97:88:64", "network": {"id": "bb2db53e-eed4-44e7-9510-eab184de68f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-411965443", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf998018e-38", "ovs_interfaceid": "f998018e-386d-4444-9712-9eb57b025198", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:47:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-84276ddd-6ad3-4bd0-a7fa-2c1a748bd491 req-fd6e1990-1df5-44ac-8e45-4b9c47e6ac68 service nova] Releasing lock "refresh_cache-3aaaef96-76f8-4088-a0bc-a1a72e80652e" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:47:34 user nova-compute[71113]: DEBUG nova.compute.manager [req-84276ddd-6ad3-4bd0-a7fa-2c1a748bd491 req-fd6e1990-1df5-44ac-8e45-4b9c47e6ac68 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received event network-changed-f998018e-386d-4444-9712-9eb57b025198 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:47:34 user nova-compute[71113]: DEBUG nova.compute.manager [req-84276ddd-6ad3-4bd0-a7fa-2c1a748bd491 req-fd6e1990-1df5-44ac-8e45-4b9c47e6ac68 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Refreshing instance network info cache due to event network-changed-f998018e-386d-4444-9712-9eb57b025198. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:47:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-84276ddd-6ad3-4bd0-a7fa-2c1a748bd491 req-fd6e1990-1df5-44ac-8e45-4b9c47e6ac68 service nova] Acquiring lock "refresh_cache-3aaaef96-76f8-4088-a0bc-a1a72e80652e" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:47:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-84276ddd-6ad3-4bd0-a7fa-2c1a748bd491 req-fd6e1990-1df5-44ac-8e45-4b9c47e6ac68 service nova] Acquired lock "refresh_cache-3aaaef96-76f8-4088-a0bc-a1a72e80652e" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:47:34 user nova-compute[71113]: DEBUG nova.network.neutron [req-84276ddd-6ad3-4bd0-a7fa-2c1a748bd491 req-fd6e1990-1df5-44ac-8e45-4b9c47e6ac68 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Refreshing network info cache for port f998018e-386d-4444-9712-9eb57b025198 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:47:35 user nova-compute[71113]: DEBUG nova.network.neutron [req-84276ddd-6ad3-4bd0-a7fa-2c1a748bd491 req-fd6e1990-1df5-44ac-8e45-4b9c47e6ac68 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Updated VIF entry in instance network info cache for port f998018e-386d-4444-9712-9eb57b025198. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:47:35 user nova-compute[71113]: DEBUG nova.network.neutron [req-84276ddd-6ad3-4bd0-a7fa-2c1a748bd491 req-fd6e1990-1df5-44ac-8e45-4b9c47e6ac68 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Updating instance_info_cache with network_info: [{"id": "370dc7b8-8a77-47e4-94b9-ae9be9d1de13", "address": "fa:16:3e:7b:6a:0d", "network": {"id": "9e762abf-a299-49e7-b276-0fa226649bb9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1384573536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap370dc7b8-8a", "ovs_interfaceid": "370dc7b8-8a77-47e4-94b9-ae9be9d1de13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e64b39b1-bdfc-4e38-9520-8bf02c8427a4", "address": "fa:16:3e:0d:7e:fd", "network": {"id": "f7c9bb5d-84df-44c3-a496-20d634727c3c", "bridge": "br-int", "label": "tempest-device-tagging-net1-420856970", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape64b39b1-bd", "ovs_interfaceid": "e64b39b1-bdfc-4e38-9520-8bf02c8427a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3a0920cd-a09e-4a83-adcd-098a71e98229", "address": "fa:16:3e:8b:9b:9f", "network": {"id": "f7c9bb5d-84df-44c3-a496-20d634727c3c", "bridge": "br-int", "label": "tempest-device-tagging-net1-420856970", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a0920cd-a0", "ovs_interfaceid": "3a0920cd-a09e-4a83-adcd-098a71e98229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "79461167-7380-4b36-ac54-b58585f55c20", "address": "fa:16:3e:51:a4:07", "network": {"id": "f7c9bb5d-84df-44c3-a496-20d634727c3c", "bridge": "br-int", "label": "tempest-device-tagging-net1-420856970", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79461167-73", "ovs_interfaceid": "79461167-7380-4b36-ac54-b58585f55c20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dc38d490-4eb0-496c-817d-639264048797", "address": "fa:16:3e:92:54:8b", "network": {"id": "f7c9bb5d-84df-44c3-a496-20d634727c3c", "bridge": "br-int", "label": "tempest-device-tagging-net1-420856970", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc38d490-4e", "ovs_interfaceid": "dc38d490-4eb0-496c-817d-639264048797", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c60ea5a4-1214-4163-ad18-e7bdf71e4bef", "address": "fa:16:3e:ab:70:c1", "network": {"id": "bb2db53e-eed4-44e7-9510-eab184de68f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-411965443", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60ea5a4-12", "ovs_interfaceid": "c60ea5a4-1214-4163-ad18-e7bdf71e4bef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f998018e-386d-4444-9712-9eb57b025198", "address": "fa:16:3e:97:88:64", "network": {"id": "bb2db53e-eed4-44e7-9510-eab184de68f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-411965443", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf998018e-38", "ovs_interfaceid": "f998018e-386d-4444-9712-9eb57b025198", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:47:35 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-84276ddd-6ad3-4bd0-a7fa-2c1a748bd491 req-fd6e1990-1df5-44ac-8e45-4b9c47e6ac68 service nova] Releasing lock "refresh_cache-3aaaef96-76f8-4088-a0bc-a1a72e80652e" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:47:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:38 user nova-compute[71113]: INFO nova.virt.block_device [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Booting with volume ab8a5e88-17f8-4128-abbe-211ec120be61 at /dev/vdc
Jul 31 09:47:38 user nova-compute[71113]: DEBUG os_brick.utils [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:47:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:38 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7e967f-4642-4fc3-a525-b63adbb53042]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:47:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:38 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c26435-23d5-4448-9502-01598663f7ad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:47:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:38 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1906cc-9846-41dc-bc00-099d008f2a01]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:47:38 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd27175d-8d04-40cc-b9b4-e2e90739bce8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:47:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:47:38 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 09:47:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:38 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:47:38 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 09:47:38 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2749ae-f3b4-485f-aa95-e7ffc37bf3eb]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:47:38 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 09:47:38 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 09:47:38 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 09:47:38 user nova-compute[71113]: DEBUG os_brick.utils [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:47:38 user nova-compute[71113]: DEBUG nova.virt.block_device [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Updating existing volume attachment record: 4aa1da78-e70e-4c7b-95d6-efdd9bbb91ef {{(pid=71113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 09:47:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG nova.compute.manager [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Start spawning the instance on the hypervisor. {{(pid=71113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 09:47:46 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Creating image(s)
Jul 31 09:47:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Did not create local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Ensure instance console log exists: /opt/stack/data/nova/instances/3aaaef96-76f8-4088-a0bc-a1a72e80652e/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Start _get_guest_xml network_info=[{"id": "370dc7b8-8a77-47e4-94b9-ae9be9d1de13", "address": "fa:16:3e:7b:6a:0d", "network": {"id": "9e762abf-a299-49e7-b276-0fa226649bb9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1384573536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap370dc7b8-8a", "ovs_interfaceid": "370dc7b8-8a77-47e4-94b9-ae9be9d1de13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e64b39b1-bdfc-4e38-9520-8bf02c8427a4", "address": "fa:16:3e:0d:7e:fd", "network": {"id": "f7c9bb5d-84df-44c3-a496-20d634727c3c", "bridge": "br-int", "label": "tempest-device-tagging-net1-420856970", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape64b39b1-bd", "ovs_interfaceid": "e64b39b1-bdfc-4e38-9520-8bf02c8427a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3a0920cd-a09e-4a83-adcd-098a71e98229", "address": "fa:16:3e:8b:9b:9f", "network": {"id": "f7c9bb5d-84df-44c3-a496-20d634727c3c", "bridge": "br-int", "label": "tempest-device-tagging-net1-420856970", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a0920cd-a0", "ovs_interfaceid": "3a0920cd-a09e-4a83-adcd-098a71e98229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "79461167-7380-4b36-ac54-b58585f55c20", "address": "fa:16:3e:51:a4:07", "network": {"id": "f7c9bb5d-84df-44c3-a496-20d634727c3c", "bridge": "br-int", "label": "tempest-device-tagging-net1-420856970", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79461167-73", "ovs_interfaceid": "79461167-7380-4b36-ac54-b58585f55c20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dc38d490-4eb0-496c-817d-639264048797", "address": "fa:16:3e:92:54:8b", "network": {"id": "f7c9bb5d-84df-44c3-a496-20d634727c3c", "bridge": "br-int", "label": "tempest-device-tagging-net1-420856970", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc38d490-4e", "ovs_interfaceid": "dc38d490-4eb0-496c-817d-639264048797", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c60ea5a4-1214-4163-ad18-e7bdf71e4bef", "address": "fa:16:3e:ab:70:c1", "network": {"id": "bb2db53e-eed4-44e7-9510-eab184de68f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-411965443", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60ea5a4-12", "ovs_interfaceid": "c60ea5a4-1214-4163-ad18-e7bdf71e4bef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f998018e-386d-4444-9712-9eb57b025198", "address": "fa:16:3e:97:88:64", "network": {"id": "bb2db53e-eed4-44e7-9510-eab184de68f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-411965443", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf998018e-38", "ovs_interfaceid": "f998018e-386d-4444-9712-9eb57b025198", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '7d512bb1-2eb1-4222-b0e8-4dc1e06ba989', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UArGijqH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3aaaef96-76f8-4088-a0bc-a1a72e80652e', 'attached_at': '', 'detached_at': '', 'volume_id': 'a69daa37-ae46-4518-bb27-5b57f6e06288', 'serial': 'a69daa37-ae46-4518-bb27-5b57f6e06288'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None}, {'attachment_id': 'c4e10620-d277-4713-b172-49871c944c1d', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AQBdsZGX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3aaaef96-76f8-4088-a0bc-a1a72e80652e', 'attached_at': '', 'detached_at': '', 'volume_id': 'f51b00bb-6a76-4ed9-bb8f-e6c91340b321', 'serial': 'f51b00bb-6a76-4ed9-bb8f-e6c91340b321'}, 'boot_index': 1, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None}, {'attachment_id': '4aa1da78-e70e-4c7b-95d6-efdd9bbb91ef', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dDJreMHI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3aaaef96-76f8-4088-a0bc-a1a72e80652e', 'attached_at': '', 'detached_at': '', 'volume_id': 'ab8a5e88-17f8-4128-abbe-211ec120be61', 'serial': 'ab8a5e88-17f8-4128-abbe-211ec120be61'}, 'boot_index': 2, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 09:47:46 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:47:46 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:47:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG os_brick.initiator.connector [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Factory for ISCSI on None {{(pid=71113) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UArGijqH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:47:46 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:47:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:47:46 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:47:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:47:46 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 09:47:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfb50f5-f2da-478e-bc2d-4a84c77b9c49]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 09:47:46 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac35bea-6049-45d2-b78c-61123bed4239]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288] added
Jul 31 09:47:46 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2769df-ad01-4094-914b-36cc4003f246]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[509e94c8-c8f4-4117-985a-40107a271aea]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UArGijqH {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UArGijqH" returned: 0 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ddd48f5-846a-489a-8079-f9564d78099b]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UArGijqH'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c413c4d8-4253-4e6d-8175-47eba07e95d2]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3d1123-fde0-42c9-a036-b985c878b9b1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 31 09:47:46 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 31 09:47:46 user nova-compute[71113]:  {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:47:46 user nova-compute[71113]: WARNING os_brick.initiator.connectors.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 31 09:47:46 user nova-compute[71113]: 
Jul 31 09:47:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9c85f0-47f9-4e43-9a90-81254bbb480e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288, portal: 172.16.0.220,3260]
Jul 31 09:47:46 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288, portal: 172.16.0.220,3260] successful.
Jul 31 09:47:46 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea6e2f1-4152-4f78-ae41-9f0141d01bc2]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[075b6574-13ef-4759-8ac7-1b67b267a4a9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)
Jul 31 09:47:46 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)
Jul 31 09:47:46 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea782bb-236d-4e07-bc70-009b29b66806]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 09:47:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UArGijqH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 09:47:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:47 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:47:47 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23830663135613164', 'path': '/dev/sdb'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:47:47 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830663135613164', 'path': '/dev/sdb'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 09:47:47 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 09:47:47 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AQBdsZGX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:47:47 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:47:47 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:47:47 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:47:47 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:47:47 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:47:47 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:47:47 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 09:47:47 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:47 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:47 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[548d732b-3b8e-4547-bbe9-22937076a7c5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:47:47 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 09:47:47 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:47:47 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:47 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:47 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f284645-de9e-4dab-ac53-f2585cc68f3a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:47:47 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321] added
Jul 31 09:47:47 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:47:47 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:47 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:47 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d094a2a9-24e1-42ca-a89a-8e729cea468e]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:47:47 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:47:47 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:48 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba11b582-ce11-4d3d-b7ba-70b42ff27502]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:47:48 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:47:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AQBdsZGX {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AQBdsZGX" returned: 0 in 0.026s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:48 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8730d458-c1b8-4509-9d34-bdf3ae2a460d]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:47:48 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AQBdsZGX'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:47:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:48 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[70833adc-fbc3-4155-a334-101aa7965b80]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:47:48 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:47:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:48 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d54164b-9862-4db1-99df-8258d7495ecf]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:47:48 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)
Jul 31 09:47:48 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:47:48 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)
Jul 31 09:47:48 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:47:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:48 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d797afe-8be8-4145-a5bd-5cd37c3524b4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:47:48 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321, portal: 172.16.0.220,3260]
Jul 31 09:47:48 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321, portal: 172.16.0.220,3260] successful.
Jul 31 09:47:48 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:47:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:48 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3538157e-9cf3-4e58-af81-dea9802d29e3]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:47:48 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:47:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:48 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f386a7f9-37b0-4cdd-ba88-25a2c8539de0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:47:48 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)
Jul 31 09:47:48 user nova-compute[71113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)
Jul 31 09:47:48 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:47:48 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)
Jul 31 09:47:48 user nova-compute[71113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)
Jul 31 09:47:48 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:47:48 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:47:48 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 09:47:48 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 09:47:48 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 09:47:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:48 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1ea111-c55a-4de0-9495-6b155c1323b0]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:47:48 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 09:47:48 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AQBdsZGX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23361363638303062', 'path': '/dev/sdc'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23361363638303062', 'path': '/dev/sdc'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dDJreMHI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:47:49 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:47:49 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:47:49 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:47:49 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:47:49 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 09:47:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb52527-f3d2-4af4-8525-2ae30215ba92]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 09:47:49 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3accf52a-eba0-4697-9d2d-e701bdd4aab1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61] added
Jul 31 09:47:49 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6943a61e-aba9-4518-b31c-3b7ad1d9da88]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2256777-3413-42f3-ad76-ad230bba55cf]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dDJreMHI {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dDJreMHI" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e75c25-6c78-4c5d-8a7f-a5703e35654d]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dDJreMHI'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[993ba1ec-80ca-47f4-9b7f-eedd5de6ee08]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a05464c-864f-4efe-aaf5-e11ade36cc00]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)
Jul 31 09:47:49 user nova-compute[71113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)
Jul 31 09:47:49 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)
Jul 31 09:47:49 user nova-compute[71113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)
Jul 31 09:47:49 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[95dc5128-bdd1-4afe-8b4d-2d9d355b9ad2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61, portal: 172.16.0.220,3260]
Jul 31 09:47:49 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61, portal: 172.16.0.220,3260] successful.
Jul 31 09:47:49 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa86a497-41d8-4f9b-b8b4-395384cbe726]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4413d15b-14ae-4471-92de-c250c130b199]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)
Jul 31 09:47:49 user nova-compute[71113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)
Jul 31 09:47:49 user nova-compute[71113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)
Jul 31 09:47:49 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)
Jul 31 09:47:49 user nova-compute[71113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)
Jul 31 09:47:49 user nova-compute[71113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)
Jul 31 09:47:49 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1b5f98-9a6f-4e61-8184-df16f3cd60cf]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 09:47:49 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dDJreMHI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23961616533633838', 'path': '/dev/sdd'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961616533633838', 'path': '/dev/sdd'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T09:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2136690925',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2136690925',id=9,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK37xL1BAMkSaHD27/dclDrDquKxGSbRz4om1spfqNUqYMogTIgM2NduHLjCNONc4OJfQWmM6xekLwEzzN15WwLbkZLHNz1raY0ZMpW2iVvvb6iQ47za56ehfKCbzjCDMw==',key_name='tempest-keypair-1445988611',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='219e950d6a5141ef93bd970e5c1d3805',ramdisk_id='',reservation_id='r-ll7h8n2p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-730691933',owner_user_name='tempest-TaggedBootDevicesTest_v242-730691933-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:47:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8f072d506b141dc92dddb9dc6348f72',uuid=3aaaef96-76f8-4088-a0bc-a1a72e80652e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "370dc7b8-8a77-47e4-94b9-ae9be9d1de13", "address": "fa:16:3e:7b:6a:0d", "network": {"id": "9e762abf-a299-49e7-b276-0fa226649bb9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1384573536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap370dc7b8-8a", "ovs_interfaceid": "370dc7b8-8a77-47e4-94b9-ae9be9d1de13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Converting VIF {"id": "370dc7b8-8a77-47e4-94b9-ae9be9d1de13", "address": "fa:16:3e:7b:6a:0d", "network": {"id": "9e762abf-a299-49e7-b276-0fa226649bb9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1384573536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap370dc7b8-8a", "ovs_interfaceid": "370dc7b8-8a77-47e4-94b9-ae9be9d1de13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:6a:0d,bridge_name='br-int',has_traffic_filtering=True,id=370dc7b8-8a77-47e4-94b9-ae9be9d1de13,network=Network(9e762abf-a299-49e7-b276-0fa226649bb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap370dc7b8-8a') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T09:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2136690925',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2136690925',id=9,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK37xL1BAMkSaHD27/dclDrDquKxGSbRz4om1spfqNUqYMogTIgM2NduHLjCNONc4OJfQWmM6xekLwEzzN15WwLbkZLHNz1raY0ZMpW2iVvvb6iQ47za56ehfKCbzjCDMw==',key_name='tempest-keypair-1445988611',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='219e950d6a5141ef93bd970e5c1d3805',ramdisk_id='',reservation_id='r-ll7h8n2p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-730691933',owner_user_name='tempest-TaggedBootDevicesTest_v242-730691933-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:47:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8f072d506b141dc92dddb9dc6348f72',uuid=3aaaef96-76f8-4088-a0bc-a1a72e80652e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e64b39b1-bdfc-4e38-9520-8bf02c8427a4", "address": "fa:16:3e:0d:7e:fd", "network": {"id": "f7c9bb5d-84df-44c3-a496-20d634727c3c", "bridge": "br-int", "label": "tempest-device-tagging-net1-420856970", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape64b39b1-bd", "ovs_interfaceid": "e64b39b1-bdfc-4e38-9520-8bf02c8427a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Converting VIF {"id": "e64b39b1-bdfc-4e38-9520-8bf02c8427a4", "address": "fa:16:3e:0d:7e:fd", "network": {"id": "f7c9bb5d-84df-44c3-a496-20d634727c3c", "bridge": "br-int", "label": "tempest-device-tagging-net1-420856970", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape64b39b1-bd", "ovs_interfaceid": "e64b39b1-bdfc-4e38-9520-8bf02c8427a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:7e:fd,bridge_name='br-int',has_traffic_filtering=True,id=e64b39b1-bdfc-4e38-9520-8bf02c8427a4,network=Network(f7c9bb5d-84df-44c3-a496-20d634727c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape64b39b1-bd') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T09:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2136690925',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2136690925',id=9,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK37xL1BAMkSaHD27/dclDrDquKxGSbRz4om1spfqNUqYMogTIgM2NduHLjCNONc4OJfQWmM6xekLwEzzN15WwLbkZLHNz1raY0ZMpW2iVvvb6iQ47za56ehfKCbzjCDMw==',key_name='tempest-keypair-1445988611',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='219e950d6a5141ef93bd970e5c1d3805',ramdisk_id='',reservation_id='r-ll7h8n2p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-730691933',owner_user_name='tempest-TaggedBootDevicesTest_v242-730691933-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:47:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8f072d506b141dc92dddb9dc6348f72',uuid=3aaaef96-76f8-4088-a0bc-a1a72e80652e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a0920cd-a09e-4a83-adcd-098a71e98229", "address": "fa:16:3e:8b:9b:9f", "network": {"id": "f7c9bb5d-84df-44c3-a496-20d634727c3c", "bridge": "br-int", "label": "tempest-device-tagging-net1-420856970", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a0920cd-a0", "ovs_interfaceid": "3a0920cd-a09e-4a83-adcd-098a71e98229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Converting VIF {"id": "3a0920cd-a09e-4a83-adcd-098a71e98229", "address": "fa:16:3e:8b:9b:9f", "network": {"id": "f7c9bb5d-84df-44c3-a496-20d634727c3c", "bridge": "br-int", "label": "tempest-device-tagging-net1-420856970", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a0920cd-a0", "ovs_interfaceid": "3a0920cd-a09e-4a83-adcd-098a71e98229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:9b:9f,bridge_name='br-int',has_traffic_filtering=True,id=3a0920cd-a09e-4a83-adcd-098a71e98229,network=Network(f7c9bb5d-84df-44c3-a496-20d634727c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3a0920cd-a0') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T09:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2136690925',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2136690925',id=9,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK37xL1BAMkSaHD27/dclDrDquKxGSbRz4om1spfqNUqYMogTIgM2NduHLjCNONc4OJfQWmM6xekLwEzzN15WwLbkZLHNz1raY0ZMpW2iVvvb6iQ47za56ehfKCbzjCDMw==',key_name='tempest-keypair-1445988611',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='219e950d6a5141ef93bd970e5c1d3805',ramdisk_id='',reservation_id='r-ll7h8n2p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-730691933',owner_user_name='tempest-TaggedBootDevicesTest_v242-730691933-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:47:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8f072d506b141dc92dddb9dc6348f72',uuid=3aaaef96-76f8-4088-a0bc-a1a72e80652e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79461167-7380-4b36-ac54-b58585f55c20", "address": "fa:16:3e:51:a4:07", "network": {"id": "f7c9bb5d-84df-44c3-a496-20d634727c3c", "bridge": "br-int", "label": "tempest-device-tagging-net1-420856970", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79461167-73", "ovs_interfaceid": "79461167-7380-4b36-ac54-b58585f55c20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Converting VIF {"id": "79461167-7380-4b36-ac54-b58585f55c20", "address": "fa:16:3e:51:a4:07", "network": {"id": "f7c9bb5d-84df-44c3-a496-20d634727c3c", "bridge": "br-int", "label": "tempest-device-tagging-net1-420856970", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79461167-73", "ovs_interfaceid": "79461167-7380-4b36-ac54-b58585f55c20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:a4:07,bridge_name='br-int',has_traffic_filtering=True,id=79461167-7380-4b36-ac54-b58585f55c20,network=Network(f7c9bb5d-84df-44c3-a496-20d634727c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79461167-73') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T09:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2136690925',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2136690925',id=9,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK37xL1BAMkSaHD27/dclDrDquKxGSbRz4om1spfqNUqYMogTIgM2NduHLjCNONc4OJfQWmM6xekLwEzzN15WwLbkZLHNz1raY0ZMpW2iVvvb6iQ47za56ehfKCbzjCDMw==',key_name='tempest-keypair-1445988611',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='219e950d6a5141ef93bd970e5c1d3805',ramdisk_id='',reservation_id='r-ll7h8n2p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-730691933',owner_user_name='tempest-TaggedBootDevicesTest_v242-730691933-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:47:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8f072d506b141dc92dddb9dc6348f72',uuid=3aaaef96-76f8-4088-a0bc-a1a72e80652e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc38d490-4eb0-496c-817d-639264048797", "address": "fa:16:3e:92:54:8b", "network": {"id": "f7c9bb5d-84df-44c3-a496-20d634727c3c", "bridge": "br-int", "label": "tempest-device-tagging-net1-420856970", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc38d490-4e", "ovs_interfaceid": "dc38d490-4eb0-496c-817d-639264048797", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Converting VIF {"id": "dc38d490-4eb0-496c-817d-639264048797", "address": "fa:16:3e:92:54:8b", "network": {"id": "f7c9bb5d-84df-44c3-a496-20d634727c3c", "bridge": "br-int", "label": "tempest-device-tagging-net1-420856970", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc38d490-4e", "ovs_interfaceid": "dc38d490-4eb0-496c-817d-639264048797", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:54:8b,bridge_name='br-int',has_traffic_filtering=True,id=dc38d490-4eb0-496c-817d-639264048797,network=Network(f7c9bb5d-84df-44c3-a496-20d634727c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc38d490-4e') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T09:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2136690925',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2136690925',id=9,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK37xL1BAMkSaHD27/dclDrDquKxGSbRz4om1spfqNUqYMogTIgM2NduHLjCNONc4OJfQWmM6xekLwEzzN15WwLbkZLHNz1raY0ZMpW2iVvvb6iQ47za56ehfKCbzjCDMw==',key_name='tempest-keypair-1445988611',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='219e950d6a5141ef93bd970e5c1d3805',ramdisk_id='',reservation_id='r-ll7h8n2p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-730691933',owner_user_name='tempest-TaggedBootDevicesTest_v242-730691933-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:47:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8f072d506b141dc92dddb9dc6348f72',uuid=3aaaef96-76f8-4088-a0bc-a1a72e80652e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c60ea5a4-1214-4163-ad18-e7bdf71e4bef", "address": "fa:16:3e:ab:70:c1", "network": {"id": "bb2db53e-eed4-44e7-9510-eab184de68f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-411965443", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60ea5a4-12", "ovs_interfaceid": "c60ea5a4-1214-4163-ad18-e7bdf71e4bef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Converting VIF {"id": "c60ea5a4-1214-4163-ad18-e7bdf71e4bef", "address": "fa:16:3e:ab:70:c1", "network": {"id": "bb2db53e-eed4-44e7-9510-eab184de68f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-411965443", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60ea5a4-12", "ovs_interfaceid": "c60ea5a4-1214-4163-ad18-e7bdf71e4bef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:70:c1,bridge_name='br-int',has_traffic_filtering=True,id=c60ea5a4-1214-4163-ad18-e7bdf71e4bef,network=Network(bb2db53e-eed4-44e7-9510-eab184de68f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc60ea5a4-12') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T09:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2136690925',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2136690925',id=9,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK37xL1BAMkSaHD27/dclDrDquKxGSbRz4om1spfqNUqYMogTIgM2NduHLjCNONc4OJfQWmM6xekLwEzzN15WwLbkZLHNz1raY0ZMpW2iVvvb6iQ47za56ehfKCbzjCDMw==',key_name='tempest-keypair-1445988611',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='219e950d6a5141ef93bd970e5c1d3805',ramdisk_id='',reservation_id='r-ll7h8n2p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-730691933',owner_user_name='tempest-TaggedBootDevicesTest_v242-730691933-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:47:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8f072d506b141dc92dddb9dc6348f72',uuid=3aaaef96-76f8-4088-a0bc-a1a72e80652e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f998018e-386d-4444-9712-9eb57b025198", "address": "fa:16:3e:97:88:64", "network": {"id": "bb2db53e-eed4-44e7-9510-eab184de68f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-411965443", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf998018e-38", "ovs_interfaceid": "f998018e-386d-4444-9712-9eb57b025198", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Converting VIF {"id": "f998018e-386d-4444-9712-9eb57b025198", "address": "fa:16:3e:97:88:64", "network": {"id": "bb2db53e-eed4-44e7-9510-eab184de68f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-411965443", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf998018e-38", "ovs_interfaceid": "f998018e-386d-4444-9712-9eb57b025198", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:88:64,bridge_name='br-int',has_traffic_filtering=True,id=f998018e-386d-4444-9712-9eb57b025198,network=Network(bb2db53e-eed4-44e7-9510-eab184de68f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf998018e-38') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG nova.objects.instance [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Lazy-loading 'pci_devices' on Instance uuid 3aaaef96-76f8-4088-a0bc-a1a72e80652e {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] End _get_guest_xml xml=<domain type="kvm">
Jul 31 09:47:50 user nova-compute[71113]:   <uuid>3aaaef96-76f8-4088-a0bc-a1a72e80652e</uuid>
Jul 31 09:47:50 user nova-compute[71113]:   <name>instance-00000009</name>
Jul 31 09:47:50 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 09:47:50 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 09:47:50 user nova-compute[71113]:   <metadata>
Jul 31 09:47:50 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 09:47:50 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 09:47:50 user nova-compute[71113]:       <nova:name>tempest-device-tagging-server-2136690925</nova:name>
Jul 31 09:47:50 user nova-compute[71113]:       <nova:creationTime>2023-07-31 09:47:46</nova:creationTime>
Jul 31 09:47:50 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 09:47:50 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 09:47:50 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 09:47:50 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 09:47:50 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 09:47:50 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 09:47:50 user nova-compute[71113]:       </nova:flavor>
Jul 31 09:47:50 user nova-compute[71113]:       <nova:owner>
Jul 31 09:47:50 user nova-compute[71113]:         <nova:user uuid="f8f072d506b141dc92dddb9dc6348f72">tempest-TaggedBootDevicesTest_v242-730691933-project-member</nova:user>
Jul 31 09:47:50 user nova-compute[71113]:         <nova:project uuid="219e950d6a5141ef93bd970e5c1d3805">tempest-TaggedBootDevicesTest_v242-730691933</nova:project>
Jul 31 09:47:50 user nova-compute[71113]:       </nova:owner>
Jul 31 09:47:50 user nova-compute[71113]:       <nova:root type="image" uuid="078646fe-b504-41ed-a147-61072e903e51"/>
Jul 31 09:47:50 user nova-compute[71113]:       <nova:ports>
Jul 31 09:47:50 user nova-compute[71113]:         <nova:port uuid="370dc7b8-8a77-47e4-94b9-ae9be9d1de13">
Jul 31 09:47:50 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 31 09:47:50 user nova-compute[71113]:         </nova:port>
Jul 31 09:47:50 user nova-compute[71113]:         <nova:port uuid="e64b39b1-bdfc-4e38-9520-8bf02c8427a4">
Jul 31 09:47:50 user nova-compute[71113]:           <nova:ip type="fixed" address="10.1.1.155" ipVersion="4"/>
Jul 31 09:47:50 user nova-compute[71113]:         </nova:port>
Jul 31 09:47:50 user nova-compute[71113]:         <nova:port uuid="3a0920cd-a09e-4a83-adcd-098a71e98229">
Jul 31 09:47:50 user nova-compute[71113]:           <nova:ip type="fixed" address="10.1.1.117" ipVersion="4"/>
Jul 31 09:47:50 user nova-compute[71113]:         </nova:port>
Jul 31 09:47:50 user nova-compute[71113]:         <nova:port uuid="79461167-7380-4b36-ac54-b58585f55c20">
Jul 31 09:47:50 user nova-compute[71113]:           <nova:ip type="fixed" address="10.1.1.207" ipVersion="4"/>
Jul 31 09:47:50 user nova-compute[71113]:         </nova:port>
Jul 31 09:47:50 user nova-compute[71113]:         <nova:port uuid="dc38d490-4eb0-496c-817d-639264048797">
Jul 31 09:47:50 user nova-compute[71113]:           <nova:ip type="fixed" address="10.1.1.246" ipVersion="4"/>
Jul 31 09:47:50 user nova-compute[71113]:         </nova:port>
Jul 31 09:47:50 user nova-compute[71113]:         <nova:port uuid="c60ea5a4-1214-4163-ad18-e7bdf71e4bef">
Jul 31 09:47:50 user nova-compute[71113]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Jul 31 09:47:50 user nova-compute[71113]:         </nova:port>
Jul 31 09:47:50 user nova-compute[71113]:         <nova:port uuid="f998018e-386d-4444-9712-9eb57b025198">
Jul 31 09:47:50 user nova-compute[71113]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Jul 31 09:47:50 user nova-compute[71113]:         </nova:port>
Jul 31 09:47:50 user nova-compute[71113]:       </nova:ports>
Jul 31 09:47:50 user nova-compute[71113]:     </nova:instance>
Jul 31 09:47:50 user nova-compute[71113]:   </metadata>
Jul 31 09:47:50 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 09:47:50 user nova-compute[71113]:     <system>
Jul 31 09:47:50 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 09:47:50 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 09:47:50 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 09:47:50 user nova-compute[71113]:       <entry name="serial">3aaaef96-76f8-4088-a0bc-a1a72e80652e</entry>
Jul 31 09:47:50 user nova-compute[71113]:       <entry name="uuid">3aaaef96-76f8-4088-a0bc-a1a72e80652e</entry>
Jul 31 09:47:50 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 09:47:50 user nova-compute[71113]:     </system>
Jul 31 09:47:50 user nova-compute[71113]:   </sysinfo>
Jul 31 09:47:50 user nova-compute[71113]:   <os>
Jul 31 09:47:50 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 09:47:50 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 09:47:50 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 09:47:50 user nova-compute[71113]:   </os>
Jul 31 09:47:50 user nova-compute[71113]:   <features>
Jul 31 09:47:50 user nova-compute[71113]:     <acpi/>
Jul 31 09:47:50 user nova-compute[71113]:     <apic/>
Jul 31 09:47:50 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 09:47:50 user nova-compute[71113]:   </features>
Jul 31 09:47:50 user nova-compute[71113]:   <clock offset="utc">
Jul 31 09:47:50 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 09:47:50 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 09:47:50 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 09:47:50 user nova-compute[71113]:   </clock>
Jul 31 09:47:50 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 09:47:50 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 09:47:50 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 09:47:50 user nova-compute[71113]:   </cpu>
Jul 31 09:47:50 user nova-compute[71113]:   <devices>
Jul 31 09:47:50 user nova-compute[71113]:     <disk type="file" device="cdrom">
Jul 31 09:47:50 user nova-compute[71113]:       <driver name="qemu" type="raw" cache="none"/>
Jul 31 09:47:50 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/3aaaef96-76f8-4088-a0bc-a1a72e80652e/disk.config"/>
Jul 31 09:47:50 user nova-compute[71113]:       <target dev="hda" bus="ide"/>
Jul 31 09:47:50 user nova-compute[71113]:     </disk>
Jul 31 09:47:50 user nova-compute[71113]:     <disk type="block" device="disk">
Jul 31 09:47:50 user nova-compute[71113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:47:50 user nova-compute[71113]:       <source dev="/dev/sdb"/>
Jul 31 09:47:50 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 09:47:50 user nova-compute[71113]:       <serial>a69daa37-ae46-4518-bb27-5b57f6e06288</serial>
Jul 31 09:47:50 user nova-compute[71113]:     </disk>
Jul 31 09:47:50 user nova-compute[71113]:     <disk type="block" device="disk">
Jul 31 09:47:50 user nova-compute[71113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:47:50 user nova-compute[71113]:       <source dev="/dev/sdc"/>
Jul 31 09:47:50 user nova-compute[71113]:       <target dev="vdb" bus="virtio"/>
Jul 31 09:47:50 user nova-compute[71113]:       <serial>f51b00bb-6a76-4ed9-bb8f-e6c91340b321</serial>
Jul 31 09:47:50 user nova-compute[71113]:     </disk>
Jul 31 09:47:50 user nova-compute[71113]:     <disk type="block" device="disk">
Jul 31 09:47:50 user nova-compute[71113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:47:50 user nova-compute[71113]:       <source dev="/dev/sdd"/>
Jul 31 09:47:50 user nova-compute[71113]:       <target dev="vdc" bus="virtio"/>
Jul 31 09:47:50 user nova-compute[71113]:       <serial>ab8a5e88-17f8-4128-abbe-211ec120be61</serial>
Jul 31 09:47:50 user nova-compute[71113]:     </disk>
Jul 31 09:47:50 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 09:47:50 user nova-compute[71113]:       <mac address="fa:16:3e:7b:6a:0d"/>
Jul 31 09:47:50 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:47:50 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 09:47:50 user nova-compute[71113]:       <target dev="tap370dc7b8-8a"/>
Jul 31 09:47:50 user nova-compute[71113]:     </interface>
Jul 31 09:47:50 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 09:47:50 user nova-compute[71113]:       <mac address="fa:16:3e:0d:7e:fd"/>
Jul 31 09:47:50 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:47:50 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 09:47:50 user nova-compute[71113]:       <target dev="tape64b39b1-bd"/>
Jul 31 09:47:50 user nova-compute[71113]:     </interface>
Jul 31 09:47:50 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 09:47:50 user nova-compute[71113]:       <mac address="fa:16:3e:8b:9b:9f"/>
Jul 31 09:47:50 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:47:50 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 09:47:50 user nova-compute[71113]:       <target dev="tap3a0920cd-a0"/>
Jul 31 09:47:50 user nova-compute[71113]:     </interface>
Jul 31 09:47:50 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 09:47:50 user nova-compute[71113]:       <mac address="fa:16:3e:51:a4:07"/>
Jul 31 09:47:50 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:47:50 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 09:47:50 user nova-compute[71113]:       <target dev="tap79461167-73"/>
Jul 31 09:47:50 user nova-compute[71113]:     </interface>
Jul 31 09:47:50 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 09:47:50 user nova-compute[71113]:       <mac address="fa:16:3e:92:54:8b"/>
Jul 31 09:47:50 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:47:50 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 09:47:50 user nova-compute[71113]:       <target dev="tapdc38d490-4e"/>
Jul 31 09:47:50 user nova-compute[71113]:     </interface>
Jul 31 09:47:50 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 09:47:50 user nova-compute[71113]:       <mac address="fa:16:3e:ab:70:c1"/>
Jul 31 09:47:50 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:47:50 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 09:47:50 user nova-compute[71113]:       <target dev="tapc60ea5a4-12"/>
Jul 31 09:47:50 user nova-compute[71113]:     </interface>
Jul 31 09:47:50 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 09:47:50 user nova-compute[71113]:       <mac address="fa:16:3e:97:88:64"/>
Jul 31 09:47:50 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:47:50 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 09:47:50 user nova-compute[71113]:       <target dev="tapf998018e-38"/>
Jul 31 09:47:50 user nova-compute[71113]:     </interface>
Jul 31 09:47:50 user nova-compute[71113]:     <serial type="pty">
Jul 31 09:47:50 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/3aaaef96-76f8-4088-a0bc-a1a72e80652e/console.log" append="off"/>
Jul 31 09:47:50 user nova-compute[71113]:     </serial>
Jul 31 09:47:50 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 09:47:50 user nova-compute[71113]:     <video>
Jul 31 09:47:50 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:47:50 user nova-compute[71113]:     </video>
Jul 31 09:47:50 user nova-compute[71113]:     <rng model="virtio">
Jul 31 09:47:50 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 09:47:50 user nova-compute[71113]:     </rng>
Jul 31 09:47:50 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 09:47:50 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 09:47:50 user nova-compute[71113]:       <stats period="10"/>
Jul 31 09:47:50 user nova-compute[71113]:     </memballoon>
Jul 31 09:47:50 user nova-compute[71113]:   </devices>
Jul 31 09:47:50 user nova-compute[71113]: </domain>
Jul 31 09:47:50 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T09:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2136690925',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2136690925',id=9,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK37xL1BAMkSaHD27/dclDrDquKxGSbRz4om1spfqNUqYMogTIgM2NduHLjCNONc4OJfQWmM6xekLwEzzN15WwLbkZLHNz1raY0ZMpW2iVvvb6iQ47za56ehfKCbzjCDMw==',key_name='tempest-keypair-1445988611',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='219e950d6a5141ef93bd970e5c1d3805',ramdisk_id='',reservation_id='r-ll7h8n2p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-730691933',owner_user_name='tempest-TaggedBootDevicesTest_v242-730691933-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:47:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8f072d506b141dc92dddb9dc6348f72',uuid=3aaaef96-76f8-4088-a0bc-a1a72e80652e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "370dc7b8-8a77-47e4-94b9-ae9be9d1de13", "address": "fa:16:3e:7b:6a:0d", "network": {"id": "9e762abf-a299-49e7-b276-0fa226649bb9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1384573536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap370dc7b8-8a", "ovs_interfaceid": "370dc7b8-8a77-47e4-94b9-ae9be9d1de13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Converting VIF {"id": "370dc7b8-8a77-47e4-94b9-ae9be9d1de13", "address": "fa:16:3e:7b:6a:0d", "network": {"id": "9e762abf-a299-49e7-b276-0fa226649bb9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1384573536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap370dc7b8-8a", "ovs_interfaceid": "370dc7b8-8a77-47e4-94b9-ae9be9d1de13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:6a:0d,bridge_name='br-int',has_traffic_filtering=True,id=370dc7b8-8a77-47e4-94b9-ae9be9d1de13,network=Network(9e762abf-a299-49e7-b276-0fa226649bb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap370dc7b8-8a') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG os_vif [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:6a:0d,bridge_name='br-int',has_traffic_filtering=True,id=370dc7b8-8a77-47e4-94b9-ae9be9d1de13,network=Network(9e762abf-a299-49e7-b276-0fa226649bb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap370dc7b8-8a') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap370dc7b8-8a, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap370dc7b8-8a, col_values=(('external_ids', {'iface-id': '370dc7b8-8a77-47e4-94b9-ae9be9d1de13', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:6a:0d', 'vm-uuid': '3aaaef96-76f8-4088-a0bc-a1a72e80652e'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:50 user nova-compute[71113]: INFO os_vif [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:6a:0d,bridge_name='br-int',has_traffic_filtering=True,id=370dc7b8-8a77-47e4-94b9-ae9be9d1de13,network=Network(9e762abf-a299-49e7-b276-0fa226649bb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap370dc7b8-8a')
Jul 31 09:47:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T09:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2136690925',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2136690925',id=9,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK37xL1BAMkSaHD27/dclDrDquKxGSbRz4om1spfqNUqYMogTIgM2NduHLjCNONc4OJfQWmM6xekLwEzzN15WwLbkZLHNz1raY0ZMpW2iVvvb6iQ47za56ehfKCbzjCDMw==',key_name='tempest-keypair-1445988611',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='219e950d6a5141ef93bd970e5c1d3805',ramdisk_id='',reservation_id='r-ll7h8n2p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-730691933',owner_user_name='tempest-TaggedBootDevicesTest_v242-730691933-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:47:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8f072d506b141dc92dddb9dc6348f72',uuid=3aaaef96-76f8-4088-a0bc-a1a72e80652e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e64b39b1-bdfc-4e38-9520-8bf02c8427a4", "address": "fa:16:3e:0d:7e:fd", "network": {"id": "f7c9bb5d-84df-44c3-a496-20d634727c3c", "bridge": "br-int", "label": "tempest-device-tagging-net1-420856970", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape64b39b1-bd", "ovs_interfaceid": "e64b39b1-bdfc-4e38-9520-8bf02c8427a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Converting VIF {"id": "e64b39b1-bdfc-4e38-9520-8bf02c8427a4", "address": "fa:16:3e:0d:7e:fd", "network": {"id": "f7c9bb5d-84df-44c3-a496-20d634727c3c", "bridge": "br-int", "label": "tempest-device-tagging-net1-420856970", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape64b39b1-bd", "ovs_interfaceid": "e64b39b1-bdfc-4e38-9520-8bf02c8427a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:7e:fd,bridge_name='br-int',has_traffic_filtering=True,id=e64b39b1-bdfc-4e38-9520-8bf02c8427a4,network=Network(f7c9bb5d-84df-44c3-a496-20d634727c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape64b39b1-bd') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG os_vif [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:7e:fd,bridge_name='br-int',has_traffic_filtering=True,id=e64b39b1-bdfc-4e38-9520-8bf02c8427a4,network=Network(f7c9bb5d-84df-44c3-a496-20d634727c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape64b39b1-bd') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape64b39b1-bd, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape64b39b1-bd, col_values=(('external_ids', {'iface-id': 'e64b39b1-bdfc-4e38-9520-8bf02c8427a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:7e:fd', 'vm-uuid': '3aaaef96-76f8-4088-a0bc-a1a72e80652e'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:50 user nova-compute[71113]: INFO os_vif [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:7e:fd,bridge_name='br-int',has_traffic_filtering=True,id=e64b39b1-bdfc-4e38-9520-8bf02c8427a4,network=Network(f7c9bb5d-84df-44c3-a496-20d634727c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape64b39b1-bd')
Jul 31 09:47:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T09:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2136690925',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2136690925',id=9,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK37xL1BAMkSaHD27/dclDrDquKxGSbRz4om1spfqNUqYMogTIgM2NduHLjCNONc4OJfQWmM6xekLwEzzN15WwLbkZLHNz1raY0ZMpW2iVvvb6iQ47za56ehfKCbzjCDMw==',key_name='tempest-keypair-1445988611',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='219e950d6a5141ef93bd970e5c1d3805',ramdisk_id='',reservation_id='r-ll7h8n2p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-730691933',owner_user_name='tempest-TaggedBootDevicesTest_v242-730691933-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:47:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8f072d506b141dc92dddb9dc6348f72',uuid=3aaaef96-76f8-4088-a0bc-a1a72e80652e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a0920cd-a09e-4a83-adcd-098a71e98229", "address": "fa:16:3e:8b:9b:9f", "network": {"id": "f7c9bb5d-84df-44c3-a496-20d634727c3c", "bridge": "br-int", "label": "tempest-device-tagging-net1-420856970", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a0920cd-a0", "ovs_interfaceid": "3a0920cd-a09e-4a83-adcd-098a71e98229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Converting VIF {"id": "3a0920cd-a09e-4a83-adcd-098a71e98229", "address": "fa:16:3e:8b:9b:9f", "network": {"id": "f7c9bb5d-84df-44c3-a496-20d634727c3c", "bridge": "br-int", "label": "tempest-device-tagging-net1-420856970", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a0920cd-a0", "ovs_interfaceid": "3a0920cd-a09e-4a83-adcd-098a71e98229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:9b:9f,bridge_name='br-int',has_traffic_filtering=True,id=3a0920cd-a09e-4a83-adcd-098a71e98229,network=Network(f7c9bb5d-84df-44c3-a496-20d634727c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3a0920cd-a0') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG os_vif [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:9b:9f,bridge_name='br-int',has_traffic_filtering=True,id=3a0920cd-a09e-4a83-adcd-098a71e98229,network=Network(f7c9bb5d-84df-44c3-a496-20d634727c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3a0920cd-a0') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a0920cd-a0, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3a0920cd-a0, col_values=(('external_ids', {'iface-id': '3a0920cd-a09e-4a83-adcd-098a71e98229', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:9b:9f', 'vm-uuid': '3aaaef96-76f8-4088-a0bc-a1a72e80652e'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:50 user nova-compute[71113]: INFO os_vif [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:9b:9f,bridge_name='br-int',has_traffic_filtering=True,id=3a0920cd-a09e-4a83-adcd-098a71e98229,network=Network(f7c9bb5d-84df-44c3-a496-20d634727c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3a0920cd-a0')
Jul 31 09:47:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T09:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2136690925',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2136690925',id=9,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK37xL1BAMkSaHD27/dclDrDquKxGSbRz4om1spfqNUqYMogTIgM2NduHLjCNONc4OJfQWmM6xekLwEzzN15WwLbkZLHNz1raY0ZMpW2iVvvb6iQ47za56ehfKCbzjCDMw==',key_name='tempest-keypair-1445988611',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='219e950d6a5141ef93bd970e5c1d3805',ramdisk_id='',reservation_id='r-ll7h8n2p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-730691933',owner_user_name='tempest-TaggedBootDevicesTest_v242-730691933-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:47:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8f072d506b141dc92dddb9dc6348f72',uuid=3aaaef96-76f8-4088-a0bc-a1a72e80652e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79461167-7380-4b36-ac54-b58585f55c20", "address": "fa:16:3e:51:a4:07", "network": {"id": "f7c9bb5d-84df-44c3-a496-20d634727c3c", "bridge": "br-int", "label": "tempest-device-tagging-net1-420856970", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79461167-73", "ovs_interfaceid": "79461167-7380-4b36-ac54-b58585f55c20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Converting VIF {"id": "79461167-7380-4b36-ac54-b58585f55c20", "address": "fa:16:3e:51:a4:07", "network": {"id": "f7c9bb5d-84df-44c3-a496-20d634727c3c", "bridge": "br-int", "label": "tempest-device-tagging-net1-420856970", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79461167-73", "ovs_interfaceid": "79461167-7380-4b36-ac54-b58585f55c20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:a4:07,bridge_name='br-int',has_traffic_filtering=True,id=79461167-7380-4b36-ac54-b58585f55c20,network=Network(f7c9bb5d-84df-44c3-a496-20d634727c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79461167-73') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG os_vif [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:a4:07,bridge_name='br-int',has_traffic_filtering=True,id=79461167-7380-4b36-ac54-b58585f55c20,network=Network(f7c9bb5d-84df-44c3-a496-20d634727c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79461167-73') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap79461167-73, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap79461167-73, col_values=(('external_ids', {'iface-id': '79461167-7380-4b36-ac54-b58585f55c20', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:a4:07', 'vm-uuid': '3aaaef96-76f8-4088-a0bc-a1a72e80652e'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:50 user nova-compute[71113]: INFO os_vif [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:a4:07,bridge_name='br-int',has_traffic_filtering=True,id=79461167-7380-4b36-ac54-b58585f55c20,network=Network(f7c9bb5d-84df-44c3-a496-20d634727c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79461167-73')
Jul 31 09:47:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T09:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2136690925',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2136690925',id=9,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK37xL1BAMkSaHD27/dclDrDquKxGSbRz4om1spfqNUqYMogTIgM2NduHLjCNONc4OJfQWmM6xekLwEzzN15WwLbkZLHNz1raY0ZMpW2iVvvb6iQ47za56ehfKCbzjCDMw==',key_name='tempest-keypair-1445988611',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='219e950d6a5141ef93bd970e5c1d3805',ramdisk_id='',reservation_id='r-ll7h8n2p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-730691933',owner_user_name='tempest-TaggedBootDevicesTest_v242-730691933-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:47:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8f072d506b141dc92dddb9dc6348f72',uuid=3aaaef96-76f8-4088-a0bc-a1a72e80652e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc38d490-4eb0-496c-817d-639264048797", "address": "fa:16:3e:92:54:8b", "network": {"id": "f7c9bb5d-84df-44c3-a496-20d634727c3c", "bridge": "br-int", "label": "tempest-device-tagging-net1-420856970", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc38d490-4e", "ovs_interfaceid": "dc38d490-4eb0-496c-817d-639264048797", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Converting VIF {"id": "dc38d490-4eb0-496c-817d-639264048797", "address": "fa:16:3e:92:54:8b", "network": {"id": "f7c9bb5d-84df-44c3-a496-20d634727c3c", "bridge": "br-int", "label": "tempest-device-tagging-net1-420856970", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc38d490-4e", "ovs_interfaceid": "dc38d490-4eb0-496c-817d-639264048797", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:54:8b,bridge_name='br-int',has_traffic_filtering=True,id=dc38d490-4eb0-496c-817d-639264048797,network=Network(f7c9bb5d-84df-44c3-a496-20d634727c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc38d490-4e') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG os_vif [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:54:8b,bridge_name='br-int',has_traffic_filtering=True,id=dc38d490-4eb0-496c-817d-639264048797,network=Network(f7c9bb5d-84df-44c3-a496-20d634727c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc38d490-4e') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc38d490-4e, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdc38d490-4e, col_values=(('external_ids', {'iface-id': 'dc38d490-4eb0-496c-817d-639264048797', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:54:8b', 'vm-uuid': '3aaaef96-76f8-4088-a0bc-a1a72e80652e'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:50 user nova-compute[71113]: INFO os_vif [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:54:8b,bridge_name='br-int',has_traffic_filtering=True,id=dc38d490-4eb0-496c-817d-639264048797,network=Network(f7c9bb5d-84df-44c3-a496-20d634727c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc38d490-4e')
Jul 31 09:47:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T09:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2136690925',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2136690925',id=9,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK37xL1BAMkSaHD27/dclDrDquKxGSbRz4om1spfqNUqYMogTIgM2NduHLjCNONc4OJfQWmM6xekLwEzzN15WwLbkZLHNz1raY0ZMpW2iVvvb6iQ47za56ehfKCbzjCDMw==',key_name='tempest-keypair-1445988611',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='219e950d6a5141ef93bd970e5c1d3805',ramdisk_id='',reservation_id='r-ll7h8n2p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-730691933',owner_user_name='tempest-TaggedBootDevicesTest_v242-730691933-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:47:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8f072d506b141dc92dddb9dc6348f72',uuid=3aaaef96-76f8-4088-a0bc-a1a72e80652e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c60ea5a4-1214-4163-ad18-e7bdf71e4bef", "address": "fa:16:3e:ab:70:c1", "network": {"id": "bb2db53e-eed4-44e7-9510-eab184de68f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-411965443", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60ea5a4-12", "ovs_interfaceid": "c60ea5a4-1214-4163-ad18-e7bdf71e4bef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Converting VIF {"id": "c60ea5a4-1214-4163-ad18-e7bdf71e4bef", "address": "fa:16:3e:ab:70:c1", "network": {"id": "bb2db53e-eed4-44e7-9510-eab184de68f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-411965443", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60ea5a4-12", "ovs_interfaceid": "c60ea5a4-1214-4163-ad18-e7bdf71e4bef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:70:c1,bridge_name='br-int',has_traffic_filtering=True,id=c60ea5a4-1214-4163-ad18-e7bdf71e4bef,network=Network(bb2db53e-eed4-44e7-9510-eab184de68f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc60ea5a4-12') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG os_vif [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:70:c1,bridge_name='br-int',has_traffic_filtering=True,id=c60ea5a4-1214-4163-ad18-e7bdf71e4bef,network=Network(bb2db53e-eed4-44e7-9510-eab184de68f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc60ea5a4-12') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc60ea5a4-12, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc60ea5a4-12, col_values=(('external_ids', {'iface-id': 'c60ea5a4-1214-4163-ad18-e7bdf71e4bef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:70:c1', 'vm-uuid': '3aaaef96-76f8-4088-a0bc-a1a72e80652e'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:50 user nova-compute[71113]: INFO os_vif [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:70:c1,bridge_name='br-int',has_traffic_filtering=True,id=c60ea5a4-1214-4163-ad18-e7bdf71e4bef,network=Network(bb2db53e-eed4-44e7-9510-eab184de68f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc60ea5a4-12')
Jul 31 09:47:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T09:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2136690925',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2136690925',id=9,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK37xL1BAMkSaHD27/dclDrDquKxGSbRz4om1spfqNUqYMogTIgM2NduHLjCNONc4OJfQWmM6xekLwEzzN15WwLbkZLHNz1raY0ZMpW2iVvvb6iQ47za56ehfKCbzjCDMw==',key_name='tempest-keypair-1445988611',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='219e950d6a5141ef93bd970e5c1d3805',ramdisk_id='',reservation_id='r-ll7h8n2p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-730691933',owner_user_name='tempest-TaggedBootDevicesTest_v242-730691933-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:47:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8f072d506b141dc92dddb9dc6348f72',uuid=3aaaef96-76f8-4088-a0bc-a1a72e80652e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f998018e-386d-4444-9712-9eb57b025198", "address": "fa:16:3e:97:88:64", "network": {"id": "bb2db53e-eed4-44e7-9510-eab184de68f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-411965443", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf998018e-38", "ovs_interfaceid": "f998018e-386d-4444-9712-9eb57b025198", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Converting VIF {"id": "f998018e-386d-4444-9712-9eb57b025198", "address": "fa:16:3e:97:88:64", "network": {"id": "bb2db53e-eed4-44e7-9510-eab184de68f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-411965443", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf998018e-38", "ovs_interfaceid": "f998018e-386d-4444-9712-9eb57b025198", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:88:64,bridge_name='br-int',has_traffic_filtering=True,id=f998018e-386d-4444-9712-9eb57b025198,network=Network(bb2db53e-eed4-44e7-9510-eab184de68f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf998018e-38') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG os_vif [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:88:64,bridge_name='br-int',has_traffic_filtering=True,id=f998018e-386d-4444-9712-9eb57b025198,network=Network(bb2db53e-eed4-44e7-9510-eab184de68f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf998018e-38') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf998018e-38, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf998018e-38, col_values=(('external_ids', {'iface-id': 'f998018e-386d-4444-9712-9eb57b025198', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:88:64', 'vm-uuid': '3aaaef96-76f8-4088-a0bc-a1a72e80652e'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:47:51 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:51 user nova-compute[71113]: INFO os_vif [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:88:64,bridge_name='br-int',has_traffic_filtering=True,id=f998018e-386d-4444-9712-9eb57b025198,network=Network(bb2db53e-eed4-44e7-9510-eab184de68f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf998018e-38')
Jul 31 09:47:51 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] No BDM found with device name hda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:47:51 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:47:51 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] No VIF found with MAC fa:16:3e:7b:6a:0d, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 09:47:51 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] No VIF found with MAC fa:16:3e:92:54:8b, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 09:47:51 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Using config drive
Jul 31 09:47:51 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Creating config drive at /opt/stack/data/nova/instances/3aaaef96-76f8-4088-a0bc-a1a72e80652e/disk.config
Jul 31 09:47:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3aaaef96-76f8-4088-a0bc-a1a72e80652e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpp6g_bw7f {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3aaaef96-76f8-4088-a0bc-a1a72e80652e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpp6g_bw7f" returned: 0 in 0.054s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:53 user nova-compute[71113]: DEBUG nova.compute.manager [req-6af7acaf-5ded-4be9-957c-8b0e3d2bbddf req-ab3f3623-e14a-44a3-939e-87c0286e3985 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received event network-vif-plugged-370dc7b8-8a77-47e4-94b9-ae9be9d1de13 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:47:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-6af7acaf-5ded-4be9-957c-8b0e3d2bbddf req-ab3f3623-e14a-44a3-939e-87c0286e3985 service nova] Acquiring lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:47:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-6af7acaf-5ded-4be9-957c-8b0e3d2bbddf req-ab3f3623-e14a-44a3-939e-87c0286e3985 service nova] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:47:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-6af7acaf-5ded-4be9-957c-8b0e3d2bbddf req-ab3f3623-e14a-44a3-939e-87c0286e3985 service nova] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:47:53 user nova-compute[71113]: DEBUG nova.compute.manager [req-6af7acaf-5ded-4be9-957c-8b0e3d2bbddf req-ab3f3623-e14a-44a3-939e-87c0286e3985 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] No waiting events found dispatching network-vif-plugged-370dc7b8-8a77-47e4-94b9-ae9be9d1de13 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:47:53 user nova-compute[71113]: WARNING nova.compute.manager [req-6af7acaf-5ded-4be9-957c-8b0e3d2bbddf req-ab3f3623-e14a-44a3-939e-87c0286e3985 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received unexpected event network-vif-plugged-370dc7b8-8a77-47e4-94b9-ae9be9d1de13 for instance with vm_state building and task_state spawning.
Jul 31 09:47:53 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:53 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:53 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:53 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:53 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:53 user nova-compute[71113]: DEBUG nova.compute.manager [req-8f49eac6-ebef-4e3e-b239-d0485b8fbad3 req-4d73a082-c413-4161-8ca2-917837e34189 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received event network-vif-plugged-e64b39b1-bdfc-4e38-9520-8bf02c8427a4 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:47:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8f49eac6-ebef-4e3e-b239-d0485b8fbad3 req-4d73a082-c413-4161-8ca2-917837e34189 service nova] Acquiring lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:47:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8f49eac6-ebef-4e3e-b239-d0485b8fbad3 req-4d73a082-c413-4161-8ca2-917837e34189 service nova] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:47:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8f49eac6-ebef-4e3e-b239-d0485b8fbad3 req-4d73a082-c413-4161-8ca2-917837e34189 service nova] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:47:53 user nova-compute[71113]: DEBUG nova.compute.manager [req-8f49eac6-ebef-4e3e-b239-d0485b8fbad3 req-4d73a082-c413-4161-8ca2-917837e34189 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] No waiting events found dispatching network-vif-plugged-e64b39b1-bdfc-4e38-9520-8bf02c8427a4 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:47:53 user nova-compute[71113]: WARNING nova.compute.manager [req-8f49eac6-ebef-4e3e-b239-d0485b8fbad3 req-4d73a082-c413-4161-8ca2-917837e34189 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received unexpected event network-vif-plugged-e64b39b1-bdfc-4e38-9520-8bf02c8427a4 for instance with vm_state building and task_state spawning.
Jul 31 09:47:53 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:53 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:53 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:53 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:53 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:53 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:53 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:53 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:54 user nova-compute[71113]: DEBUG nova.compute.manager [req-c5a4472c-2135-45b5-8abe-ed42eaa44f4b req-9f842fa1-cde4-4c1a-a59a-b49d08161cf5 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received event network-vif-plugged-dc38d490-4eb0-496c-817d-639264048797 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:47:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-c5a4472c-2135-45b5-8abe-ed42eaa44f4b req-9f842fa1-cde4-4c1a-a59a-b49d08161cf5 service nova] Acquiring lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:47:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-c5a4472c-2135-45b5-8abe-ed42eaa44f4b req-9f842fa1-cde4-4c1a-a59a-b49d08161cf5 service nova] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:47:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-c5a4472c-2135-45b5-8abe-ed42eaa44f4b req-9f842fa1-cde4-4c1a-a59a-b49d08161cf5 service nova] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:47:54 user nova-compute[71113]: DEBUG nova.compute.manager [req-c5a4472c-2135-45b5-8abe-ed42eaa44f4b req-9f842fa1-cde4-4c1a-a59a-b49d08161cf5 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] No waiting events found dispatching network-vif-plugged-dc38d490-4eb0-496c-817d-639264048797 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:47:54 user nova-compute[71113]: WARNING nova.compute.manager [req-c5a4472c-2135-45b5-8abe-ed42eaa44f4b req-9f842fa1-cde4-4c1a-a59a-b49d08161cf5 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received unexpected event network-vif-plugged-dc38d490-4eb0-496c-817d-639264048797 for instance with vm_state building and task_state spawning.
Jul 31 09:47:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:55 user nova-compute[71113]: DEBUG nova.compute.manager [req-1c821d76-4023-4e56-bf0a-cbfffa957164 req-1592f94b-9c8d-4cc1-9ebd-5a9ac699da93 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received event network-vif-plugged-370dc7b8-8a77-47e4-94b9-ae9be9d1de13 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:47:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1c821d76-4023-4e56-bf0a-cbfffa957164 req-1592f94b-9c8d-4cc1-9ebd-5a9ac699da93 service nova] Acquiring lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:47:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1c821d76-4023-4e56-bf0a-cbfffa957164 req-1592f94b-9c8d-4cc1-9ebd-5a9ac699da93 service nova] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:47:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1c821d76-4023-4e56-bf0a-cbfffa957164 req-1592f94b-9c8d-4cc1-9ebd-5a9ac699da93 service nova] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:47:55 user nova-compute[71113]: DEBUG nova.compute.manager [req-1c821d76-4023-4e56-bf0a-cbfffa957164 req-1592f94b-9c8d-4cc1-9ebd-5a9ac699da93 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] No waiting events found dispatching network-vif-plugged-370dc7b8-8a77-47e4-94b9-ae9be9d1de13 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:47:55 user nova-compute[71113]: WARNING nova.compute.manager [req-1c821d76-4023-4e56-bf0a-cbfffa957164 req-1592f94b-9c8d-4cc1-9ebd-5a9ac699da93 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received unexpected event network-vif-plugged-370dc7b8-8a77-47e4-94b9-ae9be9d1de13 for instance with vm_state building and task_state spawning.
Jul 31 09:47:55 user nova-compute[71113]: DEBUG nova.compute.manager [req-1c821d76-4023-4e56-bf0a-cbfffa957164 req-1592f94b-9c8d-4cc1-9ebd-5a9ac699da93 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received event network-vif-plugged-3a0920cd-a09e-4a83-adcd-098a71e98229 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:47:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1c821d76-4023-4e56-bf0a-cbfffa957164 req-1592f94b-9c8d-4cc1-9ebd-5a9ac699da93 service nova] Acquiring lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:47:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1c821d76-4023-4e56-bf0a-cbfffa957164 req-1592f94b-9c8d-4cc1-9ebd-5a9ac699da93 service nova] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:47:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1c821d76-4023-4e56-bf0a-cbfffa957164 req-1592f94b-9c8d-4cc1-9ebd-5a9ac699da93 service nova] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:47:55 user nova-compute[71113]: DEBUG nova.compute.manager [req-1c821d76-4023-4e56-bf0a-cbfffa957164 req-1592f94b-9c8d-4cc1-9ebd-5a9ac699da93 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] No waiting events found dispatching network-vif-plugged-3a0920cd-a09e-4a83-adcd-098a71e98229 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:47:55 user nova-compute[71113]: WARNING nova.compute.manager [req-1c821d76-4023-4e56-bf0a-cbfffa957164 req-1592f94b-9c8d-4cc1-9ebd-5a9ac699da93 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received unexpected event network-vif-plugged-3a0920cd-a09e-4a83-adcd-098a71e98229 for instance with vm_state building and task_state spawning.
Jul 31 09:47:55 user nova-compute[71113]: DEBUG nova.compute.manager [req-1c821d76-4023-4e56-bf0a-cbfffa957164 req-1592f94b-9c8d-4cc1-9ebd-5a9ac699da93 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received event network-vif-plugged-3a0920cd-a09e-4a83-adcd-098a71e98229 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:47:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1c821d76-4023-4e56-bf0a-cbfffa957164 req-1592f94b-9c8d-4cc1-9ebd-5a9ac699da93 service nova] Acquiring lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:47:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1c821d76-4023-4e56-bf0a-cbfffa957164 req-1592f94b-9c8d-4cc1-9ebd-5a9ac699da93 service nova] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:47:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1c821d76-4023-4e56-bf0a-cbfffa957164 req-1592f94b-9c8d-4cc1-9ebd-5a9ac699da93 service nova] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:47:55 user nova-compute[71113]: DEBUG nova.compute.manager [req-1c821d76-4023-4e56-bf0a-cbfffa957164 req-1592f94b-9c8d-4cc1-9ebd-5a9ac699da93 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] No waiting events found dispatching network-vif-plugged-3a0920cd-a09e-4a83-adcd-098a71e98229 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:47:55 user nova-compute[71113]: WARNING nova.compute.manager [req-1c821d76-4023-4e56-bf0a-cbfffa957164 req-1592f94b-9c8d-4cc1-9ebd-5a9ac699da93 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received unexpected event network-vif-plugged-3a0920cd-a09e-4a83-adcd-098a71e98229 for instance with vm_state building and task_state spawning.
Jul 31 09:47:55 user nova-compute[71113]: DEBUG nova.compute.manager [req-a1d2e989-e0dd-4399-a703-2c187510d3d2 req-12985fdc-e26d-456a-b360-3f7abec76bd1 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received event network-vif-plugged-e64b39b1-bdfc-4e38-9520-8bf02c8427a4 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:47:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-a1d2e989-e0dd-4399-a703-2c187510d3d2 req-12985fdc-e26d-456a-b360-3f7abec76bd1 service nova] Acquiring lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:47:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-a1d2e989-e0dd-4399-a703-2c187510d3d2 req-12985fdc-e26d-456a-b360-3f7abec76bd1 service nova] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:47:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-a1d2e989-e0dd-4399-a703-2c187510d3d2 req-12985fdc-e26d-456a-b360-3f7abec76bd1 service nova] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:47:55 user nova-compute[71113]: DEBUG nova.compute.manager [req-a1d2e989-e0dd-4399-a703-2c187510d3d2 req-12985fdc-e26d-456a-b360-3f7abec76bd1 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] No waiting events found dispatching network-vif-plugged-e64b39b1-bdfc-4e38-9520-8bf02c8427a4 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:47:55 user nova-compute[71113]: WARNING nova.compute.manager [req-a1d2e989-e0dd-4399-a703-2c187510d3d2 req-12985fdc-e26d-456a-b360-3f7abec76bd1 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received unexpected event network-vif-plugged-e64b39b1-bdfc-4e38-9520-8bf02c8427a4 for instance with vm_state building and task_state spawning.
Jul 31 09:47:55 user nova-compute[71113]: DEBUG nova.compute.manager [req-a1d2e989-e0dd-4399-a703-2c187510d3d2 req-12985fdc-e26d-456a-b360-3f7abec76bd1 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received event network-vif-plugged-79461167-7380-4b36-ac54-b58585f55c20 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:47:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-a1d2e989-e0dd-4399-a703-2c187510d3d2 req-12985fdc-e26d-456a-b360-3f7abec76bd1 service nova] Acquiring lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:47:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-a1d2e989-e0dd-4399-a703-2c187510d3d2 req-12985fdc-e26d-456a-b360-3f7abec76bd1 service nova] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:47:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-a1d2e989-e0dd-4399-a703-2c187510d3d2 req-12985fdc-e26d-456a-b360-3f7abec76bd1 service nova] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:47:55 user nova-compute[71113]: DEBUG nova.compute.manager [req-a1d2e989-e0dd-4399-a703-2c187510d3d2 req-12985fdc-e26d-456a-b360-3f7abec76bd1 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] No waiting events found dispatching network-vif-plugged-79461167-7380-4b36-ac54-b58585f55c20 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:47:55 user nova-compute[71113]: WARNING nova.compute.manager [req-a1d2e989-e0dd-4399-a703-2c187510d3d2 req-12985fdc-e26d-456a-b360-3f7abec76bd1 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received unexpected event network-vif-plugged-79461167-7380-4b36-ac54-b58585f55c20 for instance with vm_state building and task_state spawning.
Jul 31 09:47:55 user nova-compute[71113]: DEBUG nova.compute.manager [req-a1d2e989-e0dd-4399-a703-2c187510d3d2 req-12985fdc-e26d-456a-b360-3f7abec76bd1 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received event network-vif-plugged-79461167-7380-4b36-ac54-b58585f55c20 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:47:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-a1d2e989-e0dd-4399-a703-2c187510d3d2 req-12985fdc-e26d-456a-b360-3f7abec76bd1 service nova] Acquiring lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:47:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-a1d2e989-e0dd-4399-a703-2c187510d3d2 req-12985fdc-e26d-456a-b360-3f7abec76bd1 service nova] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:47:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-a1d2e989-e0dd-4399-a703-2c187510d3d2 req-12985fdc-e26d-456a-b360-3f7abec76bd1 service nova] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:47:55 user nova-compute[71113]: DEBUG nova.compute.manager [req-a1d2e989-e0dd-4399-a703-2c187510d3d2 req-12985fdc-e26d-456a-b360-3f7abec76bd1 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] No waiting events found dispatching network-vif-plugged-79461167-7380-4b36-ac54-b58585f55c20 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:47:55 user nova-compute[71113]: WARNING nova.compute.manager [req-a1d2e989-e0dd-4399-a703-2c187510d3d2 req-12985fdc-e26d-456a-b360-3f7abec76bd1 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received unexpected event network-vif-plugged-79461167-7380-4b36-ac54-b58585f55c20 for instance with vm_state building and task_state spawning.
Jul 31 09:47:55 user nova-compute[71113]: DEBUG nova.compute.manager [req-a1d2e989-e0dd-4399-a703-2c187510d3d2 req-12985fdc-e26d-456a-b360-3f7abec76bd1 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received event network-vif-plugged-c60ea5a4-1214-4163-ad18-e7bdf71e4bef {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:47:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-a1d2e989-e0dd-4399-a703-2c187510d3d2 req-12985fdc-e26d-456a-b360-3f7abec76bd1 service nova] Acquiring lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:47:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-a1d2e989-e0dd-4399-a703-2c187510d3d2 req-12985fdc-e26d-456a-b360-3f7abec76bd1 service nova] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:47:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-a1d2e989-e0dd-4399-a703-2c187510d3d2 req-12985fdc-e26d-456a-b360-3f7abec76bd1 service nova] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:47:55 user nova-compute[71113]: DEBUG nova.compute.manager [req-a1d2e989-e0dd-4399-a703-2c187510d3d2 req-12985fdc-e26d-456a-b360-3f7abec76bd1 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] No waiting events found dispatching network-vif-plugged-c60ea5a4-1214-4163-ad18-e7bdf71e4bef {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:47:55 user nova-compute[71113]: WARNING nova.compute.manager [req-a1d2e989-e0dd-4399-a703-2c187510d3d2 req-12985fdc-e26d-456a-b360-3f7abec76bd1 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received unexpected event network-vif-plugged-c60ea5a4-1214-4163-ad18-e7bdf71e4bef for instance with vm_state building and task_state spawning.
Jul 31 09:47:55 user nova-compute[71113]: DEBUG nova.compute.manager [req-a1d2e989-e0dd-4399-a703-2c187510d3d2 req-12985fdc-e26d-456a-b360-3f7abec76bd1 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received event network-vif-plugged-c60ea5a4-1214-4163-ad18-e7bdf71e4bef {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:47:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-a1d2e989-e0dd-4399-a703-2c187510d3d2 req-12985fdc-e26d-456a-b360-3f7abec76bd1 service nova] Acquiring lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:47:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-a1d2e989-e0dd-4399-a703-2c187510d3d2 req-12985fdc-e26d-456a-b360-3f7abec76bd1 service nova] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:47:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-a1d2e989-e0dd-4399-a703-2c187510d3d2 req-12985fdc-e26d-456a-b360-3f7abec76bd1 service nova] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:47:55 user nova-compute[71113]: DEBUG nova.compute.manager [req-a1d2e989-e0dd-4399-a703-2c187510d3d2 req-12985fdc-e26d-456a-b360-3f7abec76bd1 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] No waiting events found dispatching network-vif-plugged-c60ea5a4-1214-4163-ad18-e7bdf71e4bef {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:47:55 user nova-compute[71113]: WARNING nova.compute.manager [req-a1d2e989-e0dd-4399-a703-2c187510d3d2 req-12985fdc-e26d-456a-b360-3f7abec76bd1 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received unexpected event network-vif-plugged-c60ea5a4-1214-4163-ad18-e7bdf71e4bef for instance with vm_state building and task_state spawning.
Jul 31 09:47:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:56 user nova-compute[71113]: DEBUG nova.compute.manager [req-4511bf54-daa4-4f9f-8cab-3c49ffc427e5 req-b784d564-ff14-4532-801a-6ef6cc58db9c service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received event network-vif-plugged-dc38d490-4eb0-496c-817d-639264048797 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:47:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-4511bf54-daa4-4f9f-8cab-3c49ffc427e5 req-b784d564-ff14-4532-801a-6ef6cc58db9c service nova] Acquiring lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:47:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-4511bf54-daa4-4f9f-8cab-3c49ffc427e5 req-b784d564-ff14-4532-801a-6ef6cc58db9c service nova] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:47:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-4511bf54-daa4-4f9f-8cab-3c49ffc427e5 req-b784d564-ff14-4532-801a-6ef6cc58db9c service nova] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:47:56 user nova-compute[71113]: DEBUG nova.compute.manager [req-4511bf54-daa4-4f9f-8cab-3c49ffc427e5 req-b784d564-ff14-4532-801a-6ef6cc58db9c service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] No waiting events found dispatching network-vif-plugged-dc38d490-4eb0-496c-817d-639264048797 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:47:56 user nova-compute[71113]: WARNING nova.compute.manager [req-4511bf54-daa4-4f9f-8cab-3c49ffc427e5 req-b784d564-ff14-4532-801a-6ef6cc58db9c service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received unexpected event network-vif-plugged-dc38d490-4eb0-496c-817d-639264048797 for instance with vm_state building and task_state spawning.
Jul 31 09:47:56 user nova-compute[71113]: DEBUG nova.compute.manager [req-4511bf54-daa4-4f9f-8cab-3c49ffc427e5 req-b784d564-ff14-4532-801a-6ef6cc58db9c service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received event network-vif-plugged-f998018e-386d-4444-9712-9eb57b025198 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:47:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-4511bf54-daa4-4f9f-8cab-3c49ffc427e5 req-b784d564-ff14-4532-801a-6ef6cc58db9c service nova] Acquiring lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:47:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-4511bf54-daa4-4f9f-8cab-3c49ffc427e5 req-b784d564-ff14-4532-801a-6ef6cc58db9c service nova] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:47:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-4511bf54-daa4-4f9f-8cab-3c49ffc427e5 req-b784d564-ff14-4532-801a-6ef6cc58db9c service nova] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:47:56 user nova-compute[71113]: DEBUG nova.compute.manager [req-4511bf54-daa4-4f9f-8cab-3c49ffc427e5 req-b784d564-ff14-4532-801a-6ef6cc58db9c service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] No waiting events found dispatching network-vif-plugged-f998018e-386d-4444-9712-9eb57b025198 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:47:56 user nova-compute[71113]: WARNING nova.compute.manager [req-4511bf54-daa4-4f9f-8cab-3c49ffc427e5 req-b784d564-ff14-4532-801a-6ef6cc58db9c service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received unexpected event network-vif-plugged-f998018e-386d-4444-9712-9eb57b025198 for instance with vm_state building and task_state spawning.
Jul 31 09:47:56 user nova-compute[71113]: DEBUG nova.compute.manager [req-4511bf54-daa4-4f9f-8cab-3c49ffc427e5 req-b784d564-ff14-4532-801a-6ef6cc58db9c service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received event network-vif-plugged-f998018e-386d-4444-9712-9eb57b025198 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:47:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-4511bf54-daa4-4f9f-8cab-3c49ffc427e5 req-b784d564-ff14-4532-801a-6ef6cc58db9c service nova] Acquiring lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:47:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-4511bf54-daa4-4f9f-8cab-3c49ffc427e5 req-b784d564-ff14-4532-801a-6ef6cc58db9c service nova] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:47:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-4511bf54-daa4-4f9f-8cab-3c49ffc427e5 req-b784d564-ff14-4532-801a-6ef6cc58db9c service nova] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:47:56 user nova-compute[71113]: DEBUG nova.compute.manager [req-4511bf54-daa4-4f9f-8cab-3c49ffc427e5 req-b784d564-ff14-4532-801a-6ef6cc58db9c service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] No waiting events found dispatching network-vif-plugged-f998018e-386d-4444-9712-9eb57b025198 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:47:56 user nova-compute[71113]: WARNING nova.compute.manager [req-4511bf54-daa4-4f9f-8cab-3c49ffc427e5 req-b784d564-ff14-4532-801a-6ef6cc58db9c service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received unexpected event network-vif-plugged-f998018e-386d-4444-9712-9eb57b025198 for instance with vm_state building and task_state spawning.
Jul 31 09:47:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:56 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:47:56 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:47:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-949bb1ab-4f29-442d-9998-76648b49691b tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Acquiring lock "530ee025-6faf-4497-aee9-dab145920012" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:47:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-949bb1ab-4f29-442d-9998-76648b49691b tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Lock "530ee025-6faf-4497-aee9-dab145920012" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:47:57 user nova-compute[71113]: DEBUG nova.objects.instance [None req-949bb1ab-4f29-442d-9998-76648b49691b tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Lazy-loading 'flavor' on Instance uuid 530ee025-6faf-4497-aee9-dab145920012 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:47:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-949bb1ab-4f29-442d-9998-76648b49691b tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Lock "530ee025-6faf-4497-aee9-dab145920012" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.084s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:47:57 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690796877.4994771, 3aaaef96-76f8-4088-a0bc-a1a72e80652e => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:47:57 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] VM Resumed (Lifecycle Event)
Jul 31 09:47:57 user nova-compute[71113]: DEBUG nova.compute.manager [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 09:47:57 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 09:47:57 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:47:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-949bb1ab-4f29-442d-9998-76648b49691b tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Acquiring lock "530ee025-6faf-4497-aee9-dab145920012" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:47:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-949bb1ab-4f29-442d-9998-76648b49691b tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Lock "530ee025-6faf-4497-aee9-dab145920012" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:47:57 user nova-compute[71113]: INFO nova.compute.manager [None req-949bb1ab-4f29-442d-9998-76648b49691b tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] [instance: 530ee025-6faf-4497-aee9-dab145920012] Attaching volume 080b56eb-a494-4fb0-a7de-308dabc5a4de to /dev/vdb
Jul 31 09:47:57 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Instance spawned successfully.
Jul 31 09:47:57 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 09:47:57 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:47:57 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Found default for hw_cdrom_bus of ide {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:47:57 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Found default for hw_disk_bus of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:47:57 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Found default for hw_input_bus of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:47:57 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Found default for hw_pointer_model of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:47:57 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Found default for hw_video_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:47:57 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Found default for hw_vif_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:47:57 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:47:57 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690796877.5038047, 3aaaef96-76f8-4088-a0bc-a1a72e80652e => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:47:57 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] VM Started (Lifecycle Event)
Jul 31 09:47:57 user nova-compute[71113]: DEBUG os_brick.utils [None req-949bb1ab-4f29-442d-9998-76648b49691b tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:47:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:57 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:47:57 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:47:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:57 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[43107706-eba1-471b-b23d-d353ae3f5ded]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:47:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:57 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:47:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:57 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8402b6f8-9f1f-4fa7-9e96-035ea59b0630]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:47:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:57 user nova-compute[71113]: INFO nova.compute.manager [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Took 11.16 seconds to spawn the instance on the hypervisor.
Jul 31 09:47:57 user nova-compute[71113]: DEBUG nova.compute.manager [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:47:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:47:57 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3f0e16-5e12-4326-8be7-52f43f7c2ee3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:47:57 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9090a725-bbb5-488e-a3ed-8901226ab78f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:47:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-949bb1ab-4f29-442d-9998-76648b49691b tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-949bb1ab-4f29-442d-9998-76648b49691b tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:47:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-949bb1ab-4f29-442d-9998-76648b49691b tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 09:47:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:47:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:47:57 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 09:47:57 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd9096e-2204-468b-9959-ccc045dfe43a]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:47:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-949bb1ab-4f29-442d-9998-76648b49691b tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 09:47:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-949bb1ab-4f29-442d-9998-76648b49691b tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 09:47:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-949bb1ab-4f29-442d-9998-76648b49691b tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 09:47:57 user nova-compute[71113]: DEBUG os_brick.utils [None req-949bb1ab-4f29-442d-9998-76648b49691b tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:47:57 user nova-compute[71113]: DEBUG nova.virt.block_device [None req-949bb1ab-4f29-442d-9998-76648b49691b tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] [instance: 530ee025-6faf-4497-aee9-dab145920012] Updating existing volume attachment record: b62e02a1-3ec3-4f4d-9f81-9081c200fdce {{(pid=71113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 09:47:57 user nova-compute[71113]: INFO nova.compute.manager [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Took 37.80 seconds to build instance.
Jul 31 09:47:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-11644967-0a0f-4968-b5af-60c9cf7bcfd6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 37.915s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:47:58 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:47:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:47:59 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:47:59 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:47:59 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:47:59 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 09:48:00 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:00 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:48:00 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:48:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:48:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:48:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:48:00 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 09:48:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:00 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caac13d2-ceb3-4fee-84ad-5376c1c2cc23/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caac13d2-ceb3-4fee-84ad-5376c1c2cc23/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caac13d2-ceb3-4fee-84ad-5376c1c2cc23/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caac13d2-ceb3-4fee-84ad-5376c1c2cc23/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:02 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 09:48:02 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 09:48:02 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 09:48:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f84b913d-0794-43a6-90d3-aaf4102f9fb6/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f84b913d-0794-43a6-90d3-aaf4102f9fb6/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f84b913d-0794-43a6-90d3-aaf4102f9fb6/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f84b913d-0794-43a6-90d3-aaf4102f9fb6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b574cfa3-5724-424c-a68e-8e88e6c8c69c/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b574cfa3-5724-424c-a68e-8e88e6c8c69c/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b574cfa3-5724-424c-a68e-8e88e6c8c69c/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b574cfa3-5724-424c-a68e-8e88e6c8c69c/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b324fed7-5df8-4ca1-9a5a-06eaffd5e101/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b324fed7-5df8-4ca1-9a5a-06eaffd5e101/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b324fed7-5df8-4ca1-9a5a-06eaffd5e101/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b324fed7-5df8-4ca1-9a5a-06eaffd5e101/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530ee025-6faf-4497-aee9-dab145920012/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530ee025-6faf-4497-aee9-dab145920012/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530ee025-6faf-4497-aee9-dab145920012/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530ee025-6faf-4497-aee9-dab145920012/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:04 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:48:04 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:48:04 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=7194MB free_disk=25.679996490478516GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 09:48:04 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:48:04 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:48:04 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 530ee025-6faf-4497-aee9-dab145920012 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:48:04 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 0ea0401b-26c2-4655-956b-1bc000debd53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:48:04 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance efa311a0-fe2e-4c0f-af66-09c3eb38fbf1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:48:04 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 1112a49d-27bd-4fc8-bae6-ec1decbb47db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:48:04 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance caac13d2-ceb3-4fee-84ad-5376c1c2cc23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:48:04 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance b324fed7-5df8-4ca1-9a5a-06eaffd5e101 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:48:04 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance f84b913d-0794-43a6-90d3-aaf4102f9fb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:48:04 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance b574cfa3-5724-424c-a68e-8e88e6c8c69c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:48:04 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 3aaaef96-76f8-4088-a0bc-a1a72e80652e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:48:04 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 09:48:04 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 09:48:04 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:48:04 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:48:04 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 09:48:04 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.684s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:48:05 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:48:05 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:48:05 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "refresh_cache-0ea0401b-26c2-4655-956b-1bc000debd53" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquired lock "refresh_cache-0ea0401b-26c2-4655-956b-1bc000debd53" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Forcefully refreshing network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-949bb1ab-4f29-442d-9998-76648b49691b tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] [instance: 530ee025-6faf-4497-aee9-dab145920012] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-949bb1ab-4f29-442d-9998-76648b49691b tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:080b56eb-a494-4fb0-a7de-308dabc5a4de'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rNJYoEne', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:48:06 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-949bb1ab-4f29-442d-9998-76648b49691b tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:48:06 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-949bb1ab-4f29-442d-9998-76648b49691b tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-949bb1ab-4f29-442d-9998-76648b49691b tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:48:06 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-949bb1ab-4f29-442d-9998-76648b49691b tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:48:06 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-949bb1ab-4f29-442d-9998-76648b49691b tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:080b56eb-a494-4fb0-a7de-308dabc5a4de" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-949bb1ab-4f29-442d-9998-76648b49691b tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:080b56eb-a494-4fb0-a7de-308dabc5a4de" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:48:06 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-949bb1ab-4f29-442d-9998-76648b49691b tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 09:48:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:080b56eb-a494-4fb0-a7de-308dabc5a4de -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:080b56eb-a494-4fb0-a7de-308dabc5a4de -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86605ff-d1bb-4fd9-85d2-edc7f7c1f18b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-949bb1ab-4f29-442d-9998-76648b49691b tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 09:48:06 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:080b56eb-a494-4fb0-a7de-308dabc5a4de -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:080b56eb-a494-4fb0-a7de-308dabc5a4de -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[13875dd9-5ed9-4b02-8515-d33f2df790e6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:080b56eb-a494-4fb0-a7de-308dabc5a4de] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-949bb1ab-4f29-442d-9998-76648b49691b tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:080b56eb-a494-4fb0-a7de-308dabc5a4de] added
Jul 31 09:48:06 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:080b56eb-a494-4fb0-a7de-308dabc5a4de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:080b56eb-a494-4fb0-a7de-308dabc5a4de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16794af-8727-41f7-b718-9d1873f23dc0]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-949bb1ab-4f29-442d-9998-76648b49691b tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:080b56eb-a494-4fb0-a7de-308dabc5a4de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:080b56eb-a494-4fb0-a7de-308dabc5a4de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53623ae-05e0-40a4-807e-c3c415d7287e]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-949bb1ab-4f29-442d-9998-76648b49691b tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:080b56eb-a494-4fb0-a7de-308dabc5a4de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rNJYoEne {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:080b56eb-a494-4fb0-a7de-308dabc5a4de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rNJYoEne" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[98196ef7-aafd-4edc-9261-1e0a9e8f4b77]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-949bb1ab-4f29-442d-9998-76648b49691b tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rNJYoEne'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:080b56eb-a494-4fb0-a7de-308dabc5a4de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:080b56eb-a494-4fb0-a7de-308dabc5a4de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5186b0f-12ff-4da2-8348-18e48ee9f952]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-949bb1ab-4f29-442d-9998-76648b49691b tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4a327d-33bb-4cd2-8240-cd25b0879756]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-949bb1ab-4f29-442d-9998-76648b49691b tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)
Jul 31 09:48:06 user nova-compute[71113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)
Jul 31 09:48:06 user nova-compute[71113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)
Jul 31 09:48:06 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-949bb1ab-4f29-442d-9998-76648b49691b tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)
Jul 31 09:48:06 user nova-compute[71113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)
Jul 31 09:48:06 user nova-compute[71113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)
Jul 31 09:48:06 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:080b56eb-a494-4fb0-a7de-308dabc5a4de -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:080b56eb-a494-4fb0-a7de-308dabc5a4de -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0864502a-c701-4406-b9a0-24398942371a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:080b56eb-a494-4fb0-a7de-308dabc5a4de, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:080b56eb-a494-4fb0-a7de-308dabc5a4de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-949bb1ab-4f29-442d-9998-76648b49691b tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:080b56eb-a494-4fb0-a7de-308dabc5a4de, portal: 172.16.0.220,3260]
Jul 31 09:48:06 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:080b56eb-a494-4fb0-a7de-308dabc5a4de, portal: 172.16.0.220,3260] successful.
Jul 31 09:48:06 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:080b56eb-a494-4fb0-a7de-308dabc5a4de -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:080b56eb-a494-4fb0-a7de-308dabc5a4de -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2753b6b8-cc69-49c0-b6a0-07354f0a6655]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-949bb1ab-4f29-442d-9998-76648b49691b tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[11eef570-b576-4656-82a7-db87587e56ac]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:080b56eb-a494-4fb0-a7de-308dabc5a4de (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-949bb1ab-4f29-442d-9998-76648b49691b tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)
Jul 31 09:48:06 user nova-compute[71113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)
Jul 31 09:48:06 user nova-compute[71113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)
Jul 31 09:48:06 user nova-compute[71113]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:080b56eb-a494-4fb0-a7de-308dabc5a4de (non-flash)
Jul 31 09:48:06 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-949bb1ab-4f29-442d-9998-76648b49691b tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)
Jul 31 09:48:06 user nova-compute[71113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)
Jul 31 09:48:06 user nova-compute[71113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)
Jul 31 09:48:06 user nova-compute[71113]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:080b56eb-a494-4fb0-a7de-308dabc5a4de (non-flash)
Jul 31 09:48:06 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-949bb1ab-4f29-442d-9998-76648b49691b tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:080b56eb-a494-4fb0-a7de-308dabc5a4de" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-949bb1ab-4f29-442d-9998-76648b49691b tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-949bb1ab-4f29-442d-9998-76648b49691b tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-949bb1ab-4f29-442d-9998-76648b49691b tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79c969b-8948-4c3a-844b-3d6c549b82ac]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-949bb1ab-4f29-442d-9998-76648b49691b tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-949bb1ab-4f29-442d-9998-76648b49691b tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rNJYoEne', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Updating instance_info_cache with network_info: [{"id": "5408a169-bdde-42da-be35-24006f474bc6", "address": "fa:16:3e:77:a3:62", "network": {"id": "cc84435f-b983-425d-bad0-36039e592e25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1662840158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f7a5479fd014325b8790a80b2405d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5408a169-bd", "ovs_interfaceid": "5408a169-bdde-42da-be35-24006f474bc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Releasing lock "refresh_cache-0ea0401b-26c2-4655-956b-1bc000debd53" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:48:06 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Updated the network info_cache for instance {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 09:48:07 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-949bb1ab-4f29-442d-9998-76648b49691b tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:48:07 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-949bb1ab-4f29-442d-9998-76648b49691b tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '23737613663623934', 'path': '/dev/sde'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:48:07 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-949bb1ab-4f29-442d-9998-76648b49691b tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] [instance: 530ee025-6faf-4497-aee9-dab145920012] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737613663623934', 'path': '/dev/sde'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 09:48:07 user nova-compute[71113]: DEBUG nova.objects.instance [None req-949bb1ab-4f29-442d-9998-76648b49691b tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Lazy-loading 'flavor' on Instance uuid 530ee025-6faf-4497-aee9-dab145920012 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:48:07 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-949bb1ab-4f29-442d-9998-76648b49691b tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 09:48:07 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:48:07 user nova-compute[71113]:   <source dev="/dev/sde"/>
Jul 31 09:48:07 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 09:48:07 user nova-compute[71113]:   <serial>080b56eb-a494-4fb0-a7de-308dabc5a4de</serial>
Jul 31 09:48:07 user nova-compute[71113]: </disk>
Jul 31 09:48:07 user nova-compute[71113]:  {{(pid=71113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 09:48:07 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-949bb1ab-4f29-442d-9998-76648b49691b tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:48:07 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-949bb1ab-4f29-442d-9998-76648b49691b tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:48:07 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-949bb1ab-4f29-442d-9998-76648b49691b tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] No VIF found with MAC fa:16:3e:b3:98:c6, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 09:48:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-949bb1ab-4f29-442d-9998-76648b49691b tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Lock "530ee025-6faf-4497-aee9-dab145920012" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.545s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:48:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-39850c50-d10b-48d6-b7d4-61dd0dcb96ee tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Acquiring lock "530ee025-6faf-4497-aee9-dab145920012" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:48:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-39850c50-d10b-48d6-b7d4-61dd0dcb96ee tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Lock "530ee025-6faf-4497-aee9-dab145920012" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:48:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-39850c50-d10b-48d6-b7d4-61dd0dcb96ee tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Acquiring lock "530ee025-6faf-4497-aee9-dab145920012-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:48:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-39850c50-d10b-48d6-b7d4-61dd0dcb96ee tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Lock "530ee025-6faf-4497-aee9-dab145920012-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:48:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-39850c50-d10b-48d6-b7d4-61dd0dcb96ee tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Lock "530ee025-6faf-4497-aee9-dab145920012-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:48:08 user nova-compute[71113]: INFO nova.compute.manager [None req-39850c50-d10b-48d6-b7d4-61dd0dcb96ee tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] [instance: 530ee025-6faf-4497-aee9-dab145920012] Terminating instance
Jul 31 09:48:08 user nova-compute[71113]: DEBUG nova.compute.manager [None req-39850c50-d10b-48d6-b7d4-61dd0dcb96ee tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] [instance: 530ee025-6faf-4497-aee9-dab145920012] Start destroying the instance on the hypervisor. {{(pid=71113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 09:48:08 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:08 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:08 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:08 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:08 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:08 user nova-compute[71113]: DEBUG nova.compute.manager [req-73427c46-7b42-4bf5-93f5-dba3f4346bf7 req-03d1abbd-d562-4e96-ac87-59b533ad1acf service nova] [instance: 530ee025-6faf-4497-aee9-dab145920012] Received event network-vif-unplugged-87156da3-0a08-44a2-a914-c69566bf1b5a {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:48:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-73427c46-7b42-4bf5-93f5-dba3f4346bf7 req-03d1abbd-d562-4e96-ac87-59b533ad1acf service nova] Acquiring lock "530ee025-6faf-4497-aee9-dab145920012-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:48:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-73427c46-7b42-4bf5-93f5-dba3f4346bf7 req-03d1abbd-d562-4e96-ac87-59b533ad1acf service nova] Lock "530ee025-6faf-4497-aee9-dab145920012-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:48:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-73427c46-7b42-4bf5-93f5-dba3f4346bf7 req-03d1abbd-d562-4e96-ac87-59b533ad1acf service nova] Lock "530ee025-6faf-4497-aee9-dab145920012-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:48:08 user nova-compute[71113]: DEBUG nova.compute.manager [req-73427c46-7b42-4bf5-93f5-dba3f4346bf7 req-03d1abbd-d562-4e96-ac87-59b533ad1acf service nova] [instance: 530ee025-6faf-4497-aee9-dab145920012] No waiting events found dispatching network-vif-unplugged-87156da3-0a08-44a2-a914-c69566bf1b5a {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:48:08 user nova-compute[71113]: DEBUG nova.compute.manager [req-73427c46-7b42-4bf5-93f5-dba3f4346bf7 req-03d1abbd-d562-4e96-ac87-59b533ad1acf service nova] [instance: 530ee025-6faf-4497-aee9-dab145920012] Received event network-vif-unplugged-87156da3-0a08-44a2-a914-c69566bf1b5a for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:09 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 530ee025-6faf-4497-aee9-dab145920012] Instance destroyed successfully.
Jul 31 09:48:09 user nova-compute[71113]: DEBUG nova.objects.instance [None req-39850c50-d10b-48d6-b7d4-61dd0dcb96ee tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Lazy-loading 'resources' on Instance uuid 530ee025-6faf-4497-aee9-dab145920012 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-39850c50-d10b-48d6-b7d4-61dd0dcb96ee tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:46:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1015016307',display_name='tempest-DeleteServersTestJSON-server-1015016307',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1015016307',id=1,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:46:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e8d767c71014105a4a343be6bf71dd4',ramdisk_id='',reservation_id='r-cw09hi00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-715920358',owner_user_name='tempest-DeleteServersTestJSON-715920358-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:46:17Z,user_data=None,user_id='d4f6a7b1d69b4c04ba6fbb821b720450',uuid=530ee025-6faf-4497-aee9-dab145920012,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "87156da3-0a08-44a2-a914-c69566bf1b5a", "address": "fa:16:3e:b3:98:c6", "network": {"id": "e63260c7-ffb2-4928-bff0-4d8fba378b2b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1431475840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e8d767c71014105a4a343be6bf71dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87156da3-0a", "ovs_interfaceid": "87156da3-0a08-44a2-a914-c69566bf1b5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-39850c50-d10b-48d6-b7d4-61dd0dcb96ee tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Converting VIF {"id": "87156da3-0a08-44a2-a914-c69566bf1b5a", "address": "fa:16:3e:b3:98:c6", "network": {"id": "e63260c7-ffb2-4928-bff0-4d8fba378b2b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1431475840-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e8d767c71014105a4a343be6bf71dd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87156da3-0a", "ovs_interfaceid": "87156da3-0a08-44a2-a914-c69566bf1b5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-39850c50-d10b-48d6-b7d4-61dd0dcb96ee tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:98:c6,bridge_name='br-int',has_traffic_filtering=True,id=87156da3-0a08-44a2-a914-c69566bf1b5a,network=Network(e63260c7-ffb2-4928-bff0-4d8fba378b2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87156da3-0a') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG os_vif [None req-39850c50-d10b-48d6-b7d4-61dd0dcb96ee tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:98:c6,bridge_name='br-int',has_traffic_filtering=True,id=87156da3-0a08-44a2-a914-c69566bf1b5a,network=Network(e63260c7-ffb2-4928-bff0-4d8fba378b2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87156da3-0a') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap87156da3-0a, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:48:09 user nova-compute[71113]: INFO os_vif [None req-39850c50-d10b-48d6-b7d4-61dd0dcb96ee tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:98:c6,bridge_name='br-int',has_traffic_filtering=True,id=87156da3-0a08-44a2-a914-c69566bf1b5a,network=Network(e63260c7-ffb2-4928-bff0-4d8fba378b2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87156da3-0a')
Jul 31 09:48:09 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39850c50-d10b-48d6-b7d4-61dd0dcb96ee tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] [instance: 530ee025-6faf-4497-aee9-dab145920012] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-39850c50-d10b-48d6-b7d4-61dd0dcb96ee tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:080b56eb-a494-4fb0-a7de-308dabc5a4de'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rNJYoEne', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:48:09 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-39850c50-d10b-48d6-b7d4-61dd0dcb96ee tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:48:09 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-39850c50-d10b-48d6-b7d4-61dd0dcb96ee tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-39850c50-d10b-48d6-b7d4-61dd0dcb96ee tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-39850c50-d10b-48d6-b7d4-61dd0dcb96ee tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:080b56eb-a494-4fb0-a7de-308dabc5a4de', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1751363-25e4-491e-98bd-ad45269c2e44]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:080b56eb-a494-4fb0-a7de-308dabc5a4de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[85645319-f473-4157-b317-f2282af1aa41]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:080b56eb-a494-4fb0-a7de-308dabc5a4de (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-39850c50-d10b-48d6-b7d4-61dd0dcb96ee tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)
Jul 31 09:48:09 user nova-compute[71113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)
Jul 31 09:48:09 user nova-compute[71113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)
Jul 31 09:48:09 user nova-compute[71113]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:080b56eb-a494-4fb0-a7de-308dabc5a4de (non-flash)
Jul 31 09:48:09 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-39850c50-d10b-48d6-b7d4-61dd0dcb96ee tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)
Jul 31 09:48:09 user nova-compute[71113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)
Jul 31 09:48:09 user nova-compute[71113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)
Jul 31 09:48:09 user nova-compute[71113]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:080b56eb-a494-4fb0-a7de-308dabc5a4de (non-flash)
Jul 31 09:48:09 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-39850c50-d10b-48d6-b7d4-61dd0dcb96ee tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f78f0793490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:080b56eb-a494-4fb0-a7de-308dabc5a4de'): ({'sde'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-39850c50-d10b-48d6-b7d4-61dd0dcb96ee tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Removing single pathed devices sde {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d4332a-012c-46b7-9fd2-fcd7c51da611]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[32718ba6-1940-4e91-8ede-109afe6368ba]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-39850c50-d10b-48d6-b7d4-61dd0dcb96ee tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Flushing IO for device /dev/sde {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e3a638-be51-4c11-8e10-774bd618cd5d]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-39850c50-d10b-48d6-b7d4-61dd0dcb96ee tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.052s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b0156d-3f39-4632-a1ce-e4d6ddc0134b]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-39850c50-d10b-48d6-b7d4-61dd0dcb96ee tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-39850c50-d10b-48d6-b7d4-61dd0dcb96ee tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] SCSI volumes sde have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-39850c50-d10b-48d6-b7d4-61dd0dcb96ee tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:080b56eb-a494-4fb0-a7de-308dabc5a4de')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:080b56eb-a494-4fb0-a7de-308dabc5a4de -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:080b56eb-a494-4fb0-a7de-308dabc5a4de -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d7781c-7e08-499b-aed2-f935b43cc903]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-39850c50-d10b-48d6-b7d4-61dd0dcb96ee tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:080b56eb-a494-4fb0-a7de-308dabc5a4de -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:080b56eb-a494-4fb0-a7de-308dabc5a4de -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe1c70a-030e-4934-bfad-b9d0ca986295]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:080b56eb-a494-4fb0-a7de-308dabc5a4de, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:080b56eb-a494-4fb0-a7de-308dabc5a4de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-39850c50-d10b-48d6-b7d4-61dd0dcb96ee tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:080b56eb-a494-4fb0-a7de-308dabc5a4de, portal: 172.16.0.220,3260]
Jul 31 09:48:09 user nova-compute[71113]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:080b56eb-a494-4fb0-a7de-308dabc5a4de, portal: 172.16.0.220,3260] successful.
Jul 31 09:48:09 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:080b56eb-a494-4fb0-a7de-308dabc5a4de -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:080b56eb-a494-4fb0-a7de-308dabc5a4de -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4a1750-89ca-414e-a0ec-d5e1b21bb1c1]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-39850c50-d10b-48d6-b7d4-61dd0dcb96ee tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-39850c50-d10b-48d6-b7d4-61dd0dcb96ee tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-39850c50-d10b-48d6-b7d4-61dd0dcb96ee tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] <== disconnect_volume: return (340ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:48:09 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39850c50-d10b-48d6-b7d4-61dd0dcb96ee tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] [instance: 530ee025-6faf-4497-aee9-dab145920012] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 09:48:09 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-39850c50-d10b-48d6-b7d4-61dd0dcb96ee tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] [instance: 530ee025-6faf-4497-aee9-dab145920012] Deleting instance files /opt/stack/data/nova/instances/530ee025-6faf-4497-aee9-dab145920012_del
Jul 31 09:48:09 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-39850c50-d10b-48d6-b7d4-61dd0dcb96ee tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] [instance: 530ee025-6faf-4497-aee9-dab145920012] Deletion of /opt/stack/data/nova/instances/530ee025-6faf-4497-aee9-dab145920012_del complete
Jul 31 09:48:10 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-39850c50-d10b-48d6-b7d4-61dd0dcb96ee tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Checking UEFI support for host arch (x86_64) {{(pid=71113) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Jul 31 09:48:10 user nova-compute[71113]: INFO nova.virt.libvirt.host [None req-39850c50-d10b-48d6-b7d4-61dd0dcb96ee tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] UEFI support detected
Jul 31 09:48:10 user nova-compute[71113]: INFO nova.compute.manager [None req-39850c50-d10b-48d6-b7d4-61dd0dcb96ee tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] [instance: 530ee025-6faf-4497-aee9-dab145920012] Took 1.45 seconds to destroy the instance on the hypervisor.
Jul 31 09:48:10 user nova-compute[71113]: DEBUG oslo.service.loopingcall [None req-39850c50-d10b-48d6-b7d4-61dd0dcb96ee tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71113) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 09:48:10 user nova-compute[71113]: DEBUG nova.compute.manager [-] [instance: 530ee025-6faf-4497-aee9-dab145920012] Deallocating network for instance {{(pid=71113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 09:48:10 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: 530ee025-6faf-4497-aee9-dab145920012] deallocate_for_instance() {{(pid=71113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 09:48:11 user nova-compute[71113]: DEBUG nova.compute.manager [req-f7baab05-0d67-4ebb-b61f-f3012391f2f1 req-aa2ec493-b13a-478e-a4c0-8d8cfa4d0139 service nova] [instance: 530ee025-6faf-4497-aee9-dab145920012] Received event network-vif-plugged-87156da3-0a08-44a2-a914-c69566bf1b5a {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:48:11 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f7baab05-0d67-4ebb-b61f-f3012391f2f1 req-aa2ec493-b13a-478e-a4c0-8d8cfa4d0139 service nova] Acquiring lock "530ee025-6faf-4497-aee9-dab145920012-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:48:11 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f7baab05-0d67-4ebb-b61f-f3012391f2f1 req-aa2ec493-b13a-478e-a4c0-8d8cfa4d0139 service nova] Lock "530ee025-6faf-4497-aee9-dab145920012-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:48:11 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f7baab05-0d67-4ebb-b61f-f3012391f2f1 req-aa2ec493-b13a-478e-a4c0-8d8cfa4d0139 service nova] Lock "530ee025-6faf-4497-aee9-dab145920012-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:48:11 user nova-compute[71113]: DEBUG nova.compute.manager [req-f7baab05-0d67-4ebb-b61f-f3012391f2f1 req-aa2ec493-b13a-478e-a4c0-8d8cfa4d0139 service nova] [instance: 530ee025-6faf-4497-aee9-dab145920012] No waiting events found dispatching network-vif-plugged-87156da3-0a08-44a2-a914-c69566bf1b5a {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:48:11 user nova-compute[71113]: WARNING nova.compute.manager [req-f7baab05-0d67-4ebb-b61f-f3012391f2f1 req-aa2ec493-b13a-478e-a4c0-8d8cfa4d0139 service nova] [instance: 530ee025-6faf-4497-aee9-dab145920012] Received unexpected event network-vif-plugged-87156da3-0a08-44a2-a914-c69566bf1b5a for instance with vm_state active and task_state deleting.
Jul 31 09:48:12 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: 530ee025-6faf-4497-aee9-dab145920012] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:48:12 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 530ee025-6faf-4497-aee9-dab145920012] Took 2.42 seconds to deallocate network for instance.
Jul 31 09:48:12 user nova-compute[71113]: DEBUG nova.compute.manager [req-cb914f9c-ceaa-4d83-b8f5-7337e2701a8b req-025ea65b-cd06-425f-8cf2-c77e193f2034 service nova] [instance: 530ee025-6faf-4497-aee9-dab145920012] Received event network-vif-deleted-87156da3-0a08-44a2-a914-c69566bf1b5a {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:48:12 user nova-compute[71113]: INFO nova.compute.manager [req-cb914f9c-ceaa-4d83-b8f5-7337e2701a8b req-025ea65b-cd06-425f-8cf2-c77e193f2034 service nova] [instance: 530ee025-6faf-4497-aee9-dab145920012] Neutron deleted interface 87156da3-0a08-44a2-a914-c69566bf1b5a; detaching it from the instance and deleting it from the info cache
Jul 31 09:48:12 user nova-compute[71113]: DEBUG nova.network.neutron [req-cb914f9c-ceaa-4d83-b8f5-7337e2701a8b req-025ea65b-cd06-425f-8cf2-c77e193f2034 service nova] [instance: 530ee025-6faf-4497-aee9-dab145920012] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:48:12 user nova-compute[71113]: DEBUG nova.compute.manager [req-cb914f9c-ceaa-4d83-b8f5-7337e2701a8b req-025ea65b-cd06-425f-8cf2-c77e193f2034 service nova] [instance: 530ee025-6faf-4497-aee9-dab145920012] Detach interface failed, port_id=87156da3-0a08-44a2-a914-c69566bf1b5a, reason: Instance 530ee025-6faf-4497-aee9-dab145920012 could not be found. {{(pid=71113) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 09:48:13 user nova-compute[71113]: INFO nova.compute.manager [None req-39850c50-d10b-48d6-b7d4-61dd0dcb96ee tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] [instance: 530ee025-6faf-4497-aee9-dab145920012] Took 0.84 seconds to detach 1 volumes for instance.
Jul 31 09:48:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-39850c50-d10b-48d6-b7d4-61dd0dcb96ee tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:48:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-39850c50-d10b-48d6-b7d4-61dd0dcb96ee tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:48:13 user nova-compute[71113]: DEBUG nova.compute.manager [req-b11fcd90-9d18-4087-baf2-80f032180683 req-cff87a41-2cf9-4da4-93d4-d304c5dfd7eb service nova] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Received event network-changed-647f984e-a9e3-4e49-9877-75ad4826e467 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:48:13 user nova-compute[71113]: DEBUG nova.compute.manager [req-b11fcd90-9d18-4087-baf2-80f032180683 req-cff87a41-2cf9-4da4-93d4-d304c5dfd7eb service nova] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Refreshing instance network info cache due to event network-changed-647f984e-a9e3-4e49-9877-75ad4826e467. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:48:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-b11fcd90-9d18-4087-baf2-80f032180683 req-cff87a41-2cf9-4da4-93d4-d304c5dfd7eb service nova] Acquiring lock "refresh_cache-1112a49d-27bd-4fc8-bae6-ec1decbb47db" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:48:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-b11fcd90-9d18-4087-baf2-80f032180683 req-cff87a41-2cf9-4da4-93d4-d304c5dfd7eb service nova] Acquired lock "refresh_cache-1112a49d-27bd-4fc8-bae6-ec1decbb47db" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:48:13 user nova-compute[71113]: DEBUG nova.network.neutron [req-b11fcd90-9d18-4087-baf2-80f032180683 req-cff87a41-2cf9-4da4-93d4-d304c5dfd7eb service nova] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Refreshing network info cache for port 647f984e-a9e3-4e49-9877-75ad4826e467 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:48:13 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-39850c50-d10b-48d6-b7d4-61dd0dcb96ee tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:48:13 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-39850c50-d10b-48d6-b7d4-61dd0dcb96ee tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:48:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-39850c50-d10b-48d6-b7d4-61dd0dcb96ee tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.417s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:48:13 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-39850c50-d10b-48d6-b7d4-61dd0dcb96ee tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Deleted allocations for instance 530ee025-6faf-4497-aee9-dab145920012
Jul 31 09:48:13 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:14 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-39850c50-d10b-48d6-b7d4-61dd0dcb96ee tempest-DeleteServersTestJSON-715920358 tempest-DeleteServersTestJSON-715920358-project-member] Lock "530ee025-6faf-4497-aee9-dab145920012" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.451s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:48:14 user nova-compute[71113]: DEBUG nova.network.neutron [req-b11fcd90-9d18-4087-baf2-80f032180683 req-cff87a41-2cf9-4da4-93d4-d304c5dfd7eb service nova] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Updated VIF entry in instance network info cache for port 647f984e-a9e3-4e49-9877-75ad4826e467. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:48:14 user nova-compute[71113]: DEBUG nova.network.neutron [req-b11fcd90-9d18-4087-baf2-80f032180683 req-cff87a41-2cf9-4da4-93d4-d304c5dfd7eb service nova] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Updating instance_info_cache with network_info: [{"id": "647f984e-a9e3-4e49-9877-75ad4826e467", "address": "fa:16:3e:72:e2:f2", "network": {"id": "26352e29-fc15-48ac-be14-8af7a0c80219", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866093358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bae93d4fff5e4990bd9fe78e71d6d2d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647f984e-a9", "ovs_interfaceid": "647f984e-a9e3-4e49-9877-75ad4826e467", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:48:14 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-b11fcd90-9d18-4087-baf2-80f032180683 req-cff87a41-2cf9-4da4-93d4-d304c5dfd7eb service nova] Releasing lock "refresh_cache-1112a49d-27bd-4fc8-bae6-ec1decbb47db" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:48:14 user nova-compute[71113]: DEBUG nova.compute.manager [req-f781310b-9df4-4197-b078-cfcccb5d6abb req-c5af9ba7-3ccc-44e6-bbb2-caf9649f7e7a service nova] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Received event network-changed-39b5a493-47bd-4599-9a9f-bb80c93fb332 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:48:14 user nova-compute[71113]: DEBUG nova.compute.manager [req-f781310b-9df4-4197-b078-cfcccb5d6abb req-c5af9ba7-3ccc-44e6-bbb2-caf9649f7e7a service nova] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Refreshing instance network info cache due to event network-changed-39b5a493-47bd-4599-9a9f-bb80c93fb332. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:48:14 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f781310b-9df4-4197-b078-cfcccb5d6abb req-c5af9ba7-3ccc-44e6-bbb2-caf9649f7e7a service nova] Acquiring lock "refresh_cache-efa311a0-fe2e-4c0f-af66-09c3eb38fbf1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:48:14 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f781310b-9df4-4197-b078-cfcccb5d6abb req-c5af9ba7-3ccc-44e6-bbb2-caf9649f7e7a service nova] Acquired lock "refresh_cache-efa311a0-fe2e-4c0f-af66-09c3eb38fbf1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:48:14 user nova-compute[71113]: DEBUG nova.network.neutron [req-f781310b-9df4-4197-b078-cfcccb5d6abb req-c5af9ba7-3ccc-44e6-bbb2-caf9649f7e7a service nova] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Refreshing network info cache for port 39b5a493-47bd-4599-9a9f-bb80c93fb332 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:48:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:15 user nova-compute[71113]: DEBUG nova.network.neutron [req-f781310b-9df4-4197-b078-cfcccb5d6abb req-c5af9ba7-3ccc-44e6-bbb2-caf9649f7e7a service nova] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Updated VIF entry in instance network info cache for port 39b5a493-47bd-4599-9a9f-bb80c93fb332. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:48:15 user nova-compute[71113]: DEBUG nova.network.neutron [req-f781310b-9df4-4197-b078-cfcccb5d6abb req-c5af9ba7-3ccc-44e6-bbb2-caf9649f7e7a service nova] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Updating instance_info_cache with network_info: [{"id": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "address": "fa:16:3e:16:bb:aa", "network": {"id": "4f2ea02a-9b26-4f2a-af23-39c060703ff3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-725518740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5bb5c0790e54702b881dc5e45641be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b5a493-47", "ovs_interfaceid": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:48:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f781310b-9df4-4197-b078-cfcccb5d6abb req-c5af9ba7-3ccc-44e6-bbb2-caf9649f7e7a service nova] Releasing lock "refresh_cache-efa311a0-fe2e-4c0f-af66-09c3eb38fbf1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:48:15 user nova-compute[71113]: DEBUG nova.compute.manager [req-f781310b-9df4-4197-b078-cfcccb5d6abb req-c5af9ba7-3ccc-44e6-bbb2-caf9649f7e7a service nova] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Received event network-changed-5408a169-bdde-42da-be35-24006f474bc6 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:48:15 user nova-compute[71113]: DEBUG nova.compute.manager [req-f781310b-9df4-4197-b078-cfcccb5d6abb req-c5af9ba7-3ccc-44e6-bbb2-caf9649f7e7a service nova] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Refreshing instance network info cache due to event network-changed-5408a169-bdde-42da-be35-24006f474bc6. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:48:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f781310b-9df4-4197-b078-cfcccb5d6abb req-c5af9ba7-3ccc-44e6-bbb2-caf9649f7e7a service nova] Acquiring lock "refresh_cache-0ea0401b-26c2-4655-956b-1bc000debd53" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:48:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f781310b-9df4-4197-b078-cfcccb5d6abb req-c5af9ba7-3ccc-44e6-bbb2-caf9649f7e7a service nova] Acquired lock "refresh_cache-0ea0401b-26c2-4655-956b-1bc000debd53" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:48:15 user nova-compute[71113]: DEBUG nova.network.neutron [req-f781310b-9df4-4197-b078-cfcccb5d6abb req-c5af9ba7-3ccc-44e6-bbb2-caf9649f7e7a service nova] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Refreshing network info cache for port 5408a169-bdde-42da-be35-24006f474bc6 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:48:16 user nova-compute[71113]: DEBUG nova.network.neutron [req-f781310b-9df4-4197-b078-cfcccb5d6abb req-c5af9ba7-3ccc-44e6-bbb2-caf9649f7e7a service nova] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Updated VIF entry in instance network info cache for port 5408a169-bdde-42da-be35-24006f474bc6. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:48:16 user nova-compute[71113]: DEBUG nova.network.neutron [req-f781310b-9df4-4197-b078-cfcccb5d6abb req-c5af9ba7-3ccc-44e6-bbb2-caf9649f7e7a service nova] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Updating instance_info_cache with network_info: [{"id": "5408a169-bdde-42da-be35-24006f474bc6", "address": "fa:16:3e:77:a3:62", "network": {"id": "cc84435f-b983-425d-bad0-36039e592e25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1662840158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f7a5479fd014325b8790a80b2405d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5408a169-bd", "ovs_interfaceid": "5408a169-bdde-42da-be35-24006f474bc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:48:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f781310b-9df4-4197-b078-cfcccb5d6abb req-c5af9ba7-3ccc-44e6-bbb2-caf9649f7e7a service nova] Releasing lock "refresh_cache-0ea0401b-26c2-4655-956b-1bc000debd53" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:48:16 user nova-compute[71113]: DEBUG nova.compute.manager [req-7657b534-3cf1-4440-a57a-f54008d3e9ac req-d3898e12-217f-4d59-a5c4-cf14f33b4def service nova] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Received event network-changed-1bdc8450-11f3-4a96-b68b-42f57ed9dcd9 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:48:16 user nova-compute[71113]: DEBUG nova.compute.manager [req-7657b534-3cf1-4440-a57a-f54008d3e9ac req-d3898e12-217f-4d59-a5c4-cf14f33b4def service nova] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Refreshing instance network info cache due to event network-changed-1bdc8450-11f3-4a96-b68b-42f57ed9dcd9. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:48:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7657b534-3cf1-4440-a57a-f54008d3e9ac req-d3898e12-217f-4d59-a5c4-cf14f33b4def service nova] Acquiring lock "refresh_cache-caac13d2-ceb3-4fee-84ad-5376c1c2cc23" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:48:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7657b534-3cf1-4440-a57a-f54008d3e9ac req-d3898e12-217f-4d59-a5c4-cf14f33b4def service nova] Acquired lock "refresh_cache-caac13d2-ceb3-4fee-84ad-5376c1c2cc23" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:48:16 user nova-compute[71113]: DEBUG nova.network.neutron [req-7657b534-3cf1-4440-a57a-f54008d3e9ac req-d3898e12-217f-4d59-a5c4-cf14f33b4def service nova] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Refreshing network info cache for port 1bdc8450-11f3-4a96-b68b-42f57ed9dcd9 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:48:17 user nova-compute[71113]: DEBUG nova.network.neutron [req-7657b534-3cf1-4440-a57a-f54008d3e9ac req-d3898e12-217f-4d59-a5c4-cf14f33b4def service nova] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Updated VIF entry in instance network info cache for port 1bdc8450-11f3-4a96-b68b-42f57ed9dcd9. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:48:17 user nova-compute[71113]: DEBUG nova.network.neutron [req-7657b534-3cf1-4440-a57a-f54008d3e9ac req-d3898e12-217f-4d59-a5c4-cf14f33b4def service nova] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Updating instance_info_cache with network_info: [{"id": "1bdc8450-11f3-4a96-b68b-42f57ed9dcd9", "address": "fa:16:3e:e8:e4:f6", "network": {"id": "5f0b75d1-03eb-4e68-85fd-8b27d4fda660", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-726146587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "025b7e2f3e894690b9cade6b6df70a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bdc8450-11", "ovs_interfaceid": "1bdc8450-11f3-4a96-b68b-42f57ed9dcd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:48:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7657b534-3cf1-4440-a57a-f54008d3e9ac req-d3898e12-217f-4d59-a5c4-cf14f33b4def service nova] Releasing lock "refresh_cache-caac13d2-ceb3-4fee-84ad-5376c1c2cc23" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:48:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-cdfe359f-437c-46c5-8212-388029515580 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Acquiring lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:48:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-cdfe359f-437c-46c5-8212-388029515580 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:48:18 user nova-compute[71113]: DEBUG nova.objects.instance [None req-cdfe359f-437c-46c5-8212-388029515580 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lazy-loading 'flavor' on Instance uuid 1112a49d-27bd-4fc8-bae6-ec1decbb47db {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:48:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-cdfe359f-437c-46c5-8212-388029515580 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.089s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:48:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-cdfe359f-437c-46c5-8212-388029515580 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Acquiring lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:48:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-cdfe359f-437c-46c5-8212-388029515580 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:48:18 user nova-compute[71113]: INFO nova.compute.manager [None req-cdfe359f-437c-46c5-8212-388029515580 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Attaching volume 76f6fa14-9162-43ca-9631-6c09fc7f2754 to /dev/vdb
Jul 31 09:48:18 user nova-compute[71113]: DEBUG os_brick.utils [None req-cdfe359f-437c-46c5-8212-388029515580 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:48:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:18 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[04df9b59-c945-4a9d-a047-405c26f753dc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:18 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4c028f-e264-4116-8497-923d6b3aa5bb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:18 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[283446db-2c21-44e4-a24c-6a955b3e3754]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:18 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[095211eb-4d47-4c9f-8c81-d5b6cfe66532]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-cdfe359f-437c-46c5-8212-388029515580 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-cdfe359f-437c-46c5-8212-388029515580 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:48:18 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cdfe359f-437c-46c5-8212-388029515580 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 09:48:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:48:18 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 09:48:18 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc45b60-80d6-4b75-b426-505bfe09b186]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:18 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-cdfe359f-437c-46c5-8212-388029515580 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 09:48:18 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-cdfe359f-437c-46c5-8212-388029515580 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 09:48:18 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-cdfe359f-437c-46c5-8212-388029515580 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 09:48:18 user nova-compute[71113]: DEBUG os_brick.utils [None req-cdfe359f-437c-46c5-8212-388029515580 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:48:18 user nova-compute[71113]: DEBUG nova.virt.block_device [None req-cdfe359f-437c-46c5-8212-388029515580 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Updating existing volume attachment record: 8daf51e2-3a7a-43ce-99e9-d0a033bd524f {{(pid=71113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 09:48:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Acquiring lock "8d033eac-23ea-417a-981c-578328f1c3ac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:48:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "8d033eac-23ea-417a-981c-578328f1c3ac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:48:18 user nova-compute[71113]: DEBUG nova.compute.manager [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Starting instance... {{(pid=71113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 09:48:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:48:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:48:19 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 09:48:19 user nova-compute[71113]: INFO nova.compute.claims [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Claim successful on node user
Jul 31 09:48:19 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:48:19 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:48:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.535s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:48:19 user nova-compute[71113]: DEBUG nova.compute.manager [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Start building networks asynchronously for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 09:48:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:19 user nova-compute[71113]: DEBUG nova.compute.manager [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Allocating IP information in the background. {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 09:48:19 user nova-compute[71113]: DEBUG nova.network.neutron [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] allocate_for_instance() {{(pid=71113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 09:48:19 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 09:48:19 user nova-compute[71113]: DEBUG nova.compute.manager [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Start building block device mappings for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 09:48:19 user nova-compute[71113]: DEBUG nova.policy [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e57ba3fd2d7a4d21a7653020def3f884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b02dfb26bc2472baef63892ab5b2492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71113) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 09:48:19 user nova-compute[71113]: DEBUG nova.compute.manager [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Start spawning the instance on the hypervisor. {{(pid=71113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 09:48:19 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 09:48:19 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Creating image(s)
Jul 31 09:48:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Acquiring lock "/opt/stack/data/nova/instances/8d033eac-23ea-417a-981c-578328f1c3ac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:48:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "/opt/stack/data/nova/instances/8d033eac-23ea-417a-981c-578328f1c3ac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:48:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "/opt/stack/data/nova/instances/8d033eac-23ea-417a-981c-578328f1c3ac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:48:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.209s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Acquiring lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:48:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:48:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.150s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/8d033eac-23ea-417a-981c-578328f1c3ac/disk 1073741824 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/8d033eac-23ea-417a-981c-578328f1c3ac/disk 1073741824" returned: 0 in 0.051s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.209s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:48:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.158s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:20 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8d033eac-23ea-417a-981c-578328f1c3ac/disk. size=1073741824 {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 09:48:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d033eac-23ea-417a-981c-578328f1c3ac/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:20 user nova-compute[71113]: DEBUG nova.network.neutron [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Successfully created port: a9e62527-eba5-484a-9b2d-6ff8fdead8e9 {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 09:48:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d033eac-23ea-417a-981c-578328f1c3ac/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:20 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Cannot resize image /opt/stack/data/nova/instances/8d033eac-23ea-417a-981c-578328f1c3ac/disk to a smaller size. {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 09:48:20 user nova-compute[71113]: DEBUG nova.objects.instance [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lazy-loading 'migration_context' on Instance uuid 8d033eac-23ea-417a-981c-578328f1c3ac {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:48:20 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Created local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 09:48:20 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Ensure instance console log exists: /opt/stack/data/nova/instances/8d033eac-23ea-417a-981c-578328f1c3ac/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 09:48:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:48:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:48:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:48:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7ba3e575-b863-4de9-8472-2d735a2423b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Acquiring lock "caac13d2-ceb3-4fee-84ad-5376c1c2cc23" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:48:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7ba3e575-b863-4de9-8472-2d735a2423b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Lock "caac13d2-ceb3-4fee-84ad-5376c1c2cc23" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:48:20 user nova-compute[71113]: DEBUG nova.objects.instance [None req-7ba3e575-b863-4de9-8472-2d735a2423b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Lazy-loading 'flavor' on Instance uuid caac13d2-ceb3-4fee-84ad-5376c1c2cc23 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:48:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7ba3e575-b863-4de9-8472-2d735a2423b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Lock "caac13d2-ceb3-4fee-84ad-5376c1c2cc23" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:48:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7ba3e575-b863-4de9-8472-2d735a2423b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Acquiring lock "caac13d2-ceb3-4fee-84ad-5376c1c2cc23" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:48:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7ba3e575-b863-4de9-8472-2d735a2423b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Lock "caac13d2-ceb3-4fee-84ad-5376c1c2cc23" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:48:20 user nova-compute[71113]: INFO nova.compute.manager [None req-7ba3e575-b863-4de9-8472-2d735a2423b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Attaching volume ecd76d7e-a580-4361-bcf2-232961825ac0 to /dev/vdb
Jul 31 09:48:21 user nova-compute[71113]: DEBUG os_brick.utils [None req-7ba3e575-b863-4de9-8472-2d735a2423b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:48:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:21 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3b28ce-caa2-4d8e-b4c1-20b98a8d1da3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:21 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b7aca8-5554-48fa-8e28-71bcbfe5bdea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:21 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fa2523-2ae9-498b-a220-16ddb280ade6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:21 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[55479c15-9f04-49d4-9421-cee3e6d4ec88]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-7ba3e575-b863-4de9-8472-2d735a2423b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-7ba3e575-b863-4de9-8472-2d735a2423b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:48:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7ba3e575-b863-4de9-8472-2d735a2423b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 09:48:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:48:21 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 09:48:21 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7c1812-5361-45f0-814b-1af7c9d38a45]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-7ba3e575-b863-4de9-8472-2d735a2423b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 09:48:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-7ba3e575-b863-4de9-8472-2d735a2423b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 09:48:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-7ba3e575-b863-4de9-8472-2d735a2423b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 09:48:21 user nova-compute[71113]: DEBUG os_brick.utils [None req-7ba3e575-b863-4de9-8472-2d735a2423b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:48:21 user nova-compute[71113]: DEBUG nova.virt.block_device [None req-7ba3e575-b863-4de9-8472-2d735a2423b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Updating existing volume attachment record: 3c524f6b-5d44-4840-afa1-82f98ef00919 {{(pid=71113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 09:48:21 user nova-compute[71113]: DEBUG nova.network.neutron [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Successfully updated port: a9e62527-eba5-484a-9b2d-6ff8fdead8e9 {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 09:48:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Acquiring lock "refresh_cache-8d033eac-23ea-417a-981c-578328f1c3ac" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:48:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Acquired lock "refresh_cache-8d033eac-23ea-417a-981c-578328f1c3ac" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:48:21 user nova-compute[71113]: DEBUG nova.network.neutron [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 09:48:21 user nova-compute[71113]: DEBUG nova.compute.manager [req-8e706b64-4298-40e5-bd8f-e882426923fd req-7f7e2344-833f-4c98-bf80-47815433b427 service nova] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Received event network-changed-a9e62527-eba5-484a-9b2d-6ff8fdead8e9 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:48:21 user nova-compute[71113]: DEBUG nova.compute.manager [req-8e706b64-4298-40e5-bd8f-e882426923fd req-7f7e2344-833f-4c98-bf80-47815433b427 service nova] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Refreshing instance network info cache due to event network-changed-a9e62527-eba5-484a-9b2d-6ff8fdead8e9. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:48:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8e706b64-4298-40e5-bd8f-e882426923fd req-7f7e2344-833f-4c98-bf80-47815433b427 service nova] Acquiring lock "refresh_cache-8d033eac-23ea-417a-981c-578328f1c3ac" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:48:22 user nova-compute[71113]: DEBUG nova.network.neutron [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 09:48:22 user nova-compute[71113]: DEBUG nova.network.neutron [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Updating instance_info_cache with network_info: [{"id": "a9e62527-eba5-484a-9b2d-6ff8fdead8e9", "address": "fa:16:3e:04:98:ca", "network": {"id": "2ce9c333-b413-4073-af8c-2e583872df61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1283872978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b02dfb26bc2472baef63892ab5b2492", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e62527-eb", "ovs_interfaceid": "a9e62527-eba5-484a-9b2d-6ff8fdead8e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:48:22 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Releasing lock "refresh_cache-8d033eac-23ea-417a-981c-578328f1c3ac" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:48:22 user nova-compute[71113]: DEBUG nova.compute.manager [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Instance network_info: |[{"id": "a9e62527-eba5-484a-9b2d-6ff8fdead8e9", "address": "fa:16:3e:04:98:ca", "network": {"id": "2ce9c333-b413-4073-af8c-2e583872df61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1283872978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b02dfb26bc2472baef63892ab5b2492", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e62527-eb", "ovs_interfaceid": "a9e62527-eba5-484a-9b2d-6ff8fdead8e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 09:48:22 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8e706b64-4298-40e5-bd8f-e882426923fd req-7f7e2344-833f-4c98-bf80-47815433b427 service nova] Acquired lock "refresh_cache-8d033eac-23ea-417a-981c-578328f1c3ac" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:48:22 user nova-compute[71113]: DEBUG nova.network.neutron [req-8e706b64-4298-40e5-bd8f-e882426923fd req-7f7e2344-833f-4c98-bf80-47815433b427 service nova] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Refreshing network info cache for port a9e62527-eba5-484a-9b2d-6ff8fdead8e9 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:48:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Start _get_guest_xml network_info=[{"id": "a9e62527-eba5-484a-9b2d-6ff8fdead8e9", "address": "fa:16:3e:04:98:ca", "network": {"id": "2ce9c333-b413-4073-af8c-2e583872df61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1283872978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b02dfb26bc2472baef63892ab5b2492", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e62527-eb", "ovs_interfaceid": "a9e62527-eba5-484a-9b2d-6ff8fdead8e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'image_id': '078646fe-b504-41ed-a147-61072e903e51'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 09:48:22 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:48:22 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:48:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 09:48:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 09:48:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 09:48:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 09:48:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 09:48:22 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 09:48:22 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 09:48:22 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 09:48:22 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 09:48:22 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 09:48:22 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 09:48:22 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 09:48:22 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 09:48:22 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 09:48:22 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 09:48:22 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 09:48:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:48:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1395689819',display_name='tempest-VolumesSnapshotTestJSON-instance-1395689819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1395689819',id=10,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBM68OHMA/jy9YdMp/DCJ+Up8xJwSip5H1pkoGQlX8MBodT5uqjpAyYMuOgadOnE+4/5VngPbBYaoJPsrKZAeD1A9tG8iPlticCkV9M0OtB4+6kpePx2gtYkCDLjoSSFaw==',key_name='tempest-keypair-559321023',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b02dfb26bc2472baef63892ab5b2492',ramdisk_id='',reservation_id='r-msu08b01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1215488088',owner_user_name='tempest-VolumesSnapshotTestJSON-1215488088-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:48:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e57ba3fd2d7a4d21a7653020def3f884',uuid=8d033eac-23ea-417a-981c-578328f1c3ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9e62527-eba5-484a-9b2d-6ff8fdead8e9", "address": "fa:16:3e:04:98:ca", "network": {"id": "2ce9c333-b413-4073-af8c-2e583872df61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1283872978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b02dfb26bc2472baef63892ab5b2492", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e62527-eb", "ovs_interfaceid": "a9e62527-eba5-484a-9b2d-6ff8fdead8e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 09:48:22 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Converting VIF {"id": "a9e62527-eba5-484a-9b2d-6ff8fdead8e9", "address": "fa:16:3e:04:98:ca", "network": {"id": "2ce9c333-b413-4073-af8c-2e583872df61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1283872978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b02dfb26bc2472baef63892ab5b2492", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e62527-eb", "ovs_interfaceid": "a9e62527-eba5-484a-9b2d-6ff8fdead8e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:48:22 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:98:ca,bridge_name='br-int',has_traffic_filtering=True,id=a9e62527-eba5-484a-9b2d-6ff8fdead8e9,network=Network(2ce9c333-b413-4073-af8c-2e583872df61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9e62527-eb') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:48:22 user nova-compute[71113]: DEBUG nova.objects.instance [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d033eac-23ea-417a-981c-578328f1c3ac {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:48:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] End _get_guest_xml xml=<domain type="kvm">
Jul 31 09:48:22 user nova-compute[71113]:   <uuid>8d033eac-23ea-417a-981c-578328f1c3ac</uuid>
Jul 31 09:48:22 user nova-compute[71113]:   <name>instance-0000000a</name>
Jul 31 09:48:22 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 09:48:22 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 09:48:22 user nova-compute[71113]:   <metadata>
Jul 31 09:48:22 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 09:48:22 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 09:48:22 user nova-compute[71113]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1395689819</nova:name>
Jul 31 09:48:22 user nova-compute[71113]:       <nova:creationTime>2023-07-31 09:48:22</nova:creationTime>
Jul 31 09:48:22 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 09:48:22 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 09:48:22 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 09:48:22 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 09:48:22 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 09:48:22 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 09:48:22 user nova-compute[71113]:       </nova:flavor>
Jul 31 09:48:22 user nova-compute[71113]:       <nova:owner>
Jul 31 09:48:22 user nova-compute[71113]:         <nova:user uuid="e57ba3fd2d7a4d21a7653020def3f884">tempest-VolumesSnapshotTestJSON-1215488088-project-member</nova:user>
Jul 31 09:48:22 user nova-compute[71113]:         <nova:project uuid="6b02dfb26bc2472baef63892ab5b2492">tempest-VolumesSnapshotTestJSON-1215488088</nova:project>
Jul 31 09:48:22 user nova-compute[71113]:       </nova:owner>
Jul 31 09:48:22 user nova-compute[71113]:       <nova:root type="image" uuid="078646fe-b504-41ed-a147-61072e903e51"/>
Jul 31 09:48:22 user nova-compute[71113]:       <nova:ports>
Jul 31 09:48:22 user nova-compute[71113]:         <nova:port uuid="a9e62527-eba5-484a-9b2d-6ff8fdead8e9">
Jul 31 09:48:22 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 31 09:48:22 user nova-compute[71113]:         </nova:port>
Jul 31 09:48:22 user nova-compute[71113]:       </nova:ports>
Jul 31 09:48:22 user nova-compute[71113]:     </nova:instance>
Jul 31 09:48:22 user nova-compute[71113]:   </metadata>
Jul 31 09:48:22 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 09:48:22 user nova-compute[71113]:     <system>
Jul 31 09:48:22 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 09:48:22 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 09:48:22 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 09:48:22 user nova-compute[71113]:       <entry name="serial">8d033eac-23ea-417a-981c-578328f1c3ac</entry>
Jul 31 09:48:22 user nova-compute[71113]:       <entry name="uuid">8d033eac-23ea-417a-981c-578328f1c3ac</entry>
Jul 31 09:48:22 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 09:48:22 user nova-compute[71113]:     </system>
Jul 31 09:48:22 user nova-compute[71113]:   </sysinfo>
Jul 31 09:48:22 user nova-compute[71113]:   <os>
Jul 31 09:48:22 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 09:48:22 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 09:48:22 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 09:48:22 user nova-compute[71113]:   </os>
Jul 31 09:48:22 user nova-compute[71113]:   <features>
Jul 31 09:48:22 user nova-compute[71113]:     <acpi/>
Jul 31 09:48:22 user nova-compute[71113]:     <apic/>
Jul 31 09:48:22 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 09:48:22 user nova-compute[71113]:   </features>
Jul 31 09:48:22 user nova-compute[71113]:   <clock offset="utc">
Jul 31 09:48:22 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 09:48:22 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 09:48:22 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 09:48:22 user nova-compute[71113]:   </clock>
Jul 31 09:48:22 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 09:48:22 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 09:48:22 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 09:48:22 user nova-compute[71113]:   </cpu>
Jul 31 09:48:22 user nova-compute[71113]:   <devices>
Jul 31 09:48:22 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 09:48:22 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 09:48:22 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/8d033eac-23ea-417a-981c-578328f1c3ac/disk"/>
Jul 31 09:48:22 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 09:48:22 user nova-compute[71113]:     </disk>
Jul 31 09:48:22 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 09:48:22 user nova-compute[71113]:       <mac address="fa:16:3e:04:98:ca"/>
Jul 31 09:48:22 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:48:22 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 09:48:22 user nova-compute[71113]:       <target dev="tapa9e62527-eb"/>
Jul 31 09:48:22 user nova-compute[71113]:     </interface>
Jul 31 09:48:22 user nova-compute[71113]:     <serial type="pty">
Jul 31 09:48:22 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/8d033eac-23ea-417a-981c-578328f1c3ac/console.log" append="off"/>
Jul 31 09:48:22 user nova-compute[71113]:     </serial>
Jul 31 09:48:22 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 09:48:22 user nova-compute[71113]:     <video>
Jul 31 09:48:22 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:48:22 user nova-compute[71113]:     </video>
Jul 31 09:48:22 user nova-compute[71113]:     <rng model="virtio">
Jul 31 09:48:22 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 09:48:22 user nova-compute[71113]:     </rng>
Jul 31 09:48:22 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 09:48:22 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 09:48:22 user nova-compute[71113]:       <stats period="10"/>
Jul 31 09:48:22 user nova-compute[71113]:     </memballoon>
Jul 31 09:48:22 user nova-compute[71113]:   </devices>
Jul 31 09:48:22 user nova-compute[71113]: </domain>
Jul 31 09:48:22 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 09:48:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:48:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1395689819',display_name='tempest-VolumesSnapshotTestJSON-instance-1395689819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1395689819',id=10,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBM68OHMA/jy9YdMp/DCJ+Up8xJwSip5H1pkoGQlX8MBodT5uqjpAyYMuOgadOnE+4/5VngPbBYaoJPsrKZAeD1A9tG8iPlticCkV9M0OtB4+6kpePx2gtYkCDLjoSSFaw==',key_name='tempest-keypair-559321023',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b02dfb26bc2472baef63892ab5b2492',ramdisk_id='',reservation_id='r-msu08b01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1215488088',owner_user_name='tempest-VolumesSnapshotTestJSON-1215488088-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:48:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e57ba3fd2d7a4d21a7653020def3f884',uuid=8d033eac-23ea-417a-981c-578328f1c3ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9e62527-eba5-484a-9b2d-6ff8fdead8e9", "address": "fa:16:3e:04:98:ca", "network": {"id": "2ce9c333-b413-4073-af8c-2e583872df61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1283872978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b02dfb26bc2472baef63892ab5b2492", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e62527-eb", "ovs_interfaceid": "a9e62527-eba5-484a-9b2d-6ff8fdead8e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 09:48:22 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Converting VIF {"id": "a9e62527-eba5-484a-9b2d-6ff8fdead8e9", "address": "fa:16:3e:04:98:ca", "network": {"id": "2ce9c333-b413-4073-af8c-2e583872df61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1283872978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b02dfb26bc2472baef63892ab5b2492", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e62527-eb", "ovs_interfaceid": "a9e62527-eba5-484a-9b2d-6ff8fdead8e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:48:22 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:98:ca,bridge_name='br-int',has_traffic_filtering=True,id=a9e62527-eba5-484a-9b2d-6ff8fdead8e9,network=Network(2ce9c333-b413-4073-af8c-2e583872df61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9e62527-eb') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:48:22 user nova-compute[71113]: DEBUG os_vif [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:98:ca,bridge_name='br-int',has_traffic_filtering=True,id=a9e62527-eba5-484a-9b2d-6ff8fdead8e9,network=Network(2ce9c333-b413-4073-af8c-2e583872df61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9e62527-eb') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 09:48:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:48:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 09:48:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa9e62527-eb, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:48:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa9e62527-eb, col_values=(('external_ids', {'iface-id': 'a9e62527-eba5-484a-9b2d-6ff8fdead8e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:98:ca', 'vm-uuid': '8d033eac-23ea-417a-981c-578328f1c3ac'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:48:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:48:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:22 user nova-compute[71113]: INFO os_vif [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:98:ca,bridge_name='br-int',has_traffic_filtering=True,id=a9e62527-eba5-484a-9b2d-6ff8fdead8e9,network=Network(2ce9c333-b413-4073-af8c-2e583872df61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9e62527-eb')
Jul 31 09:48:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:48:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] No VIF found with MAC fa:16:3e:04:98:ca, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 09:48:22 user nova-compute[71113]: DEBUG nova.network.neutron [req-8e706b64-4298-40e5-bd8f-e882426923fd req-7f7e2344-833f-4c98-bf80-47815433b427 service nova] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Updated VIF entry in instance network info cache for port a9e62527-eba5-484a-9b2d-6ff8fdead8e9. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:48:22 user nova-compute[71113]: DEBUG nova.network.neutron [req-8e706b64-4298-40e5-bd8f-e882426923fd req-7f7e2344-833f-4c98-bf80-47815433b427 service nova] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Updating instance_info_cache with network_info: [{"id": "a9e62527-eba5-484a-9b2d-6ff8fdead8e9", "address": "fa:16:3e:04:98:ca", "network": {"id": "2ce9c333-b413-4073-af8c-2e583872df61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1283872978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b02dfb26bc2472baef63892ab5b2492", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e62527-eb", "ovs_interfaceid": "a9e62527-eba5-484a-9b2d-6ff8fdead8e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:48:22 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8e706b64-4298-40e5-bd8f-e882426923fd req-7f7e2344-833f-4c98-bf80-47815433b427 service nova] Releasing lock "refresh_cache-8d033eac-23ea-417a-981c-578328f1c3ac" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:48:23 user nova-compute[71113]: DEBUG nova.compute.manager [req-1f8a1475-b6e1-4665-8376-ce17e64b3920 req-c96c46ea-2e00-4b48-9443-fb47c57e1334 service nova] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Received event network-changed-07f33c66-0fa4-4154-a498-d6d42864a9a5 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:48:23 user nova-compute[71113]: DEBUG nova.compute.manager [req-1f8a1475-b6e1-4665-8376-ce17e64b3920 req-c96c46ea-2e00-4b48-9443-fb47c57e1334 service nova] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Refreshing instance network info cache due to event network-changed-07f33c66-0fa4-4154-a498-d6d42864a9a5. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:48:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1f8a1475-b6e1-4665-8376-ce17e64b3920 req-c96c46ea-2e00-4b48-9443-fb47c57e1334 service nova] Acquiring lock "refresh_cache-b324fed7-5df8-4ca1-9a5a-06eaffd5e101" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:48:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1f8a1475-b6e1-4665-8376-ce17e64b3920 req-c96c46ea-2e00-4b48-9443-fb47c57e1334 service nova] Acquired lock "refresh_cache-b324fed7-5df8-4ca1-9a5a-06eaffd5e101" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:48:23 user nova-compute[71113]: DEBUG nova.network.neutron [req-1f8a1475-b6e1-4665-8376-ce17e64b3920 req-c96c46ea-2e00-4b48-9443-fb47c57e1334 service nova] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Refreshing network info cache for port 07f33c66-0fa4-4154-a498-d6d42864a9a5 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:48:23 user nova-compute[71113]: DEBUG nova.compute.manager [req-358360f0-f68f-4b91-b210-012fb2716842 req-476aff82-be6b-40e1-b55b-92446a2d5bce service nova] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Received event network-changed-e5c43d23-3cda-4763-af71-7c6fddbf6bd3 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:48:23 user nova-compute[71113]: DEBUG nova.compute.manager [req-358360f0-f68f-4b91-b210-012fb2716842 req-476aff82-be6b-40e1-b55b-92446a2d5bce service nova] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Refreshing instance network info cache due to event network-changed-e5c43d23-3cda-4763-af71-7c6fddbf6bd3. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:48:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-358360f0-f68f-4b91-b210-012fb2716842 req-476aff82-be6b-40e1-b55b-92446a2d5bce service nova] Acquiring lock "refresh_cache-f84b913d-0794-43a6-90d3-aaf4102f9fb6" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:48:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-358360f0-f68f-4b91-b210-012fb2716842 req-476aff82-be6b-40e1-b55b-92446a2d5bce service nova] Acquired lock "refresh_cache-f84b913d-0794-43a6-90d3-aaf4102f9fb6" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:48:23 user nova-compute[71113]: DEBUG nova.network.neutron [req-358360f0-f68f-4b91-b210-012fb2716842 req-476aff82-be6b-40e1-b55b-92446a2d5bce service nova] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Refreshing network info cache for port e5c43d23-3cda-4763-af71-7c6fddbf6bd3 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:48:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1a7e49fa-8189-49fd-8583-ab0545618bdd tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Acquiring lock "b324fed7-5df8-4ca1-9a5a-06eaffd5e101" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:48:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1a7e49fa-8189-49fd-8583-ab0545618bdd tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Lock "b324fed7-5df8-4ca1-9a5a-06eaffd5e101" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:48:23 user nova-compute[71113]: DEBUG nova.objects.instance [None req-1a7e49fa-8189-49fd-8583-ab0545618bdd tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Lazy-loading 'flavor' on Instance uuid b324fed7-5df8-4ca1-9a5a-06eaffd5e101 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:48:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1a7e49fa-8189-49fd-8583-ab0545618bdd tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Lock "b324fed7-5df8-4ca1-9a5a-06eaffd5e101" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.097s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:48:23 user nova-compute[71113]: DEBUG nova.network.neutron [req-1f8a1475-b6e1-4665-8376-ce17e64b3920 req-c96c46ea-2e00-4b48-9443-fb47c57e1334 service nova] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Updated VIF entry in instance network info cache for port 07f33c66-0fa4-4154-a498-d6d42864a9a5. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:48:23 user nova-compute[71113]: DEBUG nova.network.neutron [req-1f8a1475-b6e1-4665-8376-ce17e64b3920 req-c96c46ea-2e00-4b48-9443-fb47c57e1334 service nova] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Updating instance_info_cache with network_info: [{"id": "07f33c66-0fa4-4154-a498-d6d42864a9a5", "address": "fa:16:3e:14:e4:e5", "network": {"id": "c49991aa-9260-4358-b3e2-309d558b5805", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1291245964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e01569d9e6a4aff974e6dc99141f089", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07f33c66-0f", "ovs_interfaceid": "07f33c66-0fa4-4154-a498-d6d42864a9a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:48:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1f8a1475-b6e1-4665-8376-ce17e64b3920 req-c96c46ea-2e00-4b48-9443-fb47c57e1334 service nova] Releasing lock "refresh_cache-b324fed7-5df8-4ca1-9a5a-06eaffd5e101" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:48:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1a7e49fa-8189-49fd-8583-ab0545618bdd tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Acquiring lock "b324fed7-5df8-4ca1-9a5a-06eaffd5e101" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:48:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1a7e49fa-8189-49fd-8583-ab0545618bdd tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Lock "b324fed7-5df8-4ca1-9a5a-06eaffd5e101" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:48:23 user nova-compute[71113]: INFO nova.compute.manager [None req-1a7e49fa-8189-49fd-8583-ab0545618bdd tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Attaching volume 015a658c-3fc8-4c04-9bd3-2318bec06a8e to /dev/vdb
Jul 31 09:48:23 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:24 user nova-compute[71113]: DEBUG os_brick.utils [None req-1a7e49fa-8189-49fd-8583-ab0545618bdd tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:48:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:24 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[93415c36-8ed8-42d9-bc23-a0e2bd35f9a2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:24 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[70247bb6-f224-4773-9de8-a20f44df921c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:24 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[34fe65ce-b4e0-4c07-be2b-6b82cccdf412]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:24 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa23452d-55e0-4db7-abbd-1379d91c6733]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-1a7e49fa-8189-49fd-8583-ab0545618bdd tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-1a7e49fa-8189-49fd-8583-ab0545618bdd tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:48:24 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1a7e49fa-8189-49fd-8583-ab0545618bdd tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 09:48:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:48:24 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 09:48:24 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[04cfde8a-21df-41b1-819d-3e0614214727]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:24 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-1a7e49fa-8189-49fd-8583-ab0545618bdd tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 09:48:24 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-1a7e49fa-8189-49fd-8583-ab0545618bdd tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 09:48:24 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-1a7e49fa-8189-49fd-8583-ab0545618bdd tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 09:48:24 user nova-compute[71113]: DEBUG os_brick.utils [None req-1a7e49fa-8189-49fd-8583-ab0545618bdd tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:48:24 user nova-compute[71113]: DEBUG nova.virt.block_device [None req-1a7e49fa-8189-49fd-8583-ab0545618bdd tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Updating existing volume attachment record: c3d8ebd4-e8a8-49f5-8c36-274aca5e5021 {{(pid=71113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 09:48:24 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690796889.5471957, 530ee025-6faf-4497-aee9-dab145920012 => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:48:24 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 530ee025-6faf-4497-aee9-dab145920012] VM Stopped (Lifecycle Event)
Jul 31 09:48:24 user nova-compute[71113]: DEBUG nova.network.neutron [req-358360f0-f68f-4b91-b210-012fb2716842 req-476aff82-be6b-40e1-b55b-92446a2d5bce service nova] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Updated VIF entry in instance network info cache for port e5c43d23-3cda-4763-af71-7c6fddbf6bd3. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:48:24 user nova-compute[71113]: DEBUG nova.network.neutron [req-358360f0-f68f-4b91-b210-012fb2716842 req-476aff82-be6b-40e1-b55b-92446a2d5bce service nova] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Updating instance_info_cache with network_info: [{"id": "e5c43d23-3cda-4763-af71-7c6fddbf6bd3", "address": "fa:16:3e:33:5c:af", "network": {"id": "6cd9dded-5835-41d6-9407-1a1f04223da4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-184846099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ede230cc40e449bb8747fe13f655799", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5c43d23-3c", "ovs_interfaceid": "e5c43d23-3cda-4763-af71-7c6fddbf6bd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:48:24 user nova-compute[71113]: DEBUG nova.compute.manager [None req-3fcf2dfa-e9dc-4fa5-b8b8-673327f1eaf6 None None] [instance: 530ee025-6faf-4497-aee9-dab145920012] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:48:24 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-358360f0-f68f-4b91-b210-012fb2716842 req-476aff82-be6b-40e1-b55b-92446a2d5bce service nova] Releasing lock "refresh_cache-f84b913d-0794-43a6-90d3-aaf4102f9fb6" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:48:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:25 user nova-compute[71113]: DEBUG nova.compute.manager [req-3277b370-fd62-4b5b-8fc8-5d7430583071 req-b477852c-c3cf-4d70-9b7e-feb62f9f5f60 service nova] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Received event network-vif-plugged-a9e62527-eba5-484a-9b2d-6ff8fdead8e9 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:48:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3277b370-fd62-4b5b-8fc8-5d7430583071 req-b477852c-c3cf-4d70-9b7e-feb62f9f5f60 service nova] Acquiring lock "8d033eac-23ea-417a-981c-578328f1c3ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:48:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3277b370-fd62-4b5b-8fc8-5d7430583071 req-b477852c-c3cf-4d70-9b7e-feb62f9f5f60 service nova] Lock "8d033eac-23ea-417a-981c-578328f1c3ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:48:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3277b370-fd62-4b5b-8fc8-5d7430583071 req-b477852c-c3cf-4d70-9b7e-feb62f9f5f60 service nova] Lock "8d033eac-23ea-417a-981c-578328f1c3ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:48:25 user nova-compute[71113]: DEBUG nova.compute.manager [req-3277b370-fd62-4b5b-8fc8-5d7430583071 req-b477852c-c3cf-4d70-9b7e-feb62f9f5f60 service nova] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] No waiting events found dispatching network-vif-plugged-a9e62527-eba5-484a-9b2d-6ff8fdead8e9 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:48:25 user nova-compute[71113]: WARNING nova.compute.manager [req-3277b370-fd62-4b5b-8fc8-5d7430583071 req-b477852c-c3cf-4d70-9b7e-feb62f9f5f60 service nova] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Received unexpected event network-vif-plugged-a9e62527-eba5-484a-9b2d-6ff8fdead8e9 for instance with vm_state building and task_state spawning.
Jul 31 09:48:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:26 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690796906.495745, 8d033eac-23ea-417a-981c-578328f1c3ac => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:48:26 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] VM Resumed (Lifecycle Event)
Jul 31 09:48:26 user nova-compute[71113]: DEBUG nova.compute.manager [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 09:48:26 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 09:48:26 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Instance spawned successfully.
Jul 31 09:48:26 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 09:48:26 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:48:26 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:48:26 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Found default for hw_cdrom_bus of ide {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:48:26 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Found default for hw_disk_bus of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:48:26 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Found default for hw_input_bus of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:48:26 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Found default for hw_pointer_model of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:48:26 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Found default for hw_video_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:48:26 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Found default for hw_vif_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:48:26 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:48:26 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690796906.4983501, 8d033eac-23ea-417a-981c-578328f1c3ac => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:48:26 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] VM Started (Lifecycle Event)
Jul 31 09:48:26 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:48:26 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:48:26 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:48:26 user nova-compute[71113]: INFO nova.compute.manager [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Took 7.07 seconds to spawn the instance on the hypervisor.
Jul 31 09:48:26 user nova-compute[71113]: DEBUG nova.compute.manager [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:48:26 user nova-compute[71113]: INFO nova.compute.manager [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Took 7.95 seconds to build instance.
Jul 31 09:48:26 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-3490579d-98c1-44a5-a196-e9c15aa96555 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "8d033eac-23ea-417a-981c-578328f1c3ac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.057s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdfe359f-437c-46c5-8212-388029515580 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfe359f-437c-46c5-8212-388029515580 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ogOtdHKG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:48:27 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-cdfe359f-437c-46c5-8212-388029515580 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:48:27 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-cdfe359f-437c-46c5-8212-388029515580 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-cdfe359f-437c-46c5-8212-388029515580 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:48:27 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-cdfe359f-437c-46c5-8212-388029515580 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:48:27 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-cdfe359f-437c-46c5-8212-388029515580 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-cdfe359f-437c-46c5-8212-388029515580 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:48:27 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-cdfe359f-437c-46c5-8212-388029515580 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 09:48:27 user nova-compute[71113]: DEBUG nova.compute.manager [req-d3eab82f-f1c7-4cc7-b5ca-f9fc19e2b8c2 req-17327ab7-9644-4c99-9b7e-049c43bb356f service nova] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Received event network-vif-plugged-a9e62527-eba5-484a-9b2d-6ff8fdead8e9 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-d3eab82f-f1c7-4cc7-b5ca-f9fc19e2b8c2 req-17327ab7-9644-4c99-9b7e-049c43bb356f service nova] Acquiring lock "8d033eac-23ea-417a-981c-578328f1c3ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-d3eab82f-f1c7-4cc7-b5ca-f9fc19e2b8c2 req-17327ab7-9644-4c99-9b7e-049c43bb356f service nova] Lock "8d033eac-23ea-417a-981c-578328f1c3ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-d3eab82f-f1c7-4cc7-b5ca-f9fc19e2b8c2 req-17327ab7-9644-4c99-9b7e-049c43bb356f service nova] Lock "8d033eac-23ea-417a-981c-578328f1c3ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG nova.compute.manager [req-d3eab82f-f1c7-4cc7-b5ca-f9fc19e2b8c2 req-17327ab7-9644-4c99-9b7e-049c43bb356f service nova] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] No waiting events found dispatching network-vif-plugged-a9e62527-eba5-484a-9b2d-6ff8fdead8e9 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:48:27 user nova-compute[71113]: WARNING nova.compute.manager [req-d3eab82f-f1c7-4cc7-b5ca-f9fc19e2b8c2 req-17327ab7-9644-4c99-9b7e-049c43bb356f service nova] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Received unexpected event network-vif-plugged-a9e62527-eba5-484a-9b2d-6ff8fdead8e9 for instance with vm_state active and task_state None.
Jul 31 09:48:27 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[430d7e01-f99e-43e6-935c-06172ce8334a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfe359f-437c-46c5-8212-388029515580 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 09:48:27 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f00af1-d594-4700-9dda-a2b796891fc2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfe359f-437c-46c5-8212-388029515580 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754] added
Jul 31 09:48:27 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.072s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d584361e-8811-4eaa-a301-de9672868952]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfe359f-437c-46c5-8212-388029515580 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[521af789-df2d-4794-9789-fa5d8684fa99]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfe359f-437c-46c5-8212-388029515580 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ogOtdHKG {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ogOtdHKG" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ea7a67-c87b-4ed7-8656-d6c08334618a]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfe359f-437c-46c5-8212-388029515580 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ogOtdHKG'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17dde61-441f-41e6-8c00-e13c436d33f7]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfe359f-437c-46c5-8212-388029515580 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-43eb5a21-fc66-45ce-a99c-170df33c5565 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Acquiring lock "f84b913d-0794-43a6-90d3-aaf4102f9fb6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-43eb5a21-fc66-45ce-a99c-170df33c5565 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Lock "f84b913d-0794-43a6-90d3-aaf4102f9fb6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[883bf34b-ecb9-406f-a00e-c855348c6de9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfe359f-437c-46c5-8212-388029515580 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)
Jul 31 09:48:27 user nova-compute[71113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)
Jul 31 09:48:27 user nova-compute[71113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)
Jul 31 09:48:27 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfe359f-437c-46c5-8212-388029515580 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)
Jul 31 09:48:27 user nova-compute[71113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)
Jul 31 09:48:27 user nova-compute[71113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)
Jul 31 09:48:27 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG nova.objects.instance [None req-43eb5a21-fc66-45ce-a99c-170df33c5565 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Lazy-loading 'flavor' on Instance uuid f84b913d-0794-43a6-90d3-aaf4102f9fb6 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-43eb5a21-fc66-45ce-a99c-170df33c5565 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Lock "f84b913d-0794-43a6-90d3-aaf4102f9fb6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad52645c-1231-4084-89fe-5ac2bd29183f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfe359f-437c-46c5-8212-388029515580 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754, portal: 172.16.0.220,3260]
Jul 31 09:48:27 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754, portal: 172.16.0.220,3260] successful.
Jul 31 09:48:27 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5ba2fe-8a6a-4017-bb10-9d89da1bbbd4]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfe359f-437c-46c5-8212-388029515580 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd7639f-6cd0-4655-a0bb-454273cebb5f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfe359f-437c-46c5-8212-388029515580 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)
Jul 31 09:48:27 user nova-compute[71113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)
Jul 31 09:48:27 user nova-compute[71113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)
Jul 31 09:48:27 user nova-compute[71113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:48:27 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfe359f-437c-46c5-8212-388029515580 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)
Jul 31 09:48:27 user nova-compute[71113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)
Jul 31 09:48:27 user nova-compute[71113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)
Jul 31 09:48:27 user nova-compute[71113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:48:27 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-cdfe359f-437c-46c5-8212-388029515580 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.456s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfe359f-437c-46c5-8212-388029515580 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-cdfe359f-437c-46c5-8212-388029515580 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-cdfe359f-437c-46c5-8212-388029515580 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[981d1ec9-8930-4dea-a0e6-cb3e48f3eb2f]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:27 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-cdfe359f-437c-46c5-8212-388029515580 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: None {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 09:48:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-43eb5a21-fc66-45ce-a99c-170df33c5565 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Acquiring lock "f84b913d-0794-43a6-90d3-aaf4102f9fb6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:48:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-43eb5a21-fc66-45ce-a99c-170df33c5565 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Lock "f84b913d-0794-43a6-90d3-aaf4102f9fb6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:48:28 user nova-compute[71113]: INFO nova.compute.manager [None req-43eb5a21-fc66-45ce-a99c-170df33c5565 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Attaching volume bda51ed4-07ad-4407-9185-2369362702ee to /dev/sdc
Jul 31 09:48:28 user nova-compute[71113]: DEBUG os_brick.utils [None req-43eb5a21-fc66-45ce-a99c-170df33c5565 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:48:28 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:28 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:28 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[62fdf28a-fbaa-43dd-949d-86f0d0e83181]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:28 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:28 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:28 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d757d2e4-87d7-4667-b96e-06651506c4eb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:28 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:28 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:28 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92f087c-4d4a-46b0-91a4-0f7ba41c299c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:28 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[199f6718-03d3-4a36-b660-74bef56858ac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:28 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-43eb5a21-fc66-45ce-a99c-170df33c5565 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:28 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-43eb5a21-fc66-45ce-a99c-170df33c5565 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:48:28 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-43eb5a21-fc66-45ce-a99c-170df33c5565 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 09:48:28 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:28 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:48:28 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 09:48:28 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ec1059-e77a-4b79-ad3e-f1bf23d3bda5]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:28 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-43eb5a21-fc66-45ce-a99c-170df33c5565 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 09:48:28 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-43eb5a21-fc66-45ce-a99c-170df33c5565 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 09:48:28 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-43eb5a21-fc66-45ce-a99c-170df33c5565 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 09:48:28 user nova-compute[71113]: DEBUG os_brick.utils [None req-43eb5a21-fc66-45ce-a99c-170df33c5565 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:48:28 user nova-compute[71113]: DEBUG nova.virt.block_device [None req-43eb5a21-fc66-45ce-a99c-170df33c5565 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Updating existing volume attachment record: 64d43a0a-b6f9-462b-ba87-00eeb7110e23 {{(pid=71113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 09:48:28 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-cdfe359f-437c-46c5-8212-388029515580 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 09:48:28 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfe359f-437c-46c5-8212-388029515580 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ogOtdHKG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 09:48:28 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-cdfe359f-437c-46c5-8212-388029515580 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.491s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:48:28 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfe359f-437c-46c5-8212-388029515580 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] <== connect_volume: return (1493ms) {'type': 'block', 'scsi_wwn': '26662306533363038', 'path': '/dev/sde'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:48:28 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdfe359f-437c-46c5-8212-388029515580 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662306533363038', 'path': '/dev/sde'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 09:48:28 user nova-compute[71113]: DEBUG nova.objects.instance [None req-cdfe359f-437c-46c5-8212-388029515580 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lazy-loading 'flavor' on Instance uuid 1112a49d-27bd-4fc8-bae6-ec1decbb47db {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:48:28 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-cdfe359f-437c-46c5-8212-388029515580 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 09:48:28 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:48:28 user nova-compute[71113]:   <source dev="/dev/sde"/>
Jul 31 09:48:28 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 09:48:28 user nova-compute[71113]:   <serial>76f6fa14-9162-43ca-9631-6c09fc7f2754</serial>
Jul 31 09:48:28 user nova-compute[71113]: </disk>
Jul 31 09:48:28 user nova-compute[71113]:  {{(pid=71113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 09:48:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:29 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-cdfe359f-437c-46c5-8212-388029515580 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:48:29 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-cdfe359f-437c-46c5-8212-388029515580 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:48:29 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-cdfe359f-437c-46c5-8212-388029515580 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] No VIF found with MAC fa:16:3e:72:e2:f2, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 09:48:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Acquiring lock "9a4b47dd-b335-4c2f-9dee-5421357a0ee1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:48:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "9a4b47dd-b335-4c2f-9dee-5421357a0ee1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:48:29 user nova-compute[71113]: DEBUG nova.compute.manager [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Starting instance... {{(pid=71113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 09:48:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:48:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:48:29 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 09:48:29 user nova-compute[71113]: INFO nova.compute.claims [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Claim successful on node user
Jul 31 09:48:29 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ba3e575-b863-4de9-8472-2d735a2423b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 09:48:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba3e575-b863-4de9-8472-2d735a2423b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ecd76d7e-a580-4361-bcf2-232961825ac0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jAWlLrZt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:48:29 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-7ba3e575-b863-4de9-8472-2d735a2423b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:48:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-7ba3e575-b863-4de9-8472-2d735a2423b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:48:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-7ba3e575-b863-4de9-8472-2d735a2423b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:48:29 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-7ba3e575-b863-4de9-8472-2d735a2423b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:48:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-7ba3e575-b863-4de9-8472-2d735a2423b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecd76d7e-a580-4361-bcf2-232961825ac0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:48:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-7ba3e575-b863-4de9-8472-2d735a2423b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecd76d7e-a580-4361-bcf2-232961825ac0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:48:29 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-7ba3e575-b863-4de9-8472-2d735a2423b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 09:48:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecd76d7e-a580-4361-bcf2-232961825ac0 -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecd76d7e-a580-4361-bcf2-232961825ac0 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:29 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[40eb78a9-bc1a-4f93-a077-2ebb7c0f7007]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba3e575-b863-4de9-8472-2d735a2423b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 09:48:29 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecd76d7e-a580-4361-bcf2-232961825ac0 -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecd76d7e-a580-4361-bcf2-232961825ac0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:29 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3dea3c-0a9e-4ffe-865e-c5ba33ff1544]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ecd76d7e-a580-4361-bcf2-232961825ac0] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba3e575-b863-4de9-8472-2d735a2423b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ecd76d7e-a580-4361-bcf2-232961825ac0] added
Jul 31 09:48:29 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecd76d7e-a580-4361-bcf2-232961825ac0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecd76d7e-a580-4361-bcf2-232961825ac0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:29 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4dbf627-1225-4f97-a6ba-cb46a4a1f7fe]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba3e575-b863-4de9-8472-2d735a2423b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecd76d7e-a580-4361-bcf2-232961825ac0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecd76d7e-a580-4361-bcf2-232961825ac0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:29 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b88801-c2a2-42c6-b59b-bbd98a7078e3]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba3e575-b863-4de9-8472-2d735a2423b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecd76d7e-a580-4361-bcf2-232961825ac0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jAWlLrZt {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecd76d7e-a580-4361-bcf2-232961825ac0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jAWlLrZt" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:29 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7963f44a-c1f3-4724-9fd3-dc7d897ecea4]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba3e575-b863-4de9-8472-2d735a2423b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jAWlLrZt'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecd76d7e-a580-4361-bcf2-232961825ac0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecd76d7e-a580-4361-bcf2-232961825ac0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:29 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6441b0fa-0460-49f4-a3b4-7b7572f06e16]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba3e575-b863-4de9-8472-2d735a2423b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:30 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fc98ab-c866-4012-84b5-73882bda6655]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:30 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba3e575-b863-4de9-8472-2d735a2423b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)
Jul 31 09:48:30 user nova-compute[71113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)
Jul 31 09:48:30 user nova-compute[71113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)
Jul 31 09:48:30 user nova-compute[71113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:48:30 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:48:30 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba3e575-b863-4de9-8472-2d735a2423b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)
Jul 31 09:48:30 user nova-compute[71113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)
Jul 31 09:48:30 user nova-compute[71113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)
Jul 31 09:48:30 user nova-compute[71113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:48:30 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:48:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecd76d7e-a580-4361-bcf2-232961825ac0 -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-cdfe359f-437c-46c5-8212-388029515580 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.589s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:48:30 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:48:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecd76d7e-a580-4361-bcf2-232961825ac0 -p 172.16.0.220:3260 --login" returned: 0 in 0.099s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:30 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd312c2-9e92-448c-8e0d-9c7e30d03396]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ecd76d7e-a580-4361-bcf2-232961825ac0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ecd76d7e-a580-4361-bcf2-232961825ac0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:30 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba3e575-b863-4de9-8472-2d735a2423b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ecd76d7e-a580-4361-bcf2-232961825ac0, portal: 172.16.0.220,3260]
Jul 31 09:48:30 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:ecd76d7e-a580-4361-bcf2-232961825ac0, portal: 172.16.0.220,3260] successful.
Jul 31 09:48:30 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecd76d7e-a580-4361-bcf2-232961825ac0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:30 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:48:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecd76d7e-a580-4361-bcf2-232961825ac0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:30 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b999742-2934-4600-bf27-b08dbf816c57]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:30 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba3e575-b863-4de9-8472-2d735a2423b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.538s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:48:30 user nova-compute[71113]: DEBUG nova.compute.manager [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Start building networks asynchronously for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 09:48:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:30 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[db759fc3-6dea-41aa-8f60-4417b20b1d07]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecd76d7e-a580-4361-bcf2-232961825ac0 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:30 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba3e575-b863-4de9-8472-2d735a2423b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)
Jul 31 09:48:30 user nova-compute[71113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)
Jul 31 09:48:30 user nova-compute[71113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)
Jul 31 09:48:30 user nova-compute[71113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:48:30 user nova-compute[71113]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecd76d7e-a580-4361-bcf2-232961825ac0 (non-flash)
Jul 31 09:48:30 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:48:30 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba3e575-b863-4de9-8472-2d735a2423b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)
Jul 31 09:48:30 user nova-compute[71113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)
Jul 31 09:48:30 user nova-compute[71113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)
Jul 31 09:48:30 user nova-compute[71113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:48:30 user nova-compute[71113]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecd76d7e-a580-4361-bcf2-232961825ac0 (non-flash)
Jul 31 09:48:30 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:48:30 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-7ba3e575-b863-4de9-8472-2d735a2423b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecd76d7e-a580-4361-bcf2-232961825ac0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.384s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:48:30 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba3e575-b863-4de9-8472-2d735a2423b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 09:48:30 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-7ba3e575-b863-4de9-8472-2d735a2423b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 09:48:30 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-7ba3e575-b863-4de9-8472-2d735a2423b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 09:48:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:30 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e00abb7-bbe4-46a2-a645-53d281ae0976]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:30 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-7ba3e575-b863-4de9-8472-2d735a2423b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 09:48:30 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba3e575-b863-4de9-8472-2d735a2423b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jAWlLrZt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 09:48:30 user nova-compute[71113]: DEBUG nova.compute.manager [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Allocating IP information in the background. {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 09:48:30 user nova-compute[71113]: DEBUG nova.network.neutron [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] allocate_for_instance() {{(pid=71113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 09:48:30 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 09:48:30 user nova-compute[71113]: DEBUG nova.compute.manager [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Start building block device mappings for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 09:48:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-44316597-59bf-4428-818f-99cdf98d2621 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Acquiring lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:48:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-44316597-59bf-4428-818f-99cdf98d2621 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:48:30 user nova-compute[71113]: DEBUG nova.compute.manager [None req-44316597-59bf-4428-818f-99cdf98d2621 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:48:30 user nova-compute[71113]: DEBUG nova.compute.manager [None req-44316597-59bf-4428-818f-99cdf98d2621 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71113) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Jul 31 09:48:30 user nova-compute[71113]: DEBUG nova.objects.instance [None req-44316597-59bf-4428-818f-99cdf98d2621 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lazy-loading 'flavor' on Instance uuid 1112a49d-27bd-4fc8-bae6-ec1decbb47db {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:48:30 user nova-compute[71113]: DEBUG nova.compute.manager [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Start spawning the instance on the hypervisor. {{(pid=71113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 09:48:30 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 09:48:30 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Creating image(s)
Jul 31 09:48:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Acquiring lock "/opt/stack/data/nova/instances/9a4b47dd-b335-4c2f-9dee-5421357a0ee1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:48:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "/opt/stack/data/nova/instances/9a4b47dd-b335-4c2f-9dee-5421357a0ee1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:48:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "/opt/stack/data/nova/instances/9a4b47dd-b335-4c2f-9dee-5421357a0ee1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:48:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:30 user nova-compute[71113]: DEBUG nova.policy [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a414c37ab0384024821d33e393b711af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60e95a8fd2446d5bd5308f10caa6930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71113) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 09:48:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.157s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Acquiring lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:48:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:48:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:31 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.182s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:31 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/9a4b47dd-b335-4c2f-9dee-5421357a0ee1/disk 1073741824 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:31 user nova-compute[71113]: DEBUG nova.compute.manager [req-52f60bda-50c3-41e6-8eac-20a4ef214f3b req-eec67fc5-02e3-4ace-8367-de74cf96cf7d service nova] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Received event network-vif-unplugged-647f984e-a9e3-4e49-9877-75ad4826e467 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:48:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-52f60bda-50c3-41e6-8eac-20a4ef214f3b req-eec67fc5-02e3-4ace-8367-de74cf96cf7d service nova] Acquiring lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:48:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-52f60bda-50c3-41e6-8eac-20a4ef214f3b req-eec67fc5-02e3-4ace-8367-de74cf96cf7d service nova] Lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:48:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-52f60bda-50c3-41e6-8eac-20a4ef214f3b req-eec67fc5-02e3-4ace-8367-de74cf96cf7d service nova] Lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:48:31 user nova-compute[71113]: DEBUG nova.compute.manager [req-52f60bda-50c3-41e6-8eac-20a4ef214f3b req-eec67fc5-02e3-4ace-8367-de74cf96cf7d service nova] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] No waiting events found dispatching network-vif-unplugged-647f984e-a9e3-4e49-9877-75ad4826e467 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:48:31 user nova-compute[71113]: WARNING nova.compute.manager [req-52f60bda-50c3-41e6-8eac-20a4ef214f3b req-eec67fc5-02e3-4ace-8367-de74cf96cf7d service nova] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Received unexpected event network-vif-unplugged-647f984e-a9e3-4e49-9877-75ad4826e467 for instance with vm_state active and task_state powering-off.
Jul 31 09:48:31 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/9a4b47dd-b335-4c2f-9dee-5421357a0ee1/disk 1073741824" returned: 0 in 0.062s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:48:31 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:31 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-7ba3e575-b863-4de9-8472-2d735a2423b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.423s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:48:31 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba3e575-b863-4de9-8472-2d735a2423b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] <== connect_volume: return (1426ms) {'type': 'block', 'scsi_wwn': '23338623331316331', 'path': '/dev/sdf'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:48:31 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ba3e575-b863-4de9-8472-2d735a2423b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338623331316331', 'path': '/dev/sdf'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 09:48:31 user nova-compute[71113]: DEBUG nova.objects.instance [None req-7ba3e575-b863-4de9-8472-2d735a2423b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Lazy-loading 'flavor' on Instance uuid caac13d2-ceb3-4fee-84ad-5376c1c2cc23 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:48:31 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.176s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:31 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9a4b47dd-b335-4c2f-9dee-5421357a0ee1/disk. size=1073741824 {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 09:48:31 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a4b47dd-b335-4c2f-9dee-5421357a0ee1/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:31 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-7ba3e575-b863-4de9-8472-2d735a2423b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 09:48:31 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:48:31 user nova-compute[71113]:   <source dev="/dev/sdf"/>
Jul 31 09:48:31 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 09:48:31 user nova-compute[71113]:   <serial>ecd76d7e-a580-4361-bcf2-232961825ac0</serial>
Jul 31 09:48:31 user nova-compute[71113]: </disk>
Jul 31 09:48:31 user nova-compute[71113]:  {{(pid=71113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 09:48:31 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a4b47dd-b335-4c2f-9dee-5421357a0ee1/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:31 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Cannot resize image /opt/stack/data/nova/instances/9a4b47dd-b335-4c2f-9dee-5421357a0ee1/disk to a smaller size. {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 09:48:31 user nova-compute[71113]: DEBUG nova.objects.instance [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lazy-loading 'migration_context' on Instance uuid 9a4b47dd-b335-4c2f-9dee-5421357a0ee1 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:48:31 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Created local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 09:48:31 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Ensure instance console log exists: /opt/stack/data/nova/instances/9a4b47dd-b335-4c2f-9dee-5421357a0ee1/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 09:48:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:48:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:48:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:48:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:31 user nova-compute[71113]: DEBUG nova.network.neutron [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Successfully created port: e95375b7-8c89-4353-9ba9-0469792056dd {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 09:48:31 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Instance destroyed successfully.
Jul 31 09:48:31 user nova-compute[71113]: DEBUG nova.compute.manager [None req-44316597-59bf-4428-818f-99cdf98d2621 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:48:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-44316597-59bf-4428-818f-99cdf98d2621 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.329s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:48:32 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-7ba3e575-b863-4de9-8472-2d735a2423b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:48:32 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-7ba3e575-b863-4de9-8472-2d735a2423b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:48:32 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-7ba3e575-b863-4de9-8472-2d735a2423b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] No VIF found with MAC fa:16:3e:e8:e4:f6, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 09:48:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7ba3e575-b863-4de9-8472-2d735a2423b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Lock "caac13d2-ceb3-4fee-84ad-5376c1c2cc23" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.310s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:48:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:32 user nova-compute[71113]: DEBUG nova.network.neutron [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Successfully updated port: e95375b7-8c89-4353-9ba9-0469792056dd {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 09:48:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Acquiring lock "refresh_cache-9a4b47dd-b335-4c2f-9dee-5421357a0ee1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:48:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Acquired lock "refresh_cache-9a4b47dd-b335-4c2f-9dee-5421357a0ee1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:48:32 user nova-compute[71113]: DEBUG nova.network.neutron [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 09:48:32 user nova-compute[71113]: DEBUG nova.compute.manager [req-e586c111-4d4c-42ea-844d-f5c72ccf9a35 req-f42a7653-f135-4130-8b8d-8180bd4e848d service nova] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Received event network-changed-e95375b7-8c89-4353-9ba9-0469792056dd {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:48:32 user nova-compute[71113]: DEBUG nova.compute.manager [req-e586c111-4d4c-42ea-844d-f5c72ccf9a35 req-f42a7653-f135-4130-8b8d-8180bd4e848d service nova] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Refreshing instance network info cache due to event network-changed-e95375b7-8c89-4353-9ba9-0469792056dd. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:48:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e586c111-4d4c-42ea-844d-f5c72ccf9a35 req-f42a7653-f135-4130-8b8d-8180bd4e848d service nova] Acquiring lock "refresh_cache-9a4b47dd-b335-4c2f-9dee-5421357a0ee1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:48:32 user nova-compute[71113]: DEBUG nova.network.neutron [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 09:48:32 user nova-compute[71113]: DEBUG nova.network.neutron [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Updating instance_info_cache with network_info: [{"id": "e95375b7-8c89-4353-9ba9-0469792056dd", "address": "fa:16:3e:16:25:0d", "network": {"id": "8c75ddf2-700c-4f01-b8cf-af57bdab7d37", "bridge": "br-int", "label": "tempest-TestStampPattern-1367141606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60e95a8fd2446d5bd5308f10caa6930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape95375b7-8c", "ovs_interfaceid": "e95375b7-8c89-4353-9ba9-0469792056dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:48:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Releasing lock "refresh_cache-9a4b47dd-b335-4c2f-9dee-5421357a0ee1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:48:32 user nova-compute[71113]: DEBUG nova.compute.manager [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Instance network_info: |[{"id": "e95375b7-8c89-4353-9ba9-0469792056dd", "address": "fa:16:3e:16:25:0d", "network": {"id": "8c75ddf2-700c-4f01-b8cf-af57bdab7d37", "bridge": "br-int", "label": "tempest-TestStampPattern-1367141606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60e95a8fd2446d5bd5308f10caa6930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape95375b7-8c", "ovs_interfaceid": "e95375b7-8c89-4353-9ba9-0469792056dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 09:48:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e586c111-4d4c-42ea-844d-f5c72ccf9a35 req-f42a7653-f135-4130-8b8d-8180bd4e848d service nova] Acquired lock "refresh_cache-9a4b47dd-b335-4c2f-9dee-5421357a0ee1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:48:32 user nova-compute[71113]: DEBUG nova.network.neutron [req-e586c111-4d4c-42ea-844d-f5c72ccf9a35 req-f42a7653-f135-4130-8b8d-8180bd4e848d service nova] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Refreshing network info cache for port e95375b7-8c89-4353-9ba9-0469792056dd {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:48:32 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Start _get_guest_xml network_info=[{"id": "e95375b7-8c89-4353-9ba9-0469792056dd", "address": "fa:16:3e:16:25:0d", "network": {"id": "8c75ddf2-700c-4f01-b8cf-af57bdab7d37", "bridge": "br-int", "label": "tempest-TestStampPattern-1367141606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60e95a8fd2446d5bd5308f10caa6930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape95375b7-8c", "ovs_interfaceid": "e95375b7-8c89-4353-9ba9-0469792056dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'image_id': '078646fe-b504-41ed-a147-61072e903e51'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 09:48:33 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:48:33 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:48:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:48:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1259370919',display_name='tempest-TestStampPattern-server-1259370919',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1259370919',id=11,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrIg8Re0SPL90KGI/7mfKXKiutrisvPKJSJwI2GyIKoRN6YbCL8gOrKsaFBkaHBzRjOk6oMjoGJtW64C2f48/NDQKl52ZNucPGtAtvZuIzC2XttPHjvBX5TLIsYhRNoTA==',key_name='tempest-TestStampPattern-211360877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f60e95a8fd2446d5bd5308f10caa6930',ramdisk_id='',reservation_id='r-mosn1a30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-12160385',owner_user_name='tempest-TestStampPattern-12160385-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:48:30Z,user_data=None,user_id='a414c37ab0384024821d33e393b711af',uuid=9a4b47dd-b335-4c2f-9dee-5421357a0ee1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e95375b7-8c89-4353-9ba9-0469792056dd", "address": "fa:16:3e:16:25:0d", "network": {"id": "8c75ddf2-700c-4f01-b8cf-af57bdab7d37", "bridge": "br-int", "label": "tempest-TestStampPattern-1367141606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60e95a8fd2446d5bd5308f10caa6930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape95375b7-8c", "ovs_interfaceid": "e95375b7-8c89-4353-9ba9-0469792056dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Converting VIF {"id": "e95375b7-8c89-4353-9ba9-0469792056dd", "address": "fa:16:3e:16:25:0d", "network": {"id": "8c75ddf2-700c-4f01-b8cf-af57bdab7d37", "bridge": "br-int", "label": "tempest-TestStampPattern-1367141606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60e95a8fd2446d5bd5308f10caa6930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape95375b7-8c", "ovs_interfaceid": "e95375b7-8c89-4353-9ba9-0469792056dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:25:0d,bridge_name='br-int',has_traffic_filtering=True,id=e95375b7-8c89-4353-9ba9-0469792056dd,network=Network(8c75ddf2-700c-4f01-b8cf-af57bdab7d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape95375b7-8c') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG nova.objects.instance [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lazy-loading 'pci_devices' on Instance uuid 9a4b47dd-b335-4c2f-9dee-5421357a0ee1 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] End _get_guest_xml xml=<domain type="kvm">
Jul 31 09:48:33 user nova-compute[71113]:   <uuid>9a4b47dd-b335-4c2f-9dee-5421357a0ee1</uuid>
Jul 31 09:48:33 user nova-compute[71113]:   <name>instance-0000000b</name>
Jul 31 09:48:33 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 09:48:33 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 09:48:33 user nova-compute[71113]:   <metadata>
Jul 31 09:48:33 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 09:48:33 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 09:48:33 user nova-compute[71113]:       <nova:name>tempest-TestStampPattern-server-1259370919</nova:name>
Jul 31 09:48:33 user nova-compute[71113]:       <nova:creationTime>2023-07-31 09:48:33</nova:creationTime>
Jul 31 09:48:33 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 09:48:33 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 09:48:33 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 09:48:33 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 09:48:33 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 09:48:33 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 09:48:33 user nova-compute[71113]:       </nova:flavor>
Jul 31 09:48:33 user nova-compute[71113]:       <nova:owner>
Jul 31 09:48:33 user nova-compute[71113]:         <nova:user uuid="a414c37ab0384024821d33e393b711af">tempest-TestStampPattern-12160385-project-member</nova:user>
Jul 31 09:48:33 user nova-compute[71113]:         <nova:project uuid="f60e95a8fd2446d5bd5308f10caa6930">tempest-TestStampPattern-12160385</nova:project>
Jul 31 09:48:33 user nova-compute[71113]:       </nova:owner>
Jul 31 09:48:33 user nova-compute[71113]:       <nova:root type="image" uuid="078646fe-b504-41ed-a147-61072e903e51"/>
Jul 31 09:48:33 user nova-compute[71113]:       <nova:ports>
Jul 31 09:48:33 user nova-compute[71113]:         <nova:port uuid="e95375b7-8c89-4353-9ba9-0469792056dd">
Jul 31 09:48:33 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 31 09:48:33 user nova-compute[71113]:         </nova:port>
Jul 31 09:48:33 user nova-compute[71113]:       </nova:ports>
Jul 31 09:48:33 user nova-compute[71113]:     </nova:instance>
Jul 31 09:48:33 user nova-compute[71113]:   </metadata>
Jul 31 09:48:33 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 09:48:33 user nova-compute[71113]:     <system>
Jul 31 09:48:33 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 09:48:33 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 09:48:33 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 09:48:33 user nova-compute[71113]:       <entry name="serial">9a4b47dd-b335-4c2f-9dee-5421357a0ee1</entry>
Jul 31 09:48:33 user nova-compute[71113]:       <entry name="uuid">9a4b47dd-b335-4c2f-9dee-5421357a0ee1</entry>
Jul 31 09:48:33 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 09:48:33 user nova-compute[71113]:     </system>
Jul 31 09:48:33 user nova-compute[71113]:   </sysinfo>
Jul 31 09:48:33 user nova-compute[71113]:   <os>
Jul 31 09:48:33 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 09:48:33 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 09:48:33 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 09:48:33 user nova-compute[71113]:   </os>
Jul 31 09:48:33 user nova-compute[71113]:   <features>
Jul 31 09:48:33 user nova-compute[71113]:     <acpi/>
Jul 31 09:48:33 user nova-compute[71113]:     <apic/>
Jul 31 09:48:33 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 09:48:33 user nova-compute[71113]:   </features>
Jul 31 09:48:33 user nova-compute[71113]:   <clock offset="utc">
Jul 31 09:48:33 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 09:48:33 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 09:48:33 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 09:48:33 user nova-compute[71113]:   </clock>
Jul 31 09:48:33 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 09:48:33 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 09:48:33 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 09:48:33 user nova-compute[71113]:   </cpu>
Jul 31 09:48:33 user nova-compute[71113]:   <devices>
Jul 31 09:48:33 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 09:48:33 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 09:48:33 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/9a4b47dd-b335-4c2f-9dee-5421357a0ee1/disk"/>
Jul 31 09:48:33 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 09:48:33 user nova-compute[71113]:     </disk>
Jul 31 09:48:33 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 09:48:33 user nova-compute[71113]:       <mac address="fa:16:3e:16:25:0d"/>
Jul 31 09:48:33 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:48:33 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 09:48:33 user nova-compute[71113]:       <target dev="tape95375b7-8c"/>
Jul 31 09:48:33 user nova-compute[71113]:     </interface>
Jul 31 09:48:33 user nova-compute[71113]:     <serial type="pty">
Jul 31 09:48:33 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/9a4b47dd-b335-4c2f-9dee-5421357a0ee1/console.log" append="off"/>
Jul 31 09:48:33 user nova-compute[71113]:     </serial>
Jul 31 09:48:33 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 09:48:33 user nova-compute[71113]:     <video>
Jul 31 09:48:33 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:48:33 user nova-compute[71113]:     </video>
Jul 31 09:48:33 user nova-compute[71113]:     <rng model="virtio">
Jul 31 09:48:33 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 09:48:33 user nova-compute[71113]:     </rng>
Jul 31 09:48:33 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 09:48:33 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 09:48:33 user nova-compute[71113]:       <stats period="10"/>
Jul 31 09:48:33 user nova-compute[71113]:     </memballoon>
Jul 31 09:48:33 user nova-compute[71113]:   </devices>
Jul 31 09:48:33 user nova-compute[71113]: </domain>
Jul 31 09:48:33 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:48:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1259370919',display_name='tempest-TestStampPattern-server-1259370919',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1259370919',id=11,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrIg8Re0SPL90KGI/7mfKXKiutrisvPKJSJwI2GyIKoRN6YbCL8gOrKsaFBkaHBzRjOk6oMjoGJtW64C2f48/NDQKl52ZNucPGtAtvZuIzC2XttPHjvBX5TLIsYhRNoTA==',key_name='tempest-TestStampPattern-211360877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f60e95a8fd2446d5bd5308f10caa6930',ramdisk_id='',reservation_id='r-mosn1a30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-12160385',owner_user_name='tempest-TestStampPattern-12160385-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:48:30Z,user_data=None,user_id='a414c37ab0384024821d33e393b711af',uuid=9a4b47dd-b335-4c2f-9dee-5421357a0ee1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e95375b7-8c89-4353-9ba9-0469792056dd", "address": "fa:16:3e:16:25:0d", "network": {"id": "8c75ddf2-700c-4f01-b8cf-af57bdab7d37", "bridge": "br-int", "label": "tempest-TestStampPattern-1367141606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60e95a8fd2446d5bd5308f10caa6930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape95375b7-8c", "ovs_interfaceid": "e95375b7-8c89-4353-9ba9-0469792056dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Converting VIF {"id": "e95375b7-8c89-4353-9ba9-0469792056dd", "address": "fa:16:3e:16:25:0d", "network": {"id": "8c75ddf2-700c-4f01-b8cf-af57bdab7d37", "bridge": "br-int", "label": "tempest-TestStampPattern-1367141606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60e95a8fd2446d5bd5308f10caa6930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape95375b7-8c", "ovs_interfaceid": "e95375b7-8c89-4353-9ba9-0469792056dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:25:0d,bridge_name='br-int',has_traffic_filtering=True,id=e95375b7-8c89-4353-9ba9-0469792056dd,network=Network(8c75ddf2-700c-4f01-b8cf-af57bdab7d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape95375b7-8c') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG os_vif [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:25:0d,bridge_name='br-int',has_traffic_filtering=True,id=e95375b7-8c89-4353-9ba9-0469792056dd,network=Network(8c75ddf2-700c-4f01-b8cf-af57bdab7d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape95375b7-8c') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape95375b7-8c, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape95375b7-8c, col_values=(('external_ids', {'iface-id': 'e95375b7-8c89-4353-9ba9-0469792056dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:25:0d', 'vm-uuid': '9a4b47dd-b335-4c2f-9dee-5421357a0ee1'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG nova.compute.manager [req-e08cf003-405d-4060-a804-48953745eeae req-d006c88b-a92d-4a63-a743-785a42ec5b0b service nova] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Received event network-vif-plugged-647f984e-a9e3-4e49-9877-75ad4826e467 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e08cf003-405d-4060-a804-48953745eeae req-d006c88b-a92d-4a63-a743-785a42ec5b0b service nova] Acquiring lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e08cf003-405d-4060-a804-48953745eeae req-d006c88b-a92d-4a63-a743-785a42ec5b0b service nova] Lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e08cf003-405d-4060-a804-48953745eeae req-d006c88b-a92d-4a63-a743-785a42ec5b0b service nova] Lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG nova.compute.manager [req-e08cf003-405d-4060-a804-48953745eeae req-d006c88b-a92d-4a63-a743-785a42ec5b0b service nova] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] No waiting events found dispatching network-vif-plugged-647f984e-a9e3-4e49-9877-75ad4826e467 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:48:33 user nova-compute[71113]: WARNING nova.compute.manager [req-e08cf003-405d-4060-a804-48953745eeae req-d006c88b-a92d-4a63-a743-785a42ec5b0b service nova] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Received unexpected event network-vif-plugged-647f984e-a9e3-4e49-9877-75ad4826e467 for instance with vm_state stopped and task_state None.
Jul 31 09:48:33 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:33 user nova-compute[71113]: INFO os_vif [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:25:0d,bridge_name='br-int',has_traffic_filtering=True,id=e95375b7-8c89-4353-9ba9-0469792056dd,network=Network(8c75ddf2-700c-4f01-b8cf-af57bdab7d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape95375b7-8c')
Jul 31 09:48:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] No VIF found with MAC fa:16:3e:16:25:0d, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a7e49fa-8189-49fd-8583-ab0545618bdd tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7e49fa-8189-49fd-8583-ab0545618bdd tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hLvNyHQd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:48:33 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-1a7e49fa-8189-49fd-8583-ab0545618bdd tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:48:33 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-1a7e49fa-8189-49fd-8583-ab0545618bdd tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-1a7e49fa-8189-49fd-8583-ab0545618bdd tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:48:33 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-1a7e49fa-8189-49fd-8583-ab0545618bdd tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:48:33 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-1a7e49fa-8189-49fd-8583-ab0545618bdd tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-1a7e49fa-8189-49fd-8583-ab0545618bdd tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:48:33 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-1a7e49fa-8189-49fd-8583-ab0545618bdd tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 09:48:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6619dd4f-0c35-4572-96f9-e1e549f81fad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7e49fa-8189-49fd-8583-ab0545618bdd tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 09:48:33 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1596d53e-0048-414a-a619-c4c36b8c73a4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7e49fa-8189-49fd-8583-ab0545618bdd tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e] added
Jul 31 09:48:33 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f498ab-9aba-48c7-9767-14851a9d0e90]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7e49fa-8189-49fd-8583-ab0545618bdd tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2a608b-1933-4172-bffe-5d5d4b6fcbdc]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7e49fa-8189-49fd-8583-ab0545618bdd tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hLvNyHQd {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hLvNyHQd" returned: 0 in 0.025s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb8c5cd-b7c0-4230-adc2-44825c9f8446]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7e49fa-8189-49fd-8583-ab0545618bdd tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hLvNyHQd'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f99be3-d6a7-46a2-aafd-dee9e849b922]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7e49fa-8189-49fd-8583-ab0545618bdd tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e2e825-8214-42d8-b1ba-5145ee5a39de]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecd76d7e-a580-4361-bcf2-232961825ac0 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7e49fa-8189-49fd-8583-ab0545618bdd tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)
Jul 31 09:48:33 user nova-compute[71113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)
Jul 31 09:48:33 user nova-compute[71113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)
Jul 31 09:48:33 user nova-compute[71113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:48:33 user nova-compute[71113]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecd76d7e-a580-4361-bcf2-232961825ac0 (non-flash)
Jul 31 09:48:33 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7e49fa-8189-49fd-8583-ab0545618bdd tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)
Jul 31 09:48:33 user nova-compute[71113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)
Jul 31 09:48:33 user nova-compute[71113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)
Jul 31 09:48:33 user nova-compute[71113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:48:33 user nova-compute[71113]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecd76d7e-a580-4361-bcf2-232961825ac0 (non-flash)
Jul 31 09:48:33 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG nova.network.neutron [req-e586c111-4d4c-42ea-844d-f5c72ccf9a35 req-f42a7653-f135-4130-8b8d-8180bd4e848d service nova] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Updated VIF entry in instance network info cache for port e95375b7-8c89-4353-9ba9-0469792056dd. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG nova.network.neutron [req-e586c111-4d4c-42ea-844d-f5c72ccf9a35 req-f42a7653-f135-4130-8b8d-8180bd4e848d service nova] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Updating instance_info_cache with network_info: [{"id": "e95375b7-8c89-4353-9ba9-0469792056dd", "address": "fa:16:3e:16:25:0d", "network": {"id": "8c75ddf2-700c-4f01-b8cf-af57bdab7d37", "bridge": "br-int", "label": "tempest-TestStampPattern-1367141606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60e95a8fd2446d5bd5308f10caa6930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape95375b7-8c", "ovs_interfaceid": "e95375b7-8c89-4353-9ba9-0469792056dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e586c111-4d4c-42ea-844d-f5c72ccf9a35 req-f42a7653-f135-4130-8b8d-8180bd4e848d service nova] Releasing lock "refresh_cache-9a4b47dd-b335-4c2f-9dee-5421357a0ee1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6357b3b-25b8-43d4-ab15-81b4d0f46ce7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7e49fa-8189-49fd-8583-ab0545618bdd tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e, portal: 172.16.0.220,3260]
Jul 31 09:48:33 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e, portal: 172.16.0.220,3260] successful.
Jul 31 09:48:33 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c3aaa0-9c5f-4a28-b828-05680171fdfe]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7e49fa-8189-49fd-8583-ab0545618bdd tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0448589-8e8f-4170-93ca-094526b398f5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecd76d7e-a580-4361-bcf2-232961825ac0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7e49fa-8189-49fd-8583-ab0545618bdd tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)
Jul 31 09:48:33 user nova-compute[71113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)
Jul 31 09:48:33 user nova-compute[71113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)
Jul 31 09:48:33 user nova-compute[71113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:48:33 user nova-compute[71113]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecd76d7e-a580-4361-bcf2-232961825ac0 (non-flash)
Jul 31 09:48:33 user nova-compute[71113]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e (non-flash)
Jul 31 09:48:33 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7e49fa-8189-49fd-8583-ab0545618bdd tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)
Jul 31 09:48:33 user nova-compute[71113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)
Jul 31 09:48:33 user nova-compute[71113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)
Jul 31 09:48:33 user nova-compute[71113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:48:33 user nova-compute[71113]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecd76d7e-a580-4361-bcf2-232961825ac0 (non-flash)
Jul 31 09:48:33 user nova-compute[71113]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e (non-flash)
Jul 31 09:48:33 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-1a7e49fa-8189-49fd-8583-ab0545618bdd tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7e49fa-8189-49fd-8583-ab0545618bdd tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-1a7e49fa-8189-49fd-8583-ab0545618bdd tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-1a7e49fa-8189-49fd-8583-ab0545618bdd tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd163705-d69b-4a2d-ba61-44e7290c9c2a]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-1a7e49fa-8189-49fd-8583-ab0545618bdd tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7e49fa-8189-49fd-8583-ab0545618bdd tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hLvNyHQd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-12bdbe6d-26b2-484c-b768-d63aec19bfa9 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Acquiring lock "caac13d2-ceb3-4fee-84ad-5376c1c2cc23" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:48:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-12bdbe6d-26b2-484c-b768-d63aec19bfa9 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Lock "caac13d2-ceb3-4fee-84ad-5376c1c2cc23" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:48:34 user nova-compute[71113]: INFO nova.compute.manager [None req-12bdbe6d-26b2-484c-b768-d63aec19bfa9 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Detaching volume ecd76d7e-a580-4361-bcf2-232961825ac0
Jul 31 09:48:34 user nova-compute[71113]: INFO nova.virt.block_device [None req-12bdbe6d-26b2-484c-b768-d63aec19bfa9 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Attempting to driver detach volume ecd76d7e-a580-4361-bcf2-232961825ac0 from mountpoint /dev/vdb
Jul 31 09:48:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:34 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-12bdbe6d-26b2-484c-b768-d63aec19bfa9 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Attempting to detach device vdb from instance caac13d2-ceb3-4fee-84ad-5376c1c2cc23 from the persistent domain config. {{(pid=71113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 09:48:34 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-12bdbe6d-26b2-484c-b768-d63aec19bfa9 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 09:48:34 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:48:34 user nova-compute[71113]:   <source dev="/dev/sdf"/>
Jul 31 09:48:34 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 09:48:34 user nova-compute[71113]:   <serial>ecd76d7e-a580-4361-bcf2-232961825ac0</serial>
Jul 31 09:48:34 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 09:48:34 user nova-compute[71113]: </disk>
Jul 31 09:48:34 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 09:48:34 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-12bdbe6d-26b2-484c-b768-d63aec19bfa9 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Successfully detached device vdb from instance caac13d2-ceb3-4fee-84ad-5376c1c2cc23 from the persistent domain config.
Jul 31 09:48:34 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-12bdbe6d-26b2-484c-b768-d63aec19bfa9 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance caac13d2-ceb3-4fee-84ad-5376c1c2cc23 from the live domain config. {{(pid=71113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 09:48:34 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-12bdbe6d-26b2-484c-b768-d63aec19bfa9 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 09:48:34 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:48:34 user nova-compute[71113]:   <source dev="/dev/sdf"/>
Jul 31 09:48:34 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 09:48:34 user nova-compute[71113]:   <serial>ecd76d7e-a580-4361-bcf2-232961825ac0</serial>
Jul 31 09:48:34 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 09:48:34 user nova-compute[71113]: </disk>
Jul 31 09:48:34 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 09:48:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:34 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-1a7e49fa-8189-49fd-8583-ab0545618bdd tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.407s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:48:34 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7e49fa-8189-49fd-8583-ab0545618bdd tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] <== connect_volume: return (1409ms) {'type': 'block', 'scsi_wwn': '23932313239353166', 'path': '/dev/sdg'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:48:34 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a7e49fa-8189-49fd-8583-ab0545618bdd tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932313239353166', 'path': '/dev/sdg'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 09:48:34 user nova-compute[71113]: DEBUG nova.objects.instance [None req-1a7e49fa-8189-49fd-8583-ab0545618bdd tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Lazy-loading 'flavor' on Instance uuid b324fed7-5df8-4ca1-9a5a-06eaffd5e101 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:48:34 user nova-compute[71113]: DEBUG nova.compute.manager [req-f015fe03-76d3-4111-99af-6022d9c42a8f req-3f1a8323-6b88-4308-9b39-9fe7e650a6d0 service nova] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Received event network-vif-plugged-e95375b7-8c89-4353-9ba9-0469792056dd {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:48:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f015fe03-76d3-4111-99af-6022d9c42a8f req-3f1a8323-6b88-4308-9b39-9fe7e650a6d0 service nova] Acquiring lock "9a4b47dd-b335-4c2f-9dee-5421357a0ee1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:48:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f015fe03-76d3-4111-99af-6022d9c42a8f req-3f1a8323-6b88-4308-9b39-9fe7e650a6d0 service nova] Lock "9a4b47dd-b335-4c2f-9dee-5421357a0ee1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:48:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f015fe03-76d3-4111-99af-6022d9c42a8f req-3f1a8323-6b88-4308-9b39-9fe7e650a6d0 service nova] Lock "9a4b47dd-b335-4c2f-9dee-5421357a0ee1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:48:34 user nova-compute[71113]: DEBUG nova.compute.manager [req-f015fe03-76d3-4111-99af-6022d9c42a8f req-3f1a8323-6b88-4308-9b39-9fe7e650a6d0 service nova] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] No waiting events found dispatching network-vif-plugged-e95375b7-8c89-4353-9ba9-0469792056dd {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:48:34 user nova-compute[71113]: WARNING nova.compute.manager [req-f015fe03-76d3-4111-99af-6022d9c42a8f req-3f1a8323-6b88-4308-9b39-9fe7e650a6d0 service nova] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Received unexpected event network-vif-plugged-e95375b7-8c89-4353-9ba9-0469792056dd for instance with vm_state building and task_state spawning.
Jul 31 09:48:34 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-1a7e49fa-8189-49fd-8583-ab0545618bdd tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 09:48:34 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:48:34 user nova-compute[71113]:   <source dev="/dev/sdg"/>
Jul 31 09:48:34 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 09:48:34 user nova-compute[71113]:   <serial>015a658c-3fc8-4c04-9bd3-2318bec06a8e</serial>
Jul 31 09:48:34 user nova-compute[71113]: </disk>
Jul 31 09:48:34 user nova-compute[71113]:  {{(pid=71113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 09:48:34 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Received event <DeviceRemovedEvent: 1690796914.775291, caac13d2-ceb3-4fee-84ad-5376c1c2cc23 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71113) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 09:48:34 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-12bdbe6d-26b2-484c-b768-d63aec19bfa9 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance caac13d2-ceb3-4fee-84ad-5376c1c2cc23 {{(pid=71113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 09:48:34 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-12bdbe6d-26b2-484c-b768-d63aec19bfa9 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Successfully detached device vdb from instance caac13d2-ceb3-4fee-84ad-5376c1c2cc23 from the live domain config.
Jul 31 09:48:34 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12bdbe6d-26b2-484c-b768-d63aec19bfa9 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 09:48:34 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-12bdbe6d-26b2-484c-b768-d63aec19bfa9 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:ecd76d7e-a580-4361-bcf2-232961825ac0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jAWlLrZt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:48:34 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-12bdbe6d-26b2-484c-b768-d63aec19bfa9 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:48:34 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-12bdbe6d-26b2-484c-b768-d63aec19bfa9 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:48:34 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-12bdbe6d-26b2-484c-b768-d63aec19bfa9 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:48:34 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-12bdbe6d-26b2-484c-b768-d63aec19bfa9 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ecd76d7e-a580-4361-bcf2-232961825ac0', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 09:48:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:34 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d542f371-5eb9-4f67-aaf0-68d7b3285b17]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecd76d7e-a580-4361-bcf2-232961825ac0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:34 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[86eb52c6-9dff-4fcb-98e1-ce7f08a0ec63]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecd76d7e-a580-4361-bcf2-232961825ac0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:34 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-12bdbe6d-26b2-484c-b768-d63aec19bfa9 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)
Jul 31 09:48:34 user nova-compute[71113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)
Jul 31 09:48:34 user nova-compute[71113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)
Jul 31 09:48:34 user nova-compute[71113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:48:34 user nova-compute[71113]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecd76d7e-a580-4361-bcf2-232961825ac0 (non-flash)
Jul 31 09:48:34 user nova-compute[71113]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e (non-flash)
Jul 31 09:48:34 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:48:34 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-12bdbe6d-26b2-484c-b768-d63aec19bfa9 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)
Jul 31 09:48:34 user nova-compute[71113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)
Jul 31 09:48:34 user nova-compute[71113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)
Jul 31 09:48:34 user nova-compute[71113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:48:34 user nova-compute[71113]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecd76d7e-a580-4361-bcf2-232961825ac0 (non-flash)
Jul 31 09:48:34 user nova-compute[71113]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e (non-flash)
Jul 31 09:48:34 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:48:34 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-12bdbe6d-26b2-484c-b768-d63aec19bfa9 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f78f06b2440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ecd76d7e-a580-4361-bcf2-232961825ac0'): ({'sdf'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 09:48:34 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-12bdbe6d-26b2-484c-b768-d63aec19bfa9 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Removing single pathed devices sdf {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 09:48:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:34 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e50cc90-d135-4da9-b2bb-3692a6f9a5de]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:34 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c94925-1e1f-4e35-8a73-9d59d1f3ae73]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:34 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-12bdbe6d-26b2-484c-b768-d63aec19bfa9 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Flushing IO for device /dev/sdf {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 09:48:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:34 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9917e7-1fdb-49c7-8d50-41b9178e93fa]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:34 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-12bdbe6d-26b2-484c-b768-d63aec19bfa9 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 09:48:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:34 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e9a706-cb0a-4bb4-8cf2-b52d003aae06]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:34 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-12bdbe6d-26b2-484c-b768-d63aec19bfa9 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 09:48:34 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-12bdbe6d-26b2-484c-b768-d63aec19bfa9 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] SCSI volumes sdf have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 09:48:34 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-12bdbe6d-26b2-484c-b768-d63aec19bfa9 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ecd76d7e-a580-4361-bcf2-232961825ac0')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 09:48:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecd76d7e-a580-4361-bcf2-232961825ac0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecd76d7e-a580-4361-bcf2-232961825ac0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a42cdf-76b2-4f07-908d-aa0bfe77eb62]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-12bdbe6d-26b2-484c-b768-d63aec19bfa9 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecd76d7e-a580-4361-bcf2-232961825ac0 -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecd76d7e-a580-4361-bcf2-232961825ac0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a84d9f3-091f-4d43-89f7-5e6d319bc912]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:ecd76d7e-a580-4361-bcf2-232961825ac0, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:ecd76d7e-a580-4361-bcf2-232961825ac0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-12bdbe6d-26b2-484c-b768-d63aec19bfa9 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:ecd76d7e-a580-4361-bcf2-232961825ac0, portal: 172.16.0.220,3260]
Jul 31 09:48:35 user nova-compute[71113]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:ecd76d7e-a580-4361-bcf2-232961825ac0, portal: 172.16.0.220,3260] successful.
Jul 31 09:48:35 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecd76d7e-a580-4361-bcf2-232961825ac0 -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecd76d7e-a580-4361-bcf2-232961825ac0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f8eac5-0768-4e96-ae62-28e834d604b2]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-12bdbe6d-26b2-484c-b768-d63aec19bfa9 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-12bdbe6d-26b2-484c-b768-d63aec19bfa9 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:48:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-12bdbe6d-26b2-484c-b768-d63aec19bfa9 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] <== disconnect_volume: return (318ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:48:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12bdbe6d-26b2-484c-b768-d63aec19bfa9 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 09:48:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-1a7e49fa-8189-49fd-8583-ab0545618bdd tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:48:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-1a7e49fa-8189-49fd-8583-ab0545618bdd tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:48:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-1a7e49fa-8189-49fd-8583-ab0545618bdd tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] No VIF found with MAC fa:16:3e:14:e4:e5, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 09:48:35 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1a7e49fa-8189-49fd-8583-ab0545618bdd tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Lock "b324fed7-5df8-4ca1-9a5a-06eaffd5e101" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.788s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:48:35 user nova-compute[71113]: DEBUG nova.objects.instance [None req-12bdbe6d-26b2-484c-b768-d63aec19bfa9 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Lazy-loading 'flavor' on Instance uuid caac13d2-ceb3-4fee-84ad-5376c1c2cc23 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:48:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-12bdbe6d-26b2-484c-b768-d63aec19bfa9 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Lock "caac13d2-ceb3-4fee-84ad-5376c1c2cc23" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.041s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:48:36 user nova-compute[71113]: DEBUG nova.compute.manager [req-cb27aa28-0cc7-40a6-a2e6-e5d04cc8073b req-e1398689-f0f4-4bb0-b940-3a360726abbf service nova] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Received event network-vif-plugged-e95375b7-8c89-4353-9ba9-0469792056dd {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:48:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-cb27aa28-0cc7-40a6-a2e6-e5d04cc8073b req-e1398689-f0f4-4bb0-b940-3a360726abbf service nova] Acquiring lock "9a4b47dd-b335-4c2f-9dee-5421357a0ee1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:48:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-cb27aa28-0cc7-40a6-a2e6-e5d04cc8073b req-e1398689-f0f4-4bb0-b940-3a360726abbf service nova] Lock "9a4b47dd-b335-4c2f-9dee-5421357a0ee1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:48:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-cb27aa28-0cc7-40a6-a2e6-e5d04cc8073b req-e1398689-f0f4-4bb0-b940-3a360726abbf service nova] Lock "9a4b47dd-b335-4c2f-9dee-5421357a0ee1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:48:36 user nova-compute[71113]: DEBUG nova.compute.manager [req-cb27aa28-0cc7-40a6-a2e6-e5d04cc8073b req-e1398689-f0f4-4bb0-b940-3a360726abbf service nova] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] No waiting events found dispatching network-vif-plugged-e95375b7-8c89-4353-9ba9-0469792056dd {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:48:36 user nova-compute[71113]: WARNING nova.compute.manager [req-cb27aa28-0cc7-40a6-a2e6-e5d04cc8073b req-e1398689-f0f4-4bb0-b940-3a360726abbf service nova] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Received unexpected event network-vif-plugged-e95375b7-8c89-4353-9ba9-0469792056dd for instance with vm_state building and task_state spawning.
Jul 31 09:48:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Acquiring lock "b324fed7-5df8-4ca1-9a5a-06eaffd5e101" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:48:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Lock "b324fed7-5df8-4ca1-9a5a-06eaffd5e101" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:48:36 user nova-compute[71113]: DEBUG os_brick.utils [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:48:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:36 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[390cbacb-dc5a-490e-9c0d-927fcd1aa834]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:36 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd578f9f-b643-4d2f-a4e0-5628ccfad3e0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:36 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[130d435d-76a3-4398-9209-57b42f5dbed8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:36 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb17b3f-4765-4ab7-b019-e2bb9d150dbe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:48:37 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 09:48:37 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f111caaf-6a7c-4d4b-89d6-2d3c281643b3]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG os_brick.utils [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:48:37 user nova-compute[71113]: INFO nova.compute.manager [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Swapping volume 015a658c-3fc8-4c04-9bd3-2318bec06a8e for 64e05017-e2e4-4c5d-b02a-76df6cc8560b
Jul 31 09:48:37 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43eb5a21-fc66-45ce-a99c-170df33c5565 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-43eb5a21-fc66-45ce-a99c-170df33c5565 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bda51ed4-07ad-4407-9185-2369362702ee'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TLRpusVz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:48:37 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-43eb5a21-fc66-45ce-a99c-170df33c5565 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:48:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-43eb5a21-fc66-45ce-a99c-170df33c5565 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-43eb5a21-fc66-45ce-a99c-170df33c5565 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:48:37 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-43eb5a21-fc66-45ce-a99c-170df33c5565 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:48:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-43eb5a21-fc66-45ce-a99c-170df33c5565 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bda51ed4-07ad-4407-9185-2369362702ee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-43eb5a21-fc66-45ce-a99c-170df33c5565 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bda51ed4-07ad-4407-9185-2369362702ee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:48:37 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-43eb5a21-fc66-45ce-a99c-170df33c5565 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 09:48:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bda51ed4-07ad-4407-9185-2369362702ee -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bda51ed4-07ad-4407-9185-2369362702ee -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[34541949-c571-4bbc-b23a-3f3e4d6e8627]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-43eb5a21-fc66-45ce-a99c-170df33c5565 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 09:48:37 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bda51ed4-07ad-4407-9185-2369362702ee -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bda51ed4-07ad-4407-9185-2369362702ee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a76cf73-9555-4c1d-8b41-8da396b753c1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bda51ed4-07ad-4407-9185-2369362702ee] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-43eb5a21-fc66-45ce-a99c-170df33c5565 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bda51ed4-07ad-4407-9185-2369362702ee] added
Jul 31 09:48:37 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bda51ed4-07ad-4407-9185-2369362702ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bda51ed4-07ad-4407-9185-2369362702ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[62019cb4-1a47-472d-89b4-7f247522ba58]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-43eb5a21-fc66-45ce-a99c-170df33c5565 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bda51ed4-07ad-4407-9185-2369362702ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bda51ed4-07ad-4407-9185-2369362702ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690796917.3186169, 9a4b47dd-b335-4c2f-9dee-5421357a0ee1 => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:48:37 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] VM Resumed (Lifecycle Event)
Jul 31 09:48:37 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b138a7-2393-4d9a-963f-c4e9db70329d]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG nova.compute.manager [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-43eb5a21-fc66-45ce-a99c-170df33c5565 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bda51ed4-07ad-4407-9185-2369362702ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TLRpusVz {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:37 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Instance spawned successfully.
Jul 31 09:48:37 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bda51ed4-07ad-4407-9185-2369362702ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TLRpusVz" returned: 0 in 0.035s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f76f15-16be-488b-a275-d3caecd9776f]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Found default for hw_cdrom_bus of ide {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Found default for hw_disk_bus of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Found default for hw_input_bus of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Found default for hw_pointer_model of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Found default for hw_video_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Found default for hw_vif_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-43eb5a21-fc66-45ce-a99c-170df33c5565 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TLRpusVz'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bda51ed4-07ad-4407-9185-2369362702ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:37 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:48:37 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690796917.3199394, 9a4b47dd-b335-4c2f-9dee-5421357a0ee1 => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:48:37 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] VM Started (Lifecycle Event)
Jul 31 09:48:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bda51ed4-07ad-4407-9185-2369362702ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd00211-b9ed-4b9e-88ca-980626f64f78]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-43eb5a21-fc66-45ce-a99c-170df33c5565 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1e4973-2a60-4ca1-afb6-99a689d5f3b3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-43eb5a21-fc66-45ce-a99c-170df33c5565 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)
Jul 31 09:48:37 user nova-compute[71113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)
Jul 31 09:48:37 user nova-compute[71113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)
Jul 31 09:48:37 user nova-compute[71113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:48:37 user nova-compute[71113]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e (non-flash)
Jul 31 09:48:37 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-43eb5a21-fc66-45ce-a99c-170df33c5565 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)
Jul 31 09:48:37 user nova-compute[71113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)
Jul 31 09:48:37 user nova-compute[71113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)
Jul 31 09:48:37 user nova-compute[71113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:48:37 user nova-compute[71113]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e (non-flash)
Jul 31 09:48:37 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:48:37 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:48:37 user nova-compute[71113]: INFO nova.compute.manager [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Took 6.78 seconds to spawn the instance on the hypervisor.
Jul 31 09:48:37 user nova-compute[71113]: DEBUG nova.compute.manager [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bda51ed4-07ad-4407-9185-2369362702ee -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bda51ed4-07ad-4407-9185-2369362702ee -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95e9226-c526-4e74-887b-af5d02e279c4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bda51ed4-07ad-4407-9185-2369362702ee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bda51ed4-07ad-4407-9185-2369362702ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-43eb5a21-fc66-45ce-a99c-170df33c5565 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bda51ed4-07ad-4407-9185-2369362702ee, portal: 172.16.0.220,3260]
Jul 31 09:48:37 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:bda51ed4-07ad-4407-9185-2369362702ee, portal: 172.16.0.220,3260] successful.
Jul 31 09:48:37 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bda51ed4-07ad-4407-9185-2369362702ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:37 user nova-compute[71113]: INFO nova.compute.manager [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Took 7.95 seconds to build instance.
Jul 31 09:48:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bda51ed4-07ad-4407-9185-2369362702ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a11749e-96d1-445e-8a99-6a617bac1879]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-43eb5a21-fc66-45ce-a99c-170df33c5565 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-eb8319ef-908d-4778-b3f6-0ef6d0a5cb9f tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "9a4b47dd-b335-4c2f-9dee-5421357a0ee1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.094s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e957a0d-2706-49d5-a907-f80244ae1019]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bda51ed4-07ad-4407-9185-2369362702ee (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-43eb5a21-fc66-45ce-a99c-170df33c5565 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)
Jul 31 09:48:37 user nova-compute[71113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)
Jul 31 09:48:37 user nova-compute[71113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)
Jul 31 09:48:37 user nova-compute[71113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:48:37 user nova-compute[71113]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e (non-flash)
Jul 31 09:48:37 user nova-compute[71113]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bda51ed4-07ad-4407-9185-2369362702ee (non-flash)
Jul 31 09:48:37 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-43eb5a21-fc66-45ce-a99c-170df33c5565 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)
Jul 31 09:48:37 user nova-compute[71113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)
Jul 31 09:48:37 user nova-compute[71113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)
Jul 31 09:48:37 user nova-compute[71113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:48:37 user nova-compute[71113]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e (non-flash)
Jul 31 09:48:37 user nova-compute[71113]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bda51ed4-07ad-4407-9185-2369362702ee (non-flash)
Jul 31 09:48:37 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-43eb5a21-fc66-45ce-a99c-170df33c5565 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bda51ed4-07ad-4407-9185-2369362702ee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.368s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-43eb5a21-fc66-45ce-a99c-170df33c5565 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-43eb5a21-fc66-45ce-a99c-170df33c5565 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] HCTL ('37', '-', '-', 0) found on session 9 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-43eb5a21-fc66-45ce-a99c-170df33c5565 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb104d0-c6b8-4e75-8b2b-3b427e8fb3f3]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-43eb5a21-fc66-45ce-a99c-170df33c5565 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Searching for a device in session 9 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 09:48:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-43eb5a21-fc66-45ce-a99c-170df33c5565 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TLRpusVz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 09:48:38 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:38 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-43eb5a21-fc66-45ce-a99c-170df33c5565 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.401s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:48:38 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-43eb5a21-fc66-45ce-a99c-170df33c5565 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] <== connect_volume: return (1403ms) {'type': 'block', 'scsi_wwn': '23834343362323339', 'path': '/dev/sdf'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:48:38 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43eb5a21-fc66-45ce-a99c-170df33c5565 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834343362323339', 'path': '/dev/sdf'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 09:48:38 user nova-compute[71113]: DEBUG nova.objects.instance [None req-43eb5a21-fc66-45ce-a99c-170df33c5565 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Lazy-loading 'flavor' on Instance uuid f84b913d-0794-43a6-90d3-aaf4102f9fb6 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:48:38 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-43eb5a21-fc66-45ce-a99c-170df33c5565 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 09:48:38 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:48:38 user nova-compute[71113]:   <source dev="/dev/sdf"/>
Jul 31 09:48:38 user nova-compute[71113]:   <target dev="sdc" bus="scsi"/>
Jul 31 09:48:38 user nova-compute[71113]:   <serial>bda51ed4-07ad-4407-9185-2369362702ee</serial>
Jul 31 09:48:38 user nova-compute[71113]:   <address type="drive" controller="0" unit="2"/>
Jul 31 09:48:38 user nova-compute[71113]: </disk>
Jul 31 09:48:38 user nova-compute[71113]:  {{(pid=71113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 09:48:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:39 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-43eb5a21-fc66-45ce-a99c-170df33c5565 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] No BDM found with device name sda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:48:39 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-43eb5a21-fc66-45ce-a99c-170df33c5565 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:48:39 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-43eb5a21-fc66-45ce-a99c-170df33c5565 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] No BDM found with device name sdc, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:48:39 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-43eb5a21-fc66-45ce-a99c-170df33c5565 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] No VIF found with MAC fa:16:3e:33:5c:af, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 09:48:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-43eb5a21-fc66-45ce-a99c-170df33c5565 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Lock "f84b913d-0794-43a6-90d3-aaf4102f9fb6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.112s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:48:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-51cd7857-dd01-4165-8fda-923d12090f6b tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Acquiring lock "f84b913d-0794-43a6-90d3-aaf4102f9fb6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:48:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-51cd7857-dd01-4165-8fda-923d12090f6b tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Lock "f84b913d-0794-43a6-90d3-aaf4102f9fb6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:48:40 user nova-compute[71113]: INFO nova.compute.manager [None req-51cd7857-dd01-4165-8fda-923d12090f6b tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Detaching volume bda51ed4-07ad-4407-9185-2369362702ee
Jul 31 09:48:40 user nova-compute[71113]: INFO nova.virt.block_device [None req-51cd7857-dd01-4165-8fda-923d12090f6b tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Attempting to driver detach volume bda51ed4-07ad-4407-9185-2369362702ee from mountpoint /dev/sdc
Jul 31 09:48:40 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-51cd7857-dd01-4165-8fda-923d12090f6b tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Attempting to detach device sdc from instance f84b913d-0794-43a6-90d3-aaf4102f9fb6 from the persistent domain config. {{(pid=71113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 09:48:40 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-51cd7857-dd01-4165-8fda-923d12090f6b tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 09:48:40 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:48:40 user nova-compute[71113]:   <source dev="/dev/sdf"/>
Jul 31 09:48:40 user nova-compute[71113]:   <target dev="sdc" bus="scsi"/>
Jul 31 09:48:40 user nova-compute[71113]:   <serial>bda51ed4-07ad-4407-9185-2369362702ee</serial>
Jul 31 09:48:40 user nova-compute[71113]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Jul 31 09:48:40 user nova-compute[71113]: </disk>
Jul 31 09:48:40 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 09:48:40 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-51cd7857-dd01-4165-8fda-923d12090f6b tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Successfully detached device sdc from instance f84b913d-0794-43a6-90d3-aaf4102f9fb6 from the persistent domain config.
Jul 31 09:48:40 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-51cd7857-dd01-4165-8fda-923d12090f6b tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance f84b913d-0794-43a6-90d3-aaf4102f9fb6 from the live domain config. {{(pid=71113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 09:48:40 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-51cd7857-dd01-4165-8fda-923d12090f6b tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 09:48:40 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:48:40 user nova-compute[71113]:   <source dev="/dev/sdf"/>
Jul 31 09:48:40 user nova-compute[71113]:   <target dev="sdc" bus="scsi"/>
Jul 31 09:48:40 user nova-compute[71113]:   <serial>bda51ed4-07ad-4407-9185-2369362702ee</serial>
Jul 31 09:48:40 user nova-compute[71113]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Jul 31 09:48:40 user nova-compute[71113]: </disk>
Jul 31 09:48:40 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 09:48:40 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Received event <DeviceRemovedEvent: 1690796920.790942, f84b913d-0794-43a6-90d3-aaf4102f9fb6 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71113) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 09:48:40 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-51cd7857-dd01-4165-8fda-923d12090f6b tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance f84b913d-0794-43a6-90d3-aaf4102f9fb6 {{(pid=71113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 09:48:40 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-51cd7857-dd01-4165-8fda-923d12090f6b tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Successfully detached device sdc from instance f84b913d-0794-43a6-90d3-aaf4102f9fb6 from the live domain config.
Jul 31 09:48:40 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51cd7857-dd01-4165-8fda-923d12090f6b tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 09:48:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-51cd7857-dd01-4165-8fda-923d12090f6b tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:bda51ed4-07ad-4407-9185-2369362702ee'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TLRpusVz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:48:40 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-51cd7857-dd01-4165-8fda-923d12090f6b tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:48:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-51cd7857-dd01-4165-8fda-923d12090f6b tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:48:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-51cd7857-dd01-4165-8fda-923d12090f6b tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:48:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-51cd7857-dd01-4165-8fda-923d12090f6b tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bda51ed4-07ad-4407-9185-2369362702ee', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 09:48:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:40 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[be25b072-0683-4bda-be95-430356ca2cd9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bda51ed4-07ad-4407-9185-2369362702ee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:40 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71c48b3-e06a-4e6f-b1a1-69c4405bb618]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bda51ed4-07ad-4407-9185-2369362702ee (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-51cd7857-dd01-4165-8fda-923d12090f6b tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)
Jul 31 09:48:40 user nova-compute[71113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)
Jul 31 09:48:40 user nova-compute[71113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)
Jul 31 09:48:40 user nova-compute[71113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:48:40 user nova-compute[71113]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e (non-flash)
Jul 31 09:48:40 user nova-compute[71113]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bda51ed4-07ad-4407-9185-2369362702ee (non-flash)
Jul 31 09:48:40 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:48:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-51cd7857-dd01-4165-8fda-923d12090f6b tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)
Jul 31 09:48:40 user nova-compute[71113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)
Jul 31 09:48:40 user nova-compute[71113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)
Jul 31 09:48:40 user nova-compute[71113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:48:40 user nova-compute[71113]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e (non-flash)
Jul 31 09:48:40 user nova-compute[71113]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bda51ed4-07ad-4407-9185-2369362702ee (non-flash)
Jul 31 09:48:40 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:48:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-51cd7857-dd01-4165-8fda-923d12090f6b tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f790821f520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bda51ed4-07ad-4407-9185-2369362702ee'): ({'sdf'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 09:48:40 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-51cd7857-dd01-4165-8fda-923d12090f6b tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Removing single pathed devices sdf {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 09:48:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:40 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc748078-6bc6-4feb-af22-bf4f8bdb869f]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:40 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d7cc41-1221-4bdb-87f3-0f69872f7198]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:40 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-51cd7857-dd01-4165-8fda-923d12090f6b tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Flushing IO for device /dev/sdf {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 09:48:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:40 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96fd972-97c9-42db-a167-ca3a3165712c]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:40 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-51cd7857-dd01-4165-8fda-923d12090f6b tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 09:48:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.051s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:40 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc343a8-eaa2-4abb-995f-4f6f0d4c0c73]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:40 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-51cd7857-dd01-4165-8fda-923d12090f6b tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 09:48:40 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-51cd7857-dd01-4165-8fda-923d12090f6b tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] SCSI volumes sdf have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 09:48:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-51cd7857-dd01-4165-8fda-923d12090f6b tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bda51ed4-07ad-4407-9185-2369362702ee')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 09:48:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bda51ed4-07ad-4407-9185-2369362702ee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:41 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bda51ed4-07ad-4407-9185-2369362702ee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:41 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d74423-fa63-4590-a1c8-d9a76d287564]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:41 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-51cd7857-dd01-4165-8fda-923d12090f6b tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:41 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bda51ed4-07ad-4407-9185-2369362702ee -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:41 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bda51ed4-07ad-4407-9185-2369362702ee -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:41 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9d7a81-b1ec-4d5a-bdbe-e645bd458f83]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:bda51ed4-07ad-4407-9185-2369362702ee, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:bda51ed4-07ad-4407-9185-2369362702ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:41 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-51cd7857-dd01-4165-8fda-923d12090f6b tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:bda51ed4-07ad-4407-9185-2369362702ee, portal: 172.16.0.220,3260]
Jul 31 09:48:41 user nova-compute[71113]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:bda51ed4-07ad-4407-9185-2369362702ee, portal: 172.16.0.220,3260] successful.
Jul 31 09:48:41 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:41 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bda51ed4-07ad-4407-9185-2369362702ee -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:41 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bda51ed4-07ad-4407-9185-2369362702ee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:41 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b79583-dbbd-4cd1-b244-92feca4ebaba]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:41 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-51cd7857-dd01-4165-8fda-923d12090f6b tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:41 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-51cd7857-dd01-4165-8fda-923d12090f6b tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:48:41 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-51cd7857-dd01-4165-8fda-923d12090f6b tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] <== disconnect_volume: return (319ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:48:41 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51cd7857-dd01-4165-8fda-923d12090f6b tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 09:48:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG nova.compute.manager [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TVYPFetM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b324fed7-5df8-4ca1-9a5a-06eaffd5e101', 'attached_at': '', 'detached_at': '', 'volume_id': '64e05017-e2e4-4c5d-b02a-76df6cc8560b', 'serial': '64e05017-e2e4-4c5d-b02a-76df6cc8560b'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hLvNyHQd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': 'b324fed7-5df8-4ca1-9a5a-06eaffd5e101', 'attached_at': '', 'detached_at': '', 'volume_id': '015a658c-3fc8-4c04-9bd3-2318bec06a8e', 'serial'} {{(pid=71113) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TVYPFetM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:48:45 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:48:45 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:48:45 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:48:45 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:48:45 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 09:48:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf97e23-2ddf-4a42-9c5d-0cb846ae3035]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 09:48:45 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[42dc0002-adf4-48f3-bcf4-ff09c099e664]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b] added
Jul 31 09:48:45 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5108e6f5-28ff-4e7f-a333-f1950271ae90]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b486a2-d88d-4a58-a8db-12966da797ba]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TVYPFetM {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TVYPFetM" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf70d52-d425-4f60-84be-e4462b4b76c4]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TVYPFetM'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c82150-8bea-463a-88e1-7b851447f7b7]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[203a54e0-03d9-4f3f-b159-8fba6e2e593b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)
Jul 31 09:48:45 user nova-compute[71113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)
Jul 31 09:48:45 user nova-compute[71113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)
Jul 31 09:48:45 user nova-compute[71113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:48:45 user nova-compute[71113]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e (non-flash)
Jul 31 09:48:45 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)
Jul 31 09:48:45 user nova-compute[71113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)
Jul 31 09:48:45 user nova-compute[71113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)
Jul 31 09:48:45 user nova-compute[71113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:48:45 user nova-compute[71113]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e (non-flash)
Jul 31 09:48:45 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[de910977-088d-461c-8699-fa52f87c3773]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b, portal: 172.16.0.220,3260]
Jul 31 09:48:45 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b, portal: 172.16.0.220,3260] successful.
Jul 31 09:48:45 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[50413714-d45e-4858-a074-b018f11b4a43]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG nova.objects.instance [None req-51cd7857-dd01-4165-8fda-923d12090f6b tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Lazy-loading 'flavor' on Instance uuid f84b913d-0794-43a6-90d3-aaf4102f9fb6 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f48c6b3-7f22-4c5f-bec0-9d017166b769]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b (non-flash)
Jul 31 09:48:45 user nova-compute[71113]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)
Jul 31 09:48:45 user nova-compute[71113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)
Jul 31 09:48:45 user nova-compute[71113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)
Jul 31 09:48:45 user nova-compute[71113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:48:45 user nova-compute[71113]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e (non-flash)
Jul 31 09:48:45 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b (non-flash)
Jul 31 09:48:45 user nova-compute[71113]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)
Jul 31 09:48:45 user nova-compute[71113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)
Jul 31 09:48:45 user nova-compute[71113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)
Jul 31 09:48:45 user nova-compute[71113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:48:45 user nova-compute[71113]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e (non-flash)
Jul 31 09:48:45 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] HCTL ('37', '-', '-', 0) found on session 10 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a359bb2-bed1-4030-843a-672b21c55eb1]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Searching for a device in session 10 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TVYPFetM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 09:48:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-51cd7857-dd01-4165-8fda-923d12090f6b tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Lock "f84b913d-0794-43a6-90d3-aaf4102f9fb6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.674s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:48:46 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690796911.9032757, 1112a49d-27bd-4fc8-bae6-ec1decbb47db => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:48:46 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] VM Stopped (Lifecycle Event)
Jul 31 09:48:46 user nova-compute[71113]: DEBUG nova.compute.manager [None req-13519d90-2fad-4509-a1fc-e2165677742d None None] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:48:46 user nova-compute[71113]: DEBUG nova.compute.manager [None req-13519d90-2fad-4509-a1fc-e2165677742d None None] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:48:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:48:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '26137613833386530', 'path': '/dev/sdf'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:48:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26137613833386530', 'path': '/dev/sdf'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 09:48:46 user nova-compute[71113]: DEBUG nova.objects.instance [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Lazy-loading 'flavor' on Instance uuid b324fed7-5df8-4ca1-9a5a-06eaffd5e101 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:48:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-3089d0be-ebb4-4948-bf06-b63b8270ebf8 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Acquiring lock "f84b913d-0794-43a6-90d3-aaf4102f9fb6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:48:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-3089d0be-ebb4-4948-bf06-b63b8270ebf8 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Lock "f84b913d-0794-43a6-90d3-aaf4102f9fb6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:48:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-3089d0be-ebb4-4948-bf06-b63b8270ebf8 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Acquiring lock "f84b913d-0794-43a6-90d3-aaf4102f9fb6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:48:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-3089d0be-ebb4-4948-bf06-b63b8270ebf8 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Lock "f84b913d-0794-43a6-90d3-aaf4102f9fb6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:48:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-3089d0be-ebb4-4948-bf06-b63b8270ebf8 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Lock "f84b913d-0794-43a6-90d3-aaf4102f9fb6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:48:47 user nova-compute[71113]: INFO nova.compute.manager [None req-3089d0be-ebb4-4948-bf06-b63b8270ebf8 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Terminating instance
Jul 31 09:48:47 user nova-compute[71113]: DEBUG nova.compute.manager [None req-3089d0be-ebb4-4948-bf06-b63b8270ebf8 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Start destroying the instance on the hypervisor. {{(pid=71113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 09:48:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:47 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=71113) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 09:48:47 user nova-compute[71113]: DEBUG nova.compute.manager [req-cafabfff-9617-49d9-8911-04031de7008b req-de44a38b-867b-4bb6-afaa-e4b273505ac9 service nova] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Received event network-vif-unplugged-e5c43d23-3cda-4763-af71-7c6fddbf6bd3 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:48:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-cafabfff-9617-49d9-8911-04031de7008b req-de44a38b-867b-4bb6-afaa-e4b273505ac9 service nova] Acquiring lock "f84b913d-0794-43a6-90d3-aaf4102f9fb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:48:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-cafabfff-9617-49d9-8911-04031de7008b req-de44a38b-867b-4bb6-afaa-e4b273505ac9 service nova] Lock "f84b913d-0794-43a6-90d3-aaf4102f9fb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:48:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-cafabfff-9617-49d9-8911-04031de7008b req-de44a38b-867b-4bb6-afaa-e4b273505ac9 service nova] Lock "f84b913d-0794-43a6-90d3-aaf4102f9fb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:48:47 user nova-compute[71113]: DEBUG nova.compute.manager [req-cafabfff-9617-49d9-8911-04031de7008b req-de44a38b-867b-4bb6-afaa-e4b273505ac9 service nova] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] No waiting events found dispatching network-vif-unplugged-e5c43d23-3cda-4763-af71-7c6fddbf6bd3 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:48:47 user nova-compute[71113]: DEBUG nova.compute.manager [req-cafabfff-9617-49d9-8911-04031de7008b req-de44a38b-867b-4bb6-afaa-e4b273505ac9 service nova] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Received event network-vif-unplugged-e5c43d23-3cda-4763-af71-7c6fddbf6bd3 for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 09:48:47 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] COPY block job progress, current cursor: 118489088 final cursor: 1073741824 {{(pid=71113) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 09:48:47 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Instance destroyed successfully.
Jul 31 09:48:47 user nova-compute[71113]: DEBUG nova.objects.instance [None req-3089d0be-ebb4-4948-bf06-b63b8270ebf8 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Lazy-loading 'resources' on Instance uuid f84b913d-0794-43a6-90d3-aaf4102f9fb6 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:48:47 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-3089d0be-ebb4-4948-bf06-b63b8270ebf8 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T09:46:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-452633403',display_name='tempest-AttachSCSIVolumeTestJSON-server-452633403',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-452633403',id=7,image_ref='38906fac-16b8-44e4-a540-da4374fde1c7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMBQg/n9Pbq7dZUo+F42N06oBWhBi5QTtfvGne7QkPv6rp1iNW1YP5SQWOjL0PvVVZSPgoAGQ4ycF4Z2gfsfu87iCkngq7+EVNNfaEhYVeyJ9xAOxE3bXPBWDDlWDbCug==',key_name='tempest-keypair-381024059',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:46:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ede230cc40e449bb8747fe13f655799',ramdisk_id='',reservation_id='r-s6vz9zvd',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='38906fac-16b8-44e4-a540-da4374fde1c7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-687548171',owner_user_name='tempest-AttachSCSIVolumeTestJSON-687548171-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:46:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5162014a8315486d8a6c5470c0517e00',uuid=f84b913d-0794-43a6-90d3-aaf4102f9fb6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e5c43d23-3cda-4763-af71-7c6fddbf6bd3", "address": "fa:16:3e:33:5c:af", "network": {"id": "6cd9dded-5835-41d6-9407-1a1f04223da4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-184846099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ede230cc40e449bb8747fe13f655799", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5c43d23-3c", "ovs_interfaceid": "e5c43d23-3cda-4763-af71-7c6fddbf6bd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 09:48:47 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-3089d0be-ebb4-4948-bf06-b63b8270ebf8 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Converting VIF {"id": "e5c43d23-3cda-4763-af71-7c6fddbf6bd3", "address": "fa:16:3e:33:5c:af", "network": {"id": "6cd9dded-5835-41d6-9407-1a1f04223da4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-184846099-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ede230cc40e449bb8747fe13f655799", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5c43d23-3c", "ovs_interfaceid": "e5c43d23-3cda-4763-af71-7c6fddbf6bd3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:48:47 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-3089d0be-ebb4-4948-bf06-b63b8270ebf8 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:5c:af,bridge_name='br-int',has_traffic_filtering=True,id=e5c43d23-3cda-4763-af71-7c6fddbf6bd3,network=Network(6cd9dded-5835-41d6-9407-1a1f04223da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5c43d23-3c') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:48:47 user nova-compute[71113]: DEBUG os_vif [None req-3089d0be-ebb4-4948-bf06-b63b8270ebf8 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:5c:af,bridge_name='br-int',has_traffic_filtering=True,id=e5c43d23-3cda-4763-af71-7c6fddbf6bd3,network=Network(6cd9dded-5835-41d6-9407-1a1f04223da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5c43d23-3c') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 09:48:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape5c43d23-3c, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:48:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:48:48 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:48 user nova-compute[71113]: INFO os_vif [None req-3089d0be-ebb4-4948-bf06-b63b8270ebf8 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:5c:af,bridge_name='br-int',has_traffic_filtering=True,id=e5c43d23-3cda-4763-af71-7c6fddbf6bd3,network=Network(6cd9dded-5835-41d6-9407-1a1f04223da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5c43d23-3c')
Jul 31 09:48:48 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-3089d0be-ebb4-4948-bf06-b63b8270ebf8 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Deleting instance files /opt/stack/data/nova/instances/f84b913d-0794-43a6-90d3-aaf4102f9fb6_del
Jul 31 09:48:48 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-3089d0be-ebb4-4948-bf06-b63b8270ebf8 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Deletion of /opt/stack/data/nova/instances/f84b913d-0794-43a6-90d3-aaf4102f9fb6_del complete
Jul 31 09:48:48 user nova-compute[71113]: INFO nova.compute.manager [None req-3089d0be-ebb4-4948-bf06-b63b8270ebf8 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Took 0.99 seconds to destroy the instance on the hypervisor.
Jul 31 09:48:48 user nova-compute[71113]: DEBUG oslo.service.loopingcall [None req-3089d0be-ebb4-4948-bf06-b63b8270ebf8 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71113) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 09:48:48 user nova-compute[71113]: DEBUG nova.compute.manager [-] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Deallocating network for instance {{(pid=71113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 09:48:48 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] deallocate_for_instance() {{(pid=71113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 09:48:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] COPY block job progress, current cursor: 303038464 final cursor: 1073741824 {{(pid=71113) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 09:48:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9f197984-048a-4a8e-8716-3d676dd3d7ca tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Acquiring lock "b574cfa3-5724-424c-a68e-8e88e6c8c69c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:48:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9f197984-048a-4a8e-8716-3d676dd3d7ca tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Lock "b574cfa3-5724-424c-a68e-8e88e6c8c69c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:48:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9f197984-048a-4a8e-8716-3d676dd3d7ca tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Acquiring lock "b574cfa3-5724-424c-a68e-8e88e6c8c69c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:48:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9f197984-048a-4a8e-8716-3d676dd3d7ca tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Lock "b574cfa3-5724-424c-a68e-8e88e6c8c69c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:48:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9f197984-048a-4a8e-8716-3d676dd3d7ca tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Lock "b574cfa3-5724-424c-a68e-8e88e6c8c69c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:48:48 user nova-compute[71113]: INFO nova.compute.manager [None req-9f197984-048a-4a8e-8716-3d676dd3d7ca tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Terminating instance
Jul 31 09:48:48 user nova-compute[71113]: DEBUG nova.compute.manager [None req-9f197984-048a-4a8e-8716-3d676dd3d7ca tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Start destroying the instance on the hypervisor. {{(pid=71113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 09:48:48 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] COPY block job progress, current cursor: 400556032 final cursor: 1073741824 {{(pid=71113) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 09:48:48 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:49 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] COPY block job progress, current cursor: 596639744 final cursor: 1073741824 {{(pid=71113) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 09:48:49 user nova-compute[71113]: DEBUG nova.compute.manager [req-2b6cbb11-a034-49c3-abcf-c9986697bf15 req-be86d57d-ebbd-44d5-8ccf-883873cc5f5a service nova] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Received event network-vif-plugged-e5c43d23-3cda-4763-af71-7c6fddbf6bd3 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:48:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-2b6cbb11-a034-49c3-abcf-c9986697bf15 req-be86d57d-ebbd-44d5-8ccf-883873cc5f5a service nova] Acquiring lock "f84b913d-0794-43a6-90d3-aaf4102f9fb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:48:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-2b6cbb11-a034-49c3-abcf-c9986697bf15 req-be86d57d-ebbd-44d5-8ccf-883873cc5f5a service nova] Lock "f84b913d-0794-43a6-90d3-aaf4102f9fb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:48:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-2b6cbb11-a034-49c3-abcf-c9986697bf15 req-be86d57d-ebbd-44d5-8ccf-883873cc5f5a service nova] Lock "f84b913d-0794-43a6-90d3-aaf4102f9fb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:48:49 user nova-compute[71113]: DEBUG nova.compute.manager [req-2b6cbb11-a034-49c3-abcf-c9986697bf15 req-be86d57d-ebbd-44d5-8ccf-883873cc5f5a service nova] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] No waiting events found dispatching network-vif-plugged-e5c43d23-3cda-4763-af71-7c6fddbf6bd3 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:48:49 user nova-compute[71113]: WARNING nova.compute.manager [req-2b6cbb11-a034-49c3-abcf-c9986697bf15 req-be86d57d-ebbd-44d5-8ccf-883873cc5f5a service nova] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Received unexpected event network-vif-plugged-e5c43d23-3cda-4763-af71-7c6fddbf6bd3 for instance with vm_state active and task_state deleting.
Jul 31 09:48:49 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Instance destroyed successfully.
Jul 31 09:48:49 user nova-compute[71113]: DEBUG nova.objects.instance [None req-9f197984-048a-4a8e-8716-3d676dd3d7ca tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Lazy-loading 'resources' on Instance uuid b574cfa3-5724-424c-a68e-8e88e6c8c69c {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:48:49 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-9f197984-048a-4a8e-8716-3d676dd3d7ca tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:46:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-787725243',display_name='tempest-VolumesActionsTest-instance-787725243',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-787725243',id=8,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:47:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3fc8b3757a845ad89068797348d02bd',ramdisk_id='',reservation_id='r-0p1q8s0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1052619025',owner_user_name='tempest-VolumesActionsTest-1052619025-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:47:06Z,user_data=None,user_id='201cdf33fbd74e77877dd1342b33aedc',uuid=b574cfa3-5724-424c-a68e-8e88e6c8c69c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ddcabffa-42cf-4a5a-8773-821d4e474f66", "address": "fa:16:3e:08:01:23", "network": {"id": "19009bbc-db2c-4a99-aef8-bc8cb7ce0608", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2005545678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fc8b3757a845ad89068797348d02bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddcabffa-42", "ovs_interfaceid": "ddcabffa-42cf-4a5a-8773-821d4e474f66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 09:48:49 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-9f197984-048a-4a8e-8716-3d676dd3d7ca tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Converting VIF {"id": "ddcabffa-42cf-4a5a-8773-821d4e474f66", "address": "fa:16:3e:08:01:23", "network": {"id": "19009bbc-db2c-4a99-aef8-bc8cb7ce0608", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2005545678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fc8b3757a845ad89068797348d02bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddcabffa-42", "ovs_interfaceid": "ddcabffa-42cf-4a5a-8773-821d4e474f66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:48:49 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-9f197984-048a-4a8e-8716-3d676dd3d7ca tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:01:23,bridge_name='br-int',has_traffic_filtering=True,id=ddcabffa-42cf-4a5a-8773-821d4e474f66,network=Network(19009bbc-db2c-4a99-aef8-bc8cb7ce0608),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddcabffa-42') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:48:49 user nova-compute[71113]: DEBUG os_vif [None req-9f197984-048a-4a8e-8716-3d676dd3d7ca tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:01:23,bridge_name='br-int',has_traffic_filtering=True,id=ddcabffa-42cf-4a5a-8773-821d4e474f66,network=Network(19009bbc-db2c-4a99-aef8-bc8cb7ce0608),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddcabffa-42') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 09:48:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapddcabffa-42, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:48:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:48:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:49 user nova-compute[71113]: INFO os_vif [None req-9f197984-048a-4a8e-8716-3d676dd3d7ca tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:01:23,bridge_name='br-int',has_traffic_filtering=True,id=ddcabffa-42cf-4a5a-8773-821d4e474f66,network=Network(19009bbc-db2c-4a99-aef8-bc8cb7ce0608),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddcabffa-42')
Jul 31 09:48:49 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-9f197984-048a-4a8e-8716-3d676dd3d7ca tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Deleting instance files /opt/stack/data/nova/instances/b574cfa3-5724-424c-a68e-8e88e6c8c69c_del
Jul 31 09:48:49 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-9f197984-048a-4a8e-8716-3d676dd3d7ca tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Deletion of /opt/stack/data/nova/instances/b574cfa3-5724-424c-a68e-8e88e6c8c69c_del complete
Jul 31 09:48:49 user nova-compute[71113]: INFO nova.compute.manager [None req-9f197984-048a-4a8e-8716-3d676dd3d7ca tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Took 1.04 seconds to destroy the instance on the hypervisor.
Jul 31 09:48:49 user nova-compute[71113]: DEBUG oslo.service.loopingcall [None req-9f197984-048a-4a8e-8716-3d676dd3d7ca tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71113) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 09:48:49 user nova-compute[71113]: DEBUG nova.compute.manager [-] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Deallocating network for instance {{(pid=71113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 09:48:49 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] deallocate_for_instance() {{(pid=71113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 09:48:49 user nova-compute[71113]: DEBUG nova.compute.manager [req-1e4bfa21-6a62-4366-8fdb-e6e98456cfee req-4f30ad93-ef5d-4483-bc69-3e48f5cdac68 service nova] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Received event network-vif-unplugged-ddcabffa-42cf-4a5a-8773-821d4e474f66 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:48:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1e4bfa21-6a62-4366-8fdb-e6e98456cfee req-4f30ad93-ef5d-4483-bc69-3e48f5cdac68 service nova] Acquiring lock "b574cfa3-5724-424c-a68e-8e88e6c8c69c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:48:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1e4bfa21-6a62-4366-8fdb-e6e98456cfee req-4f30ad93-ef5d-4483-bc69-3e48f5cdac68 service nova] Lock "b574cfa3-5724-424c-a68e-8e88e6c8c69c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:48:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1e4bfa21-6a62-4366-8fdb-e6e98456cfee req-4f30ad93-ef5d-4483-bc69-3e48f5cdac68 service nova] Lock "b574cfa3-5724-424c-a68e-8e88e6c8c69c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:48:49 user nova-compute[71113]: DEBUG nova.compute.manager [req-1e4bfa21-6a62-4366-8fdb-e6e98456cfee req-4f30ad93-ef5d-4483-bc69-3e48f5cdac68 service nova] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] No waiting events found dispatching network-vif-unplugged-ddcabffa-42cf-4a5a-8773-821d4e474f66 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:48:49 user nova-compute[71113]: DEBUG nova.compute.manager [req-1e4bfa21-6a62-4366-8fdb-e6e98456cfee req-4f30ad93-ef5d-4483-bc69-3e48f5cdac68 service nova] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Received event network-vif-unplugged-ddcabffa-42cf-4a5a-8773-821d4e474f66 for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 09:48:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] COPY block job progress, current cursor: 770703360 final cursor: 1073741824 {{(pid=71113) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 09:48:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:50 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:48:50 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Took 2.35 seconds to deallocate network for instance.
Jul 31 09:48:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] COPY block job progress, current cursor: 941621248 final cursor: 1073741824 {{(pid=71113) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 09:48:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-3089d0be-ebb4-4948-bf06-b63b8270ebf8 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:48:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-3089d0be-ebb4-4948-bf06-b63b8270ebf8 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:48:50 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:48:50 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Took 0.78 seconds to deallocate network for instance.
Jul 31 09:48:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9f197984-048a-4a8e-8716-3d676dd3d7ca tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:48:50 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-3089d0be-ebb4-4948-bf06-b63b8270ebf8 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:48:51 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-3089d0be-ebb4-4948-bf06-b63b8270ebf8 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:48:51 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-3089d0be-ebb4-4948-bf06-b63b8270ebf8 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.443s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:48:51 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9f197984-048a-4a8e-8716-3d676dd3d7ca tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.299s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:48:51 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71113) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 09:48:51 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-3089d0be-ebb4-4948-bf06-b63b8270ebf8 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Deleted allocations for instance f84b913d-0794-43a6-90d3-aaf4102f9fb6
Jul 31 09:48:51 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 09:48:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hLvNyHQd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:48:51 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:48:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:48:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:48:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 09:48:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:51 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[00710e5f-1855-4d62-8f6c-f1b7c1f5810f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:51 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec6775b-ead3-44f4-b08b-9f0ec521fd1c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b (non-flash)
Jul 31 09:48:51 user nova-compute[71113]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)
Jul 31 09:48:51 user nova-compute[71113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)
Jul 31 09:48:51 user nova-compute[71113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)
Jul 31 09:48:51 user nova-compute[71113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:48:51 user nova-compute[71113]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e (non-flash)
Jul 31 09:48:51 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:48:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b (non-flash)
Jul 31 09:48:51 user nova-compute[71113]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)
Jul 31 09:48:51 user nova-compute[71113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)
Jul 31 09:48:51 user nova-compute[71113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)
Jul 31 09:48:51 user nova-compute[71113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:48:51 user nova-compute[71113]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e (non-flash)
Jul 31 09:48:51 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:48:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f790821e8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e'): ({'sdg'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 09:48:51 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Removing single pathed devices sdg {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 09:48:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:51 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-3089d0be-ebb4-4948-bf06-b63b8270ebf8 tempest-AttachSCSIVolumeTestJSON-687548171 tempest-AttachSCSIVolumeTestJSON-687548171-project-member] Lock "f84b913d-0794-43a6-90d3-aaf4102f9fb6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.088s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:48:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:51 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6228dbe4-d4e2-42b8-bd41-987497b70002]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:51 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[640635dd-5526-4ec6-8c84-800b22d19db8]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:51 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Flushing IO for device /dev/sdg {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 09:48:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:51 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf8fa3c-438c-4a5e-b25a-42848cf01be3]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:51 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 09:48:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:51 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-9f197984-048a-4a8e-8716-3d676dd3d7ca tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:48:51 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-9f197984-048a-4a8e-8716-3d676dd3d7ca tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:48:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.046s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:51 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e472cd91-374a-4aba-94cc-ac3454ac6276]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:51 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 09:48:51 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] SCSI volumes sdg have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 09:48:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 09:48:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:51 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a793392-7a73-4b15-a667-e0e432e31d95]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:51 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9f197984-048a-4a8e-8716-3d676dd3d7ca tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.337s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:48:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:51 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-9f197984-048a-4a8e-8716-3d676dd3d7ca tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Deleted allocations for instance b574cfa3-5724-424c-a68e-8e88e6c8c69c
Jul 31 09:48:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e -p 172.16.0.220:3260 --logout" returned: 0 in 0.101s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:51 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9beae90e-cb57-4a76-a019-1be7df9869c8]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e, portal: 172.16.0.220,3260]
Jul 31 09:48:51 user nova-compute[71113]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e, portal: 172.16.0.220,3260] successful.
Jul 31 09:48:51 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:51 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[554cb701-f940-44c5-9b88-78c6adcd01bf]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:48:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:48:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] <== disconnect_volume: return (364ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:48:51 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 09:48:51 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9f197984-048a-4a8e-8716-3d676dd3d7ca tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Lock "b574cfa3-5724-424c-a68e-8e88e6c8c69c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.756s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:48:51 user nova-compute[71113]: DEBUG nova.compute.manager [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TVYPFetM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'b324fed7-5df8-4ca1-9a5a-06eaffd5e101', 'attached_at': '', 'detached_at': '', 'volume_id': '64e05017-e2e4-4c5d-b02a-76df6cc8560b', 'serial'} {{(pid=71113) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Jul 31 09:48:51 user nova-compute[71113]: DEBUG nova.compute.manager [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] swap_volume: removing Cinder connection for volume 015a658c-3fc8-4c04-9bd3-2318bec06a8e {{(pid=71113) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Jul 31 09:48:51 user nova-compute[71113]: DEBUG nova.compute.manager [req-8816bb01-5653-4b42-94eb-4ff80e37a353 req-18bf8f11-c025-4cb9-be98-b549954da3cd service nova] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Received event network-vif-deleted-ddcabffa-42cf-4a5a-8773-821d4e474f66 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:48:52 user nova-compute[71113]: DEBUG nova.compute.manager [req-ac934925-5652-4c87-af88-72e1e7cb93c5 req-d1c5558f-b5ab-45aa-a972-23114ca438c6 service nova] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Received event network-vif-deleted-e5c43d23-3cda-4763-af71-7c6fddbf6bd3 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:48:52 user nova-compute[71113]: DEBUG nova.compute.manager [req-ac934925-5652-4c87-af88-72e1e7cb93c5 req-d1c5558f-b5ab-45aa-a972-23114ca438c6 service nova] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Received event network-vif-plugged-ddcabffa-42cf-4a5a-8773-821d4e474f66 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:48:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ac934925-5652-4c87-af88-72e1e7cb93c5 req-d1c5558f-b5ab-45aa-a972-23114ca438c6 service nova] Acquiring lock "b574cfa3-5724-424c-a68e-8e88e6c8c69c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:48:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ac934925-5652-4c87-af88-72e1e7cb93c5 req-d1c5558f-b5ab-45aa-a972-23114ca438c6 service nova] Lock "b574cfa3-5724-424c-a68e-8e88e6c8c69c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:48:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ac934925-5652-4c87-af88-72e1e7cb93c5 req-d1c5558f-b5ab-45aa-a972-23114ca438c6 service nova] Lock "b574cfa3-5724-424c-a68e-8e88e6c8c69c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:48:52 user nova-compute[71113]: DEBUG nova.compute.manager [req-ac934925-5652-4c87-af88-72e1e7cb93c5 req-d1c5558f-b5ab-45aa-a972-23114ca438c6 service nova] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] No waiting events found dispatching network-vif-plugged-ddcabffa-42cf-4a5a-8773-821d4e474f66 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:48:52 user nova-compute[71113]: WARNING nova.compute.manager [req-ac934925-5652-4c87-af88-72e1e7cb93c5 req-d1c5558f-b5ab-45aa-a972-23114ca438c6 service nova] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Received unexpected event network-vif-plugged-ddcabffa-42cf-4a5a-8773-821d4e474f66 for instance with vm_state deleted and task_state None.
Jul 31 09:48:52 user nova-compute[71113]: DEBUG nova.compute.manager [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] swap_volume: Updating volume 015a658c-3fc8-4c04-9bd3-2318bec06a8e BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "TVYPFetM", "auth_password": "qKC4Msgd3bStoh", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "64e05017-e2e4-4c5d-b02a-76df6cc8560b"}, "status": "reserved", "instance": "b324fed7-5df8-4ca1-9a5a-06eaffd5e101", "attached_at": "", "detached_at": "", "volume_id": "64e05017-e2e4-4c5d-b02a-76df6cc8560b", "serial": "64e05017-e2e4-4c5d-b02a-76df6cc8560b"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '64e05017-e2e4-4c5d-b02a-76df6cc8560b', 'no_device': None, 'attachment_id': 'fb4cf6fa-6dbf-427e-a27d-ad503649b7c3'} {{(pid=71113) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Jul 31 09:48:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-e1627c5a-0d52-4b71-8de0-6520cb15e83a tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Lock "b324fed7-5df8-4ca1-9a5a-06eaffd5e101" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 15.437s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:48:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Acquiring lock "b324fed7-5df8-4ca1-9a5a-06eaffd5e101" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:48:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Lock "b324fed7-5df8-4ca1-9a5a-06eaffd5e101" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:48:53 user nova-compute[71113]: DEBUG os_brick.utils [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:48:53 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:53 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:53 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ebc68e-84e3-438a-a817-7f726339d212]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:53 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:53 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:53 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8416f4-2d59-48f9-8259-a4ade472bb19]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:53 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:53 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:48:53 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f524969-19e5-4598-848e-ee4da0684185]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:53 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[039ce49d-4c92-43d7-84db-3fa28186a66b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:53 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:53 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:48:53 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 09:48:53 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:48:53 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:48:53 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 09:48:53 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[120877c4-a6a5-47ff-bf72-a1d482f5282d]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:48:53 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 09:48:53 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 09:48:53 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 09:48:53 user nova-compute[71113]: DEBUG os_brick.utils [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:48:53 user nova-compute[71113]: INFO nova.compute.manager [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Swapping volume 64e05017-e2e4-4c5d-b02a-76df6cc8560b for 015a658c-3fc8-4c04-9bd3-2318bec06a8e
Jul 31 09:48:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:56 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:48:56 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:48:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:48:59 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:48:59 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:48:59 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 09:48:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:00 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hLvNyHQd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b324fed7-5df8-4ca1-9a5a-06eaffd5e101', 'attached_at': '', 'detached_at': '', 'volume_id': '015a658c-3fc8-4c04-9bd3-2318bec06a8e', 'serial': '015a658c-3fc8-4c04-9bd3-2318bec06a8e'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TVYPFetM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '64e05017-e2e4-4c5d-b02a-76df6cc8560b'}, 'status': 'reserved', 'instance': 'b324fed7-5df8-4ca1-9a5a-06eaffd5e101', 'attached_at': '', 'detached_at': '', 'volume_id': '64e05017-e2e4-4c5d-b02a-76df6cc8560b', 'serial'} {{(pid=71113) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hLvNyHQd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:49:01 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:49:01 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:49:01 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:49:01 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:49:01 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 09:49:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94ef07f-96db-46e4-b706-27ae03acb9fa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 09:49:01 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfc7bc0-89f9-4ba4-97e0-12fc81548c37]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e] added
Jul 31 09:49:01 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[483df85d-ca0e-458e-acdc-1edf7e70fc1e]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba75030-9668-4833-b654-bbb03ab7393a]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hLvNyHQd {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hLvNyHQd" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a22eac1-cb3f-4cb3-a45b-0c5082467ed3]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hLvNyHQd'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9809c083-8599-412a-9c57-4c2d87c087bb]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[722c4732-65d2-4873-8131-bac3b530f69d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b (non-flash)
Jul 31 09:49:01 user nova-compute[71113]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)
Jul 31 09:49:01 user nova-compute[71113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)
Jul 31 09:49:01 user nova-compute[71113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)
Jul 31 09:49:01 user nova-compute[71113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:49:01 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b (non-flash)
Jul 31 09:49:01 user nova-compute[71113]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)
Jul 31 09:49:01 user nova-compute[71113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)
Jul 31 09:49:01 user nova-compute[71113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)
Jul 31 09:49:01 user nova-compute[71113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:49:01 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceca1cff-34f6-4a9d-a20b-2da1120a183c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e, portal: 172.16.0.220,3260]
Jul 31 09:49:01 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e, portal: 172.16.0.220,3260] successful.
Jul 31 09:49:01 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3795a399-3cdc-4c54-970e-ed2f38492c45]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd3e743-5e46-4fcb-875d-cf94b466fccc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b (non-flash)
Jul 31 09:49:01 user nova-compute[71113]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e (non-flash)
Jul 31 09:49:01 user nova-compute[71113]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)
Jul 31 09:49:01 user nova-compute[71113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)
Jul 31 09:49:01 user nova-compute[71113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)
Jul 31 09:49:01 user nova-compute[71113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:49:01 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b (non-flash)
Jul 31 09:49:01 user nova-compute[71113]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e (non-flash)
Jul 31 09:49:01 user nova-compute[71113]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)
Jul 31 09:49:01 user nova-compute[71113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)
Jul 31 09:49:01 user nova-compute[71113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)
Jul 31 09:49:01 user nova-compute[71113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:49:01 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] HCTL ('38', '-', '-', 0) found on session 11 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Scanning host 38 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e71e0e-2de2-491d-85c5-d95c51b32c7f]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Searching for a device in session 11 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hLvNyHQd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 09:49:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d033eac-23ea-417a-981c-578328f1c3ac/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d033eac-23ea-417a-981c-578328f1c3ac/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d033eac-23ea-417a-981c-578328f1c3ac/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d033eac-23ea-417a-981c-578328f1c3ac/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caac13d2-ceb3-4fee-84ad-5376c1c2cc23/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caac13d2-ceb3-4fee-84ad-5376c1c2cc23/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caac13d2-ceb3-4fee-84ad-5376c1c2cc23/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:02 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:49:02 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23932313239353166', 'path': '/dev/sdg'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:49:02 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932313239353166', 'path': '/dev/sdg'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 09:49:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caac13d2-ceb3-4fee-84ad-5376c1c2cc23/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:02 user nova-compute[71113]: DEBUG nova.objects.instance [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Lazy-loading 'flavor' on Instance uuid b324fed7-5df8-4ca1-9a5a-06eaffd5e101 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:49:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a4b47dd-b335-4c2f-9dee-5421357a0ee1/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:02 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690796927.950161, f84b913d-0794-43a6-90d3-aaf4102f9fb6 => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:49:02 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] VM Stopped (Lifecycle Event)
Jul 31 09:49:02 user nova-compute[71113]: DEBUG nova.compute.manager [None req-f7abc0de-9af2-49f7-b971-094def20048a None None] [instance: f84b913d-0794-43a6-90d3-aaf4102f9fb6] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:49:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a4b47dd-b335-4c2f-9dee-5421357a0ee1/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a4b47dd-b335-4c2f-9dee-5421357a0ee1/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a4b47dd-b335-4c2f-9dee-5421357a0ee1/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=71113) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 09:49:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 09:49:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 09:49:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 09:49:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 09:49:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b324fed7-5df8-4ca1-9a5a-06eaffd5e101/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] COPY block job progress, current cursor: 170917888 final cursor: 1073741824 {{(pid=71113) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 09:49:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b324fed7-5df8-4ca1-9a5a-06eaffd5e101/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b324fed7-5df8-4ca1-9a5a-06eaffd5e101/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b324fed7-5df8-4ca1-9a5a-06eaffd5e101/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:04 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 09:49:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:04 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690796929.684654, b574cfa3-5724-424c-a68e-8e88e6c8c69c => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:49:04 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] VM Stopped (Lifecycle Event)
Jul 31 09:49:04 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] COPY block job progress, current cursor: 438304768 final cursor: 1073741824 {{(pid=71113) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 09:49:04 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:49:04 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:49:04 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=7627MB free_disk=25.677162170410156GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 09:49:04 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:49:04 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:49:04 user nova-compute[71113]: DEBUG nova.compute.manager [None req-6dea50cb-eda5-44f3-9824-c741ed8db782 None None] [instance: b574cfa3-5724-424c-a68e-8e88e6c8c69c] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:49:05 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 0ea0401b-26c2-4655-956b-1bc000debd53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:49:05 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance efa311a0-fe2e-4c0f-af66-09c3eb38fbf1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:49:05 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 1112a49d-27bd-4fc8-bae6-ec1decbb47db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:49:05 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance caac13d2-ceb3-4fee-84ad-5376c1c2cc23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:49:05 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance b324fed7-5df8-4ca1-9a5a-06eaffd5e101 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:49:05 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 3aaaef96-76f8-4088-a0bc-a1a72e80652e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:49:05 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 8d033eac-23ea-417a-981c-578328f1c3ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:49:05 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 9a4b47dd-b335-4c2f-9dee-5421357a0ee1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:49:05 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 09:49:05 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 09:49:05 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:49:05 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:49:05 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] COPY block job progress, current cursor: 563085312 final cursor: 1073741824 {{(pid=71113) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 09:49:05 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 09:49:05 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.550s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:49:05 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] COPY block job progress, current cursor: 730857472 final cursor: 1073741824 {{(pid=71113) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 09:49:06 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] COPY block job progress, current cursor: 854589440 final cursor: 1073741824 {{(pid=71113) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 09:49:06 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] COPY block job progress, current cursor: 968884224 final cursor: 1073741824 {{(pid=71113) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 09:49:07 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:07 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71113) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 09:49:07 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:49:07 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:49:07 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 09:49:07 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 09:49:07 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TVYPFetM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '64e05017-e2e4-4c5d-b02a-76df6cc8560b'}, None), 'kwargs': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:49:07 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:49:07 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:49:07 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:49:07 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 09:49:07 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:07 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "refresh_cache-efa311a0-fe2e-4c0f-af66-09c3eb38fbf1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:49:07 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquired lock "refresh_cache-efa311a0-fe2e-4c0f-af66-09c3eb38fbf1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:49:07 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Forcefully refreshing network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 09:49:07 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:07 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e5dbab-fba3-4981-b544-8fc439843e40]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:49:07 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:07 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:07 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab1494f-fce4-44b2-b695-094053d33f8c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:49:07 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b (non-flash)
Jul 31 09:49:07 user nova-compute[71113]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e (non-flash)
Jul 31 09:49:07 user nova-compute[71113]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)
Jul 31 09:49:07 user nova-compute[71113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)
Jul 31 09:49:07 user nova-compute[71113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)
Jul 31 09:49:07 user nova-compute[71113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:49:07 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:49:07 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b (non-flash)
Jul 31 09:49:07 user nova-compute[71113]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e (non-flash)
Jul 31 09:49:07 user nova-compute[71113]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)
Jul 31 09:49:07 user nova-compute[71113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)
Jul 31 09:49:07 user nova-compute[71113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)
Jul 31 09:49:07 user nova-compute[71113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:49:07 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:49:07 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79082c5a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b'): ({'sdf'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 09:49:07 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Removing single pathed devices sdf {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 09:49:07 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:07 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:07 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9b5525-af69-4fdc-9bc0-49adda232f95]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:49:07 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:07 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:07 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[22fb4751-789f-4e70-9b6a-b01243d27893]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:49:07 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Flushing IO for device /dev/sdf {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 09:49:07 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:07 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:07 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bae95a7-01cf-4552-89f4-f33c4321e331]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:49:07 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 09:49:07 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:07 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.055s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:07 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5121ea80-b340-4bc3-8598-06e23b68b298]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:49:07 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 09:49:07 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] SCSI volumes sdf have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 09:49:07 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 09:49:07 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:07 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:07 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1824e64-b313-4001-a598-540c1554ebfd]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:49:07 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:49:07 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:07 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b -p 172.16.0.220:3260 --logout" returned: 0 in 0.094s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:07 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf306a54-71fc-484a-953c-31180307d999]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:49:07 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b, portal: 172.16.0.220,3260]
Jul 31 09:49:07 user nova-compute[71113]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b, portal: 172.16.0.220,3260] successful.
Jul 31 09:49:07 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:49:07 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:07 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64e05017-e2e4-4c5d-b02a-76df6cc8560b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:07 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eeaf927-bfa2-4202-8987-f6a649257fd6]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:49:07 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:49:07 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:49:07 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] <== disconnect_volume: return (359ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:49:07 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 09:49:08 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hLvNyHQd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': 'b324fed7-5df8-4ca1-9a5a-06eaffd5e101', 'attached_at': '', 'detached_at': '', 'volume_id': '015a658c-3fc8-4c04-9bd3-2318bec06a8e', 'serial'} {{(pid=71113) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Jul 31 09:49:08 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] swap_volume: removing Cinder connection for volume 64e05017-e2e4-4c5d-b02a-76df6cc8560b {{(pid=71113) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Jul 31 09:49:08 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Updating instance_info_cache with network_info: [{"id": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "address": "fa:16:3e:16:bb:aa", "network": {"id": "4f2ea02a-9b26-4f2a-af23-39c060703ff3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-725518740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5bb5c0790e54702b881dc5e45641be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b5a493-47", "ovs_interfaceid": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:49:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Releasing lock "refresh_cache-efa311a0-fe2e-4c0f-af66-09c3eb38fbf1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:49:08 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Updated the network info_cache for instance {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 09:49:08 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] swap_volume: Updating volume 64e05017-e2e4-4c5d-b02a-76df6cc8560b BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "hLvNyHQd", "auth_password": "dPmbrxJVpwZBkW", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdg", "volume_id": "015a658c-3fc8-4c04-9bd3-2318bec06a8e"}, "status": "reserved", "instance": "b324fed7-5df8-4ca1-9a5a-06eaffd5e101", "attached_at": "", "detached_at": "", "volume_id": "015a658c-3fc8-4c04-9bd3-2318bec06a8e", "serial": "015a658c-3fc8-4c04-9bd3-2318bec06a8e"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '015a658c-3fc8-4c04-9bd3-2318bec06a8e', 'no_device': None, 'attachment_id': 'df37a0dd-11de-4094-90a4-947fa6358494'} {{(pid=71113) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Jul 31 09:49:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ab023a0c-4e30-4d70-a738-e832e2f31eaf tempest-TestVolumeSwap-51039723 tempest-TestVolumeSwap-51039723-project-admin] Lock "b324fed7-5df8-4ca1-9a5a-06eaffd5e101" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 15.110s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:49:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-a3152433-6cc9-4ece-a35c-4488f568d0c9 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Acquiring lock "b324fed7-5df8-4ca1-9a5a-06eaffd5e101" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:49:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-a3152433-6cc9-4ece-a35c-4488f568d0c9 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Lock "b324fed7-5df8-4ca1-9a5a-06eaffd5e101" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:49:10 user nova-compute[71113]: INFO nova.compute.manager [None req-a3152433-6cc9-4ece-a35c-4488f568d0c9 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Detaching volume 015a658c-3fc8-4c04-9bd3-2318bec06a8e
Jul 31 09:49:10 user nova-compute[71113]: INFO nova.virt.block_device [None req-a3152433-6cc9-4ece-a35c-4488f568d0c9 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Attempting to driver detach volume 015a658c-3fc8-4c04-9bd3-2318bec06a8e from mountpoint /dev/vdb
Jul 31 09:49:10 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-a3152433-6cc9-4ece-a35c-4488f568d0c9 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Attempting to detach device vdb from instance b324fed7-5df8-4ca1-9a5a-06eaffd5e101 from the persistent domain config. {{(pid=71113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 09:49:10 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-a3152433-6cc9-4ece-a35c-4488f568d0c9 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 09:49:10 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:49:10 user nova-compute[71113]:   <source dev="/dev/sdg"/>
Jul 31 09:49:10 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 09:49:10 user nova-compute[71113]:   <serial>015a658c-3fc8-4c04-9bd3-2318bec06a8e</serial>
Jul 31 09:49:10 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 09:49:10 user nova-compute[71113]: </disk>
Jul 31 09:49:10 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 09:49:10 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-a3152433-6cc9-4ece-a35c-4488f568d0c9 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Successfully detached device vdb from instance b324fed7-5df8-4ca1-9a5a-06eaffd5e101 from the persistent domain config.
Jul 31 09:49:10 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-a3152433-6cc9-4ece-a35c-4488f568d0c9 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b324fed7-5df8-4ca1-9a5a-06eaffd5e101 from the live domain config. {{(pid=71113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 09:49:10 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-a3152433-6cc9-4ece-a35c-4488f568d0c9 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 09:49:10 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:49:10 user nova-compute[71113]:   <source dev="/dev/sdg"/>
Jul 31 09:49:10 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 09:49:10 user nova-compute[71113]:   <serial>015a658c-3fc8-4c04-9bd3-2318bec06a8e</serial>
Jul 31 09:49:10 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 09:49:10 user nova-compute[71113]: </disk>
Jul 31 09:49:10 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 09:49:10 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Received event <DeviceRemovedEvent: 1690796950.8877952, b324fed7-5df8-4ca1-9a5a-06eaffd5e101 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71113) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 09:49:10 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-a3152433-6cc9-4ece-a35c-4488f568d0c9 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b324fed7-5df8-4ca1-9a5a-06eaffd5e101 {{(pid=71113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 09:49:10 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-a3152433-6cc9-4ece-a35c-4488f568d0c9 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Successfully detached device vdb from instance b324fed7-5df8-4ca1-9a5a-06eaffd5e101 from the live domain config.
Jul 31 09:49:10 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3152433-6cc9-4ece-a35c-4488f568d0c9 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 09:49:10 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3152433-6cc9-4ece-a35c-4488f568d0c9 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hLvNyHQd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': '015a658c-3fc8-4c04-9bd3-2318bec06a8e'}, None), 'kwargs': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:49:10 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-a3152433-6cc9-4ece-a35c-4488f568d0c9 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:49:10 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-a3152433-6cc9-4ece-a35c-4488f568d0c9 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:49:10 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-a3152433-6cc9-4ece-a35c-4488f568d0c9 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:49:10 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3152433-6cc9-4ece-a35c-4488f568d0c9 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 09:49:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:10 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff9484f-b471-4bb7-ac2e-da57aed49516]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:49:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:10 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[541ff771-7b45-409d-b10e-50882fc56c91]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:49:10 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3152433-6cc9-4ece-a35c-4488f568d0c9 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e (non-flash)
Jul 31 09:49:10 user nova-compute[71113]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)
Jul 31 09:49:10 user nova-compute[71113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)
Jul 31 09:49:10 user nova-compute[71113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)
Jul 31 09:49:10 user nova-compute[71113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:49:10 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:49:10 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3152433-6cc9-4ece-a35c-4488f568d0c9 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e (non-flash)
Jul 31 09:49:10 user nova-compute[71113]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)
Jul 31 09:49:10 user nova-compute[71113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)
Jul 31 09:49:10 user nova-compute[71113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)
Jul 31 09:49:10 user nova-compute[71113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:49:10 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:49:10 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3152433-6cc9-4ece-a35c-4488f568d0c9 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7914c1f5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e'): ({'sdg'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 09:49:10 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-a3152433-6cc9-4ece-a35c-4488f568d0c9 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Removing single pathed devices sdg {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 09:49:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:10 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dba5742-09b7-415b-990d-acbb1f44f3dd]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:49:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:11 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d8dac8-c309-4076-811e-0f6336c9e70e]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:49:11 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-a3152433-6cc9-4ece-a35c-4488f568d0c9 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Flushing IO for device /dev/sdg {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 09:49:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:11 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d42908-b61c-4ac1-b4df-30fd4ecbc768]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:49:11 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-a3152433-6cc9-4ece-a35c-4488f568d0c9 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 09:49:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.053s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:11 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[48740f42-ef37-4dc7-b564-2772a0b2d389]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:49:11 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-a3152433-6cc9-4ece-a35c-4488f568d0c9 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 09:49:11 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-a3152433-6cc9-4ece-a35c-4488f568d0c9 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] SCSI volumes sdg have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 09:49:11 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3152433-6cc9-4ece-a35c-4488f568d0c9 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 09:49:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:11 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8aae154-f294-4c9c-9053-28421c518cff]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:49:11 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3152433-6cc9-4ece-a35c-4488f568d0c9 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:49:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:11 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b5618e-24bb-4797-87ea-007e9e11f637]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:49:11 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3152433-6cc9-4ece-a35c-4488f568d0c9 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e, portal: 172.16.0.220,3260]
Jul 31 09:49:11 user nova-compute[71113]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e, portal: 172.16.0.220,3260] successful.
Jul 31 09:49:11 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:49:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:015a658c-3fc8-4c04-9bd3-2318bec06a8e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:11 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2392ed54-6f3a-4514-9dc9-53827e8290cf]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:49:11 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3152433-6cc9-4ece-a35c-4488f568d0c9 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:49:11 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-a3152433-6cc9-4ece-a35c-4488f568d0c9 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:49:11 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3152433-6cc9-4ece-a35c-4488f568d0c9 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] <== disconnect_volume: return (295ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:49:11 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3152433-6cc9-4ece-a35c-4488f568d0c9 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 09:49:11 user nova-compute[71113]: DEBUG nova.compute.manager [req-33e4fc3f-5874-4656-aa3a-1865e52f90c3 req-df559872-7505-4db0-be21-611312737c1e service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received event network-changed-370dc7b8-8a77-47e4-94b9-ae9be9d1de13 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:49:11 user nova-compute[71113]: DEBUG nova.compute.manager [req-33e4fc3f-5874-4656-aa3a-1865e52f90c3 req-df559872-7505-4db0-be21-611312737c1e service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Refreshing instance network info cache due to event network-changed-370dc7b8-8a77-47e4-94b9-ae9be9d1de13. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:49:11 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-33e4fc3f-5874-4656-aa3a-1865e52f90c3 req-df559872-7505-4db0-be21-611312737c1e service nova] Acquiring lock "refresh_cache-3aaaef96-76f8-4088-a0bc-a1a72e80652e" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:49:11 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-33e4fc3f-5874-4656-aa3a-1865e52f90c3 req-df559872-7505-4db0-be21-611312737c1e service nova] Acquired lock "refresh_cache-3aaaef96-76f8-4088-a0bc-a1a72e80652e" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:49:11 user nova-compute[71113]: DEBUG nova.network.neutron [req-33e4fc3f-5874-4656-aa3a-1865e52f90c3 req-df559872-7505-4db0-be21-611312737c1e service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Refreshing network info cache for port 370dc7b8-8a77-47e4-94b9-ae9be9d1de13 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:49:12 user nova-compute[71113]: DEBUG nova.objects.instance [None req-a3152433-6cc9-4ece-a35c-4488f568d0c9 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Lazy-loading 'flavor' on Instance uuid b324fed7-5df8-4ca1-9a5a-06eaffd5e101 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:49:12 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-a3152433-6cc9-4ece-a35c-4488f568d0c9 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Lock "b324fed7-5df8-4ca1-9a5a-06eaffd5e101" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.879s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:49:12 user nova-compute[71113]: DEBUG nova.network.neutron [req-33e4fc3f-5874-4656-aa3a-1865e52f90c3 req-df559872-7505-4db0-be21-611312737c1e service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Updated VIF entry in instance network info cache for port 370dc7b8-8a77-47e4-94b9-ae9be9d1de13. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:49:12 user nova-compute[71113]: DEBUG nova.network.neutron [req-33e4fc3f-5874-4656-aa3a-1865e52f90c3 req-df559872-7505-4db0-be21-611312737c1e service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Updating instance_info_cache with network_info: [{"id": "370dc7b8-8a77-47e4-94b9-ae9be9d1de13", "address": "fa:16:3e:7b:6a:0d", "network": {"id": "9e762abf-a299-49e7-b276-0fa226649bb9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1384573536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap370dc7b8-8a", "ovs_interfaceid": "370dc7b8-8a77-47e4-94b9-ae9be9d1de13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e64b39b1-bdfc-4e38-9520-8bf02c8427a4", "address": "fa:16:3e:0d:7e:fd", "network": {"id": "f7c9bb5d-84df-44c3-a496-20d634727c3c", "bridge": "br-int", "label": "tempest-device-tagging-net1-420856970", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape64b39b1-bd", "ovs_interfaceid": "e64b39b1-bdfc-4e38-9520-8bf02c8427a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3a0920cd-a09e-4a83-adcd-098a71e98229", "address": "fa:16:3e:8b:9b:9f", "network": {"id": "f7c9bb5d-84df-44c3-a496-20d634727c3c", "bridge": "br-int", "label": "tempest-device-tagging-net1-420856970", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a0920cd-a0", "ovs_interfaceid": "3a0920cd-a09e-4a83-adcd-098a71e98229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "79461167-7380-4b36-ac54-b58585f55c20", "address": "fa:16:3e:51:a4:07", "network": {"id": "f7c9bb5d-84df-44c3-a496-20d634727c3c", "bridge": "br-int", "label": "tempest-device-tagging-net1-420856970", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79461167-73", "ovs_interfaceid": "79461167-7380-4b36-ac54-b58585f55c20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dc38d490-4eb0-496c-817d-639264048797", "address": "fa:16:3e:92:54:8b", "network": {"id": "f7c9bb5d-84df-44c3-a496-20d634727c3c", "bridge": "br-int", "label": "tempest-device-tagging-net1-420856970", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc38d490-4e", "ovs_interfaceid": "dc38d490-4eb0-496c-817d-639264048797", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c60ea5a4-1214-4163-ad18-e7bdf71e4bef", "address": "fa:16:3e:ab:70:c1", "network": {"id": "bb2db53e-eed4-44e7-9510-eab184de68f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-411965443", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60ea5a4-12", "ovs_interfaceid": "c60ea5a4-1214-4163-ad18-e7bdf71e4bef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f998018e-386d-4444-9712-9eb57b025198", "address": "fa:16:3e:97:88:64", "network": {"id": "bb2db53e-eed4-44e7-9510-eab184de68f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-411965443", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf998018e-38", "ovs_interfaceid": "f998018e-386d-4444-9712-9eb57b025198", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:49:12 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-33e4fc3f-5874-4656-aa3a-1865e52f90c3 req-df559872-7505-4db0-be21-611312737c1e service nova] Releasing lock "refresh_cache-3aaaef96-76f8-4088-a0bc-a1a72e80652e" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:49:12 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Acquiring lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:49:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:49:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Acquiring lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:49:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:49:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:49:13 user nova-compute[71113]: INFO nova.compute.manager [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Terminating instance
Jul 31 09:49:13 user nova-compute[71113]: DEBUG nova.compute.manager [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Start destroying the instance on the hypervisor. {{(pid=71113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 09:49:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:14 user nova-compute[71113]: DEBUG nova.compute.manager [req-900493c5-2dd8-447f-8339-2a6fb64aa3b2 req-a1a5a4fe-eaaf-4b8b-bee6-33577fd8997d service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received event network-vif-unplugged-370dc7b8-8a77-47e4-94b9-ae9be9d1de13 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:49:14 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-900493c5-2dd8-447f-8339-2a6fb64aa3b2 req-a1a5a4fe-eaaf-4b8b-bee6-33577fd8997d service nova] Acquiring lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:49:14 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-900493c5-2dd8-447f-8339-2a6fb64aa3b2 req-a1a5a4fe-eaaf-4b8b-bee6-33577fd8997d service nova] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:49:14 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-900493c5-2dd8-447f-8339-2a6fb64aa3b2 req-a1a5a4fe-eaaf-4b8b-bee6-33577fd8997d service nova] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:49:14 user nova-compute[71113]: DEBUG nova.compute.manager [req-900493c5-2dd8-447f-8339-2a6fb64aa3b2 req-a1a5a4fe-eaaf-4b8b-bee6-33577fd8997d service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] No waiting events found dispatching network-vif-unplugged-370dc7b8-8a77-47e4-94b9-ae9be9d1de13 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:49:14 user nova-compute[71113]: DEBUG nova.compute.manager [req-900493c5-2dd8-447f-8339-2a6fb64aa3b2 req-a1a5a4fe-eaaf-4b8b-bee6-33577fd8997d service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received event network-vif-unplugged-370dc7b8-8a77-47e4-94b9-ae9be9d1de13 for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 09:49:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:14 user nova-compute[71113]: DEBUG nova.compute.manager [req-bba379bf-122b-4216-9c4c-4da2706232ca req-53aa5ce8-9350-4363-8a08-3ff20ab9ffb9 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received event network-vif-unplugged-e64b39b1-bdfc-4e38-9520-8bf02c8427a4 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:49:14 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-bba379bf-122b-4216-9c4c-4da2706232ca req-53aa5ce8-9350-4363-8a08-3ff20ab9ffb9 service nova] Acquiring lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:49:14 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-bba379bf-122b-4216-9c4c-4da2706232ca req-53aa5ce8-9350-4363-8a08-3ff20ab9ffb9 service nova] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:49:14 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-bba379bf-122b-4216-9c4c-4da2706232ca req-53aa5ce8-9350-4363-8a08-3ff20ab9ffb9 service nova] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:49:14 user nova-compute[71113]: DEBUG nova.compute.manager [req-bba379bf-122b-4216-9c4c-4da2706232ca req-53aa5ce8-9350-4363-8a08-3ff20ab9ffb9 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] No waiting events found dispatching network-vif-unplugged-e64b39b1-bdfc-4e38-9520-8bf02c8427a4 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:49:14 user nova-compute[71113]: DEBUG nova.compute.manager [req-bba379bf-122b-4216-9c4c-4da2706232ca req-53aa5ce8-9350-4363-8a08-3ff20ab9ffb9 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received event network-vif-unplugged-e64b39b1-bdfc-4e38-9520-8bf02c8427a4 for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 09:49:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:15 user nova-compute[71113]: DEBUG nova.compute.manager [req-5eeaa581-a051-42b6-bcee-fecffc096763 req-a91304f6-9253-425e-b271-126078258916 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received event network-vif-unplugged-dc38d490-4eb0-496c-817d-639264048797 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:49:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-5eeaa581-a051-42b6-bcee-fecffc096763 req-a91304f6-9253-425e-b271-126078258916 service nova] Acquiring lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:49:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-5eeaa581-a051-42b6-bcee-fecffc096763 req-a91304f6-9253-425e-b271-126078258916 service nova] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:49:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-5eeaa581-a051-42b6-bcee-fecffc096763 req-a91304f6-9253-425e-b271-126078258916 service nova] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:49:15 user nova-compute[71113]: DEBUG nova.compute.manager [req-5eeaa581-a051-42b6-bcee-fecffc096763 req-a91304f6-9253-425e-b271-126078258916 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] No waiting events found dispatching network-vif-unplugged-dc38d490-4eb0-496c-817d-639264048797 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:49:15 user nova-compute[71113]: DEBUG nova.compute.manager [req-5eeaa581-a051-42b6-bcee-fecffc096763 req-a91304f6-9253-425e-b271-126078258916 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received event network-vif-unplugged-dc38d490-4eb0-496c-817d-639264048797 for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 09:49:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:16 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Instance destroyed successfully.
Jul 31 09:49:16 user nova-compute[71113]: DEBUG nova.objects.instance [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Lazy-loading 'resources' on Instance uuid 3aaaef96-76f8-4088-a0bc-a1a72e80652e {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T09:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2136690925',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2136690925',id=9,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK37xL1BAMkSaHD27/dclDrDquKxGSbRz4om1spfqNUqYMogTIgM2NduHLjCNONc4OJfQWmM6xekLwEzzN15WwLbkZLHNz1raY0ZMpW2iVvvb6iQ47za56ehfKCbzjCDMw==',key_name='tempest-keypair-1445988611',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:47:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='219e950d6a5141ef93bd970e5c1d3805',ramdisk_id='',reservation_id='r-ll7h8n2p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-730691933',owner_user_name='tempest-TaggedBootDevicesTest_v242-730691933-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:47:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8f072d506b141dc92dddb9dc6348f72',uuid=3aaaef96-76f8-4088-a0bc-a1a72e80652e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "370dc7b8-8a77-47e4-94b9-ae9be9d1de13", "address": "fa:16:3e:7b:6a:0d", "network": {"id": "9e762abf-a299-49e7-b276-0fa226649bb9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1384573536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap370dc7b8-8a", "ovs_interfaceid": "370dc7b8-8a77-47e4-94b9-ae9be9d1de13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Converting VIF {"id": "370dc7b8-8a77-47e4-94b9-ae9be9d1de13", "address": "fa:16:3e:7b:6a:0d", "network": {"id": "9e762abf-a299-49e7-b276-0fa226649bb9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1384573536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap370dc7b8-8a", "ovs_interfaceid": "370dc7b8-8a77-47e4-94b9-ae9be9d1de13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:6a:0d,bridge_name='br-int',has_traffic_filtering=True,id=370dc7b8-8a77-47e4-94b9-ae9be9d1de13,network=Network(9e762abf-a299-49e7-b276-0fa226649bb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap370dc7b8-8a') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG os_vif [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:6a:0d,bridge_name='br-int',has_traffic_filtering=True,id=370dc7b8-8a77-47e4-94b9-ae9be9d1de13,network=Network(9e762abf-a299-49e7-b276-0fa226649bb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap370dc7b8-8a') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap370dc7b8-8a, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:16 user nova-compute[71113]: INFO os_vif [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:6a:0d,bridge_name='br-int',has_traffic_filtering=True,id=370dc7b8-8a77-47e4-94b9-ae9be9d1de13,network=Network(9e762abf-a299-49e7-b276-0fa226649bb9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap370dc7b8-8a')
Jul 31 09:49:16 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T09:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2136690925',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2136690925',id=9,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK37xL1BAMkSaHD27/dclDrDquKxGSbRz4om1spfqNUqYMogTIgM2NduHLjCNONc4OJfQWmM6xekLwEzzN15WwLbkZLHNz1raY0ZMpW2iVvvb6iQ47za56ehfKCbzjCDMw==',key_name='tempest-keypair-1445988611',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:47:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='219e950d6a5141ef93bd970e5c1d3805',ramdisk_id='',reservation_id='r-ll7h8n2p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-730691933',owner_user_name='tempest-TaggedBootDevicesTest_v242-730691933-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:47:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8f072d506b141dc92dddb9dc6348f72',uuid=3aaaef96-76f8-4088-a0bc-a1a72e80652e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e64b39b1-bdfc-4e38-9520-8bf02c8427a4", "address": "fa:16:3e:0d:7e:fd", "network": {"id": "f7c9bb5d-84df-44c3-a496-20d634727c3c", "bridge": "br-int", "label": "tempest-device-tagging-net1-420856970", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape64b39b1-bd", "ovs_interfaceid": "e64b39b1-bdfc-4e38-9520-8bf02c8427a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Converting VIF {"id": "e64b39b1-bdfc-4e38-9520-8bf02c8427a4", "address": "fa:16:3e:0d:7e:fd", "network": {"id": "f7c9bb5d-84df-44c3-a496-20d634727c3c", "bridge": "br-int", "label": "tempest-device-tagging-net1-420856970", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape64b39b1-bd", "ovs_interfaceid": "e64b39b1-bdfc-4e38-9520-8bf02c8427a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:7e:fd,bridge_name='br-int',has_traffic_filtering=True,id=e64b39b1-bdfc-4e38-9520-8bf02c8427a4,network=Network(f7c9bb5d-84df-44c3-a496-20d634727c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape64b39b1-bd') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG os_vif [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:7e:fd,bridge_name='br-int',has_traffic_filtering=True,id=e64b39b1-bdfc-4e38-9520-8bf02c8427a4,network=Network(f7c9bb5d-84df-44c3-a496-20d634727c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape64b39b1-bd') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape64b39b1-bd, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:16 user nova-compute[71113]: INFO os_vif [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:7e:fd,bridge_name='br-int',has_traffic_filtering=True,id=e64b39b1-bdfc-4e38-9520-8bf02c8427a4,network=Network(f7c9bb5d-84df-44c3-a496-20d634727c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape64b39b1-bd')
Jul 31 09:49:16 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T09:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2136690925',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2136690925',id=9,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK37xL1BAMkSaHD27/dclDrDquKxGSbRz4om1spfqNUqYMogTIgM2NduHLjCNONc4OJfQWmM6xekLwEzzN15WwLbkZLHNz1raY0ZMpW2iVvvb6iQ47za56ehfKCbzjCDMw==',key_name='tempest-keypair-1445988611',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:47:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='219e950d6a5141ef93bd970e5c1d3805',ramdisk_id='',reservation_id='r-ll7h8n2p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-730691933',owner_user_name='tempest-TaggedBootDevicesTest_v242-730691933-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:47:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8f072d506b141dc92dddb9dc6348f72',uuid=3aaaef96-76f8-4088-a0bc-a1a72e80652e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a0920cd-a09e-4a83-adcd-098a71e98229", "address": "fa:16:3e:8b:9b:9f", "network": {"id": "f7c9bb5d-84df-44c3-a496-20d634727c3c", "bridge": "br-int", "label": "tempest-device-tagging-net1-420856970", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a0920cd-a0", "ovs_interfaceid": "3a0920cd-a09e-4a83-adcd-098a71e98229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Converting VIF {"id": "3a0920cd-a09e-4a83-adcd-098a71e98229", "address": "fa:16:3e:8b:9b:9f", "network": {"id": "f7c9bb5d-84df-44c3-a496-20d634727c3c", "bridge": "br-int", "label": "tempest-device-tagging-net1-420856970", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a0920cd-a0", "ovs_interfaceid": "3a0920cd-a09e-4a83-adcd-098a71e98229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:9b:9f,bridge_name='br-int',has_traffic_filtering=True,id=3a0920cd-a09e-4a83-adcd-098a71e98229,network=Network(f7c9bb5d-84df-44c3-a496-20d634727c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3a0920cd-a0') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG os_vif [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:9b:9f,bridge_name='br-int',has_traffic_filtering=True,id=3a0920cd-a09e-4a83-adcd-098a71e98229,network=Network(f7c9bb5d-84df-44c3-a496-20d634727c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3a0920cd-a0') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a0920cd-a0, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:16 user nova-compute[71113]: INFO os_vif [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:9b:9f,bridge_name='br-int',has_traffic_filtering=True,id=3a0920cd-a09e-4a83-adcd-098a71e98229,network=Network(f7c9bb5d-84df-44c3-a496-20d634727c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3a0920cd-a0')
Jul 31 09:49:16 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T09:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2136690925',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2136690925',id=9,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK37xL1BAMkSaHD27/dclDrDquKxGSbRz4om1spfqNUqYMogTIgM2NduHLjCNONc4OJfQWmM6xekLwEzzN15WwLbkZLHNz1raY0ZMpW2iVvvb6iQ47za56ehfKCbzjCDMw==',key_name='tempest-keypair-1445988611',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:47:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='219e950d6a5141ef93bd970e5c1d3805',ramdisk_id='',reservation_id='r-ll7h8n2p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-730691933',owner_user_name='tempest-TaggedBootDevicesTest_v242-730691933-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:47:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8f072d506b141dc92dddb9dc6348f72',uuid=3aaaef96-76f8-4088-a0bc-a1a72e80652e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "79461167-7380-4b36-ac54-b58585f55c20", "address": "fa:16:3e:51:a4:07", "network": {"id": "f7c9bb5d-84df-44c3-a496-20d634727c3c", "bridge": "br-int", "label": "tempest-device-tagging-net1-420856970", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79461167-73", "ovs_interfaceid": "79461167-7380-4b36-ac54-b58585f55c20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Converting VIF {"id": "79461167-7380-4b36-ac54-b58585f55c20", "address": "fa:16:3e:51:a4:07", "network": {"id": "f7c9bb5d-84df-44c3-a496-20d634727c3c", "bridge": "br-int", "label": "tempest-device-tagging-net1-420856970", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.207", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79461167-73", "ovs_interfaceid": "79461167-7380-4b36-ac54-b58585f55c20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:a4:07,bridge_name='br-int',has_traffic_filtering=True,id=79461167-7380-4b36-ac54-b58585f55c20,network=Network(f7c9bb5d-84df-44c3-a496-20d634727c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79461167-73') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG os_vif [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:a4:07,bridge_name='br-int',has_traffic_filtering=True,id=79461167-7380-4b36-ac54-b58585f55c20,network=Network(f7c9bb5d-84df-44c3-a496-20d634727c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79461167-73') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap79461167-73, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG nova.compute.manager [req-a9c2c131-ab66-4b69-88cf-42130ffca2b5 req-f05b905e-4817-4ee3-b095-061af902d157 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received event network-vif-plugged-370dc7b8-8a77-47e4-94b9-ae9be9d1de13 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-a9c2c131-ab66-4b69-88cf-42130ffca2b5 req-f05b905e-4817-4ee3-b095-061af902d157 service nova] Acquiring lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-a9c2c131-ab66-4b69-88cf-42130ffca2b5 req-f05b905e-4817-4ee3-b095-061af902d157 service nova] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-a9c2c131-ab66-4b69-88cf-42130ffca2b5 req-f05b905e-4817-4ee3-b095-061af902d157 service nova] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG nova.compute.manager [req-a9c2c131-ab66-4b69-88cf-42130ffca2b5 req-f05b905e-4817-4ee3-b095-061af902d157 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] No waiting events found dispatching network-vif-plugged-370dc7b8-8a77-47e4-94b9-ae9be9d1de13 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:49:16 user nova-compute[71113]: WARNING nova.compute.manager [req-a9c2c131-ab66-4b69-88cf-42130ffca2b5 req-f05b905e-4817-4ee3-b095-061af902d157 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received unexpected event network-vif-plugged-370dc7b8-8a77-47e4-94b9-ae9be9d1de13 for instance with vm_state active and task_state deleting.
Jul 31 09:49:16 user nova-compute[71113]: DEBUG nova.compute.manager [req-a9c2c131-ab66-4b69-88cf-42130ffca2b5 req-f05b905e-4817-4ee3-b095-061af902d157 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received event network-vif-unplugged-3a0920cd-a09e-4a83-adcd-098a71e98229 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-a9c2c131-ab66-4b69-88cf-42130ffca2b5 req-f05b905e-4817-4ee3-b095-061af902d157 service nova] Acquiring lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-a9c2c131-ab66-4b69-88cf-42130ffca2b5 req-f05b905e-4817-4ee3-b095-061af902d157 service nova] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-a9c2c131-ab66-4b69-88cf-42130ffca2b5 req-f05b905e-4817-4ee3-b095-061af902d157 service nova] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG nova.compute.manager [req-a9c2c131-ab66-4b69-88cf-42130ffca2b5 req-f05b905e-4817-4ee3-b095-061af902d157 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] No waiting events found dispatching network-vif-unplugged-3a0920cd-a09e-4a83-adcd-098a71e98229 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG nova.compute.manager [req-a9c2c131-ab66-4b69-88cf-42130ffca2b5 req-f05b905e-4817-4ee3-b095-061af902d157 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received event network-vif-unplugged-3a0920cd-a09e-4a83-adcd-098a71e98229 for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG nova.compute.manager [req-a9c2c131-ab66-4b69-88cf-42130ffca2b5 req-f05b905e-4817-4ee3-b095-061af902d157 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received event network-vif-plugged-3a0920cd-a09e-4a83-adcd-098a71e98229 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-a9c2c131-ab66-4b69-88cf-42130ffca2b5 req-f05b905e-4817-4ee3-b095-061af902d157 service nova] Acquiring lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-a9c2c131-ab66-4b69-88cf-42130ffca2b5 req-f05b905e-4817-4ee3-b095-061af902d157 service nova] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-a9c2c131-ab66-4b69-88cf-42130ffca2b5 req-f05b905e-4817-4ee3-b095-061af902d157 service nova] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG nova.compute.manager [req-a9c2c131-ab66-4b69-88cf-42130ffca2b5 req-f05b905e-4817-4ee3-b095-061af902d157 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] No waiting events found dispatching network-vif-plugged-3a0920cd-a09e-4a83-adcd-098a71e98229 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:49:16 user nova-compute[71113]: WARNING nova.compute.manager [req-a9c2c131-ab66-4b69-88cf-42130ffca2b5 req-f05b905e-4817-4ee3-b095-061af902d157 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received unexpected event network-vif-plugged-3a0920cd-a09e-4a83-adcd-098a71e98229 for instance with vm_state active and task_state deleting.
Jul 31 09:49:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:16 user nova-compute[71113]: INFO os_vif [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:a4:07,bridge_name='br-int',has_traffic_filtering=True,id=79461167-7380-4b36-ac54-b58585f55c20,network=Network(f7c9bb5d-84df-44c3-a496-20d634727c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79461167-73')
Jul 31 09:49:16 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T09:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2136690925',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2136690925',id=9,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK37xL1BAMkSaHD27/dclDrDquKxGSbRz4om1spfqNUqYMogTIgM2NduHLjCNONc4OJfQWmM6xekLwEzzN15WwLbkZLHNz1raY0ZMpW2iVvvb6iQ47za56ehfKCbzjCDMw==',key_name='tempest-keypair-1445988611',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:47:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='219e950d6a5141ef93bd970e5c1d3805',ramdisk_id='',reservation_id='r-ll7h8n2p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-730691933',owner_user_name='tempest-TaggedBootDevicesTest_v242-730691933-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:47:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8f072d506b141dc92dddb9dc6348f72',uuid=3aaaef96-76f8-4088-a0bc-a1a72e80652e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc38d490-4eb0-496c-817d-639264048797", "address": "fa:16:3e:92:54:8b", "network": {"id": "f7c9bb5d-84df-44c3-a496-20d634727c3c", "bridge": "br-int", "label": "tempest-device-tagging-net1-420856970", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc38d490-4e", "ovs_interfaceid": "dc38d490-4eb0-496c-817d-639264048797", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Converting VIF {"id": "dc38d490-4eb0-496c-817d-639264048797", "address": "fa:16:3e:92:54:8b", "network": {"id": "f7c9bb5d-84df-44c3-a496-20d634727c3c", "bridge": "br-int", "label": "tempest-device-tagging-net1-420856970", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc38d490-4e", "ovs_interfaceid": "dc38d490-4eb0-496c-817d-639264048797", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:54:8b,bridge_name='br-int',has_traffic_filtering=True,id=dc38d490-4eb0-496c-817d-639264048797,network=Network(f7c9bb5d-84df-44c3-a496-20d634727c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc38d490-4e') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG os_vif [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:54:8b,bridge_name='br-int',has_traffic_filtering=True,id=dc38d490-4eb0-496c-817d-639264048797,network=Network(f7c9bb5d-84df-44c3-a496-20d634727c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc38d490-4e') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdc38d490-4e, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:16 user nova-compute[71113]: INFO os_vif [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:54:8b,bridge_name='br-int',has_traffic_filtering=True,id=dc38d490-4eb0-496c-817d-639264048797,network=Network(f7c9bb5d-84df-44c3-a496-20d634727c3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc38d490-4e')
Jul 31 09:49:16 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T09:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2136690925',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2136690925',id=9,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK37xL1BAMkSaHD27/dclDrDquKxGSbRz4om1spfqNUqYMogTIgM2NduHLjCNONc4OJfQWmM6xekLwEzzN15WwLbkZLHNz1raY0ZMpW2iVvvb6iQ47za56ehfKCbzjCDMw==',key_name='tempest-keypair-1445988611',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:47:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='219e950d6a5141ef93bd970e5c1d3805',ramdisk_id='',reservation_id='r-ll7h8n2p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-730691933',owner_user_name='tempest-TaggedBootDevicesTest_v242-730691933-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:47:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8f072d506b141dc92dddb9dc6348f72',uuid=3aaaef96-76f8-4088-a0bc-a1a72e80652e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c60ea5a4-1214-4163-ad18-e7bdf71e4bef", "address": "fa:16:3e:ab:70:c1", "network": {"id": "bb2db53e-eed4-44e7-9510-eab184de68f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-411965443", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60ea5a4-12", "ovs_interfaceid": "c60ea5a4-1214-4163-ad18-e7bdf71e4bef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Converting VIF {"id": "c60ea5a4-1214-4163-ad18-e7bdf71e4bef", "address": "fa:16:3e:ab:70:c1", "network": {"id": "bb2db53e-eed4-44e7-9510-eab184de68f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-411965443", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60ea5a4-12", "ovs_interfaceid": "c60ea5a4-1214-4163-ad18-e7bdf71e4bef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:70:c1,bridge_name='br-int',has_traffic_filtering=True,id=c60ea5a4-1214-4163-ad18-e7bdf71e4bef,network=Network(bb2db53e-eed4-44e7-9510-eab184de68f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc60ea5a4-12') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG os_vif [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:70:c1,bridge_name='br-int',has_traffic_filtering=True,id=c60ea5a4-1214-4163-ad18-e7bdf71e4bef,network=Network(bb2db53e-eed4-44e7-9510-eab184de68f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc60ea5a4-12') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc60ea5a4-12, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:16 user nova-compute[71113]: INFO os_vif [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:70:c1,bridge_name='br-int',has_traffic_filtering=True,id=c60ea5a4-1214-4163-ad18-e7bdf71e4bef,network=Network(bb2db53e-eed4-44e7-9510-eab184de68f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc60ea5a4-12')
Jul 31 09:49:16 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T09:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2136690925',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2136690925',id=9,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK37xL1BAMkSaHD27/dclDrDquKxGSbRz4om1spfqNUqYMogTIgM2NduHLjCNONc4OJfQWmM6xekLwEzzN15WwLbkZLHNz1raY0ZMpW2iVvvb6iQ47za56ehfKCbzjCDMw==',key_name='tempest-keypair-1445988611',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:47:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='219e950d6a5141ef93bd970e5c1d3805',ramdisk_id='',reservation_id='r-ll7h8n2p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-730691933',owner_user_name='tempest-TaggedBootDevicesTest_v242-730691933-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:47:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f8f072d506b141dc92dddb9dc6348f72',uuid=3aaaef96-76f8-4088-a0bc-a1a72e80652e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f998018e-386d-4444-9712-9eb57b025198", "address": "fa:16:3e:97:88:64", "network": {"id": "bb2db53e-eed4-44e7-9510-eab184de68f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-411965443", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf998018e-38", "ovs_interfaceid": "f998018e-386d-4444-9712-9eb57b025198", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Converting VIF {"id": "f998018e-386d-4444-9712-9eb57b025198", "address": "fa:16:3e:97:88:64", "network": {"id": "bb2db53e-eed4-44e7-9510-eab184de68f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-411965443", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf998018e-38", "ovs_interfaceid": "f998018e-386d-4444-9712-9eb57b025198", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:88:64,bridge_name='br-int',has_traffic_filtering=True,id=f998018e-386d-4444-9712-9eb57b025198,network=Network(bb2db53e-eed4-44e7-9510-eab184de68f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf998018e-38') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG os_vif [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:88:64,bridge_name='br-int',has_traffic_filtering=True,id=f998018e-386d-4444-9712-9eb57b025198,network=Network(bb2db53e-eed4-44e7-9510-eab184de68f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf998018e-38') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf998018e-38, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:16 user nova-compute[71113]: INFO os_vif [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:88:64,bridge_name='br-int',has_traffic_filtering=True,id=f998018e-386d-4444-9712-9eb57b025198,network=Network(bb2db53e-eed4-44e7-9510-eab184de68f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf998018e-38')
Jul 31 09:49:16 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UArGijqH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:49:16 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:49:16 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9901691-aba9-4149-b525-ed15679215d7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[478ca4b8-01ce-4a04-8f4d-68e9aaf7e9cc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)
Jul 31 09:49:16 user nova-compute[71113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)
Jul 31 09:49:16 user nova-compute[71113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)
Jul 31 09:49:16 user nova-compute[71113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:49:16 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 (non-flash)
Jul 31 09:49:16 user nova-compute[71113]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)
Jul 31 09:49:16 user nova-compute[71113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)
Jul 31 09:49:16 user nova-compute[71113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:49:16 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79117aad40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288'): ({'sdb'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Removing single pathed devices sdb {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3022d99-9a91-42f2-95df-32d037038b2f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f19ab11-6cfe-4f1c-8a67-3653e5e66bb0]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Flushing IO for device /dev/sdb {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e793184-bbbd-4d00-8858-6bd327bbf3cb]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4acf6d-4e76-4819-8efb-c28b0abb904c]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] SCSI volumes sdb have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG nova.compute.manager [req-f74bcc20-e8ad-4296-a949-b122c7a873fc req-3e9cc8e6-43da-4f87-92c6-37c324ab7dcb service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received event network-vif-plugged-e64b39b1-bdfc-4e38-9520-8bf02c8427a4 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f74bcc20-e8ad-4296-a949-b122c7a873fc req-3e9cc8e6-43da-4f87-92c6-37c324ab7dcb service nova] Acquiring lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f74bcc20-e8ad-4296-a949-b122c7a873fc req-3e9cc8e6-43da-4f87-92c6-37c324ab7dcb service nova] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f74bcc20-e8ad-4296-a949-b122c7a873fc req-3e9cc8e6-43da-4f87-92c6-37c324ab7dcb service nova] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG nova.compute.manager [req-f74bcc20-e8ad-4296-a949-b122c7a873fc req-3e9cc8e6-43da-4f87-92c6-37c324ab7dcb service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] No waiting events found dispatching network-vif-plugged-e64b39b1-bdfc-4e38-9520-8bf02c8427a4 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:49:16 user nova-compute[71113]: WARNING nova.compute.manager [req-f74bcc20-e8ad-4296-a949-b122c7a873fc req-3e9cc8e6-43da-4f87-92c6-37c324ab7dcb service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received unexpected event network-vif-plugged-e64b39b1-bdfc-4e38-9520-8bf02c8427a4 for instance with vm_state active and task_state deleting.
Jul 31 09:49:16 user nova-compute[71113]: DEBUG nova.compute.manager [req-f74bcc20-e8ad-4296-a949-b122c7a873fc req-3e9cc8e6-43da-4f87-92c6-37c324ab7dcb service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received event network-vif-unplugged-79461167-7380-4b36-ac54-b58585f55c20 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f74bcc20-e8ad-4296-a949-b122c7a873fc req-3e9cc8e6-43da-4f87-92c6-37c324ab7dcb service nova] Acquiring lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f74bcc20-e8ad-4296-a949-b122c7a873fc req-3e9cc8e6-43da-4f87-92c6-37c324ab7dcb service nova] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f74bcc20-e8ad-4296-a949-b122c7a873fc req-3e9cc8e6-43da-4f87-92c6-37c324ab7dcb service nova] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG nova.compute.manager [req-f74bcc20-e8ad-4296-a949-b122c7a873fc req-3e9cc8e6-43da-4f87-92c6-37c324ab7dcb service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] No waiting events found dispatching network-vif-unplugged-79461167-7380-4b36-ac54-b58585f55c20 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG nova.compute.manager [req-f74bcc20-e8ad-4296-a949-b122c7a873fc req-3e9cc8e6-43da-4f87-92c6-37c324ab7dcb service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received event network-vif-unplugged-79461167-7380-4b36-ac54-b58585f55c20 for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG nova.compute.manager [req-f74bcc20-e8ad-4296-a949-b122c7a873fc req-3e9cc8e6-43da-4f87-92c6-37c324ab7dcb service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received event network-vif-plugged-79461167-7380-4b36-ac54-b58585f55c20 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f74bcc20-e8ad-4296-a949-b122c7a873fc req-3e9cc8e6-43da-4f87-92c6-37c324ab7dcb service nova] Acquiring lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f74bcc20-e8ad-4296-a949-b122c7a873fc req-3e9cc8e6-43da-4f87-92c6-37c324ab7dcb service nova] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f74bcc20-e8ad-4296-a949-b122c7a873fc req-3e9cc8e6-43da-4f87-92c6-37c324ab7dcb service nova] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG nova.compute.manager [req-f74bcc20-e8ad-4296-a949-b122c7a873fc req-3e9cc8e6-43da-4f87-92c6-37c324ab7dcb service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] No waiting events found dispatching network-vif-plugged-79461167-7380-4b36-ac54-b58585f55c20 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:49:16 user nova-compute[71113]: WARNING nova.compute.manager [req-f74bcc20-e8ad-4296-a949-b122c7a873fc req-3e9cc8e6-43da-4f87-92c6-37c324ab7dcb service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received unexpected event network-vif-plugged-79461167-7380-4b36-ac54-b58585f55c20 for instance with vm_state active and task_state deleting.
Jul 31 09:49:16 user nova-compute[71113]: DEBUG nova.compute.manager [req-f74bcc20-e8ad-4296-a949-b122c7a873fc req-3e9cc8e6-43da-4f87-92c6-37c324ab7dcb service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received event network-vif-unplugged-c60ea5a4-1214-4163-ad18-e7bdf71e4bef {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f74bcc20-e8ad-4296-a949-b122c7a873fc req-3e9cc8e6-43da-4f87-92c6-37c324ab7dcb service nova] Acquiring lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f74bcc20-e8ad-4296-a949-b122c7a873fc req-3e9cc8e6-43da-4f87-92c6-37c324ab7dcb service nova] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f74bcc20-e8ad-4296-a949-b122c7a873fc req-3e9cc8e6-43da-4f87-92c6-37c324ab7dcb service nova] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG nova.compute.manager [req-f74bcc20-e8ad-4296-a949-b122c7a873fc req-3e9cc8e6-43da-4f87-92c6-37c324ab7dcb service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] No waiting events found dispatching network-vif-unplugged-c60ea5a4-1214-4163-ad18-e7bdf71e4bef {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG nova.compute.manager [req-f74bcc20-e8ad-4296-a949-b122c7a873fc req-3e9cc8e6-43da-4f87-92c6-37c324ab7dcb service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received event network-vif-unplugged-c60ea5a4-1214-4163-ad18-e7bdf71e4bef for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG nova.compute.manager [req-f74bcc20-e8ad-4296-a949-b122c7a873fc req-3e9cc8e6-43da-4f87-92c6-37c324ab7dcb service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received event network-vif-plugged-c60ea5a4-1214-4163-ad18-e7bdf71e4bef {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f74bcc20-e8ad-4296-a949-b122c7a873fc req-3e9cc8e6-43da-4f87-92c6-37c324ab7dcb service nova] Acquiring lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f74bcc20-e8ad-4296-a949-b122c7a873fc req-3e9cc8e6-43da-4f87-92c6-37c324ab7dcb service nova] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f74bcc20-e8ad-4296-a949-b122c7a873fc req-3e9cc8e6-43da-4f87-92c6-37c324ab7dcb service nova] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG nova.compute.manager [req-f74bcc20-e8ad-4296-a949-b122c7a873fc req-3e9cc8e6-43da-4f87-92c6-37c324ab7dcb service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] No waiting events found dispatching network-vif-plugged-c60ea5a4-1214-4163-ad18-e7bdf71e4bef {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:49:16 user nova-compute[71113]: WARNING nova.compute.manager [req-f74bcc20-e8ad-4296-a949-b122c7a873fc req-3e9cc8e6-43da-4f87-92c6-37c324ab7dcb service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received unexpected event network-vif-plugged-c60ea5a4-1214-4163-ad18-e7bdf71e4bef for instance with vm_state active and task_state deleting.
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.037s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e055f92-ded5-4b0a-a592-09c315513b78]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c0743b-9ef2-42bb-b47a-f18bb34c0619]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288, portal: 172.16.0.220,3260]
Jul 31 09:49:16 user nova-compute[71113]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288, portal: 172.16.0.220,3260] successful.
Jul 31 09:49:16 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a69daa37-ae46-4518-bb27-5b57f6e06288 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd361486-0fde-47d1-a189-10075864c9ad]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] <== disconnect_volume: return (329ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dDJreMHI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:49:16 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:49:16 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12c85d4-8d0b-434d-8797-a6a23baf7feb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[081d728d-7cb2-45e5-b908-a927ce775a06]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)
Jul 31 09:49:16 user nova-compute[71113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)
Jul 31 09:49:16 user nova-compute[71113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:49:16 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)
Jul 31 09:49:16 user nova-compute[71113]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 (non-flash)
Jul 31 09:49:16 user nova-compute[71113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:49:16 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f78f06b1b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61'): ({'sdd'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Removing single pathed devices sdd {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a3011d-3ed5-4505-940c-b6582daa843e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7d0097-b581-4924-b650-231d0438b27b]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Flushing IO for device /dev/sdd {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f0f993-cf4b-47fb-b3f5-28fcbac22534]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[91987042-8280-4933-9159-bd62cdf3da98]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] SCSI volumes sdd have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c451fd-cfe0-40a7-a071-074a6fd5810c]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dea5af0-85a4-4908-9434-bdc12d424990]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61, portal: 172.16.0.220,3260]
Jul 31 09:49:17 user nova-compute[71113]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61, portal: 172.16.0.220,3260] successful.
Jul 31 09:49:17 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab8a5e88-17f8-4128-abbe-211ec120be61 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[005a317b-03c7-442a-9248-14a6a81ca2ce]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] <== disconnect_volume: return (276ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AQBdsZGX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:49:17 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:49:17 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f42cc3-46d5-4ddd-a367-041ee37fd852]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd5b299-c903-4bb9-a77b-254a0fe0f7af]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)
Jul 31 09:49:17 user nova-compute[71113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:49:17 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 (non-flash)
Jul 31 09:49:17 user nova-compute[71113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:49:17 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f78f06b2290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321'): ({'sdc'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Removing single pathed devices sdc {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef0d525-c495-401d-adc7-0b40faa538b0]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ec2408-3a36-4efd-9218-f813f2015fa8]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Flushing IO for device /dev/sdc {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[79dadeb0-9679-4799-8420-f029a70c30de]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.034s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b9cbdd-8e6b-4c9b-a3c7-5b27e792d065]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] SCSI volumes sdc have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[872e3b4a-e4c1-402f-9287-06662a1ab163]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f48c5c-215a-4b58-84c8-db542ea13d84]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321, portal: 172.16.0.220,3260]
Jul 31 09:49:17 user nova-compute[71113]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321, portal: 172.16.0.220,3260] successful.
Jul 31 09:49:17 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f51b00bb-6a76-4ed9-bb8f-e6c91340b321 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8a9b66-ed36-47b5-8a07-6e05dd03632d]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.252s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] <== disconnect_volume: return (253ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 09:49:17 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Deleting instance files /opt/stack/data/nova/instances/3aaaef96-76f8-4088-a0bc-a1a72e80652e_del
Jul 31 09:49:17 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Deletion of /opt/stack/data/nova/instances/3aaaef96-76f8-4088-a0bc-a1a72e80652e_del complete
Jul 31 09:49:17 user nova-compute[71113]: INFO nova.compute.manager [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Took 3.47 seconds to destroy the instance on the hypervisor.
Jul 31 09:49:17 user nova-compute[71113]: DEBUG oslo.service.loopingcall [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71113) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG nova.compute.manager [-] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Deallocating network for instance {{(pid=71113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] deallocate_for_instance() {{(pid=71113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG nova.compute.manager [req-1ce9ae6b-164f-4ceb-afa2-bac3ad47fed8 req-9429f597-6f4e-4fc1-aae4-0ac3f2baf51d service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received event network-vif-plugged-dc38d490-4eb0-496c-817d-639264048797 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1ce9ae6b-164f-4ceb-afa2-bac3ad47fed8 req-9429f597-6f4e-4fc1-aae4-0ac3f2baf51d service nova] Acquiring lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1ce9ae6b-164f-4ceb-afa2-bac3ad47fed8 req-9429f597-6f4e-4fc1-aae4-0ac3f2baf51d service nova] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1ce9ae6b-164f-4ceb-afa2-bac3ad47fed8 req-9429f597-6f4e-4fc1-aae4-0ac3f2baf51d service nova] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG nova.compute.manager [req-1ce9ae6b-164f-4ceb-afa2-bac3ad47fed8 req-9429f597-6f4e-4fc1-aae4-0ac3f2baf51d service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] No waiting events found dispatching network-vif-plugged-dc38d490-4eb0-496c-817d-639264048797 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:49:17 user nova-compute[71113]: WARNING nova.compute.manager [req-1ce9ae6b-164f-4ceb-afa2-bac3ad47fed8 req-9429f597-6f4e-4fc1-aae4-0ac3f2baf51d service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received unexpected event network-vif-plugged-dc38d490-4eb0-496c-817d-639264048797 for instance with vm_state active and task_state deleting.
Jul 31 09:49:17 user nova-compute[71113]: DEBUG nova.compute.manager [req-1ce9ae6b-164f-4ceb-afa2-bac3ad47fed8 req-9429f597-6f4e-4fc1-aae4-0ac3f2baf51d service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received event network-vif-unplugged-f998018e-386d-4444-9712-9eb57b025198 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1ce9ae6b-164f-4ceb-afa2-bac3ad47fed8 req-9429f597-6f4e-4fc1-aae4-0ac3f2baf51d service nova] Acquiring lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1ce9ae6b-164f-4ceb-afa2-bac3ad47fed8 req-9429f597-6f4e-4fc1-aae4-0ac3f2baf51d service nova] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1ce9ae6b-164f-4ceb-afa2-bac3ad47fed8 req-9429f597-6f4e-4fc1-aae4-0ac3f2baf51d service nova] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG nova.compute.manager [req-1ce9ae6b-164f-4ceb-afa2-bac3ad47fed8 req-9429f597-6f4e-4fc1-aae4-0ac3f2baf51d service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] No waiting events found dispatching network-vif-unplugged-f998018e-386d-4444-9712-9eb57b025198 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG nova.compute.manager [req-1ce9ae6b-164f-4ceb-afa2-bac3ad47fed8 req-9429f597-6f4e-4fc1-aae4-0ac3f2baf51d service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received event network-vif-unplugged-f998018e-386d-4444-9712-9eb57b025198 for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG nova.compute.manager [req-1ce9ae6b-164f-4ceb-afa2-bac3ad47fed8 req-9429f597-6f4e-4fc1-aae4-0ac3f2baf51d service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received event network-vif-plugged-f998018e-386d-4444-9712-9eb57b025198 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1ce9ae6b-164f-4ceb-afa2-bac3ad47fed8 req-9429f597-6f4e-4fc1-aae4-0ac3f2baf51d service nova] Acquiring lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1ce9ae6b-164f-4ceb-afa2-bac3ad47fed8 req-9429f597-6f4e-4fc1-aae4-0ac3f2baf51d service nova] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1ce9ae6b-164f-4ceb-afa2-bac3ad47fed8 req-9429f597-6f4e-4fc1-aae4-0ac3f2baf51d service nova] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:49:17 user nova-compute[71113]: DEBUG nova.compute.manager [req-1ce9ae6b-164f-4ceb-afa2-bac3ad47fed8 req-9429f597-6f4e-4fc1-aae4-0ac3f2baf51d service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] No waiting events found dispatching network-vif-plugged-f998018e-386d-4444-9712-9eb57b025198 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:49:17 user nova-compute[71113]: WARNING nova.compute.manager [req-1ce9ae6b-164f-4ceb-afa2-bac3ad47fed8 req-9429f597-6f4e-4fc1-aae4-0ac3f2baf51d service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received unexpected event network-vif-plugged-f998018e-386d-4444-9712-9eb57b025198 for instance with vm_state active and task_state deleting.
Jul 31 09:49:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Acquiring lock "8d2948be-3ebb-4067-a0c8-e2ca884814ff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:49:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "8d2948be-3ebb-4067-a0c8-e2ca884814ff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:49:19 user nova-compute[71113]: DEBUG nova.compute.manager [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Starting instance... {{(pid=71113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 09:49:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:49:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:49:19 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 09:49:19 user nova-compute[71113]: INFO nova.compute.claims [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Claim successful on node user
Jul 31 09:49:19 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:49:19 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:49:19 user nova-compute[71113]: DEBUG nova.compute.manager [req-9cddde2b-6f0a-441d-91a9-34ebf16902da req-40089a14-7063-4c5a-93f0-fd96ddb4ecb4 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received event network-vif-deleted-79461167-7380-4b36-ac54-b58585f55c20 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:49:19 user nova-compute[71113]: INFO nova.compute.manager [req-9cddde2b-6f0a-441d-91a9-34ebf16902da req-40089a14-7063-4c5a-93f0-fd96ddb4ecb4 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Neutron deleted interface 79461167-7380-4b36-ac54-b58585f55c20; detaching it from the instance and deleting it from the info cache
Jul 31 09:49:19 user nova-compute[71113]: DEBUG nova.network.neutron [req-9cddde2b-6f0a-441d-91a9-34ebf16902da req-40089a14-7063-4c5a-93f0-fd96ddb4ecb4 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Updating instance_info_cache with network_info: [{"id": "370dc7b8-8a77-47e4-94b9-ae9be9d1de13", "address": "fa:16:3e:7b:6a:0d", "network": {"id": "9e762abf-a299-49e7-b276-0fa226649bb9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1384573536-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap370dc7b8-8a", "ovs_interfaceid": "370dc7b8-8a77-47e4-94b9-ae9be9d1de13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e64b39b1-bdfc-4e38-9520-8bf02c8427a4", "address": "fa:16:3e:0d:7e:fd", "network": {"id": "f7c9bb5d-84df-44c3-a496-20d634727c3c", "bridge": "br-int", "label": "tempest-device-tagging-net1-420856970", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape64b39b1-bd", "ovs_interfaceid": "e64b39b1-bdfc-4e38-9520-8bf02c8427a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3a0920cd-a09e-4a83-adcd-098a71e98229", "address": "fa:16:3e:8b:9b:9f", "network": {"id": "f7c9bb5d-84df-44c3-a496-20d634727c3c", "bridge": "br-int", "label": "tempest-device-tagging-net1-420856970", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a0920cd-a0", "ovs_interfaceid": "3a0920cd-a09e-4a83-adcd-098a71e98229", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dc38d490-4eb0-496c-817d-639264048797", "address": "fa:16:3e:92:54:8b", "network": {"id": "f7c9bb5d-84df-44c3-a496-20d634727c3c", "bridge": "br-int", "label": "tempest-device-tagging-net1-420856970", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc38d490-4e", "ovs_interfaceid": "dc38d490-4eb0-496c-817d-639264048797", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c60ea5a4-1214-4163-ad18-e7bdf71e4bef", "address": "fa:16:3e:ab:70:c1", "network": {"id": "bb2db53e-eed4-44e7-9510-eab184de68f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-411965443", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc60ea5a4-12", "ovs_interfaceid": "c60ea5a4-1214-4163-ad18-e7bdf71e4bef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f998018e-386d-4444-9712-9eb57b025198", "address": "fa:16:3e:97:88:64", "network": {"id": "bb2db53e-eed4-44e7-9510-eab184de68f1", "bridge": "br-int", "label": "tempest-device-tagging-net2-411965443", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "219e950d6a5141ef93bd970e5c1d3805", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf998018e-38", "ovs_interfaceid": "f998018e-386d-4444-9712-9eb57b025198", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:49:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.422s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:49:19 user nova-compute[71113]: DEBUG nova.compute.manager [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Start building networks asynchronously for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 09:49:19 user nova-compute[71113]: DEBUG nova.compute.manager [req-9cddde2b-6f0a-441d-91a9-34ebf16902da req-40089a14-7063-4c5a-93f0-fd96ddb4ecb4 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Detach interface failed, port_id=79461167-7380-4b36-ac54-b58585f55c20, reason: Instance 3aaaef96-76f8-4088-a0bc-a1a72e80652e could not be found. {{(pid=71113) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 09:49:19 user nova-compute[71113]: DEBUG nova.compute.manager [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Allocating IP information in the background. {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 09:49:19 user nova-compute[71113]: DEBUG nova.network.neutron [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] allocate_for_instance() {{(pid=71113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 09:49:19 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 09:49:19 user nova-compute[71113]: DEBUG nova.compute.manager [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Start building block device mappings for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 09:49:19 user nova-compute[71113]: DEBUG nova.policy [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b5199c7da0634b6e8111782122adcf70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4461b48e5470471d8fe1b61fb8af9c8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71113) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 09:49:19 user nova-compute[71113]: DEBUG nova.compute.manager [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Start spawning the instance on the hypervisor. {{(pid=71113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 09:49:19 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 09:49:19 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Creating image(s)
Jul 31 09:49:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Acquiring lock "/opt/stack/data/nova/instances/8d2948be-3ebb-4067-a0c8-e2ca884814ff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:49:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "/opt/stack/data/nova/instances/8d2948be-3ebb-4067-a0c8-e2ca884814ff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:49:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "/opt/stack/data/nova/instances/8d2948be-3ebb-4067-a0c8-e2ca884814ff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:49:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.139s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Acquiring lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:49:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:49:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.135s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/8d2948be-3ebb-4067-a0c8-e2ca884814ff/disk 1073741824 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/8d2948be-3ebb-4067-a0c8-e2ca884814ff/disk 1073741824" returned: 0 in 0.053s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:49:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.137s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:20 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8d2948be-3ebb-4067-a0c8-e2ca884814ff/disk. size=1073741824 {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 09:49:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d2948be-3ebb-4067-a0c8-e2ca884814ff/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d2948be-3ebb-4067-a0c8-e2ca884814ff/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:20 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Cannot resize image /opt/stack/data/nova/instances/8d2948be-3ebb-4067-a0c8-e2ca884814ff/disk to a smaller size. {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 09:49:20 user nova-compute[71113]: DEBUG nova.objects.instance [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lazy-loading 'migration_context' on Instance uuid 8d2948be-3ebb-4067-a0c8-e2ca884814ff {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:49:20 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Created local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 09:49:20 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Ensure instance console log exists: /opt/stack/data/nova/instances/8d2948be-3ebb-4067-a0c8-e2ca884814ff/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 09:49:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:49:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:49:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:49:21 user nova-compute[71113]: DEBUG nova.network.neutron [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Successfully created port: f3560f1f-45f9-4ab3-b7a9-338b0483a656 {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 09:49:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:21 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:49:21 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Took 4.20 seconds to deallocate network for instance.
Jul 31 09:49:21 user nova-compute[71113]: DEBUG nova.network.neutron [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Successfully updated port: f3560f1f-45f9-4ab3-b7a9-338b0483a656 {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 09:49:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Acquiring lock "refresh_cache-8d2948be-3ebb-4067-a0c8-e2ca884814ff" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:49:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Acquired lock "refresh_cache-8d2948be-3ebb-4067-a0c8-e2ca884814ff" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:49:21 user nova-compute[71113]: DEBUG nova.network.neutron [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 09:49:21 user nova-compute[71113]: DEBUG nova.compute.manager [req-d85269ce-527e-4fb4-9b04-3475b874c3b0 req-673a5174-bead-4b0b-a774-fe3ba9a31492 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received event network-vif-deleted-c60ea5a4-1214-4163-ad18-e7bdf71e4bef {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:49:21 user nova-compute[71113]: DEBUG nova.compute.manager [req-d85269ce-527e-4fb4-9b04-3475b874c3b0 req-673a5174-bead-4b0b-a774-fe3ba9a31492 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received event network-vif-deleted-370dc7b8-8a77-47e4-94b9-ae9be9d1de13 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:49:21 user nova-compute[71113]: DEBUG nova.compute.manager [req-d85269ce-527e-4fb4-9b04-3475b874c3b0 req-673a5174-bead-4b0b-a774-fe3ba9a31492 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received event network-vif-deleted-dc38d490-4eb0-496c-817d-639264048797 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:49:21 user nova-compute[71113]: DEBUG nova.compute.manager [req-d85269ce-527e-4fb4-9b04-3475b874c3b0 req-673a5174-bead-4b0b-a774-fe3ba9a31492 service nova] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Received event network-vif-deleted-f998018e-386d-4444-9712-9eb57b025198 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:49:21 user nova-compute[71113]: DEBUG nova.compute.manager [req-9dfa28e1-e7fe-4d6d-a464-72160eaafa69 req-f9329082-eced-47ca-80a3-fd22a987edb8 service nova] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Received event network-changed-f3560f1f-45f9-4ab3-b7a9-338b0483a656 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:49:21 user nova-compute[71113]: DEBUG nova.compute.manager [req-9dfa28e1-e7fe-4d6d-a464-72160eaafa69 req-f9329082-eced-47ca-80a3-fd22a987edb8 service nova] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Refreshing instance network info cache due to event network-changed-f3560f1f-45f9-4ab3-b7a9-338b0483a656. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:49:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9dfa28e1-e7fe-4d6d-a464-72160eaafa69 req-f9329082-eced-47ca-80a3-fd22a987edb8 service nova] Acquiring lock "refresh_cache-8d2948be-3ebb-4067-a0c8-e2ca884814ff" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:49:21 user nova-compute[71113]: DEBUG nova.network.neutron [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 09:49:22 user nova-compute[71113]: DEBUG nova.network.neutron [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Updating instance_info_cache with network_info: [{"id": "f3560f1f-45f9-4ab3-b7a9-338b0483a656", "address": "fa:16:3e:91:a4:b3", "network": {"id": "e498d93a-703d-4d19-9adf-61469f37d4da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1320431580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4461b48e5470471d8fe1b61fb8af9c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3560f1f-45", "ovs_interfaceid": "f3560f1f-45f9-4ab3-b7a9-338b0483a656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:49:22 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Releasing lock "refresh_cache-8d2948be-3ebb-4067-a0c8-e2ca884814ff" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:49:22 user nova-compute[71113]: DEBUG nova.compute.manager [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Instance network_info: |[{"id": "f3560f1f-45f9-4ab3-b7a9-338b0483a656", "address": "fa:16:3e:91:a4:b3", "network": {"id": "e498d93a-703d-4d19-9adf-61469f37d4da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1320431580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4461b48e5470471d8fe1b61fb8af9c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3560f1f-45", "ovs_interfaceid": "f3560f1f-45f9-4ab3-b7a9-338b0483a656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 09:49:22 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9dfa28e1-e7fe-4d6d-a464-72160eaafa69 req-f9329082-eced-47ca-80a3-fd22a987edb8 service nova] Acquired lock "refresh_cache-8d2948be-3ebb-4067-a0c8-e2ca884814ff" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:49:22 user nova-compute[71113]: DEBUG nova.network.neutron [req-9dfa28e1-e7fe-4d6d-a464-72160eaafa69 req-f9329082-eced-47ca-80a3-fd22a987edb8 service nova] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Refreshing network info cache for port f3560f1f-45f9-4ab3-b7a9-338b0483a656 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:49:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Start _get_guest_xml network_info=[{"id": "f3560f1f-45f9-4ab3-b7a9-338b0483a656", "address": "fa:16:3e:91:a4:b3", "network": {"id": "e498d93a-703d-4d19-9adf-61469f37d4da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1320431580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4461b48e5470471d8fe1b61fb8af9c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3560f1f-45", "ovs_interfaceid": "f3560f1f-45f9-4ab3-b7a9-338b0483a656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'image_id': '078646fe-b504-41ed-a147-61072e903e51'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 09:49:22 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:49:22 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:49:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 09:49:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 09:49:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 09:49:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 09:49:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 09:49:22 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 09:49:22 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 09:49:22 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 09:49:22 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 09:49:22 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 09:49:22 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 09:49:22 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 09:49:22 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 09:49:22 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 09:49:22 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 09:49:22 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 09:49:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:49:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-185195530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-185195530',id=12,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPiftDuIkWFAIfzl0BTVm1LhY7q40iWz84gStK4DPV8cFJDmAmFDRgF+Fymadhnr5qIGHF7r0Tfo5uKpEAywooFh/gX7i9sx0LkpEaQXIt1KTEtZ1669nicWOlZ3zvT41w==',key_name='tempest-keypair-404775333',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4461b48e5470471d8fe1b61fb8af9c8d',ramdisk_id='',reservation_id='r-v0gpv3qp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-960167684',owner_user_name='tempest-AttachVolumeShelveTestJSON-960167684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:49:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5199c7da0634b6e8111782122adcf70',uuid=8d2948be-3ebb-4067-a0c8-e2ca884814ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3560f1f-45f9-4ab3-b7a9-338b0483a656", "address": "fa:16:3e:91:a4:b3", "network": {"id": "e498d93a-703d-4d19-9adf-61469f37d4da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1320431580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4461b48e5470471d8fe1b61fb8af9c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3560f1f-45", "ovs_interfaceid": "f3560f1f-45f9-4ab3-b7a9-338b0483a656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 09:49:22 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Converting VIF {"id": "f3560f1f-45f9-4ab3-b7a9-338b0483a656", "address": "fa:16:3e:91:a4:b3", "network": {"id": "e498d93a-703d-4d19-9adf-61469f37d4da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1320431580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4461b48e5470471d8fe1b61fb8af9c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3560f1f-45", "ovs_interfaceid": "f3560f1f-45f9-4ab3-b7a9-338b0483a656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:49:22 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:a4:b3,bridge_name='br-int',has_traffic_filtering=True,id=f3560f1f-45f9-4ab3-b7a9-338b0483a656,network=Network(e498d93a-703d-4d19-9adf-61469f37d4da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3560f1f-45') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:49:22 user nova-compute[71113]: DEBUG nova.objects.instance [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d2948be-3ebb-4067-a0c8-e2ca884814ff {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:49:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] End _get_guest_xml xml=<domain type="kvm">
Jul 31 09:49:22 user nova-compute[71113]:   <uuid>8d2948be-3ebb-4067-a0c8-e2ca884814ff</uuid>
Jul 31 09:49:22 user nova-compute[71113]:   <name>instance-0000000c</name>
Jul 31 09:49:22 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 09:49:22 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 09:49:22 user nova-compute[71113]:   <metadata>
Jul 31 09:49:22 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 09:49:22 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 09:49:22 user nova-compute[71113]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-185195530</nova:name>
Jul 31 09:49:22 user nova-compute[71113]:       <nova:creationTime>2023-07-31 09:49:22</nova:creationTime>
Jul 31 09:49:22 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 09:49:22 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 09:49:22 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 09:49:22 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 09:49:22 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 09:49:22 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 09:49:22 user nova-compute[71113]:       </nova:flavor>
Jul 31 09:49:22 user nova-compute[71113]:       <nova:owner>
Jul 31 09:49:22 user nova-compute[71113]:         <nova:user uuid="b5199c7da0634b6e8111782122adcf70">tempest-AttachVolumeShelveTestJSON-960167684-project-member</nova:user>
Jul 31 09:49:22 user nova-compute[71113]:         <nova:project uuid="4461b48e5470471d8fe1b61fb8af9c8d">tempest-AttachVolumeShelveTestJSON-960167684</nova:project>
Jul 31 09:49:22 user nova-compute[71113]:       </nova:owner>
Jul 31 09:49:22 user nova-compute[71113]:       <nova:root type="image" uuid="078646fe-b504-41ed-a147-61072e903e51"/>
Jul 31 09:49:22 user nova-compute[71113]:       <nova:ports>
Jul 31 09:49:22 user nova-compute[71113]:         <nova:port uuid="f3560f1f-45f9-4ab3-b7a9-338b0483a656">
Jul 31 09:49:22 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 31 09:49:22 user nova-compute[71113]:         </nova:port>
Jul 31 09:49:22 user nova-compute[71113]:       </nova:ports>
Jul 31 09:49:22 user nova-compute[71113]:     </nova:instance>
Jul 31 09:49:22 user nova-compute[71113]:   </metadata>
Jul 31 09:49:22 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 09:49:22 user nova-compute[71113]:     <system>
Jul 31 09:49:22 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 09:49:22 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 09:49:22 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 09:49:22 user nova-compute[71113]:       <entry name="serial">8d2948be-3ebb-4067-a0c8-e2ca884814ff</entry>
Jul 31 09:49:22 user nova-compute[71113]:       <entry name="uuid">8d2948be-3ebb-4067-a0c8-e2ca884814ff</entry>
Jul 31 09:49:22 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 09:49:22 user nova-compute[71113]:     </system>
Jul 31 09:49:22 user nova-compute[71113]:   </sysinfo>
Jul 31 09:49:22 user nova-compute[71113]:   <os>
Jul 31 09:49:22 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 09:49:22 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 09:49:22 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 09:49:22 user nova-compute[71113]:   </os>
Jul 31 09:49:22 user nova-compute[71113]:   <features>
Jul 31 09:49:22 user nova-compute[71113]:     <acpi/>
Jul 31 09:49:22 user nova-compute[71113]:     <apic/>
Jul 31 09:49:22 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 09:49:22 user nova-compute[71113]:   </features>
Jul 31 09:49:22 user nova-compute[71113]:   <clock offset="utc">
Jul 31 09:49:22 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 09:49:22 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 09:49:22 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 09:49:22 user nova-compute[71113]:   </clock>
Jul 31 09:49:22 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 09:49:22 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 09:49:22 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 09:49:22 user nova-compute[71113]:   </cpu>
Jul 31 09:49:22 user nova-compute[71113]:   <devices>
Jul 31 09:49:22 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 09:49:22 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 09:49:22 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/8d2948be-3ebb-4067-a0c8-e2ca884814ff/disk"/>
Jul 31 09:49:22 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 09:49:22 user nova-compute[71113]:     </disk>
Jul 31 09:49:22 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 09:49:22 user nova-compute[71113]:       <mac address="fa:16:3e:91:a4:b3"/>
Jul 31 09:49:22 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:49:22 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 09:49:22 user nova-compute[71113]:       <target dev="tapf3560f1f-45"/>
Jul 31 09:49:22 user nova-compute[71113]:     </interface>
Jul 31 09:49:22 user nova-compute[71113]:     <serial type="pty">
Jul 31 09:49:22 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/8d2948be-3ebb-4067-a0c8-e2ca884814ff/console.log" append="off"/>
Jul 31 09:49:22 user nova-compute[71113]:     </serial>
Jul 31 09:49:22 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 09:49:22 user nova-compute[71113]:     <video>
Jul 31 09:49:22 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:49:22 user nova-compute[71113]:     </video>
Jul 31 09:49:22 user nova-compute[71113]:     <rng model="virtio">
Jul 31 09:49:22 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 09:49:22 user nova-compute[71113]:     </rng>
Jul 31 09:49:22 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 09:49:22 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 09:49:22 user nova-compute[71113]:       <stats period="10"/>
Jul 31 09:49:22 user nova-compute[71113]:     </memballoon>
Jul 31 09:49:22 user nova-compute[71113]:   </devices>
Jul 31 09:49:22 user nova-compute[71113]: </domain>
Jul 31 09:49:22 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 09:49:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:49:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-185195530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-185195530',id=12,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPiftDuIkWFAIfzl0BTVm1LhY7q40iWz84gStK4DPV8cFJDmAmFDRgF+Fymadhnr5qIGHF7r0Tfo5uKpEAywooFh/gX7i9sx0LkpEaQXIt1KTEtZ1669nicWOlZ3zvT41w==',key_name='tempest-keypair-404775333',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4461b48e5470471d8fe1b61fb8af9c8d',ramdisk_id='',reservation_id='r-v0gpv3qp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-960167684',owner_user_name='tempest-AttachVolumeShelveTestJSON-960167684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:49:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5199c7da0634b6e8111782122adcf70',uuid=8d2948be-3ebb-4067-a0c8-e2ca884814ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3560f1f-45f9-4ab3-b7a9-338b0483a656", "address": "fa:16:3e:91:a4:b3", "network": {"id": "e498d93a-703d-4d19-9adf-61469f37d4da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1320431580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4461b48e5470471d8fe1b61fb8af9c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3560f1f-45", "ovs_interfaceid": "f3560f1f-45f9-4ab3-b7a9-338b0483a656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 09:49:22 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Converting VIF {"id": "f3560f1f-45f9-4ab3-b7a9-338b0483a656", "address": "fa:16:3e:91:a4:b3", "network": {"id": "e498d93a-703d-4d19-9adf-61469f37d4da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1320431580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4461b48e5470471d8fe1b61fb8af9c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3560f1f-45", "ovs_interfaceid": "f3560f1f-45f9-4ab3-b7a9-338b0483a656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:49:22 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:a4:b3,bridge_name='br-int',has_traffic_filtering=True,id=f3560f1f-45f9-4ab3-b7a9-338b0483a656,network=Network(e498d93a-703d-4d19-9adf-61469f37d4da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3560f1f-45') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:49:22 user nova-compute[71113]: DEBUG os_vif [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:a4:b3,bridge_name='br-int',has_traffic_filtering=True,id=f3560f1f-45f9-4ab3-b7a9-338b0483a656,network=Network(e498d93a-703d-4d19-9adf-61469f37d4da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3560f1f-45') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 09:49:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:49:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 09:49:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf3560f1f-45, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:49:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf3560f1f-45, col_values=(('external_ids', {'iface-id': 'f3560f1f-45f9-4ab3-b7a9-338b0483a656', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:a4:b3', 'vm-uuid': '8d2948be-3ebb-4067-a0c8-e2ca884814ff'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:49:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:49:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:22 user nova-compute[71113]: INFO os_vif [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:a4:b3,bridge_name='br-int',has_traffic_filtering=True,id=f3560f1f-45f9-4ab3-b7a9-338b0483a656,network=Network(e498d93a-703d-4d19-9adf-61469f37d4da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3560f1f-45')
Jul 31 09:49:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:49:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] No VIF found with MAC fa:16:3e:91:a4:b3, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 09:49:22 user nova-compute[71113]: DEBUG nova.network.neutron [req-9dfa28e1-e7fe-4d6d-a464-72160eaafa69 req-f9329082-eced-47ca-80a3-fd22a987edb8 service nova] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Updated VIF entry in instance network info cache for port f3560f1f-45f9-4ab3-b7a9-338b0483a656. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:49:22 user nova-compute[71113]: DEBUG nova.network.neutron [req-9dfa28e1-e7fe-4d6d-a464-72160eaafa69 req-f9329082-eced-47ca-80a3-fd22a987edb8 service nova] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Updating instance_info_cache with network_info: [{"id": "f3560f1f-45f9-4ab3-b7a9-338b0483a656", "address": "fa:16:3e:91:a4:b3", "network": {"id": "e498d93a-703d-4d19-9adf-61469f37d4da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1320431580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4461b48e5470471d8fe1b61fb8af9c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3560f1f-45", "ovs_interfaceid": "f3560f1f-45f9-4ab3-b7a9-338b0483a656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:49:22 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9dfa28e1-e7fe-4d6d-a464-72160eaafa69 req-f9329082-eced-47ca-80a3-fd22a987edb8 service nova] Releasing lock "refresh_cache-8d2948be-3ebb-4067-a0c8-e2ca884814ff" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:49:23 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:23 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:23 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:23 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:23 user nova-compute[71113]: INFO nova.compute.manager [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Took 2.20 seconds to detach 3 volumes for instance.
Jul 31 09:49:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:49:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:49:23 user nova-compute[71113]: DEBUG nova.compute.manager [req-26e3fb54-ae6b-49ec-987b-7c855272272e req-c92a693d-c5f0-4b6a-87bc-ea21d2d523d0 service nova] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Received event network-vif-plugged-f3560f1f-45f9-4ab3-b7a9-338b0483a656 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:49:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-26e3fb54-ae6b-49ec-987b-7c855272272e req-c92a693d-c5f0-4b6a-87bc-ea21d2d523d0 service nova] Acquiring lock "8d2948be-3ebb-4067-a0c8-e2ca884814ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:49:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-26e3fb54-ae6b-49ec-987b-7c855272272e req-c92a693d-c5f0-4b6a-87bc-ea21d2d523d0 service nova] Lock "8d2948be-3ebb-4067-a0c8-e2ca884814ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:49:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-26e3fb54-ae6b-49ec-987b-7c855272272e req-c92a693d-c5f0-4b6a-87bc-ea21d2d523d0 service nova] Lock "8d2948be-3ebb-4067-a0c8-e2ca884814ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.008s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:49:23 user nova-compute[71113]: DEBUG nova.compute.manager [req-26e3fb54-ae6b-49ec-987b-7c855272272e req-c92a693d-c5f0-4b6a-87bc-ea21d2d523d0 service nova] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] No waiting events found dispatching network-vif-plugged-f3560f1f-45f9-4ab3-b7a9-338b0483a656 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:49:23 user nova-compute[71113]: WARNING nova.compute.manager [req-26e3fb54-ae6b-49ec-987b-7c855272272e req-c92a693d-c5f0-4b6a-87bc-ea21d2d523d0 service nova] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Received unexpected event network-vif-plugged-f3560f1f-45f9-4ab3-b7a9-338b0483a656 for instance with vm_state building and task_state spawning.
Jul 31 09:49:24 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:49:24 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:49:24 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.322s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:49:24 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Deleted allocations for instance 3aaaef96-76f8-4088-a0bc-a1a72e80652e
Jul 31 09:49:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:24 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c3ae9b10-9041-438b-b552-9e20479c22b6 tempest-TaggedBootDevicesTest_v242-730691933 tempest-TaggedBootDevicesTest_v242-730691933-project-member] Lock "3aaaef96-76f8-4088-a0bc-a1a72e80652e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.394s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:49:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Acquiring lock "f88bc35b-4996-400e-88ba-5d0f2c3f6c4a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:49:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Lock "f88bc35b-4996-400e-88ba-5d0f2c3f6c4a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:49:25 user nova-compute[71113]: DEBUG nova.compute.manager [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Starting instance... {{(pid=71113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 09:49:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:49:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:49:25 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 09:49:25 user nova-compute[71113]: INFO nova.compute.claims [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Claim successful on node user
Jul 31 09:49:25 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:49:25 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:49:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.373s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:49:25 user nova-compute[71113]: DEBUG nova.compute.manager [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Start building networks asynchronously for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 09:49:25 user nova-compute[71113]: DEBUG nova.compute.manager [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Allocating IP information in the background. {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 09:49:25 user nova-compute[71113]: DEBUG nova.network.neutron [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] allocate_for_instance() {{(pid=71113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 09:49:25 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 09:49:25 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690796965.7690077, 8d2948be-3ebb-4067-a0c8-e2ca884814ff => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:49:25 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] VM Resumed (Lifecycle Event)
Jul 31 09:49:25 user nova-compute[71113]: DEBUG nova.compute.manager [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 09:49:25 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 09:49:25 user nova-compute[71113]: DEBUG nova.compute.manager [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Start building block device mappings for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 09:49:25 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Instance spawned successfully.
Jul 31 09:49:25 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 09:49:25 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:49:25 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:49:25 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Found default for hw_cdrom_bus of ide {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:49:25 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Found default for hw_disk_bus of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:49:25 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Found default for hw_input_bus of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:49:25 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Found default for hw_pointer_model of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:49:25 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Found default for hw_video_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:49:25 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Found default for hw_vif_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:49:25 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:49:25 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690796965.7716935, 8d2948be-3ebb-4067-a0c8-e2ca884814ff => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:49:25 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] VM Started (Lifecycle Event)
Jul 31 09:49:25 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:49:25 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:49:25 user nova-compute[71113]: DEBUG nova.policy [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '68ed00ac1dba433fb6ff7281a066d55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025b7e2f3e894690b9cade6b6df70a22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71113) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 09:49:25 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:49:25 user nova-compute[71113]: DEBUG nova.compute.manager [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Start spawning the instance on the hypervisor. {{(pid=71113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 09:49:25 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 09:49:25 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Creating image(s)
Jul 31 09:49:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Acquiring lock "/opt/stack/data/nova/instances/f88bc35b-4996-400e-88ba-5d0f2c3f6c4a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:49:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Lock "/opt/stack/data/nova/instances/f88bc35b-4996-400e-88ba-5d0f2c3f6c4a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:49:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Lock "/opt/stack/data/nova/instances/f88bc35b-4996-400e-88ba-5d0f2c3f6c4a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:49:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:25 user nova-compute[71113]: INFO nova.compute.manager [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Took 5.98 seconds to spawn the instance on the hypervisor.
Jul 31 09:49:25 user nova-compute[71113]: DEBUG nova.compute.manager [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:49:25 user nova-compute[71113]: DEBUG nova.compute.manager [req-0619beab-ebf8-4af9-86cd-21ab2c8dee24 req-a7e62c5f-a422-4272-acc6-1de39e6e6f7d service nova] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Received event network-vif-plugged-f3560f1f-45f9-4ab3-b7a9-338b0483a656 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:49:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-0619beab-ebf8-4af9-86cd-21ab2c8dee24 req-a7e62c5f-a422-4272-acc6-1de39e6e6f7d service nova] Acquiring lock "8d2948be-3ebb-4067-a0c8-e2ca884814ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:49:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-0619beab-ebf8-4af9-86cd-21ab2c8dee24 req-a7e62c5f-a422-4272-acc6-1de39e6e6f7d service nova] Lock "8d2948be-3ebb-4067-a0c8-e2ca884814ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:49:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-0619beab-ebf8-4af9-86cd-21ab2c8dee24 req-a7e62c5f-a422-4272-acc6-1de39e6e6f7d service nova] Lock "8d2948be-3ebb-4067-a0c8-e2ca884814ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:49:25 user nova-compute[71113]: DEBUG nova.compute.manager [req-0619beab-ebf8-4af9-86cd-21ab2c8dee24 req-a7e62c5f-a422-4272-acc6-1de39e6e6f7d service nova] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] No waiting events found dispatching network-vif-plugged-f3560f1f-45f9-4ab3-b7a9-338b0483a656 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:49:25 user nova-compute[71113]: WARNING nova.compute.manager [req-0619beab-ebf8-4af9-86cd-21ab2c8dee24 req-a7e62c5f-a422-4272-acc6-1de39e6e6f7d service nova] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Received unexpected event network-vif-plugged-f3560f1f-45f9-4ab3-b7a9-338b0483a656 for instance with vm_state building and task_state spawning.
Jul 31 09:49:26 user nova-compute[71113]: INFO nova.compute.manager [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Took 6.71 seconds to build instance.
Jul 31 09:49:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.135s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:26 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Acquiring lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:49:26 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:49:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:26 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8fcd72c9-474d-4b5a-9bf8-b225d9c1a2ea tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "8d2948be-3ebb-4067-a0c8-e2ca884814ff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.846s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:49:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.135s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/f88bc35b-4996-400e-88ba-5d0f2c3f6c4a/disk 1073741824 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/f88bc35b-4996-400e-88ba-5d0f2c3f6c4a/disk 1073741824" returned: 0 in 0.054s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:26 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:49:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:26 user nova-compute[71113]: DEBUG nova.network.neutron [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Successfully created port: eac2770c-4df8-41f5-9643-bb0980f0777e {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 09:49:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.157s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:26 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f88bc35b-4996-400e-88ba-5d0f2c3f6c4a/disk. size=1073741824 {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 09:49:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f88bc35b-4996-400e-88ba-5d0f2c3f6c4a/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f88bc35b-4996-400e-88ba-5d0f2c3f6c4a/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:26 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Cannot resize image /opt/stack/data/nova/instances/f88bc35b-4996-400e-88ba-5d0f2c3f6c4a/disk to a smaller size. {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 09:49:26 user nova-compute[71113]: DEBUG nova.objects.instance [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Lazy-loading 'migration_context' on Instance uuid f88bc35b-4996-400e-88ba-5d0f2c3f6c4a {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:49:26 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Created local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 09:49:26 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Ensure instance console log exists: /opt/stack/data/nova/instances/f88bc35b-4996-400e-88ba-5d0f2c3f6c4a/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 09:49:26 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:49:26 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:49:26 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:49:27 user nova-compute[71113]: DEBUG nova.network.neutron [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Successfully updated port: eac2770c-4df8-41f5-9643-bb0980f0777e {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 09:49:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Acquiring lock "refresh_cache-f88bc35b-4996-400e-88ba-5d0f2c3f6c4a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:49:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Acquired lock "refresh_cache-f88bc35b-4996-400e-88ba-5d0f2c3f6c4a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:49:27 user nova-compute[71113]: DEBUG nova.network.neutron [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 09:49:27 user nova-compute[71113]: DEBUG nova.network.neutron [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 09:49:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:27 user nova-compute[71113]: DEBUG nova.network.neutron [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Updating instance_info_cache with network_info: [{"id": "eac2770c-4df8-41f5-9643-bb0980f0777e", "address": "fa:16:3e:7e:c0:f1", "network": {"id": "5f0b75d1-03eb-4e68-85fd-8b27d4fda660", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-726146587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "025b7e2f3e894690b9cade6b6df70a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac2770c-4d", "ovs_interfaceid": "eac2770c-4df8-41f5-9643-bb0980f0777e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:49:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Releasing lock "refresh_cache-f88bc35b-4996-400e-88ba-5d0f2c3f6c4a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:49:27 user nova-compute[71113]: DEBUG nova.compute.manager [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Instance network_info: |[{"id": "eac2770c-4df8-41f5-9643-bb0980f0777e", "address": "fa:16:3e:7e:c0:f1", "network": {"id": "5f0b75d1-03eb-4e68-85fd-8b27d4fda660", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-726146587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "025b7e2f3e894690b9cade6b6df70a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac2770c-4d", "ovs_interfaceid": "eac2770c-4df8-41f5-9643-bb0980f0777e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 09:49:27 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Start _get_guest_xml network_info=[{"id": "eac2770c-4df8-41f5-9643-bb0980f0777e", "address": "fa:16:3e:7e:c0:f1", "network": {"id": "5f0b75d1-03eb-4e68-85fd-8b27d4fda660", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-726146587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "025b7e2f3e894690b9cade6b6df70a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac2770c-4d", "ovs_interfaceid": "eac2770c-4df8-41f5-9643-bb0980f0777e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'image_id': '078646fe-b504-41ed-a147-61072e903e51'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 09:49:27 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:49:27 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:49:27 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 09:49:27 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 09:49:27 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 09:49:27 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 09:49:27 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 09:49:27 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 09:49:27 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 09:49:27 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 09:49:27 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 09:49:27 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 09:49:27 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 09:49:27 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 09:49:27 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 09:49:27 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 09:49:27 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 09:49:27 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 09:49:27 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:49:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2058367283',display_name='tempest-VolumesAdminNegativeTest-server-2058367283',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2058367283',id=13,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='025b7e2f3e894690b9cade6b6df70a22',ramdisk_id='',reservation_id='r-xpkoq6hk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-553928296',owner_user_name='tempest-VolumesAdminNegativeTest-553928296-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:49:26Z,user_data=None,user_id='68ed00ac1dba433fb6ff7281a066d55f',uuid=f88bc35b-4996-400e-88ba-5d0f2c3f6c4a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eac2770c-4df8-41f5-9643-bb0980f0777e", "address": "fa:16:3e:7e:c0:f1", "network": {"id": "5f0b75d1-03eb-4e68-85fd-8b27d4fda660", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-726146587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "025b7e2f3e894690b9cade6b6df70a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac2770c-4d", "ovs_interfaceid": "eac2770c-4df8-41f5-9643-bb0980f0777e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 09:49:27 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Converting VIF {"id": "eac2770c-4df8-41f5-9643-bb0980f0777e", "address": "fa:16:3e:7e:c0:f1", "network": {"id": "5f0b75d1-03eb-4e68-85fd-8b27d4fda660", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-726146587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "025b7e2f3e894690b9cade6b6df70a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac2770c-4d", "ovs_interfaceid": "eac2770c-4df8-41f5-9643-bb0980f0777e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:49:27 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:c0:f1,bridge_name='br-int',has_traffic_filtering=True,id=eac2770c-4df8-41f5-9643-bb0980f0777e,network=Network(5f0b75d1-03eb-4e68-85fd-8b27d4fda660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac2770c-4d') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:49:27 user nova-compute[71113]: DEBUG nova.objects.instance [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Lazy-loading 'pci_devices' on Instance uuid f88bc35b-4996-400e-88ba-5d0f2c3f6c4a {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:49:27 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] End _get_guest_xml xml=<domain type="kvm">
Jul 31 09:49:27 user nova-compute[71113]:   <uuid>f88bc35b-4996-400e-88ba-5d0f2c3f6c4a</uuid>
Jul 31 09:49:27 user nova-compute[71113]:   <name>instance-0000000d</name>
Jul 31 09:49:27 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 09:49:27 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 09:49:27 user nova-compute[71113]:   <metadata>
Jul 31 09:49:27 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 09:49:27 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 09:49:27 user nova-compute[71113]:       <nova:name>tempest-VolumesAdminNegativeTest-server-2058367283</nova:name>
Jul 31 09:49:27 user nova-compute[71113]:       <nova:creationTime>2023-07-31 09:49:27</nova:creationTime>
Jul 31 09:49:27 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 09:49:27 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 09:49:27 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 09:49:27 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 09:49:27 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 09:49:27 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 09:49:27 user nova-compute[71113]:       </nova:flavor>
Jul 31 09:49:27 user nova-compute[71113]:       <nova:owner>
Jul 31 09:49:27 user nova-compute[71113]:         <nova:user uuid="68ed00ac1dba433fb6ff7281a066d55f">tempest-VolumesAdminNegativeTest-553928296-project-member</nova:user>
Jul 31 09:49:27 user nova-compute[71113]:         <nova:project uuid="025b7e2f3e894690b9cade6b6df70a22">tempest-VolumesAdminNegativeTest-553928296</nova:project>
Jul 31 09:49:27 user nova-compute[71113]:       </nova:owner>
Jul 31 09:49:27 user nova-compute[71113]:       <nova:root type="image" uuid="078646fe-b504-41ed-a147-61072e903e51"/>
Jul 31 09:49:27 user nova-compute[71113]:       <nova:ports>
Jul 31 09:49:27 user nova-compute[71113]:         <nova:port uuid="eac2770c-4df8-41f5-9643-bb0980f0777e">
Jul 31 09:49:27 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 31 09:49:27 user nova-compute[71113]:         </nova:port>
Jul 31 09:49:27 user nova-compute[71113]:       </nova:ports>
Jul 31 09:49:27 user nova-compute[71113]:     </nova:instance>
Jul 31 09:49:27 user nova-compute[71113]:   </metadata>
Jul 31 09:49:27 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 09:49:27 user nova-compute[71113]:     <system>
Jul 31 09:49:27 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 09:49:27 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 09:49:27 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 09:49:27 user nova-compute[71113]:       <entry name="serial">f88bc35b-4996-400e-88ba-5d0f2c3f6c4a</entry>
Jul 31 09:49:27 user nova-compute[71113]:       <entry name="uuid">f88bc35b-4996-400e-88ba-5d0f2c3f6c4a</entry>
Jul 31 09:49:27 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 09:49:27 user nova-compute[71113]:     </system>
Jul 31 09:49:27 user nova-compute[71113]:   </sysinfo>
Jul 31 09:49:27 user nova-compute[71113]:   <os>
Jul 31 09:49:27 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 09:49:27 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 09:49:27 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 09:49:27 user nova-compute[71113]:   </os>
Jul 31 09:49:27 user nova-compute[71113]:   <features>
Jul 31 09:49:27 user nova-compute[71113]:     <acpi/>
Jul 31 09:49:27 user nova-compute[71113]:     <apic/>
Jul 31 09:49:27 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 09:49:27 user nova-compute[71113]:   </features>
Jul 31 09:49:27 user nova-compute[71113]:   <clock offset="utc">
Jul 31 09:49:27 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 09:49:27 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 09:49:27 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 09:49:27 user nova-compute[71113]:   </clock>
Jul 31 09:49:27 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 09:49:27 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 09:49:27 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 09:49:27 user nova-compute[71113]:   </cpu>
Jul 31 09:49:27 user nova-compute[71113]:   <devices>
Jul 31 09:49:27 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 09:49:27 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 09:49:27 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/f88bc35b-4996-400e-88ba-5d0f2c3f6c4a/disk"/>
Jul 31 09:49:27 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 09:49:27 user nova-compute[71113]:     </disk>
Jul 31 09:49:27 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 09:49:27 user nova-compute[71113]:       <mac address="fa:16:3e:7e:c0:f1"/>
Jul 31 09:49:27 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:49:27 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 09:49:27 user nova-compute[71113]:       <target dev="tapeac2770c-4d"/>
Jul 31 09:49:27 user nova-compute[71113]:     </interface>
Jul 31 09:49:27 user nova-compute[71113]:     <serial type="pty">
Jul 31 09:49:27 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/f88bc35b-4996-400e-88ba-5d0f2c3f6c4a/console.log" append="off"/>
Jul 31 09:49:27 user nova-compute[71113]:     </serial>
Jul 31 09:49:27 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 09:49:27 user nova-compute[71113]:     <video>
Jul 31 09:49:27 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:49:27 user nova-compute[71113]:     </video>
Jul 31 09:49:27 user nova-compute[71113]:     <rng model="virtio">
Jul 31 09:49:27 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 09:49:27 user nova-compute[71113]:     </rng>
Jul 31 09:49:27 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 09:49:27 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 09:49:27 user nova-compute[71113]:       <stats period="10"/>
Jul 31 09:49:27 user nova-compute[71113]:     </memballoon>
Jul 31 09:49:27 user nova-compute[71113]:   </devices>
Jul 31 09:49:27 user nova-compute[71113]: </domain>
Jul 31 09:49:27 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 09:49:27 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:49:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2058367283',display_name='tempest-VolumesAdminNegativeTest-server-2058367283',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2058367283',id=13,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='025b7e2f3e894690b9cade6b6df70a22',ramdisk_id='',reservation_id='r-xpkoq6hk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-553928296',owner_user_name='tempest-VolumesAdminNegativeTest-553928296-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:49:26Z,user_data=None,user_id='68ed00ac1dba433fb6ff7281a066d55f',uuid=f88bc35b-4996-400e-88ba-5d0f2c3f6c4a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eac2770c-4df8-41f5-9643-bb0980f0777e", "address": "fa:16:3e:7e:c0:f1", "network": {"id": "5f0b75d1-03eb-4e68-85fd-8b27d4fda660", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-726146587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "025b7e2f3e894690b9cade6b6df70a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac2770c-4d", "ovs_interfaceid": "eac2770c-4df8-41f5-9643-bb0980f0777e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 09:49:27 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Converting VIF {"id": "eac2770c-4df8-41f5-9643-bb0980f0777e", "address": "fa:16:3e:7e:c0:f1", "network": {"id": "5f0b75d1-03eb-4e68-85fd-8b27d4fda660", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-726146587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "025b7e2f3e894690b9cade6b6df70a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac2770c-4d", "ovs_interfaceid": "eac2770c-4df8-41f5-9643-bb0980f0777e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:49:27 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:c0:f1,bridge_name='br-int',has_traffic_filtering=True,id=eac2770c-4df8-41f5-9643-bb0980f0777e,network=Network(5f0b75d1-03eb-4e68-85fd-8b27d4fda660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac2770c-4d') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:49:27 user nova-compute[71113]: DEBUG os_vif [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:c0:f1,bridge_name='br-int',has_traffic_filtering=True,id=eac2770c-4df8-41f5-9643-bb0980f0777e,network=Network(5f0b75d1-03eb-4e68-85fd-8b27d4fda660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac2770c-4d') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 09:49:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:49:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 09:49:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeac2770c-4d, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:49:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeac2770c-4d, col_values=(('external_ids', {'iface-id': 'eac2770c-4df8-41f5-9643-bb0980f0777e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:c0:f1', 'vm-uuid': 'f88bc35b-4996-400e-88ba-5d0f2c3f6c4a'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:49:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:49:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:27 user nova-compute[71113]: INFO os_vif [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:c0:f1,bridge_name='br-int',has_traffic_filtering=True,id=eac2770c-4df8-41f5-9643-bb0980f0777e,network=Network(5f0b75d1-03eb-4e68-85fd-8b27d4fda660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac2770c-4d')
Jul 31 09:49:27 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:49:27 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] No VIF found with MAC fa:16:3e:7e:c0:f1, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 09:49:27 user nova-compute[71113]: DEBUG nova.compute.manager [req-8efcffa2-eaa5-4c22-9aa6-860b8cc85b26 req-36f7b99f-fb40-42af-bda2-2a7b8dfe8cc3 service nova] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Received event network-changed-eac2770c-4df8-41f5-9643-bb0980f0777e {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:49:27 user nova-compute[71113]: DEBUG nova.compute.manager [req-8efcffa2-eaa5-4c22-9aa6-860b8cc85b26 req-36f7b99f-fb40-42af-bda2-2a7b8dfe8cc3 service nova] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Refreshing instance network info cache due to event network-changed-eac2770c-4df8-41f5-9643-bb0980f0777e. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:49:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8efcffa2-eaa5-4c22-9aa6-860b8cc85b26 req-36f7b99f-fb40-42af-bda2-2a7b8dfe8cc3 service nova] Acquiring lock "refresh_cache-f88bc35b-4996-400e-88ba-5d0f2c3f6c4a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:49:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8efcffa2-eaa5-4c22-9aa6-860b8cc85b26 req-36f7b99f-fb40-42af-bda2-2a7b8dfe8cc3 service nova] Acquired lock "refresh_cache-f88bc35b-4996-400e-88ba-5d0f2c3f6c4a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:49:27 user nova-compute[71113]: DEBUG nova.network.neutron [req-8efcffa2-eaa5-4c22-9aa6-860b8cc85b26 req-36f7b99f-fb40-42af-bda2-2a7b8dfe8cc3 service nova] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Refreshing network info cache for port eac2770c-4df8-41f5-9643-bb0980f0777e {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:49:28 user nova-compute[71113]: DEBUG nova.network.neutron [req-8efcffa2-eaa5-4c22-9aa6-860b8cc85b26 req-36f7b99f-fb40-42af-bda2-2a7b8dfe8cc3 service nova] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Updated VIF entry in instance network info cache for port eac2770c-4df8-41f5-9643-bb0980f0777e. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:49:28 user nova-compute[71113]: DEBUG nova.network.neutron [req-8efcffa2-eaa5-4c22-9aa6-860b8cc85b26 req-36f7b99f-fb40-42af-bda2-2a7b8dfe8cc3 service nova] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Updating instance_info_cache with network_info: [{"id": "eac2770c-4df8-41f5-9643-bb0980f0777e", "address": "fa:16:3e:7e:c0:f1", "network": {"id": "5f0b75d1-03eb-4e68-85fd-8b27d4fda660", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-726146587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "025b7e2f3e894690b9cade6b6df70a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac2770c-4d", "ovs_interfaceid": "eac2770c-4df8-41f5-9643-bb0980f0777e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:49:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8efcffa2-eaa5-4c22-9aa6-860b8cc85b26 req-36f7b99f-fb40-42af-bda2-2a7b8dfe8cc3 service nova] Releasing lock "refresh_cache-f88bc35b-4996-400e-88ba-5d0f2c3f6c4a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:49:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:30 user nova-compute[71113]: DEBUG nova.compute.manager [req-74ce996e-dd28-4b17-88f0-56f2cec057e3 req-5d395225-5a5f-4e14-a9f8-cf78a078389e service nova] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Received event network-vif-plugged-eac2770c-4df8-41f5-9643-bb0980f0777e {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:49:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-74ce996e-dd28-4b17-88f0-56f2cec057e3 req-5d395225-5a5f-4e14-a9f8-cf78a078389e service nova] Acquiring lock "f88bc35b-4996-400e-88ba-5d0f2c3f6c4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:49:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-74ce996e-dd28-4b17-88f0-56f2cec057e3 req-5d395225-5a5f-4e14-a9f8-cf78a078389e service nova] Lock "f88bc35b-4996-400e-88ba-5d0f2c3f6c4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:49:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-74ce996e-dd28-4b17-88f0-56f2cec057e3 req-5d395225-5a5f-4e14-a9f8-cf78a078389e service nova] Lock "f88bc35b-4996-400e-88ba-5d0f2c3f6c4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:49:30 user nova-compute[71113]: DEBUG nova.compute.manager [req-74ce996e-dd28-4b17-88f0-56f2cec057e3 req-5d395225-5a5f-4e14-a9f8-cf78a078389e service nova] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] No waiting events found dispatching network-vif-plugged-eac2770c-4df8-41f5-9643-bb0980f0777e {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:49:30 user nova-compute[71113]: WARNING nova.compute.manager [req-74ce996e-dd28-4b17-88f0-56f2cec057e3 req-5d395225-5a5f-4e14-a9f8-cf78a078389e service nova] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Received unexpected event network-vif-plugged-eac2770c-4df8-41f5-9643-bb0980f0777e for instance with vm_state building and task_state spawning.
Jul 31 09:49:30 user nova-compute[71113]: DEBUG nova.compute.manager [req-74ce996e-dd28-4b17-88f0-56f2cec057e3 req-5d395225-5a5f-4e14-a9f8-cf78a078389e service nova] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Received event network-vif-plugged-eac2770c-4df8-41f5-9643-bb0980f0777e {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:49:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-74ce996e-dd28-4b17-88f0-56f2cec057e3 req-5d395225-5a5f-4e14-a9f8-cf78a078389e service nova] Acquiring lock "f88bc35b-4996-400e-88ba-5d0f2c3f6c4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:49:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-74ce996e-dd28-4b17-88f0-56f2cec057e3 req-5d395225-5a5f-4e14-a9f8-cf78a078389e service nova] Lock "f88bc35b-4996-400e-88ba-5d0f2c3f6c4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:49:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-74ce996e-dd28-4b17-88f0-56f2cec057e3 req-5d395225-5a5f-4e14-a9f8-cf78a078389e service nova] Lock "f88bc35b-4996-400e-88ba-5d0f2c3f6c4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:49:30 user nova-compute[71113]: DEBUG nova.compute.manager [req-74ce996e-dd28-4b17-88f0-56f2cec057e3 req-5d395225-5a5f-4e14-a9f8-cf78a078389e service nova] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] No waiting events found dispatching network-vif-plugged-eac2770c-4df8-41f5-9643-bb0980f0777e {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:49:30 user nova-compute[71113]: WARNING nova.compute.manager [req-74ce996e-dd28-4b17-88f0-56f2cec057e3 req-5d395225-5a5f-4e14-a9f8-cf78a078389e service nova] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Received unexpected event network-vif-plugged-eac2770c-4df8-41f5-9643-bb0980f0777e for instance with vm_state building and task_state spawning.
Jul 31 09:49:31 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690796956.0186775, 3aaaef96-76f8-4088-a0bc-a1a72e80652e => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:49:31 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] VM Stopped (Lifecycle Event)
Jul 31 09:49:31 user nova-compute[71113]: DEBUG nova.compute.manager [None req-2c7f21b4-e8b4-4e3c-91c1-b193b21bb8fb None None] [instance: 3aaaef96-76f8-4088-a0bc-a1a72e80652e] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:49:31 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690796971.2060804, f88bc35b-4996-400e-88ba-5d0f2c3f6c4a => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:49:31 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] VM Resumed (Lifecycle Event)
Jul 31 09:49:31 user nova-compute[71113]: DEBUG nova.compute.manager [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 09:49:31 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 09:49:31 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Instance spawned successfully.
Jul 31 09:49:31 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 09:49:31 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:49:31 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:49:31 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Found default for hw_cdrom_bus of ide {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:49:31 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Found default for hw_disk_bus of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:49:31 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Found default for hw_input_bus of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:49:31 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Found default for hw_pointer_model of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:49:31 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Found default for hw_video_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:49:31 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Found default for hw_vif_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:49:31 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:49:31 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690796971.2073646, f88bc35b-4996-400e-88ba-5d0f2c3f6c4a => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:49:31 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] VM Started (Lifecycle Event)
Jul 31 09:49:31 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:49:31 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:49:31 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:49:31 user nova-compute[71113]: INFO nova.compute.manager [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Took 5.47 seconds to spawn the instance on the hypervisor.
Jul 31 09:49:31 user nova-compute[71113]: DEBUG nova.compute.manager [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:49:31 user nova-compute[71113]: INFO nova.compute.manager [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Took 6.14 seconds to build instance.
Jul 31 09:49:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-30b1bf66-8705-40cc-a024-903e0bd2a1b0 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Lock "f88bc35b-4996-400e-88ba-5d0f2c3f6c4a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.232s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:49:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Acquiring lock "ae982ade-8b51-4948-879a-f308be7eb685" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:49:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Lock "ae982ade-8b51-4948-879a-f308be7eb685" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:49:40 user nova-compute[71113]: DEBUG nova.compute.manager [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Starting instance... {{(pid=71113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 09:49:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:49:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:49:40 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 09:49:40 user nova-compute[71113]: INFO nova.compute.claims [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Claim successful on node user
Jul 31 09:49:41 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:49:41 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:49:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.422s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:49:41 user nova-compute[71113]: DEBUG nova.compute.manager [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Start building networks asynchronously for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 09:49:41 user nova-compute[71113]: DEBUG nova.compute.manager [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Allocating IP information in the background. {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 09:49:41 user nova-compute[71113]: DEBUG nova.network.neutron [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: ae982ade-8b51-4948-879a-f308be7eb685] allocate_for_instance() {{(pid=71113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 09:49:41 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 09:49:41 user nova-compute[71113]: DEBUG nova.compute.manager [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Start building block device mappings for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 09:49:41 user nova-compute[71113]: DEBUG nova.policy [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '201cdf33fbd74e77877dd1342b33aedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fc8b3757a845ad89068797348d02bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71113) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 09:49:41 user nova-compute[71113]: DEBUG nova.compute.manager [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Start spawning the instance on the hypervisor. {{(pid=71113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 09:49:41 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 09:49:41 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Creating image(s)
Jul 31 09:49:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Acquiring lock "/opt/stack/data/nova/instances/ae982ade-8b51-4948-879a-f308be7eb685/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:49:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Lock "/opt/stack/data/nova/instances/ae982ade-8b51-4948-879a-f308be7eb685/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:49:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Lock "/opt/stack/data/nova/instances/ae982ade-8b51-4948-879a-f308be7eb685/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:49:41 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:41 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.150s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Acquiring lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:49:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:49:41 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:41 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.152s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:41 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/ae982ade-8b51-4948-879a-f308be7eb685/disk 1073741824 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:41 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/ae982ade-8b51-4948-879a-f308be7eb685/disk 1073741824" returned: 0 in 0.053s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:49:41 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.135s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:42 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ae982ade-8b51-4948-879a-f308be7eb685/disk. size=1073741824 {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 09:49:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae982ade-8b51-4948-879a-f308be7eb685/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:49:42 user nova-compute[71113]: DEBUG nova.network.neutron [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Successfully created port: 73aab5d1-7549-4c59-852d-4e2935c772ef {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 09:49:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae982ade-8b51-4948-879a-f308be7eb685/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:49:42 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Cannot resize image /opt/stack/data/nova/instances/ae982ade-8b51-4948-879a-f308be7eb685/disk to a smaller size. {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 09:49:42 user nova-compute[71113]: DEBUG nova.objects.instance [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Lazy-loading 'migration_context' on Instance uuid ae982ade-8b51-4948-879a-f308be7eb685 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:49:42 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Created local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 09:49:42 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Ensure instance console log exists: /opt/stack/data/nova/instances/ae982ade-8b51-4948-879a-f308be7eb685/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 09:49:42 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:49:42 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:49:42 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:49:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:43 user nova-compute[71113]: DEBUG nova.network.neutron [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Successfully updated port: 73aab5d1-7549-4c59-852d-4e2935c772ef {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 09:49:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Acquiring lock "refresh_cache-ae982ade-8b51-4948-879a-f308be7eb685" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:49:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Acquired lock "refresh_cache-ae982ade-8b51-4948-879a-f308be7eb685" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:49:43 user nova-compute[71113]: DEBUG nova.network.neutron [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 09:49:43 user nova-compute[71113]: DEBUG nova.compute.manager [req-a68549d6-ca16-4741-a672-3ef0b79a2a1b req-37d38fd5-9dec-4368-8d86-df5ce9856c01 service nova] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Received event network-changed-73aab5d1-7549-4c59-852d-4e2935c772ef {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:49:43 user nova-compute[71113]: DEBUG nova.compute.manager [req-a68549d6-ca16-4741-a672-3ef0b79a2a1b req-37d38fd5-9dec-4368-8d86-df5ce9856c01 service nova] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Refreshing instance network info cache due to event network-changed-73aab5d1-7549-4c59-852d-4e2935c772ef. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:49:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-a68549d6-ca16-4741-a672-3ef0b79a2a1b req-37d38fd5-9dec-4368-8d86-df5ce9856c01 service nova] Acquiring lock "refresh_cache-ae982ade-8b51-4948-879a-f308be7eb685" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:49:43 user nova-compute[71113]: DEBUG nova.network.neutron [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 09:49:43 user nova-compute[71113]: DEBUG nova.network.neutron [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Updating instance_info_cache with network_info: [{"id": "73aab5d1-7549-4c59-852d-4e2935c772ef", "address": "fa:16:3e:db:5b:1f", "network": {"id": "19009bbc-db2c-4a99-aef8-bc8cb7ce0608", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2005545678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fc8b3757a845ad89068797348d02bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73aab5d1-75", "ovs_interfaceid": "73aab5d1-7549-4c59-852d-4e2935c772ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:49:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Releasing lock "refresh_cache-ae982ade-8b51-4948-879a-f308be7eb685" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:49:43 user nova-compute[71113]: DEBUG nova.compute.manager [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Instance network_info: |[{"id": "73aab5d1-7549-4c59-852d-4e2935c772ef", "address": "fa:16:3e:db:5b:1f", "network": {"id": "19009bbc-db2c-4a99-aef8-bc8cb7ce0608", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2005545678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fc8b3757a845ad89068797348d02bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73aab5d1-75", "ovs_interfaceid": "73aab5d1-7549-4c59-852d-4e2935c772ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 09:49:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-a68549d6-ca16-4741-a672-3ef0b79a2a1b req-37d38fd5-9dec-4368-8d86-df5ce9856c01 service nova] Acquired lock "refresh_cache-ae982ade-8b51-4948-879a-f308be7eb685" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:49:43 user nova-compute[71113]: DEBUG nova.network.neutron [req-a68549d6-ca16-4741-a672-3ef0b79a2a1b req-37d38fd5-9dec-4368-8d86-df5ce9856c01 service nova] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Refreshing network info cache for port 73aab5d1-7549-4c59-852d-4e2935c772ef {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:49:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Start _get_guest_xml network_info=[{"id": "73aab5d1-7549-4c59-852d-4e2935c772ef", "address": "fa:16:3e:db:5b:1f", "network": {"id": "19009bbc-db2c-4a99-aef8-bc8cb7ce0608", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2005545678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fc8b3757a845ad89068797348d02bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73aab5d1-75", "ovs_interfaceid": "73aab5d1-7549-4c59-852d-4e2935c772ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'image_id': '078646fe-b504-41ed-a147-61072e903e51'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 09:49:43 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:49:43 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:49:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 09:49:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 09:49:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 09:49:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 09:49:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 09:49:43 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 09:49:43 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 09:49:43 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 09:49:43 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 09:49:43 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 09:49:43 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 09:49:43 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 09:49:43 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 09:49:43 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 09:49:43 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 09:49:43 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 09:49:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:49:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-173670159',display_name='tempest-VolumesActionsTest-instance-173670159',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-173670159',id=14,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3fc8b3757a845ad89068797348d02bd',ramdisk_id='',reservation_id='r-1c9jjbgu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1052619025',owner_user_name='tempest-VolumesActionsTest-1052619025-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:49:41Z,user_data=None,user_id='201cdf33fbd74e77877dd1342b33aedc',uuid=ae982ade-8b51-4948-879a-f308be7eb685,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73aab5d1-7549-4c59-852d-4e2935c772ef", "address": "fa:16:3e:db:5b:1f", "network": {"id": "19009bbc-db2c-4a99-aef8-bc8cb7ce0608", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2005545678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fc8b3757a845ad89068797348d02bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73aab5d1-75", "ovs_interfaceid": "73aab5d1-7549-4c59-852d-4e2935c772ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 09:49:43 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Converting VIF {"id": "73aab5d1-7549-4c59-852d-4e2935c772ef", "address": "fa:16:3e:db:5b:1f", "network": {"id": "19009bbc-db2c-4a99-aef8-bc8cb7ce0608", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2005545678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fc8b3757a845ad89068797348d02bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73aab5d1-75", "ovs_interfaceid": "73aab5d1-7549-4c59-852d-4e2935c772ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:49:43 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:5b:1f,bridge_name='br-int',has_traffic_filtering=True,id=73aab5d1-7549-4c59-852d-4e2935c772ef,network=Network(19009bbc-db2c-4a99-aef8-bc8cb7ce0608),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73aab5d1-75') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:49:43 user nova-compute[71113]: DEBUG nova.objects.instance [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Lazy-loading 'pci_devices' on Instance uuid ae982ade-8b51-4948-879a-f308be7eb685 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:49:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: ae982ade-8b51-4948-879a-f308be7eb685] End _get_guest_xml xml=<domain type="kvm">
Jul 31 09:49:43 user nova-compute[71113]:   <uuid>ae982ade-8b51-4948-879a-f308be7eb685</uuid>
Jul 31 09:49:43 user nova-compute[71113]:   <name>instance-0000000e</name>
Jul 31 09:49:43 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 09:49:43 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 09:49:43 user nova-compute[71113]:   <metadata>
Jul 31 09:49:43 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 09:49:43 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 09:49:43 user nova-compute[71113]:       <nova:name>tempest-VolumesActionsTest-instance-173670159</nova:name>
Jul 31 09:49:43 user nova-compute[71113]:       <nova:creationTime>2023-07-31 09:49:43</nova:creationTime>
Jul 31 09:49:43 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 09:49:43 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 09:49:43 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 09:49:43 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 09:49:43 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 09:49:43 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 09:49:43 user nova-compute[71113]:       </nova:flavor>
Jul 31 09:49:43 user nova-compute[71113]:       <nova:owner>
Jul 31 09:49:43 user nova-compute[71113]:         <nova:user uuid="201cdf33fbd74e77877dd1342b33aedc">tempest-VolumesActionsTest-1052619025-project-member</nova:user>
Jul 31 09:49:43 user nova-compute[71113]:         <nova:project uuid="b3fc8b3757a845ad89068797348d02bd">tempest-VolumesActionsTest-1052619025</nova:project>
Jul 31 09:49:43 user nova-compute[71113]:       </nova:owner>
Jul 31 09:49:43 user nova-compute[71113]:       <nova:root type="image" uuid="078646fe-b504-41ed-a147-61072e903e51"/>
Jul 31 09:49:43 user nova-compute[71113]:       <nova:ports>
Jul 31 09:49:43 user nova-compute[71113]:         <nova:port uuid="73aab5d1-7549-4c59-852d-4e2935c772ef">
Jul 31 09:49:43 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 31 09:49:43 user nova-compute[71113]:         </nova:port>
Jul 31 09:49:43 user nova-compute[71113]:       </nova:ports>
Jul 31 09:49:43 user nova-compute[71113]:     </nova:instance>
Jul 31 09:49:43 user nova-compute[71113]:   </metadata>
Jul 31 09:49:43 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 09:49:43 user nova-compute[71113]:     <system>
Jul 31 09:49:43 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 09:49:43 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 09:49:43 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 09:49:43 user nova-compute[71113]:       <entry name="serial">ae982ade-8b51-4948-879a-f308be7eb685</entry>
Jul 31 09:49:43 user nova-compute[71113]:       <entry name="uuid">ae982ade-8b51-4948-879a-f308be7eb685</entry>
Jul 31 09:49:43 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 09:49:43 user nova-compute[71113]:     </system>
Jul 31 09:49:43 user nova-compute[71113]:   </sysinfo>
Jul 31 09:49:43 user nova-compute[71113]:   <os>
Jul 31 09:49:43 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 09:49:43 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 09:49:43 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 09:49:43 user nova-compute[71113]:   </os>
Jul 31 09:49:43 user nova-compute[71113]:   <features>
Jul 31 09:49:43 user nova-compute[71113]:     <acpi/>
Jul 31 09:49:43 user nova-compute[71113]:     <apic/>
Jul 31 09:49:43 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 09:49:43 user nova-compute[71113]:   </features>
Jul 31 09:49:43 user nova-compute[71113]:   <clock offset="utc">
Jul 31 09:49:43 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 09:49:43 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 09:49:43 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 09:49:43 user nova-compute[71113]:   </clock>
Jul 31 09:49:43 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 09:49:43 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 09:49:43 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 09:49:43 user nova-compute[71113]:   </cpu>
Jul 31 09:49:43 user nova-compute[71113]:   <devices>
Jul 31 09:49:43 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 09:49:43 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 09:49:43 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/ae982ade-8b51-4948-879a-f308be7eb685/disk"/>
Jul 31 09:49:43 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 09:49:43 user nova-compute[71113]:     </disk>
Jul 31 09:49:43 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 09:49:43 user nova-compute[71113]:       <mac address="fa:16:3e:db:5b:1f"/>
Jul 31 09:49:43 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:49:43 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 09:49:43 user nova-compute[71113]:       <target dev="tap73aab5d1-75"/>
Jul 31 09:49:43 user nova-compute[71113]:     </interface>
Jul 31 09:49:43 user nova-compute[71113]:     <serial type="pty">
Jul 31 09:49:43 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/ae982ade-8b51-4948-879a-f308be7eb685/console.log" append="off"/>
Jul 31 09:49:43 user nova-compute[71113]:     </serial>
Jul 31 09:49:43 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 09:49:43 user nova-compute[71113]:     <video>
Jul 31 09:49:43 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:49:43 user nova-compute[71113]:     </video>
Jul 31 09:49:43 user nova-compute[71113]:     <rng model="virtio">
Jul 31 09:49:43 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 09:49:43 user nova-compute[71113]:     </rng>
Jul 31 09:49:43 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 09:49:43 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 09:49:43 user nova-compute[71113]:       <stats period="10"/>
Jul 31 09:49:43 user nova-compute[71113]:     </memballoon>
Jul 31 09:49:43 user nova-compute[71113]:   </devices>
Jul 31 09:49:43 user nova-compute[71113]: </domain>
Jul 31 09:49:43 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 09:49:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:49:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-173670159',display_name='tempest-VolumesActionsTest-instance-173670159',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-173670159',id=14,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3fc8b3757a845ad89068797348d02bd',ramdisk_id='',reservation_id='r-1c9jjbgu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1052619025',owner_user_name='tempest-VolumesActionsTest-1052619025-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:49:41Z,user_data=None,user_id='201cdf33fbd74e77877dd1342b33aedc',uuid=ae982ade-8b51-4948-879a-f308be7eb685,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73aab5d1-7549-4c59-852d-4e2935c772ef", "address": "fa:16:3e:db:5b:1f", "network": {"id": "19009bbc-db2c-4a99-aef8-bc8cb7ce0608", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2005545678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fc8b3757a845ad89068797348d02bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73aab5d1-75", "ovs_interfaceid": "73aab5d1-7549-4c59-852d-4e2935c772ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 09:49:43 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Converting VIF {"id": "73aab5d1-7549-4c59-852d-4e2935c772ef", "address": "fa:16:3e:db:5b:1f", "network": {"id": "19009bbc-db2c-4a99-aef8-bc8cb7ce0608", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2005545678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fc8b3757a845ad89068797348d02bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73aab5d1-75", "ovs_interfaceid": "73aab5d1-7549-4c59-852d-4e2935c772ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:49:43 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:5b:1f,bridge_name='br-int',has_traffic_filtering=True,id=73aab5d1-7549-4c59-852d-4e2935c772ef,network=Network(19009bbc-db2c-4a99-aef8-bc8cb7ce0608),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73aab5d1-75') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:49:43 user nova-compute[71113]: DEBUG os_vif [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:5b:1f,bridge_name='br-int',has_traffic_filtering=True,id=73aab5d1-7549-4c59-852d-4e2935c772ef,network=Network(19009bbc-db2c-4a99-aef8-bc8cb7ce0608),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73aab5d1-75') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 09:49:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:49:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 09:49:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap73aab5d1-75, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:49:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap73aab5d1-75, col_values=(('external_ids', {'iface-id': '73aab5d1-7549-4c59-852d-4e2935c772ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:5b:1f', 'vm-uuid': 'ae982ade-8b51-4948-879a-f308be7eb685'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:49:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:49:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:43 user nova-compute[71113]: INFO os_vif [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:5b:1f,bridge_name='br-int',has_traffic_filtering=True,id=73aab5d1-7549-4c59-852d-4e2935c772ef,network=Network(19009bbc-db2c-4a99-aef8-bc8cb7ce0608),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73aab5d1-75')
Jul 31 09:49:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:49:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] No VIF found with MAC fa:16:3e:db:5b:1f, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 09:49:44 user nova-compute[71113]: DEBUG nova.network.neutron [req-a68549d6-ca16-4741-a672-3ef0b79a2a1b req-37d38fd5-9dec-4368-8d86-df5ce9856c01 service nova] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Updated VIF entry in instance network info cache for port 73aab5d1-7549-4c59-852d-4e2935c772ef. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:49:44 user nova-compute[71113]: DEBUG nova.network.neutron [req-a68549d6-ca16-4741-a672-3ef0b79a2a1b req-37d38fd5-9dec-4368-8d86-df5ce9856c01 service nova] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Updating instance_info_cache with network_info: [{"id": "73aab5d1-7549-4c59-852d-4e2935c772ef", "address": "fa:16:3e:db:5b:1f", "network": {"id": "19009bbc-db2c-4a99-aef8-bc8cb7ce0608", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2005545678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fc8b3757a845ad89068797348d02bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73aab5d1-75", "ovs_interfaceid": "73aab5d1-7549-4c59-852d-4e2935c772ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:49:44 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-a68549d6-ca16-4741-a672-3ef0b79a2a1b req-37d38fd5-9dec-4368-8d86-df5ce9856c01 service nova] Releasing lock "refresh_cache-ae982ade-8b51-4948-879a-f308be7eb685" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:49:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:45 user nova-compute[71113]: DEBUG nova.compute.manager [req-1e2217fb-31ba-4ef5-847d-b4c7b3e16dd6 req-284b7a38-7e53-40b9-ab85-4ec6a693fc4a service nova] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Received event network-vif-plugged-73aab5d1-7549-4c59-852d-4e2935c772ef {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:49:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1e2217fb-31ba-4ef5-847d-b4c7b3e16dd6 req-284b7a38-7e53-40b9-ab85-4ec6a693fc4a service nova] Acquiring lock "ae982ade-8b51-4948-879a-f308be7eb685-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:49:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1e2217fb-31ba-4ef5-847d-b4c7b3e16dd6 req-284b7a38-7e53-40b9-ab85-4ec6a693fc4a service nova] Lock "ae982ade-8b51-4948-879a-f308be7eb685-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:49:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1e2217fb-31ba-4ef5-847d-b4c7b3e16dd6 req-284b7a38-7e53-40b9-ab85-4ec6a693fc4a service nova] Lock "ae982ade-8b51-4948-879a-f308be7eb685-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:49:45 user nova-compute[71113]: DEBUG nova.compute.manager [req-1e2217fb-31ba-4ef5-847d-b4c7b3e16dd6 req-284b7a38-7e53-40b9-ab85-4ec6a693fc4a service nova] [instance: ae982ade-8b51-4948-879a-f308be7eb685] No waiting events found dispatching network-vif-plugged-73aab5d1-7549-4c59-852d-4e2935c772ef {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:49:45 user nova-compute[71113]: WARNING nova.compute.manager [req-1e2217fb-31ba-4ef5-847d-b4c7b3e16dd6 req-284b7a38-7e53-40b9-ab85-4ec6a693fc4a service nova] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Received unexpected event network-vif-plugged-73aab5d1-7549-4c59-852d-4e2935c772ef for instance with vm_state building and task_state spawning.
Jul 31 09:49:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:46 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:46 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:46 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:46 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:46 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:47 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690796987.570692, ae982ade-8b51-4948-879a-f308be7eb685 => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:49:47 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: ae982ade-8b51-4948-879a-f308be7eb685] VM Resumed (Lifecycle Event)
Jul 31 09:49:47 user nova-compute[71113]: DEBUG nova.compute.manager [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 09:49:47 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 09:49:47 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Instance spawned successfully.
Jul 31 09:49:47 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 09:49:47 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:49:47 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:49:47 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Found default for hw_cdrom_bus of ide {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:49:47 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Found default for hw_disk_bus of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:49:47 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Found default for hw_input_bus of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:49:47 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Found default for hw_pointer_model of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:49:47 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Found default for hw_video_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:49:47 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Found default for hw_vif_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:49:47 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: ae982ade-8b51-4948-879a-f308be7eb685] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:49:47 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690796987.5756721, ae982ade-8b51-4948-879a-f308be7eb685 => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:49:47 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: ae982ade-8b51-4948-879a-f308be7eb685] VM Started (Lifecycle Event)
Jul 31 09:49:47 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:49:47 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:49:47 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: ae982ade-8b51-4948-879a-f308be7eb685] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:49:47 user nova-compute[71113]: INFO nova.compute.manager [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Took 6.14 seconds to spawn the instance on the hypervisor.
Jul 31 09:49:47 user nova-compute[71113]: DEBUG nova.compute.manager [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:49:47 user nova-compute[71113]: DEBUG nova.compute.manager [req-609c0e5c-e491-47a1-b8b2-847f0afab333 req-10d25303-4b8f-4981-9983-70631884afbb service nova] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Received event network-vif-plugged-73aab5d1-7549-4c59-852d-4e2935c772ef {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:49:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-609c0e5c-e491-47a1-b8b2-847f0afab333 req-10d25303-4b8f-4981-9983-70631884afbb service nova] Acquiring lock "ae982ade-8b51-4948-879a-f308be7eb685-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:49:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-609c0e5c-e491-47a1-b8b2-847f0afab333 req-10d25303-4b8f-4981-9983-70631884afbb service nova] Lock "ae982ade-8b51-4948-879a-f308be7eb685-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:49:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-609c0e5c-e491-47a1-b8b2-847f0afab333 req-10d25303-4b8f-4981-9983-70631884afbb service nova] Lock "ae982ade-8b51-4948-879a-f308be7eb685-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:49:47 user nova-compute[71113]: DEBUG nova.compute.manager [req-609c0e5c-e491-47a1-b8b2-847f0afab333 req-10d25303-4b8f-4981-9983-70631884afbb service nova] [instance: ae982ade-8b51-4948-879a-f308be7eb685] No waiting events found dispatching network-vif-plugged-73aab5d1-7549-4c59-852d-4e2935c772ef {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:49:47 user nova-compute[71113]: WARNING nova.compute.manager [req-609c0e5c-e491-47a1-b8b2-847f0afab333 req-10d25303-4b8f-4981-9983-70631884afbb service nova] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Received unexpected event network-vif-plugged-73aab5d1-7549-4c59-852d-4e2935c772ef for instance with vm_state building and task_state spawning.
Jul 31 09:49:47 user nova-compute[71113]: INFO nova.compute.manager [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Took 6.90 seconds to build instance.
Jul 31 09:49:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-4a7e604e-b029-4dbf-b959-fe0dda58dbda tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Lock "ae982ade-8b51-4948-879a-f308be7eb685" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.010s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:49:48 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:51 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:53 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:57 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:49:58 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:58 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:49:58 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:49:59 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:49:59 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:49:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Acquiring lock "f4df9380-7882-48a6-ba64-bb17429e54ac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:49:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Lock "f4df9380-7882-48a6-ba64-bb17429e54ac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:49:59 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Starting instance... {{(pid=71113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 09:49:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:49:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:49:59 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 09:49:59 user nova-compute[71113]: INFO nova.compute.claims [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Claim successful on node user
Jul 31 09:50:00 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:50:00 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:50:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.403s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:50:00 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Start building networks asynchronously for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 09:50:00 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Allocating IP information in the background. {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 09:50:00 user nova-compute[71113]: DEBUG nova.network.neutron [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] allocate_for_instance() {{(pid=71113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 09:50:00 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 09:50:00 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Start building block device mappings for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 09:50:00 user nova-compute[71113]: DEBUG nova.policy [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7b3fa9245be64500b9879cf4624ecdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88c00df40f46178f46c09cf14b88d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71113) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 09:50:00 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Start spawning the instance on the hypervisor. {{(pid=71113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 09:50:00 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 09:50:00 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Creating image(s)
Jul 31 09:50:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Acquiring lock "/opt/stack/data/nova/instances/f4df9380-7882-48a6-ba64-bb17429e54ac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:50:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Lock "/opt/stack/data/nova/instances/f4df9380-7882-48a6-ba64-bb17429e54ac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:50:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Lock "/opt/stack/data/nova/instances/f4df9380-7882-48a6-ba64-bb17429e54ac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:50:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-cc72a68d-3717-4f85-a962-4b1e444976e4 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Acquiring lock "b324fed7-5df8-4ca1-9a5a-06eaffd5e101" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:50:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-cc72a68d-3717-4f85-a962-4b1e444976e4 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Lock "b324fed7-5df8-4ca1-9a5a-06eaffd5e101" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:50:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-cc72a68d-3717-4f85-a962-4b1e444976e4 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Acquiring lock "b324fed7-5df8-4ca1-9a5a-06eaffd5e101-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:50:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-cc72a68d-3717-4f85-a962-4b1e444976e4 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Lock "b324fed7-5df8-4ca1-9a5a-06eaffd5e101-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:50:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-cc72a68d-3717-4f85-a962-4b1e444976e4 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Lock "b324fed7-5df8-4ca1-9a5a-06eaffd5e101-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:50:00 user nova-compute[71113]: INFO nova.compute.manager [None req-cc72a68d-3717-4f85-a962-4b1e444976e4 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Terminating instance
Jul 31 09:50:00 user nova-compute[71113]: DEBUG nova.compute.manager [None req-cc72a68d-3717-4f85-a962-4b1e444976e4 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Start destroying the instance on the hypervisor. {{(pid=71113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 09:50:00 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:50:00 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:50:00 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 09:50:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.142s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Acquiring lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:50:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:50:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:00 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:00 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.157s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/f4df9380-7882-48a6-ba64-bb17429e54ac/disk 1073741824 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/f4df9380-7882-48a6-ba64-bb17429e54ac/disk 1073741824" returned: 0 in 0.048s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:50:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:01 user nova-compute[71113]: DEBUG nova.compute.manager [req-2f47dca7-1b06-4093-8a82-394a7af7c09d req-e41b30ba-6d76-4f20-8251-ec62b7bf742d service nova] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Received event network-vif-unplugged-07f33c66-0fa4-4154-a498-d6d42864a9a5 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:50:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-2f47dca7-1b06-4093-8a82-394a7af7c09d req-e41b30ba-6d76-4f20-8251-ec62b7bf742d service nova] Acquiring lock "b324fed7-5df8-4ca1-9a5a-06eaffd5e101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:50:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-2f47dca7-1b06-4093-8a82-394a7af7c09d req-e41b30ba-6d76-4f20-8251-ec62b7bf742d service nova] Lock "b324fed7-5df8-4ca1-9a5a-06eaffd5e101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:50:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-2f47dca7-1b06-4093-8a82-394a7af7c09d req-e41b30ba-6d76-4f20-8251-ec62b7bf742d service nova] Lock "b324fed7-5df8-4ca1-9a5a-06eaffd5e101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:50:01 user nova-compute[71113]: DEBUG nova.compute.manager [req-2f47dca7-1b06-4093-8a82-394a7af7c09d req-e41b30ba-6d76-4f20-8251-ec62b7bf742d service nova] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] No waiting events found dispatching network-vif-unplugged-07f33c66-0fa4-4154-a498-d6d42864a9a5 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:50:01 user nova-compute[71113]: DEBUG nova.compute.manager [req-2f47dca7-1b06-4093-8a82-394a7af7c09d req-e41b30ba-6d76-4f20-8251-ec62b7bf742d service nova] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Received event network-vif-unplugged-07f33c66-0fa4-4154-a498-d6d42864a9a5 for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 09:50:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.133s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:01 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f4df9380-7882-48a6-ba64-bb17429e54ac/disk. size=1073741824 {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 09:50:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4df9380-7882-48a6-ba64-bb17429e54ac/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4df9380-7882-48a6-ba64-bb17429e54ac/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:01 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Cannot resize image /opt/stack/data/nova/instances/f4df9380-7882-48a6-ba64-bb17429e54ac/disk to a smaller size. {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 09:50:01 user nova-compute[71113]: DEBUG nova.objects.instance [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Lazy-loading 'migration_context' on Instance uuid f4df9380-7882-48a6-ba64-bb17429e54ac {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:50:01 user nova-compute[71113]: DEBUG nova.network.neutron [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Successfully created port: 14c27534-a6d1-4bfe-a5cf-1a4d9b573303 {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 09:50:01 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Created local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 09:50:01 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Ensure instance console log exists: /opt/stack/data/nova/instances/f4df9380-7882-48a6-ba64-bb17429e54ac/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 09:50:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:50:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:50:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:50:01 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Instance destroyed successfully.
Jul 31 09:50:01 user nova-compute[71113]: DEBUG nova.objects.instance [None req-cc72a68d-3717-4f85-a962-4b1e444976e4 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Lazy-loading 'resources' on Instance uuid b324fed7-5df8-4ca1-9a5a-06eaffd5e101 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:50:01 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-cc72a68d-3717-4f85-a962-4b1e444976e4 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:46:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1198419998',display_name='tempest-TestVolumeSwap-server-1198419998',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1198419998',id=6,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAD1pBUHVq0pRc6l8mQwSY8P92l3ivm22XPT4xkVrjSMI8DOJX5DbKXbBJnYnhLh14894vtYc5ACy8NqT6qdqyiEcTJtk/yCxi/c0LE+pv3UX3HK5xJNr9JwrljZ9RTTAw==',key_name='tempest-keypair-341060647',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:46:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e01569d9e6a4aff974e6dc99141f089',ramdisk_id='',reservation_id='r-0uqr085s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-70920097',owner_user_name='tempest-TestVolumeSwap-70920097-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:46:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b6a9a083ff064d6e89a4de0b9c4dce4f',uuid=b324fed7-5df8-4ca1-9a5a-06eaffd5e101,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "07f33c66-0fa4-4154-a498-d6d42864a9a5", "address": "fa:16:3e:14:e4:e5", "network": {"id": "c49991aa-9260-4358-b3e2-309d558b5805", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1291245964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e01569d9e6a4aff974e6dc99141f089", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07f33c66-0f", "ovs_interfaceid": "07f33c66-0fa4-4154-a498-d6d42864a9a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 09:50:01 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-cc72a68d-3717-4f85-a962-4b1e444976e4 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Converting VIF {"id": "07f33c66-0fa4-4154-a498-d6d42864a9a5", "address": "fa:16:3e:14:e4:e5", "network": {"id": "c49991aa-9260-4358-b3e2-309d558b5805", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1291245964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e01569d9e6a4aff974e6dc99141f089", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07f33c66-0f", "ovs_interfaceid": "07f33c66-0fa4-4154-a498-d6d42864a9a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:50:01 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-cc72a68d-3717-4f85-a962-4b1e444976e4 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:e4:e5,bridge_name='br-int',has_traffic_filtering=True,id=07f33c66-0fa4-4154-a498-d6d42864a9a5,network=Network(c49991aa-9260-4358-b3e2-309d558b5805),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07f33c66-0f') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:50:01 user nova-compute[71113]: DEBUG os_vif [None req-cc72a68d-3717-4f85-a962-4b1e444976e4 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:e4:e5,bridge_name='br-int',has_traffic_filtering=True,id=07f33c66-0fa4-4154-a498-d6d42864a9a5,network=Network(c49991aa-9260-4358-b3e2-309d558b5805),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07f33c66-0f') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 09:50:01 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:01 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap07f33c66-0f, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:50:01 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:01 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:50:01 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:01 user nova-compute[71113]: INFO os_vif [None req-cc72a68d-3717-4f85-a962-4b1e444976e4 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:e4:e5,bridge_name='br-int',has_traffic_filtering=True,id=07f33c66-0fa4-4154-a498-d6d42864a9a5,network=Network(c49991aa-9260-4358-b3e2-309d558b5805),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07f33c66-0f')
Jul 31 09:50:01 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-cc72a68d-3717-4f85-a962-4b1e444976e4 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Deleting instance files /opt/stack/data/nova/instances/b324fed7-5df8-4ca1-9a5a-06eaffd5e101_del
Jul 31 09:50:01 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-cc72a68d-3717-4f85-a962-4b1e444976e4 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Deletion of /opt/stack/data/nova/instances/b324fed7-5df8-4ca1-9a5a-06eaffd5e101_del complete
Jul 31 09:50:01 user nova-compute[71113]: INFO nova.compute.manager [None req-cc72a68d-3717-4f85-a962-4b1e444976e4 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Took 0.98 seconds to destroy the instance on the hypervisor.
Jul 31 09:50:01 user nova-compute[71113]: DEBUG oslo.service.loopingcall [None req-cc72a68d-3717-4f85-a962-4b1e444976e4 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71113) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 09:50:01 user nova-compute[71113]: DEBUG nova.compute.manager [-] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Deallocating network for instance {{(pid=71113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 09:50:01 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] deallocate_for_instance() {{(pid=71113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 09:50:01 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:50:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:50:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:50:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:50:01 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 09:50:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d033eac-23ea-417a-981c-578328f1c3ac/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG nova.network.neutron [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Successfully updated port: 14c27534-a6d1-4bfe-a5cf-1a4d9b573303 {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Acquiring lock "refresh_cache-f4df9380-7882-48a6-ba64-bb17429e54ac" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Acquired lock "refresh_cache-f4df9380-7882-48a6-ba64-bb17429e54ac" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG nova.network.neutron [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG nova.compute.manager [req-ea734649-e99a-4d16-922b-281f9ca44c60 req-08d16ce2-9a12-458e-ac1f-35744bce3031 service nova] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Received event network-changed-14c27534-a6d1-4bfe-a5cf-1a4d9b573303 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG nova.compute.manager [req-ea734649-e99a-4d16-922b-281f9ca44c60 req-08d16ce2-9a12-458e-ac1f-35744bce3031 service nova] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Refreshing instance network info cache due to event network-changed-14c27534-a6d1-4bfe-a5cf-1a4d9b573303. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ea734649-e99a-4d16-922b-281f9ca44c60 req-08d16ce2-9a12-458e-ac1f-35744bce3031 service nova] Acquiring lock "refresh_cache-f4df9380-7882-48a6-ba64-bb17429e54ac" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d033eac-23ea-417a-981c-578328f1c3ac/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d033eac-23ea-417a-981c-578328f1c3ac/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG nova.network.neutron [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:50:02 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Took 0.80 seconds to deallocate network for instance.
Jul 31 09:50:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d033eac-23ea-417a-981c-578328f1c3ac/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caac13d2-ceb3-4fee-84ad-5376c1c2cc23/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-cc72a68d-3717-4f85-a962-4b1e444976e4 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-cc72a68d-3717-4f85-a962-4b1e444976e4 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caac13d2-ceb3-4fee-84ad-5376c1c2cc23/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caac13d2-ceb3-4fee-84ad-5376c1c2cc23/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG nova.network.neutron [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Updating instance_info_cache with network_info: [{"id": "14c27534-a6d1-4bfe-a5cf-1a4d9b573303", "address": "fa:16:3e:00:6e:63", "network": {"id": "4ab5c9f4-e78f-4bf2-bc82-ef698b714952", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1047934668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f88c00df40f46178f46c09cf14b88d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c27534-a6", "ovs_interfaceid": "14c27534-a6d1-4bfe-a5cf-1a4d9b573303", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caac13d2-ceb3-4fee-84ad-5376c1c2cc23/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Releasing lock "refresh_cache-f4df9380-7882-48a6-ba64-bb17429e54ac" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Instance network_info: |[{"id": "14c27534-a6d1-4bfe-a5cf-1a4d9b573303", "address": "fa:16:3e:00:6e:63", "network": {"id": "4ab5c9f4-e78f-4bf2-bc82-ef698b714952", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1047934668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f88c00df40f46178f46c09cf14b88d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c27534-a6", "ovs_interfaceid": "14c27534-a6d1-4bfe-a5cf-1a4d9b573303", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ea734649-e99a-4d16-922b-281f9ca44c60 req-08d16ce2-9a12-458e-ac1f-35744bce3031 service nova] Acquired lock "refresh_cache-f4df9380-7882-48a6-ba64-bb17429e54ac" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG nova.network.neutron [req-ea734649-e99a-4d16-922b-281f9ca44c60 req-08d16ce2-9a12-458e-ac1f-35744bce3031 service nova] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Refreshing network info cache for port 14c27534-a6d1-4bfe-a5cf-1a4d9b573303 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Start _get_guest_xml network_info=[{"id": "14c27534-a6d1-4bfe-a5cf-1a4d9b573303", "address": "fa:16:3e:00:6e:63", "network": {"id": "4ab5c9f4-e78f-4bf2-bc82-ef698b714952", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1047934668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f88c00df40f46178f46c09cf14b88d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c27534-a6", "ovs_interfaceid": "14c27534-a6d1-4bfe-a5cf-1a4d9b573303", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'image_id': '078646fe-b504-41ed-a147-61072e903e51'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae982ade-8b51-4948-879a-f308be7eb685/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:02 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:50:02 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:50:02 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:49:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-306353643',display_name='tempest-ServersNegativeTestJSON-server-306353643',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-306353643',id=15,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f88c00df40f46178f46c09cf14b88d7',ramdisk_id='',reservation_id='r-npknz5z0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1314085245',owner_user_name='tempest-ServersNegativeTestJSON-1314085245-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:50:01Z,user_data=None,user_id='7b3fa9245be64500b9879cf4624ecdc9',uuid=f4df9380-7882-48a6-ba64-bb17429e54ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14c27534-a6d1-4bfe-a5cf-1a4d9b573303", "address": "fa:16:3e:00:6e:63", "network": {"id": "4ab5c9f4-e78f-4bf2-bc82-ef698b714952", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1047934668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f88c00df40f46178f46c09cf14b88d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c27534-a6", "ovs_interfaceid": "14c27534-a6d1-4bfe-a5cf-1a4d9b573303", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Converting VIF {"id": "14c27534-a6d1-4bfe-a5cf-1a4d9b573303", "address": "fa:16:3e:00:6e:63", "network": {"id": "4ab5c9f4-e78f-4bf2-bc82-ef698b714952", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1047934668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f88c00df40f46178f46c09cf14b88d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c27534-a6", "ovs_interfaceid": "14c27534-a6d1-4bfe-a5cf-1a4d9b573303", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:6e:63,bridge_name='br-int',has_traffic_filtering=True,id=14c27534-a6d1-4bfe-a5cf-1a4d9b573303,network=Network(4ab5c9f4-e78f-4bf2-bc82-ef698b714952),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14c27534-a6') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG nova.objects.instance [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Lazy-loading 'pci_devices' on Instance uuid f4df9380-7882-48a6-ba64-bb17429e54ac {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] End _get_guest_xml xml=<domain type="kvm">
Jul 31 09:50:02 user nova-compute[71113]:   <uuid>f4df9380-7882-48a6-ba64-bb17429e54ac</uuid>
Jul 31 09:50:02 user nova-compute[71113]:   <name>instance-0000000f</name>
Jul 31 09:50:02 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 09:50:02 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 09:50:02 user nova-compute[71113]:   <metadata>
Jul 31 09:50:02 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 09:50:02 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 09:50:02 user nova-compute[71113]:       <nova:name>tempest-ServersNegativeTestJSON-server-306353643</nova:name>
Jul 31 09:50:02 user nova-compute[71113]:       <nova:creationTime>2023-07-31 09:50:02</nova:creationTime>
Jul 31 09:50:02 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 09:50:02 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 09:50:02 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 09:50:02 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 09:50:02 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 09:50:02 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 09:50:02 user nova-compute[71113]:       </nova:flavor>
Jul 31 09:50:02 user nova-compute[71113]:       <nova:owner>
Jul 31 09:50:02 user nova-compute[71113]:         <nova:user uuid="7b3fa9245be64500b9879cf4624ecdc9">tempest-ServersNegativeTestJSON-1314085245-project-member</nova:user>
Jul 31 09:50:02 user nova-compute[71113]:         <nova:project uuid="8f88c00df40f46178f46c09cf14b88d7">tempest-ServersNegativeTestJSON-1314085245</nova:project>
Jul 31 09:50:02 user nova-compute[71113]:       </nova:owner>
Jul 31 09:50:02 user nova-compute[71113]:       <nova:root type="image" uuid="078646fe-b504-41ed-a147-61072e903e51"/>
Jul 31 09:50:02 user nova-compute[71113]:       <nova:ports>
Jul 31 09:50:02 user nova-compute[71113]:         <nova:port uuid="14c27534-a6d1-4bfe-a5cf-1a4d9b573303">
Jul 31 09:50:02 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 31 09:50:02 user nova-compute[71113]:         </nova:port>
Jul 31 09:50:02 user nova-compute[71113]:       </nova:ports>
Jul 31 09:50:02 user nova-compute[71113]:     </nova:instance>
Jul 31 09:50:02 user nova-compute[71113]:   </metadata>
Jul 31 09:50:02 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 09:50:02 user nova-compute[71113]:     <system>
Jul 31 09:50:02 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 09:50:02 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 09:50:02 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 09:50:02 user nova-compute[71113]:       <entry name="serial">f4df9380-7882-48a6-ba64-bb17429e54ac</entry>
Jul 31 09:50:02 user nova-compute[71113]:       <entry name="uuid">f4df9380-7882-48a6-ba64-bb17429e54ac</entry>
Jul 31 09:50:02 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 09:50:02 user nova-compute[71113]:     </system>
Jul 31 09:50:02 user nova-compute[71113]:   </sysinfo>
Jul 31 09:50:02 user nova-compute[71113]:   <os>
Jul 31 09:50:02 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 09:50:02 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 09:50:02 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 09:50:02 user nova-compute[71113]:   </os>
Jul 31 09:50:02 user nova-compute[71113]:   <features>
Jul 31 09:50:02 user nova-compute[71113]:     <acpi/>
Jul 31 09:50:02 user nova-compute[71113]:     <apic/>
Jul 31 09:50:02 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 09:50:02 user nova-compute[71113]:   </features>
Jul 31 09:50:02 user nova-compute[71113]:   <clock offset="utc">
Jul 31 09:50:02 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 09:50:02 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 09:50:02 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 09:50:02 user nova-compute[71113]:   </clock>
Jul 31 09:50:02 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 09:50:02 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 09:50:02 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 09:50:02 user nova-compute[71113]:   </cpu>
Jul 31 09:50:02 user nova-compute[71113]:   <devices>
Jul 31 09:50:02 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 09:50:02 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 09:50:02 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/f4df9380-7882-48a6-ba64-bb17429e54ac/disk"/>
Jul 31 09:50:02 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 09:50:02 user nova-compute[71113]:     </disk>
Jul 31 09:50:02 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 09:50:02 user nova-compute[71113]:       <mac address="fa:16:3e:00:6e:63"/>
Jul 31 09:50:02 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:50:02 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 09:50:02 user nova-compute[71113]:       <target dev="tap14c27534-a6"/>
Jul 31 09:50:02 user nova-compute[71113]:     </interface>
Jul 31 09:50:02 user nova-compute[71113]:     <serial type="pty">
Jul 31 09:50:02 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/f4df9380-7882-48a6-ba64-bb17429e54ac/console.log" append="off"/>
Jul 31 09:50:02 user nova-compute[71113]:     </serial>
Jul 31 09:50:02 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 09:50:02 user nova-compute[71113]:     <video>
Jul 31 09:50:02 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:50:02 user nova-compute[71113]:     </video>
Jul 31 09:50:02 user nova-compute[71113]:     <rng model="virtio">
Jul 31 09:50:02 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 09:50:02 user nova-compute[71113]:     </rng>
Jul 31 09:50:02 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 09:50:02 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 09:50:02 user nova-compute[71113]:       <stats period="10"/>
Jul 31 09:50:02 user nova-compute[71113]:     </memballoon>
Jul 31 09:50:02 user nova-compute[71113]:   </devices>
Jul 31 09:50:02 user nova-compute[71113]: </domain>
Jul 31 09:50:02 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:49:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-306353643',display_name='tempest-ServersNegativeTestJSON-server-306353643',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-306353643',id=15,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f88c00df40f46178f46c09cf14b88d7',ramdisk_id='',reservation_id='r-npknz5z0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1314085245',owner_user_name='tempest-ServersNegativeTestJSON-1314085245-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:50:01Z,user_data=None,user_id='7b3fa9245be64500b9879cf4624ecdc9',uuid=f4df9380-7882-48a6-ba64-bb17429e54ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14c27534-a6d1-4bfe-a5cf-1a4d9b573303", "address": "fa:16:3e:00:6e:63", "network": {"id": "4ab5c9f4-e78f-4bf2-bc82-ef698b714952", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1047934668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f88c00df40f46178f46c09cf14b88d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c27534-a6", "ovs_interfaceid": "14c27534-a6d1-4bfe-a5cf-1a4d9b573303", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Converting VIF {"id": "14c27534-a6d1-4bfe-a5cf-1a4d9b573303", "address": "fa:16:3e:00:6e:63", "network": {"id": "4ab5c9f4-e78f-4bf2-bc82-ef698b714952", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1047934668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f88c00df40f46178f46c09cf14b88d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c27534-a6", "ovs_interfaceid": "14c27534-a6d1-4bfe-a5cf-1a4d9b573303", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:6e:63,bridge_name='br-int',has_traffic_filtering=True,id=14c27534-a6d1-4bfe-a5cf-1a4d9b573303,network=Network(4ab5c9f4-e78f-4bf2-bc82-ef698b714952),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14c27534-a6') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG os_vif [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:6e:63,bridge_name='br-int',has_traffic_filtering=True,id=14c27534-a6d1-4bfe-a5cf-1a4d9b573303,network=Network(4ab5c9f4-e78f-4bf2-bc82-ef698b714952),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14c27534-a6') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae982ade-8b51-4948-879a-f308be7eb685/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae982ade-8b51-4948-879a-f308be7eb685/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:03 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:03 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap14c27534-a6, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:50:03 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap14c27534-a6, col_values=(('external_ids', {'iface-id': '14c27534-a6d1-4bfe-a5cf-1a4d9b573303', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:6e:63', 'vm-uuid': 'f4df9380-7882-48a6-ba64-bb17429e54ac'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:50:03 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:50:03 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-cc72a68d-3717-4f85-a962-4b1e444976e4 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:50:03 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:03 user nova-compute[71113]: INFO os_vif [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:6e:63,bridge_name='br-int',has_traffic_filtering=True,id=14c27534-a6d1-4bfe-a5cf-1a4d9b573303,network=Network(4ab5c9f4-e78f-4bf2-bc82-ef698b714952),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14c27534-a6')
Jul 31 09:50:03 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-cc72a68d-3717-4f85-a962-4b1e444976e4 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:50:03 user nova-compute[71113]: DEBUG nova.compute.manager [req-66498532-9384-4637-8b9e-cb44cdda661e req-239e2bcb-90bf-498b-b458-0595f751653a service nova] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Received event network-vif-plugged-07f33c66-0fa4-4154-a498-d6d42864a9a5 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:50:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-66498532-9384-4637-8b9e-cb44cdda661e req-239e2bcb-90bf-498b-b458-0595f751653a service nova] Acquiring lock "b324fed7-5df8-4ca1-9a5a-06eaffd5e101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:50:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-66498532-9384-4637-8b9e-cb44cdda661e req-239e2bcb-90bf-498b-b458-0595f751653a service nova] Lock "b324fed7-5df8-4ca1-9a5a-06eaffd5e101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:50:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-66498532-9384-4637-8b9e-cb44cdda661e req-239e2bcb-90bf-498b-b458-0595f751653a service nova] Lock "b324fed7-5df8-4ca1-9a5a-06eaffd5e101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:50:03 user nova-compute[71113]: DEBUG nova.compute.manager [req-66498532-9384-4637-8b9e-cb44cdda661e req-239e2bcb-90bf-498b-b458-0595f751653a service nova] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] No waiting events found dispatching network-vif-plugged-07f33c66-0fa4-4154-a498-d6d42864a9a5 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:50:03 user nova-compute[71113]: WARNING nova.compute.manager [req-66498532-9384-4637-8b9e-cb44cdda661e req-239e2bcb-90bf-498b-b458-0595f751653a service nova] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Received unexpected event network-vif-plugged-07f33c66-0fa4-4154-a498-d6d42864a9a5 for instance with vm_state deleted and task_state None.
Jul 31 09:50:03 user nova-compute[71113]: DEBUG nova.compute.manager [req-66498532-9384-4637-8b9e-cb44cdda661e req-239e2bcb-90bf-498b-b458-0595f751653a service nova] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Received event network-vif-deleted-07f33c66-0fa4-4154-a498-d6d42864a9a5 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:50:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-cc72a68d-3717-4f85-a962-4b1e444976e4 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.523s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:50:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:50:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] No VIF found with MAC fa:16:3e:00:6e:63, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 09:50:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae982ade-8b51-4948-879a-f308be7eb685/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a4b47dd-b335-4c2f-9dee-5421357a0ee1/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:03 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-cc72a68d-3717-4f85-a962-4b1e444976e4 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Deleted allocations for instance b324fed7-5df8-4ca1-9a5a-06eaffd5e101
Jul 31 09:50:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-cc72a68d-3717-4f85-a962-4b1e444976e4 tempest-TestVolumeSwap-70920097 tempest-TestVolumeSwap-70920097-project-member] Lock "b324fed7-5df8-4ca1-9a5a-06eaffd5e101" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.610s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:50:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a4b47dd-b335-4c2f-9dee-5421357a0ee1/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a4b47dd-b335-4c2f-9dee-5421357a0ee1/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:03 user nova-compute[71113]: DEBUG nova.network.neutron [req-ea734649-e99a-4d16-922b-281f9ca44c60 req-08d16ce2-9a12-458e-ac1f-35744bce3031 service nova] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Updated VIF entry in instance network info cache for port 14c27534-a6d1-4bfe-a5cf-1a4d9b573303. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:50:03 user nova-compute[71113]: DEBUG nova.network.neutron [req-ea734649-e99a-4d16-922b-281f9ca44c60 req-08d16ce2-9a12-458e-ac1f-35744bce3031 service nova] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Updating instance_info_cache with network_info: [{"id": "14c27534-a6d1-4bfe-a5cf-1a4d9b573303", "address": "fa:16:3e:00:6e:63", "network": {"id": "4ab5c9f4-e78f-4bf2-bc82-ef698b714952", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1047934668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f88c00df40f46178f46c09cf14b88d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c27534-a6", "ovs_interfaceid": "14c27534-a6d1-4bfe-a5cf-1a4d9b573303", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:50:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ea734649-e99a-4d16-922b-281f9ca44c60 req-08d16ce2-9a12-458e-ac1f-35744bce3031 service nova] Releasing lock "refresh_cache-f4df9380-7882-48a6-ba64-bb17429e54ac" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:50:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a4b47dd-b335-4c2f-9dee-5421357a0ee1/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 09:50:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d2948be-3ebb-4067-a0c8-e2ca884814ff/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d2948be-3ebb-4067-a0c8-e2ca884814ff/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d2948be-3ebb-4067-a0c8-e2ca884814ff/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d2948be-3ebb-4067-a0c8-e2ca884814ff/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f88bc35b-4996-400e-88ba-5d0f2c3f6c4a/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f88bc35b-4996-400e-88ba-5d0f2c3f6c4a/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f88bc35b-4996-400e-88ba-5d0f2c3f6c4a/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f88bc35b-4996-400e-88ba-5d0f2c3f6c4a/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:06 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:06 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797006.806971, f4df9380-7882-48a6-ba64-bb17429e54ac => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:50:06 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] VM Resumed (Lifecycle Event)
Jul 31 09:50:06 user nova-compute[71113]: DEBUG nova.compute.manager [req-ac66cc2c-75cf-4a05-b4bb-f1bc19a0c09f req-c2db6df3-6b50-4250-a49a-3e6d5d50994a service nova] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Received event network-vif-plugged-14c27534-a6d1-4bfe-a5cf-1a4d9b573303 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:50:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ac66cc2c-75cf-4a05-b4bb-f1bc19a0c09f req-c2db6df3-6b50-4250-a49a-3e6d5d50994a service nova] Acquiring lock "f4df9380-7882-48a6-ba64-bb17429e54ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:50:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ac66cc2c-75cf-4a05-b4bb-f1bc19a0c09f req-c2db6df3-6b50-4250-a49a-3e6d5d50994a service nova] Lock "f4df9380-7882-48a6-ba64-bb17429e54ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:50:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ac66cc2c-75cf-4a05-b4bb-f1bc19a0c09f req-c2db6df3-6b50-4250-a49a-3e6d5d50994a service nova] Lock "f4df9380-7882-48a6-ba64-bb17429e54ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:50:06 user nova-compute[71113]: DEBUG nova.compute.manager [req-ac66cc2c-75cf-4a05-b4bb-f1bc19a0c09f req-c2db6df3-6b50-4250-a49a-3e6d5d50994a service nova] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] No waiting events found dispatching network-vif-plugged-14c27534-a6d1-4bfe-a5cf-1a4d9b573303 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:50:06 user nova-compute[71113]: WARNING nova.compute.manager [req-ac66cc2c-75cf-4a05-b4bb-f1bc19a0c09f req-c2db6df3-6b50-4250-a49a-3e6d5d50994a service nova] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Received unexpected event network-vif-plugged-14c27534-a6d1-4bfe-a5cf-1a4d9b573303 for instance with vm_state building and task_state spawning.
Jul 31 09:50:06 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 09:50:06 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 09:50:06 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Instance spawned successfully.
Jul 31 09:50:06 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:50:06 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:50:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=7570MB free_disk=25.647891998291016GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 09:50:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:50:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:50:06 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 09:50:06 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:50:06 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:50:06 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Found default for hw_cdrom_bus of ide {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:50:06 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Found default for hw_disk_bus of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:50:06 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Found default for hw_input_bus of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:50:06 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Found default for hw_pointer_model of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:50:06 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Found default for hw_video_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:50:06 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Found default for hw_vif_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:50:06 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:50:06 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797006.8072124, f4df9380-7882-48a6-ba64-bb17429e54ac => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:50:06 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] VM Started (Lifecycle Event)
Jul 31 09:50:07 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:50:07 user nova-compute[71113]: INFO nova.compute.manager [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Took 6.46 seconds to spawn the instance on the hypervisor.
Jul 31 09:50:07 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:50:07 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:50:07 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:50:07 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 0ea0401b-26c2-4655-956b-1bc000debd53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:50:07 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance efa311a0-fe2e-4c0f-af66-09c3eb38fbf1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:50:07 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 1112a49d-27bd-4fc8-bae6-ec1decbb47db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:50:07 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance caac13d2-ceb3-4fee-84ad-5376c1c2cc23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:50:07 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 8d033eac-23ea-417a-981c-578328f1c3ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:50:07 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 9a4b47dd-b335-4c2f-9dee-5421357a0ee1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:50:07 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 8d2948be-3ebb-4067-a0c8-e2ca884814ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:50:07 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance f88bc35b-4996-400e-88ba-5d0f2c3f6c4a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:50:07 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance ae982ade-8b51-4948-879a-f308be7eb685 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:50:07 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance f4df9380-7882-48a6-ba64-bb17429e54ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:50:07 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 09:50:07 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 09:50:07 user nova-compute[71113]: INFO nova.compute.manager [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Took 7.23 seconds to build instance.
Jul 31 09:50:07 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ed504ed4-94b1-49ec-bb78-706b95bcd654 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Lock "f4df9380-7882-48a6-ba64-bb17429e54ac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.325s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:50:07 user nova-compute[71113]: DEBUG nova.compute.manager [req-982c1486-2fda-4e34-aab5-7ef0636cedb2 req-a062b335-dceb-4d6b-b554-cd5b0708c775 service nova] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Received event network-vif-plugged-14c27534-a6d1-4bfe-a5cf-1a4d9b573303 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:50:07 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-982c1486-2fda-4e34-aab5-7ef0636cedb2 req-a062b335-dceb-4d6b-b554-cd5b0708c775 service nova] Acquiring lock "f4df9380-7882-48a6-ba64-bb17429e54ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:50:07 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-982c1486-2fda-4e34-aab5-7ef0636cedb2 req-a062b335-dceb-4d6b-b554-cd5b0708c775 service nova] Lock "f4df9380-7882-48a6-ba64-bb17429e54ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:50:07 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-982c1486-2fda-4e34-aab5-7ef0636cedb2 req-a062b335-dceb-4d6b-b554-cd5b0708c775 service nova] Lock "f4df9380-7882-48a6-ba64-bb17429e54ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:50:07 user nova-compute[71113]: DEBUG nova.compute.manager [req-982c1486-2fda-4e34-aab5-7ef0636cedb2 req-a062b335-dceb-4d6b-b554-cd5b0708c775 service nova] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] No waiting events found dispatching network-vif-plugged-14c27534-a6d1-4bfe-a5cf-1a4d9b573303 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:50:07 user nova-compute[71113]: WARNING nova.compute.manager [req-982c1486-2fda-4e34-aab5-7ef0636cedb2 req-a062b335-dceb-4d6b-b554-cd5b0708c775 service nova] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Received unexpected event network-vif-plugged-14c27534-a6d1-4bfe-a5cf-1a4d9b573303 for instance with vm_state active and task_state None.
Jul 31 09:50:07 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:50:07 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:50:07 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 09:50:07 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.534s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:50:08 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9b73e7f4-4bee-4c57-87cb-529f66bf5860 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Acquiring lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:50:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9b73e7f4-4bee-4c57-87cb-529f66bf5860 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:50:08 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:50:08 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:50:08 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 09:50:08 user nova-compute[71113]: DEBUG nova.objects.instance [None req-9b73e7f4-4bee-4c57-87cb-529f66bf5860 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lazy-loading 'flavor' on Instance uuid efa311a0-fe2e-4c0f-af66-09c3eb38fbf1 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:50:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9b73e7f4-4bee-4c57-87cb-529f66bf5860 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.092s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:50:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "refresh_cache-1112a49d-27bd-4fc8-bae6-ec1decbb47db" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:50:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquired lock "refresh_cache-1112a49d-27bd-4fc8-bae6-ec1decbb47db" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:50:08 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Forcefully refreshing network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 09:50:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9b73e7f4-4bee-4c57-87cb-529f66bf5860 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Acquiring lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:50:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9b73e7f4-4bee-4c57-87cb-529f66bf5860 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:50:08 user nova-compute[71113]: INFO nova.compute.manager [None req-9b73e7f4-4bee-4c57-87cb-529f66bf5860 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Attaching volume dc7c0a40-0540-43ec-8a1d-7dd80d222f2c to /dev/vdb
Jul 31 09:50:08 user nova-compute[71113]: DEBUG os_brick.utils [None req-9b73e7f4-4bee-4c57-87cb-529f66bf5860 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:50:08 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:08 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:08 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8205decf-e703-4aa4-9375-7e88a32ea78b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:08 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:08 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:08 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[51aa0eb1-e6e1-4c3d-a31e-84740799c6be]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:08 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:08 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:08 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ae00a2-76ee-4884-a5fb-77e9bb9af0c0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:08 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3625de5f-3e2c-4f83-887e-896107a21836]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:08 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-9b73e7f4-4bee-4c57-87cb-529f66bf5860 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:08 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-9b73e7f4-4bee-4c57-87cb-529f66bf5860 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:50:08 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9b73e7f4-4bee-4c57-87cb-529f66bf5860 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 09:50:08 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:08 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:50:08 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 09:50:08 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f526103-0408-4640-bcb8-e209ed5afdf5]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:08 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-9b73e7f4-4bee-4c57-87cb-529f66bf5860 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 09:50:08 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-9b73e7f4-4bee-4c57-87cb-529f66bf5860 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 09:50:08 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-9b73e7f4-4bee-4c57-87cb-529f66bf5860 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 09:50:08 user nova-compute[71113]: DEBUG os_brick.utils [None req-9b73e7f4-4bee-4c57-87cb-529f66bf5860 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:50:08 user nova-compute[71113]: DEBUG nova.virt.block_device [None req-9b73e7f4-4bee-4c57-87cb-529f66bf5860 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Updating existing volume attachment record: 95855a1f-763c-46a7-9e1f-fcc328cdffc4 {{(pid=71113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 09:50:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-964d65fa-4f88-4332-b027-a38e480ec584 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Acquiring lock "0ea0401b-26c2-4655-956b-1bc000debd53" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:50:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-964d65fa-4f88-4332-b027-a38e480ec584 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "0ea0401b-26c2-4655-956b-1bc000debd53" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:50:09 user nova-compute[71113]: DEBUG nova.objects.instance [None req-964d65fa-4f88-4332-b027-a38e480ec584 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lazy-loading 'flavor' on Instance uuid 0ea0401b-26c2-4655-956b-1bc000debd53 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:50:09 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-964d65fa-4f88-4332-b027-a38e480ec584 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "0ea0401b-26c2-4655-956b-1bc000debd53" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:50:09 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-964d65fa-4f88-4332-b027-a38e480ec584 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Acquiring lock "0ea0401b-26c2-4655-956b-1bc000debd53" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:50:09 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-964d65fa-4f88-4332-b027-a38e480ec584 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "0ea0401b-26c2-4655-956b-1bc000debd53" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:50:09 user nova-compute[71113]: INFO nova.compute.manager [None req-964d65fa-4f88-4332-b027-a38e480ec584 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Attaching volume 61fe7a42-4e7b-4473-abe6-29802c3614be to /dev/vdb
Jul 31 09:50:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:09 user nova-compute[71113]: DEBUG os_brick.utils [None req-964d65fa-4f88-4332-b027-a38e480ec584 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:50:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:09 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0daf762c-3d5e-4195-84d0-8b18fa85886a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:09 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[34617b1b-b79d-4e8f-a0aa-71af3c8f2ca5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:09 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3f5a39-3552-4b03-a41a-5fe551eb7eff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:09 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f931603c-aac2-4a43-bb75-ca7ef1b524f3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-964d65fa-4f88-4332-b027-a38e480ec584 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-964d65fa-4f88-4332-b027-a38e480ec584 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:50:09 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-964d65fa-4f88-4332-b027-a38e480ec584 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 09:50:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:50:09 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 09:50:09 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[169d98b0-8ded-4fcd-b5d1-c82c0e2c2a80]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:09 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-964d65fa-4f88-4332-b027-a38e480ec584 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 09:50:09 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-964d65fa-4f88-4332-b027-a38e480ec584 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 09:50:09 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-964d65fa-4f88-4332-b027-a38e480ec584 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 09:50:09 user nova-compute[71113]: DEBUG os_brick.utils [None req-964d65fa-4f88-4332-b027-a38e480ec584 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:50:09 user nova-compute[71113]: DEBUG nova.virt.block_device [None req-964d65fa-4f88-4332-b027-a38e480ec584 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Updating existing volume attachment record: acf0d00d-b74a-444b-a4f9-9687f478225b {{(pid=71113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 09:50:09 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Updating instance_info_cache with network_info: [{"id": "647f984e-a9e3-4e49-9877-75ad4826e467", "address": "fa:16:3e:72:e2:f2", "network": {"id": "26352e29-fc15-48ac-be14-8af7a0c80219", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866093358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bae93d4fff5e4990bd9fe78e71d6d2d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647f984e-a9", "ovs_interfaceid": "647f984e-a9e3-4e49-9877-75ad4826e467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:50:09 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Releasing lock "refresh_cache-1112a49d-27bd-4fc8-bae6-ec1decbb47db" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:50:09 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Updated the network info_cache for instance {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 09:50:09 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:50:10 user nova-compute[71113]: DEBUG nova.compute.manager [req-117987ae-2bb9-4eb3-8912-f186eb3a1501 req-40d84eaa-89ac-4847-82ff-108aa7aaf3c5 service nova] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Received event network-changed-a9e62527-eba5-484a-9b2d-6ff8fdead8e9 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:50:10 user nova-compute[71113]: DEBUG nova.compute.manager [req-117987ae-2bb9-4eb3-8912-f186eb3a1501 req-40d84eaa-89ac-4847-82ff-108aa7aaf3c5 service nova] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Refreshing instance network info cache due to event network-changed-a9e62527-eba5-484a-9b2d-6ff8fdead8e9. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:50:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-117987ae-2bb9-4eb3-8912-f186eb3a1501 req-40d84eaa-89ac-4847-82ff-108aa7aaf3c5 service nova] Acquiring lock "refresh_cache-8d033eac-23ea-417a-981c-578328f1c3ac" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:50:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-117987ae-2bb9-4eb3-8912-f186eb3a1501 req-40d84eaa-89ac-4847-82ff-108aa7aaf3c5 service nova] Acquired lock "refresh_cache-8d033eac-23ea-417a-981c-578328f1c3ac" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:50:10 user nova-compute[71113]: DEBUG nova.network.neutron [req-117987ae-2bb9-4eb3-8912-f186eb3a1501 req-40d84eaa-89ac-4847-82ff-108aa7aaf3c5 service nova] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Refreshing network info cache for port a9e62527-eba5-484a-9b2d-6ff8fdead8e9 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:50:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-584dae72-2c59-49aa-a4eb-d29e1615d7c9 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Acquiring lock "8d033eac-23ea-417a-981c-578328f1c3ac" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:50:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-584dae72-2c59-49aa-a4eb-d29e1615d7c9 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "8d033eac-23ea-417a-981c-578328f1c3ac" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:50:10 user nova-compute[71113]: DEBUG nova.objects.instance [None req-584dae72-2c59-49aa-a4eb-d29e1615d7c9 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lazy-loading 'flavor' on Instance uuid 8d033eac-23ea-417a-981c-578328f1c3ac {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:50:10 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-584dae72-2c59-49aa-a4eb-d29e1615d7c9 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Ignoring supplied device name: /dev/vdb
Jul 31 09:50:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-584dae72-2c59-49aa-a4eb-d29e1615d7c9 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "8d033eac-23ea-417a-981c-578328f1c3ac" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:50:10 user nova-compute[71113]: DEBUG nova.network.neutron [req-117987ae-2bb9-4eb3-8912-f186eb3a1501 req-40d84eaa-89ac-4847-82ff-108aa7aaf3c5 service nova] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Updated VIF entry in instance network info cache for port a9e62527-eba5-484a-9b2d-6ff8fdead8e9. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:50:10 user nova-compute[71113]: DEBUG nova.network.neutron [req-117987ae-2bb9-4eb3-8912-f186eb3a1501 req-40d84eaa-89ac-4847-82ff-108aa7aaf3c5 service nova] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Updating instance_info_cache with network_info: [{"id": "a9e62527-eba5-484a-9b2d-6ff8fdead8e9", "address": "fa:16:3e:04:98:ca", "network": {"id": "2ce9c333-b413-4073-af8c-2e583872df61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1283872978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b02dfb26bc2472baef63892ab5b2492", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e62527-eb", "ovs_interfaceid": "a9e62527-eba5-484a-9b2d-6ff8fdead8e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:50:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-117987ae-2bb9-4eb3-8912-f186eb3a1501 req-40d84eaa-89ac-4847-82ff-108aa7aaf3c5 service nova] Releasing lock "refresh_cache-8d033eac-23ea-417a-981c-578328f1c3ac" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:50:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-584dae72-2c59-49aa-a4eb-d29e1615d7c9 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Acquiring lock "8d033eac-23ea-417a-981c-578328f1c3ac" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:50:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-584dae72-2c59-49aa-a4eb-d29e1615d7c9 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "8d033eac-23ea-417a-981c-578328f1c3ac" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:50:10 user nova-compute[71113]: INFO nova.compute.manager [None req-584dae72-2c59-49aa-a4eb-d29e1615d7c9 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Attaching volume a1d87956-535e-4821-88d6-6947e9c926a0 to /dev/vdb
Jul 31 09:50:10 user nova-compute[71113]: DEBUG os_brick.utils [None req-584dae72-2c59-49aa-a4eb-d29e1615d7c9 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:50:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:10 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[186662d0-703d-4367-8fe7-3fe0a7f8daa0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.027s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:10 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c374a1b-f054-4699-ac67-96fda123470c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:10 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d745c93-e94a-407f-bdc5-2c4de81933fd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:10 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd521ad7-71bd-45a8-a165-078575103600]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-584dae72-2c59-49aa-a4eb-d29e1615d7c9 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-584dae72-2c59-49aa-a4eb-d29e1615d7c9 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:50:10 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-584dae72-2c59-49aa-a4eb-d29e1615d7c9 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 09:50:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:50:11 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 09:50:11 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e29177d-6ec9-4fd8-991d-7b0223e7fccd]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:11 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-584dae72-2c59-49aa-a4eb-d29e1615d7c9 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 09:50:11 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-584dae72-2c59-49aa-a4eb-d29e1615d7c9 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 09:50:11 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-584dae72-2c59-49aa-a4eb-d29e1615d7c9 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 09:50:11 user nova-compute[71113]: DEBUG os_brick.utils [None req-584dae72-2c59-49aa-a4eb-d29e1615d7c9 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:50:11 user nova-compute[71113]: DEBUG nova.virt.block_device [None req-584dae72-2c59-49aa-a4eb-d29e1615d7c9 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Updating existing volume attachment record: e831c32a-0099-4957-a828-0d644ceceab7 {{(pid=71113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 09:50:13 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:16 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690797001.5028176, b324fed7-5df8-4ca1-9a5a-06eaffd5e101 => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:50:16 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] VM Stopped (Lifecycle Event)
Jul 31 09:50:16 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ed5ab394-2b9e-47cc-bce1-c761643e8f4e None None] [instance: b324fed7-5df8-4ca1-9a5a-06eaffd5e101] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:50:17 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-964d65fa-4f88-4332-b027-a38e480ec584 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 09:50:17 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-964d65fa-4f88-4332-b027-a38e480ec584 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HDmVwAzh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:50:17 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-964d65fa-4f88-4332-b027-a38e480ec584 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:50:17 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-964d65fa-4f88-4332-b027-a38e480ec584 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:50:17 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-964d65fa-4f88-4332-b027-a38e480ec584 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:50:17 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-964d65fa-4f88-4332-b027-a38e480ec584 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:50:17 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-964d65fa-4f88-4332-b027-a38e480ec584 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:50:17 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-964d65fa-4f88-4332-b027-a38e480ec584 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:50:17 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-964d65fa-4f88-4332-b027-a38e480ec584 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 09:50:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:17 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f951a80-66ef-4cf5-9724-e27f56d1ead0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:17 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-964d65fa-4f88-4332-b027-a38e480ec584 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 09:50:17 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:17 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb01734f-456b-4910-a2bc-fb61187e9bb1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:17 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-964d65fa-4f88-4332-b027-a38e480ec584 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be] added
Jul 31 09:50:17 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:17 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d315a033-4776-40c2-b305-dc911a60bb1e]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:17 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-964d65fa-4f88-4332-b027-a38e480ec584 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:17 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f934eb-7d9d-4a58-a39d-98e0612f847e]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:17 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-964d65fa-4f88-4332-b027-a38e480ec584 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HDmVwAzh {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HDmVwAzh" returned: 0 in 0.029s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:17 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0405aa4-3af5-492d-9ed6-2444e8c34b82]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:17 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-964d65fa-4f88-4332-b027-a38e480ec584 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HDmVwAzh'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:17 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcfabb40-75a1-49ba-8a23-909cbf39e9e4]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:17 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-964d65fa-4f88-4332-b027-a38e480ec584 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:17 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32e66b8-26f9-4033-9df5-054d3702d457]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:17 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-964d65fa-4f88-4332-b027-a38e480ec584 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:50:17 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:50:17 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-964d65fa-4f88-4332-b027-a38e480ec584 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:50:17 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:50:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:17 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf6c127-5839-4c08-bcfc-fcc7f7ffa05f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:17 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-964d65fa-4f88-4332-b027-a38e480ec584 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be, portal: 172.16.0.220,3260]
Jul 31 09:50:17 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be, portal: 172.16.0.220,3260] successful.
Jul 31 09:50:17 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:17 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0afbe1d0-91a4-4c46-a752-a91dccfc3a31]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:17 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-964d65fa-4f88-4332-b027-a38e480ec584 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:17 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d66c0f7-5a64-4c2d-8885-adafe5279334]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:17 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-964d65fa-4f88-4332-b027-a38e480ec584 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be (non-flash)
Jul 31 09:50:17 user nova-compute[71113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:50:17 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:50:17 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-964d65fa-4f88-4332-b027-a38e480ec584 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be (non-flash)
Jul 31 09:50:17 user nova-compute[71113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:50:17 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:50:17 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-964d65fa-4f88-4332-b027-a38e480ec584 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:50:17 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-964d65fa-4f88-4332-b027-a38e480ec584 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 09:50:17 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-964d65fa-4f88-4332-b027-a38e480ec584 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] HCTL ('33', '-', '-', 0) found on session 12 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 09:50:17 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-964d65fa-4f88-4332-b027-a38e480ec584 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 09:50:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:17 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[07acee7b-e87f-42e8-85de-0ea82613818b]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:17 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-964d65fa-4f88-4332-b027-a38e480ec584 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 09:50:17 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-964d65fa-4f88-4332-b027-a38e480ec584 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HDmVwAzh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 09:50:18 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:18 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-964d65fa-4f88-4332-b027-a38e480ec584 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:50:18 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-964d65fa-4f88-4332-b027-a38e480ec584 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '23932336161356265', 'path': '/dev/sdb'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:50:18 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-964d65fa-4f88-4332-b027-a38e480ec584 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932336161356265', 'path': '/dev/sdb'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 09:50:18 user nova-compute[71113]: DEBUG nova.objects.instance [None req-964d65fa-4f88-4332-b027-a38e480ec584 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lazy-loading 'flavor' on Instance uuid 0ea0401b-26c2-4655-956b-1bc000debd53 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:50:18 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-964d65fa-4f88-4332-b027-a38e480ec584 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 09:50:18 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:50:18 user nova-compute[71113]:   <source dev="/dev/sdb"/>
Jul 31 09:50:18 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 09:50:18 user nova-compute[71113]:   <serial>61fe7a42-4e7b-4473-abe6-29802c3614be</serial>
Jul 31 09:50:18 user nova-compute[71113]: </disk>
Jul 31 09:50:18 user nova-compute[71113]:  {{(pid=71113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 09:50:19 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-964d65fa-4f88-4332-b027-a38e480ec584 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:50:19 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-964d65fa-4f88-4332-b027-a38e480ec584 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:50:19 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-964d65fa-4f88-4332-b027-a38e480ec584 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] No VIF found with MAC fa:16:3e:77:a3:62, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 09:50:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-964d65fa-4f88-4332-b027-a38e480ec584 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "0ea0401b-26c2-4655-956b-1bc000debd53" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.937s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:50:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:20 user nova-compute[71113]: INFO nova.compute.manager [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Rebuilding instance
Jul 31 09:50:20 user nova-compute[71113]: DEBUG nova.objects.instance [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0ea0401b-26c2-4655-956b-1bc000debd53 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:50:20 user nova-compute[71113]: DEBUG nova.compute.manager [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:50:20 user nova-compute[71113]: DEBUG nova.objects.instance [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lazy-loading 'pci_requests' on Instance uuid 0ea0401b-26c2-4655-956b-1bc000debd53 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:50:20 user nova-compute[71113]: DEBUG nova.objects.instance [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ea0401b-26c2-4655-956b-1bc000debd53 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:50:20 user nova-compute[71113]: DEBUG nova.objects.instance [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lazy-loading 'resources' on Instance uuid 0ea0401b-26c2-4655-956b-1bc000debd53 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:50:20 user nova-compute[71113]: DEBUG nova.objects.instance [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lazy-loading 'migration_context' on Instance uuid 0ea0401b-26c2-4655-956b-1bc000debd53 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:50:20 user nova-compute[71113]: DEBUG nova.objects.instance [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71113) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Jul 31 09:50:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:21 user nova-compute[71113]: DEBUG nova.compute.manager [req-bf437420-7e43-4dae-877b-0b96034b4c8e req-e1741a88-28a4-4cfd-8775-621238218216 service nova] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Received event network-vif-unplugged-5408a169-bdde-42da-be35-24006f474bc6 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:50:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-bf437420-7e43-4dae-877b-0b96034b4c8e req-e1741a88-28a4-4cfd-8775-621238218216 service nova] Acquiring lock "0ea0401b-26c2-4655-956b-1bc000debd53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:50:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-bf437420-7e43-4dae-877b-0b96034b4c8e req-e1741a88-28a4-4cfd-8775-621238218216 service nova] Lock "0ea0401b-26c2-4655-956b-1bc000debd53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:50:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-bf437420-7e43-4dae-877b-0b96034b4c8e req-e1741a88-28a4-4cfd-8775-621238218216 service nova] Lock "0ea0401b-26c2-4655-956b-1bc000debd53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:50:21 user nova-compute[71113]: DEBUG nova.compute.manager [req-bf437420-7e43-4dae-877b-0b96034b4c8e req-e1741a88-28a4-4cfd-8775-621238218216 service nova] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] No waiting events found dispatching network-vif-unplugged-5408a169-bdde-42da-be35-24006f474bc6 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:50:21 user nova-compute[71113]: WARNING nova.compute.manager [req-bf437420-7e43-4dae-877b-0b96034b4c8e req-e1741a88-28a4-4cfd-8775-621238218216 service nova] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Received unexpected event network-vif-unplugged-5408a169-bdde-42da-be35-24006f474bc6 for instance with vm_state active and task_state rebuilding.
Jul 31 09:50:21 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Instance destroyed successfully.
Jul 31 09:50:21 user nova-compute[71113]: DEBUG nova.objects.instance [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lazy-loading 'flavor' on Instance uuid 1112a49d-27bd-4fc8-bae6-ec1decbb47db {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:50:21 user nova-compute[71113]: INFO nova.compute.manager [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Detaching volume 61fe7a42-4e7b-4473-abe6-29802c3614be
Jul 31 09:50:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Acquiring lock "refresh_cache-1112a49d-27bd-4fc8-bae6-ec1decbb47db" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:50:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Acquired lock "refresh_cache-1112a49d-27bd-4fc8-bae6-ec1decbb47db" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:50:21 user nova-compute[71113]: DEBUG nova.network.neutron [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 09:50:21 user nova-compute[71113]: DEBUG nova.objects.instance [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lazy-loading 'info_cache' on Instance uuid 1112a49d-27bd-4fc8-bae6-ec1decbb47db {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:50:21 user nova-compute[71113]: INFO nova.virt.block_device [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Attempting to driver detach volume 61fe7a42-4e7b-4473-abe6-29802c3614be from mountpoint /dev/vdb
Jul 31 09:50:21 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Attempting to detach device vdb from instance 0ea0401b-26c2-4655-956b-1bc000debd53 from the persistent domain config. {{(pid=71113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 09:50:21 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 09:50:21 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:50:21 user nova-compute[71113]:   <source dev="/dev/sdb"/>
Jul 31 09:50:21 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 09:50:21 user nova-compute[71113]:   <serial>61fe7a42-4e7b-4473-abe6-29802c3614be</serial>
Jul 31 09:50:21 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 09:50:21 user nova-compute[71113]: </disk>
Jul 31 09:50:21 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 09:50:21 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Successfully detached device vdb from instance 0ea0401b-26c2-4655-956b-1bc000debd53 from the persistent domain config.
Jul 31 09:50:21 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 09:50:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HDmVwAzh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:50:21 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 31 09:50:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:50:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:50:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 09:50:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:21 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6e24a2-3314-4952-b9d3-3dda4927af2c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:21 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7b5cf6-e0fc-4716-9f4f-b6ee43ce0a65]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be (non-flash)
Jul 31 09:50:21 user nova-compute[71113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:50:21 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:50:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be (non-flash)
Jul 31 09:50:21 user nova-compute[71113]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:50:21 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:50:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79117ab250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be'): ({'sdb'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 09:50:21 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Removing single pathed devices sdb {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 09:50:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:21 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac58cced-d996-435b-9a8b-b457caea66d5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:21 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ee97e1-1a71-4711-8c68-48521b4477de]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:21 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Flushing IO for device /dev/sdb {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 09:50:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:21 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ba1e58-6786-462d-8604-f814c74bb574]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:21 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 09:50:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:21 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[023012ce-fdd8-4ae9-b73e-cb010a578239]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:21 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 09:50:21 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] SCSI volumes sdb have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 09:50:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 09:50:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3600435f-9beb-42f5-8d6b-5c97bf99bac7]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[586e7413-b0d3-4564-b583-4ccb24f61c31]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be, portal: 172.16.0.220,3260]
Jul 31 09:50:22 user nova-compute[71113]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be, portal: 172.16.0.220,3260] successful.
Jul 31 09:50:22 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ab95a9-283b-4322-97e6-fbd5ff7519d7]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] <== disconnect_volume: return (313ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG nova.network.neutron [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Updating instance_info_cache with network_info: [{"id": "647f984e-a9e3-4e49-9877-75ad4826e467", "address": "fa:16:3e:72:e2:f2", "network": {"id": "26352e29-fc15-48ac-be14-8af7a0c80219", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866093358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bae93d4fff5e4990bd9fe78e71d6d2d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647f984e-a9", "ovs_interfaceid": "647f984e-a9e3-4e49-9877-75ad4826e467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Releasing lock "refresh_cache-1112a49d-27bd-4fc8-bae6-ec1decbb47db" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:50:22 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Instance destroyed successfully.
Jul 31 09:50:22 user nova-compute[71113]: DEBUG nova.objects.instance [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lazy-loading 'resources' on Instance uuid 1112a49d-27bd-4fc8-bae6-ec1decbb47db {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:46:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-945276604',display_name='tempest-AttachVolumeTestJSON-server-945276604',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-945276604',id=4,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrh1mBzVZxlJvQ7fNDAygLsv+THMZUpGRA7FK4egW/8+4V1WnWdx5N/BO7+Js/uDb74ZnuQwIBHV28KCkKnxQdjKa1wMXR+/Fwf+zqW2yRjgeNcXtlxa12OdQcYhwsVfQ==',key_name='tempest-keypair-1526222779',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:46:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='bae93d4fff5e4990bd9fe78e71d6d2d2',ramdisk_id='',reservation_id='r-l6z5atk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1230374483',owner_user_name='tempest-AttachVolumeTestJSON-1230374483-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:48:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07e8e7f9b62d452a88a29f333177c9d2',uuid=1112a49d-27bd-4fc8-bae6-ec1decbb47db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "647f984e-a9e3-4e49-9877-75ad4826e467", "address": "fa:16:3e:72:e2:f2", "network": {"id": "26352e29-fc15-48ac-be14-8af7a0c80219", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866093358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bae93d4fff5e4990bd9fe78e71d6d2d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647f984e-a9", "ovs_interfaceid": "647f984e-a9e3-4e49-9877-75ad4826e467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Converting VIF {"id": "647f984e-a9e3-4e49-9877-75ad4826e467", "address": "fa:16:3e:72:e2:f2", "network": {"id": "26352e29-fc15-48ac-be14-8af7a0c80219", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866093358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bae93d4fff5e4990bd9fe78e71d6d2d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647f984e-a9", "ovs_interfaceid": "647f984e-a9e3-4e49-9877-75ad4826e467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:e2:f2,bridge_name='br-int',has_traffic_filtering=True,id=647f984e-a9e3-4e49-9877-75ad4826e467,network=Network(26352e29-fc15-48ac-be14-8af7a0c80219),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap647f984e-a9') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG os_vif [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:e2:f2,bridge_name='br-int',has_traffic_filtering=True,id=647f984e-a9e3-4e49-9877-75ad4826e467,network=Network(26352e29-fc15-48ac-be14-8af7a0c80219),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap647f984e-a9') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap647f984e-a9, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:22 user nova-compute[71113]: INFO os_vif [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:e2:f2,bridge_name='br-int',has_traffic_filtering=True,id=647f984e-a9e3-4e49-9877-75ad4826e467,network=Network(26352e29-fc15-48ac-be14-8af7a0c80219),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap647f984e-a9')
Jul 31 09:50:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ogOtdHKG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:50:22 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:50:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7229face-4ddb-4dd2-96ea-b959362d493d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af2dfc4-a5c6-4cb8-9c3e-789ae225ab1d]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:50:22 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:50:22 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f78f07adfc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754'): ({'sde'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Removing single pathed devices sde {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c547f0ca-4344-4317-8e35-3b0124d296ce]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.026s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[757be1ff-d1b6-4054-a8e3-33f3e4ade86f]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Flushing IO for device /dev/sde {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7bbe3f-bc25-4e9d-950c-9f2d79d06332]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[10acd620-416c-40c4-8c66-d8a875f8b413]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] SCSI volumes sde have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[52052bc0-8b4e-4ec5-a6c0-4b374b8df3fb]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da7488f-ca38-4f37-baf3-a7f88301a844]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754, portal: 172.16.0.220,3260]
Jul 31 09:50:22 user nova-compute[71113]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754, portal: 172.16.0.220,3260] successful.
Jul 31 09:50:22 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7642c1dc-07fd-4ea5-a224-0e17b4635bb0]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] <== disconnect_volume: return (295ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Start _get_guest_xml network_info=[{"id": "647f984e-a9e3-4e49-9877-75ad4826e467", "address": "fa:16:3e:72:e2:f2", "network": {"id": "26352e29-fc15-48ac-be14-8af7a0c80219", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866093358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bae93d4fff5e4990bd9fe78e71d6d2d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647f984e-a9", "ovs_interfaceid": "647f984e-a9e3-4e49-9877-75ad4826e467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'image_id': '078646fe-b504-41ed-a147-61072e903e51'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '8daf51e2-3a7a-43ce-99e9-d0a033bd524f', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ogOtdHKG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '1112a49d-27bd-4fc8-bae6-ec1decbb47db', 'attached_at': '', 'detached_at': '', 'volume_id': '76f6fa14-9162-43ca-9631-6c09fc7f2754', 'serial': '76f6fa14-9162-43ca-9631-6c09fc7f2754'}, 'boot_index': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG nova.objects.instance [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lazy-loading 'numa_topology' on Instance uuid 1112a49d-27bd-4fc8-bae6-ec1decbb47db {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:50:22 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:50:22 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:50:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG nova.objects.instance [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1112a49d-27bd-4fc8-bae6-ec1decbb47db {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ogOtdHKG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:50:22 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:50:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:50:22 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:50:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:50:22 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b5cea3-5087-4fb0-a050-e18f3905d8f5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 09:50:22 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e07616-70bf-42aa-90d8-5aaabe2a5dcf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754] added
Jul 31 09:50:22 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c9d485-11e6-41c2-9cb4-1b19ebe3afc8]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e795cc-5615-42e8-a242-b64953c487d3]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ogOtdHKG {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ogOtdHKG" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3132af74-cdd5-42ae-8fe6-964a222fe951]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ogOtdHKG'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca88e4f1-0ce1-4697-b6e2-96268eb3eec8]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:22 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Instance destroyed successfully.
Jul 31 09:50:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:46:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-554499227',display_name='tempest-ServerActionsTestOtherA-server-682149866',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-554499227',id=2,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5EE1xUvLRoodLjDMpmYpiUOpJ4L9wfbpJsZ+HUVFxXJGKbpzcG8jQIKPQ0cQElq3F/Fhyr7R6+c9C8jzz21FzCpd/o9T+iI7W2nanWOzhB0iUhT1vp4Ko8/FdZGlABXg==',key_name='tempest-keypair-58057469',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:46:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9f7a5479fd014325b8790a80b2405d1d',ramdisk_id='',reservation_id='r-119yz4q0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2065923437',owner_user_name='tempest-ServerActionsTestOtherA-2065923437-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:50:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7029dd8d775d4c14bb349b72b1171d5f',uuid=0ea0401b-26c2-4655-956b-1bc000debd53,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5408a169-bdde-42da-be35-24006f474bc6", "address": "fa:16:3e:77:a3:62", "network": {"id": "cc84435f-b983-425d-bad0-36039e592e25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1662840158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f7a5479fd014325b8790a80b2405d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5408a169-bd", "ovs_interfaceid": "5408a169-bdde-42da-be35-24006f474bc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Converting VIF {"id": "5408a169-bdde-42da-be35-24006f474bc6", "address": "fa:16:3e:77:a3:62", "network": {"id": "cc84435f-b983-425d-bad0-36039e592e25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1662840158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f7a5479fd014325b8790a80b2405d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5408a169-bd", "ovs_interfaceid": "5408a169-bdde-42da-be35-24006f474bc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:a3:62,bridge_name='br-int',has_traffic_filtering=True,id=5408a169-bdde-42da-be35-24006f474bc6,network=Network(cc84435f-b983-425d-bad0-36039e592e25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5408a169-bd') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG os_vif [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:a3:62,bridge_name='br-int',has_traffic_filtering=True,id=5408a169-bdde-42da-be35-24006f474bc6,network=Network(cc84435f-b983-425d-bad0-36039e592e25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5408a169-bd') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5408a169-bd, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f207561c-f53e-484b-bade-ddb466a44baa]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 31 09:50:22 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 31 09:50:22 user nova-compute[71113]:  {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:50:22 user nova-compute[71113]: WARNING os_brick.initiator.connectors.iscsi [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 31 09:50:22 user nova-compute[71113]: 
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:22 user nova-compute[71113]: INFO os_vif [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:a3:62,bridge_name='br-int',has_traffic_filtering=True,id=5408a169-bdde-42da-be35-24006f474bc6,network=Network(cc84435f-b983-425d-bad0-36039e592e25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5408a169-bd')
Jul 31 09:50:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HDmVwAzh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:50:22 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 31 09:50:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f533878-126c-4f30-ab4d-3f4833d23858]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754, portal: 172.16.0.220,3260]
Jul 31 09:50:22 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754, portal: 172.16.0.220,3260] successful.
Jul 31 09:50:22 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a99e5be-c7a3-4139-98ff-4c34e51dcfc6]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:23 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:23 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be3f6d7-faac-4f52-9e7b-c6ab8c971495]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:23 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:50:23 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:50:23 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:50:23 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:50:23 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:50:23 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 09:50:23 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 09:50:23 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 09:50:23 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:23 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:23 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6894aca1-2a55-4136-b6cd-ea222ffec7bc]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:23 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 09:50:23 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ogOtdHKG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 09:50:23 user nova-compute[71113]: DEBUG nova.compute.manager [req-a1ac6a4c-d93e-472b-97ac-a60d2e1f6945 req-445bd5f9-2b02-42f5-bc22-10af2f25332f service nova] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Received event network-vif-plugged-5408a169-bdde-42da-be35-24006f474bc6 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:50:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-a1ac6a4c-d93e-472b-97ac-a60d2e1f6945 req-445bd5f9-2b02-42f5-bc22-10af2f25332f service nova] Acquiring lock "0ea0401b-26c2-4655-956b-1bc000debd53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:50:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-a1ac6a4c-d93e-472b-97ac-a60d2e1f6945 req-445bd5f9-2b02-42f5-bc22-10af2f25332f service nova] Lock "0ea0401b-26c2-4655-956b-1bc000debd53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:50:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-a1ac6a4c-d93e-472b-97ac-a60d2e1f6945 req-445bd5f9-2b02-42f5-bc22-10af2f25332f service nova] Lock "0ea0401b-26c2-4655-956b-1bc000debd53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:50:23 user nova-compute[71113]: DEBUG nova.compute.manager [req-a1ac6a4c-d93e-472b-97ac-a60d2e1f6945 req-445bd5f9-2b02-42f5-bc22-10af2f25332f service nova] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] No waiting events found dispatching network-vif-plugged-5408a169-bdde-42da-be35-24006f474bc6 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:50:23 user nova-compute[71113]: WARNING nova.compute.manager [req-a1ac6a4c-d93e-472b-97ac-a60d2e1f6945 req-445bd5f9-2b02-42f5-bc22-10af2f25332f service nova] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Received unexpected event network-vif-plugged-5408a169-bdde-42da-be35-24006f474bc6 for instance with vm_state active and task_state rebuilding.
Jul 31 09:50:23 user nova-compute[71113]: DEBUG nova.compute.manager [req-a1ac6a4c-d93e-472b-97ac-a60d2e1f6945 req-445bd5f9-2b02-42f5-bc22-10af2f25332f service nova] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Received event network-changed-e95375b7-8c89-4353-9ba9-0469792056dd {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:50:23 user nova-compute[71113]: DEBUG nova.compute.manager [req-a1ac6a4c-d93e-472b-97ac-a60d2e1f6945 req-445bd5f9-2b02-42f5-bc22-10af2f25332f service nova] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Refreshing instance network info cache due to event network-changed-e95375b7-8c89-4353-9ba9-0469792056dd. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:50:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-a1ac6a4c-d93e-472b-97ac-a60d2e1f6945 req-445bd5f9-2b02-42f5-bc22-10af2f25332f service nova] Acquiring lock "refresh_cache-9a4b47dd-b335-4c2f-9dee-5421357a0ee1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:50:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-a1ac6a4c-d93e-472b-97ac-a60d2e1f6945 req-445bd5f9-2b02-42f5-bc22-10af2f25332f service nova] Acquired lock "refresh_cache-9a4b47dd-b335-4c2f-9dee-5421357a0ee1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:50:23 user nova-compute[71113]: DEBUG nova.network.neutron [req-a1ac6a4c-d93e-472b-97ac-a60d2e1f6945 req-445bd5f9-2b02-42f5-bc22-10af2f25332f service nova] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Refreshing network info cache for port e95375b7-8c89-4353-9ba9-0469792056dd {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:50:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-e26f223c-c0af-4377-9056-fbf1be0a6d48 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Acquiring lock "9a4b47dd-b335-4c2f-9dee-5421357a0ee1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:50:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-e26f223c-c0af-4377-9056-fbf1be0a6d48 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "9a4b47dd-b335-4c2f-9dee-5421357a0ee1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:50:23 user nova-compute[71113]: DEBUG nova.objects.instance [None req-e26f223c-c0af-4377-9056-fbf1be0a6d48 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lazy-loading 'flavor' on Instance uuid 9a4b47dd-b335-4c2f-9dee-5421357a0ee1 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:50:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-e26f223c-c0af-4377-9056-fbf1be0a6d48 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "9a4b47dd-b335-4c2f-9dee-5421357a0ee1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:50:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-e26f223c-c0af-4377-9056-fbf1be0a6d48 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Acquiring lock "9a4b47dd-b335-4c2f-9dee-5421357a0ee1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:50:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-e26f223c-c0af-4377-9056-fbf1be0a6d48 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "9a4b47dd-b335-4c2f-9dee-5421357a0ee1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:50:23 user nova-compute[71113]: INFO nova.compute.manager [None req-e26f223c-c0af-4377-9056-fbf1be0a6d48 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Attaching volume 1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7 to /dev/vdb
Jul 31 09:50:23 user nova-compute[71113]: DEBUG os_brick.utils [None req-e26f223c-c0af-4377-9056-fbf1be0a6d48 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:50:23 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:23 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:23 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea4740a-f3f1-45f7-b171-0a38d7341ef8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:23 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:23 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:23 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbf898e-69f0-4ade-afbb-603ab12ba41d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:23 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:23 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:23 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da2ff4a-6384-41d5-a9db-d2889aca46a2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:23 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4e5d84-423a-41b0-b5d4-b583bf24f5f1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:23 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-e26f223c-c0af-4377-9056-fbf1be0a6d48 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:23 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-e26f223c-c0af-4377-9056-fbf1be0a6d48 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:50:23 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e26f223c-c0af-4377-9056-fbf1be0a6d48 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 09:50:23 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:23 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:50:23 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 09:50:23 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e491a4-1581-4d63-bddb-0ae105ef04ac]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:23 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-e26f223c-c0af-4377-9056-fbf1be0a6d48 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 09:50:23 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-e26f223c-c0af-4377-9056-fbf1be0a6d48 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 09:50:23 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-e26f223c-c0af-4377-9056-fbf1be0a6d48 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 09:50:23 user nova-compute[71113]: DEBUG os_brick.utils [None req-e26f223c-c0af-4377-9056-fbf1be0a6d48 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:50:23 user nova-compute[71113]: DEBUG nova.virt.block_device [None req-e26f223c-c0af-4377-9056-fbf1be0a6d48 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Updating existing volume attachment record: c10b4369-7b37-4ebf-aa6a-381d36217f9b {{(pid=71113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 09:50:23 user nova-compute[71113]: DEBUG nova.network.neutron [req-a1ac6a4c-d93e-472b-97ac-a60d2e1f6945 req-445bd5f9-2b02-42f5-bc22-10af2f25332f service nova] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Updated VIF entry in instance network info cache for port e95375b7-8c89-4353-9ba9-0469792056dd. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:50:23 user nova-compute[71113]: DEBUG nova.network.neutron [req-a1ac6a4c-d93e-472b-97ac-a60d2e1f6945 req-445bd5f9-2b02-42f5-bc22-10af2f25332f service nova] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Updating instance_info_cache with network_info: [{"id": "e95375b7-8c89-4353-9ba9-0469792056dd", "address": "fa:16:3e:16:25:0d", "network": {"id": "8c75ddf2-700c-4f01-b8cf-af57bdab7d37", "bridge": "br-int", "label": "tempest-TestStampPattern-1367141606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60e95a8fd2446d5bd5308f10caa6930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape95375b7-8c", "ovs_interfaceid": "e95375b7-8c89-4353-9ba9-0469792056dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:50:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-a1ac6a4c-d93e-472b-97ac-a60d2e1f6945 req-445bd5f9-2b02-42f5-bc22-10af2f25332f service nova] Releasing lock "refresh_cache-9a4b47dd-b335-4c2f-9dee-5421357a0ee1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:50:24 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:50:24 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '26662306533363038', 'path': '/dev/sdb'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:50:24 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662306533363038', 'path': '/dev/sdb'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 09:50:24 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.131s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:50:24 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 09:50:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:24 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3bf87ab-2778-4aa7-83bf-5d26ab2796a1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:24 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:46:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-945276604',display_name='tempest-AttachVolumeTestJSON-server-945276604',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-945276604',id=4,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrh1mBzVZxlJvQ7fNDAygLsv+THMZUpGRA7FK4egW/8+4V1WnWdx5N/BO7+Js/uDb74ZnuQwIBHV28KCkKnxQdjKa1wMXR+/Fwf+zqW2yRjgeNcXtlxa12OdQcYhwsVfQ==',key_name='tempest-keypair-1526222779',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:46:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='bae93d4fff5e4990bd9fe78e71d6d2d2',ramdisk_id='',reservation_id='r-l6z5atk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1230374483',owner_user_name='tempest-AttachVolumeTestJSON-1230374483-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:48:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07e8e7f9b62d452a88a29f333177c9d2',uuid=1112a49d-27bd-4fc8-bae6-ec1decbb47db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "647f984e-a9e3-4e49-9877-75ad4826e467", "address": "fa:16:3e:72:e2:f2", "network": {"id": "26352e29-fc15-48ac-be14-8af7a0c80219", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866093358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bae93d4fff5e4990bd9fe78e71d6d2d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647f984e-a9", "ovs_interfaceid": "647f984e-a9e3-4e49-9877-75ad4826e467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 09:50:24 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Converting VIF {"id": "647f984e-a9e3-4e49-9877-75ad4826e467", "address": "fa:16:3e:72:e2:f2", "network": {"id": "26352e29-fc15-48ac-be14-8af7a0c80219", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866093358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bae93d4fff5e4990bd9fe78e71d6d2d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647f984e-a9", "ovs_interfaceid": "647f984e-a9e3-4e49-9877-75ad4826e467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:50:24 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:e2:f2,bridge_name='br-int',has_traffic_filtering=True,id=647f984e-a9e3-4e49-9877-75ad4826e467,network=Network(26352e29-fc15-48ac-be14-8af7a0c80219),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap647f984e-a9') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:50:24 user nova-compute[71113]: DEBUG nova.objects.instance [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lazy-loading 'pci_devices' on Instance uuid 1112a49d-27bd-4fc8-bae6-ec1decbb47db {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:50:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:24 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20301e3-ccb3-489e-a6df-4d9019313bbe]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:24 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:50:24 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:50:24 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:50:24 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:50:24 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f790821dfc0>, {}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 09:50:24 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Disconnecting from: [] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 09:50:24 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.056s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:50:24 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] <== disconnect_volume: return (1188ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:50:24 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 09:50:24 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Deleting instance files /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53_del
Jul 31 09:50:24 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Deletion of /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53_del complete
Jul 31 09:50:24 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] End _get_guest_xml xml=<domain type="kvm">
Jul 31 09:50:24 user nova-compute[71113]:   <uuid>1112a49d-27bd-4fc8-bae6-ec1decbb47db</uuid>
Jul 31 09:50:24 user nova-compute[71113]:   <name>instance-00000004</name>
Jul 31 09:50:24 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 09:50:24 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 09:50:24 user nova-compute[71113]:   <metadata>
Jul 31 09:50:24 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 09:50:24 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 09:50:24 user nova-compute[71113]:       <nova:name>tempest-AttachVolumeTestJSON-server-945276604</nova:name>
Jul 31 09:50:24 user nova-compute[71113]:       <nova:creationTime>2023-07-31 09:50:22</nova:creationTime>
Jul 31 09:50:24 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 09:50:24 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 09:50:24 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 09:50:24 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 09:50:24 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 09:50:24 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 09:50:24 user nova-compute[71113]:       </nova:flavor>
Jul 31 09:50:24 user nova-compute[71113]:       <nova:owner>
Jul 31 09:50:24 user nova-compute[71113]:         <nova:user uuid="07e8e7f9b62d452a88a29f333177c9d2">tempest-AttachVolumeTestJSON-1230374483-project-member</nova:user>
Jul 31 09:50:24 user nova-compute[71113]:         <nova:project uuid="bae93d4fff5e4990bd9fe78e71d6d2d2">tempest-AttachVolumeTestJSON-1230374483</nova:project>
Jul 31 09:50:24 user nova-compute[71113]:       </nova:owner>
Jul 31 09:50:24 user nova-compute[71113]:       <nova:root type="image" uuid="078646fe-b504-41ed-a147-61072e903e51"/>
Jul 31 09:50:24 user nova-compute[71113]:       <nova:ports>
Jul 31 09:50:24 user nova-compute[71113]:         <nova:port uuid="647f984e-a9e3-4e49-9877-75ad4826e467">
Jul 31 09:50:24 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 31 09:50:24 user nova-compute[71113]:         </nova:port>
Jul 31 09:50:24 user nova-compute[71113]:       </nova:ports>
Jul 31 09:50:24 user nova-compute[71113]:     </nova:instance>
Jul 31 09:50:24 user nova-compute[71113]:   </metadata>
Jul 31 09:50:24 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 09:50:24 user nova-compute[71113]:     <system>
Jul 31 09:50:24 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 09:50:24 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 09:50:24 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 09:50:24 user nova-compute[71113]:       <entry name="serial">1112a49d-27bd-4fc8-bae6-ec1decbb47db</entry>
Jul 31 09:50:24 user nova-compute[71113]:       <entry name="uuid">1112a49d-27bd-4fc8-bae6-ec1decbb47db</entry>
Jul 31 09:50:24 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 09:50:24 user nova-compute[71113]:     </system>
Jul 31 09:50:24 user nova-compute[71113]:   </sysinfo>
Jul 31 09:50:24 user nova-compute[71113]:   <os>
Jul 31 09:50:24 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 09:50:24 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 09:50:24 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 09:50:24 user nova-compute[71113]:   </os>
Jul 31 09:50:24 user nova-compute[71113]:   <features>
Jul 31 09:50:24 user nova-compute[71113]:     <acpi/>
Jul 31 09:50:24 user nova-compute[71113]:     <apic/>
Jul 31 09:50:24 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 09:50:24 user nova-compute[71113]:   </features>
Jul 31 09:50:24 user nova-compute[71113]:   <clock offset="utc">
Jul 31 09:50:24 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 09:50:24 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 09:50:24 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 09:50:24 user nova-compute[71113]:   </clock>
Jul 31 09:50:24 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 09:50:24 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 09:50:24 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 09:50:24 user nova-compute[71113]:   </cpu>
Jul 31 09:50:24 user nova-compute[71113]:   <devices>
Jul 31 09:50:24 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 09:50:24 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 09:50:24 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk"/>
Jul 31 09:50:24 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 09:50:24 user nova-compute[71113]:     </disk>
Jul 31 09:50:24 user nova-compute[71113]:     <disk type="block" device="disk">
Jul 31 09:50:24 user nova-compute[71113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:50:24 user nova-compute[71113]:       <source dev="/dev/sdb"/>
Jul 31 09:50:24 user nova-compute[71113]:       <target dev="vdb" bus="virtio"/>
Jul 31 09:50:24 user nova-compute[71113]:       <serial>76f6fa14-9162-43ca-9631-6c09fc7f2754</serial>
Jul 31 09:50:24 user nova-compute[71113]:     </disk>
Jul 31 09:50:24 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 09:50:24 user nova-compute[71113]:       <mac address="fa:16:3e:72:e2:f2"/>
Jul 31 09:50:24 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:50:24 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 09:50:24 user nova-compute[71113]:       <target dev="tap647f984e-a9"/>
Jul 31 09:50:24 user nova-compute[71113]:     </interface>
Jul 31 09:50:24 user nova-compute[71113]:     <serial type="pty">
Jul 31 09:50:24 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/console.log" append="off"/>
Jul 31 09:50:24 user nova-compute[71113]:     </serial>
Jul 31 09:50:24 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 09:50:24 user nova-compute[71113]:     <video>
Jul 31 09:50:24 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:50:24 user nova-compute[71113]:     </video>
Jul 31 09:50:24 user nova-compute[71113]:     <rng model="virtio">
Jul 31 09:50:24 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 09:50:24 user nova-compute[71113]:     </rng>
Jul 31 09:50:24 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 09:50:24 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 09:50:24 user nova-compute[71113]:       <stats period="10"/>
Jul 31 09:50:24 user nova-compute[71113]:     </memballoon>
Jul 31 09:50:24 user nova-compute[71113]:   </devices>
Jul 31 09:50:24 user nova-compute[71113]: </domain>
Jul 31 09:50:24 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 09:50:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:24 user nova-compute[71113]: INFO nova.virt.block_device [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Booting with volume 61fe7a42-4e7b-4473-abe6-29802c3614be at /dev/vdb
Jul 31 09:50:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:24 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 09:50:24 user nova-compute[71113]: DEBUG nova.objects.instance [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1112a49d-27bd-4fc8-bae6-ec1decbb47db {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:50:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.146s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:24 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk. size=1073741824 {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 09:50:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:24 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Cannot resize image /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk to a smaller size. {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 09:50:24 user nova-compute[71113]: DEBUG nova.objects.instance [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lazy-loading 'migration_context' on Instance uuid 1112a49d-27bd-4fc8-bae6-ec1decbb47db {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:50:24 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:46:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-945276604',display_name='tempest-AttachVolumeTestJSON-server-945276604',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-945276604',id=4,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrh1mBzVZxlJvQ7fNDAygLsv+THMZUpGRA7FK4egW/8+4V1WnWdx5N/BO7+Js/uDb74ZnuQwIBHV28KCkKnxQdjKa1wMXR+/Fwf+zqW2yRjgeNcXtlxa12OdQcYhwsVfQ==',key_name='tempest-keypair-1526222779',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:46:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='bae93d4fff5e4990bd9fe78e71d6d2d2',ramdisk_id='',reservation_id='r-l6z5atk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1230374483',owner_user_name='tempest-AttachVolumeTestJSON-1230374483-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:48:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07e8e7f9b62d452a88a29f333177c9d2',uuid=1112a49d-27bd-4fc8-bae6-ec1decbb47db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "647f984e-a9e3-4e49-9877-75ad4826e467", "address": "fa:16:3e:72:e2:f2", "network": {"id": "26352e29-fc15-48ac-be14-8af7a0c80219", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866093358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bae93d4fff5e4990bd9fe78e71d6d2d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647f984e-a9", "ovs_interfaceid": "647f984e-a9e3-4e49-9877-75ad4826e467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 09:50:24 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Converting VIF {"id": "647f984e-a9e3-4e49-9877-75ad4826e467", "address": "fa:16:3e:72:e2:f2", "network": {"id": "26352e29-fc15-48ac-be14-8af7a0c80219", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866093358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bae93d4fff5e4990bd9fe78e71d6d2d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647f984e-a9", "ovs_interfaceid": "647f984e-a9e3-4e49-9877-75ad4826e467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:50:24 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:e2:f2,bridge_name='br-int',has_traffic_filtering=True,id=647f984e-a9e3-4e49-9877-75ad4826e467,network=Network(26352e29-fc15-48ac-be14-8af7a0c80219),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap647f984e-a9') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:50:24 user nova-compute[71113]: DEBUG os_vif [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:e2:f2,bridge_name='br-int',has_traffic_filtering=True,id=647f984e-a9e3-4e49-9877-75ad4826e467,network=Network(26352e29-fc15-48ac-be14-8af7a0c80219),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap647f984e-a9') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 09:50:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:50:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 09:50:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap647f984e-a9, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:50:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap647f984e-a9, col_values=(('external_ids', {'iface-id': '647f984e-a9e3-4e49-9877-75ad4826e467', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:e2:f2', 'vm-uuid': '1112a49d-27bd-4fc8-bae6-ec1decbb47db'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:50:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:50:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:24 user nova-compute[71113]: INFO os_vif [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:e2:f2,bridge_name='br-int',has_traffic_filtering=True,id=647f984e-a9e3-4e49-9877-75ad4826e467,network=Network(26352e29-fc15-48ac-be14-8af7a0c80219),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap647f984e-a9')
Jul 31 09:50:25 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b73e7f4-4bee-4c57-87cb-529f66bf5860 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b73e7f4-4bee-4c57-87cb-529f66bf5860 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FGERQMJC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:50:25 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-9b73e7f4-4bee-4c57-87cb-529f66bf5860 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:50:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-9b73e7f4-4bee-4c57-87cb-529f66bf5860 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-9b73e7f4-4bee-4c57-87cb-529f66bf5860 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:50:25 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-9b73e7f4-4bee-4c57-87cb-529f66bf5860 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:50:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-9b73e7f4-4bee-4c57-87cb-529f66bf5860 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-9b73e7f4-4bee-4c57-87cb-529f66bf5860 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:50:25 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-9b73e7f4-4bee-4c57-87cb-529f66bf5860 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 09:50:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09dbb72-1913-4335-b368-282655b23075]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b73e7f4-4bee-4c57-87cb-529f66bf5860 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 09:50:25 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[db913a15-12e7-4c7d-a937-0a6a07f03b14]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b73e7f4-4bee-4c57-87cb-529f66bf5860 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c] added
Jul 31 09:50:25 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ab2eb7-a7a0-4cbd-a01b-27b318397462]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b73e7f4-4bee-4c57-87cb-529f66bf5860 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a42bf57-5af3-4734-ba2c-a5f2c0e409ff]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b73e7f4-4bee-4c57-87cb-529f66bf5860 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FGERQMJC {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FGERQMJC" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[10345670-b7be-4af9-a360-5e0dfb15623c]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b73e7f4-4bee-4c57-87cb-529f66bf5860 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FGERQMJC'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-584dae72-2c59-49aa-a4eb-d29e1615d7c9 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-584dae72-2c59-49aa-a4eb-d29e1615d7c9 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oOVGxhdF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:50:25 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-584dae72-2c59-49aa-a4eb-d29e1615d7c9 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:50:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-584dae72-2c59-49aa-a4eb-d29e1615d7c9 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.035s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5acaa8f0-912d-4035-83ae-9bc449691861]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b73e7f4-4bee-4c57-87cb-529f66bf5860 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG os_brick.utils [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccc2411-b281-4792-8624-8ea226301cf9]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b73e7f4-4bee-4c57-87cb-529f66bf5860 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:50:25 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b73e7f4-4bee-4c57-87cb-529f66bf5860 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:50:25 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eea401d-4495-4d0a-90be-5041c1829a25]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[31032593-3c3d-4f07-a57b-3591a1166e85]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf7fe2d-1180-4b64-8805-2a4626a84068]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb4ae94-54d1-4cbd-a2ae-8f27a52a9ba1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb60483-a602-4c05-ad09-eacb1ccf336b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b73e7f4-4bee-4c57-87cb-529f66bf5860 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c, portal: 172.16.0.220,3260]
Jul 31 09:50:25 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c, portal: 172.16.0.220,3260] successful.
Jul 31 09:50:25 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:50:25 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 09:50:25 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ddbdac-fb73-49ef-89f1-794f57fc2723]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c3a807-ccb2-42a0-9e22-19203cc9d245]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b73e7f4-4bee-4c57-87cb-529f66bf5860 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG os_brick.utils [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG nova.virt.block_device [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Updating existing volume attachment record: 7986d5fe-ef90-43fa-91d9-597c27ce7504 {{(pid=71113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e3240c-a54c-4069-8077-a179b94af449]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b73e7f4-4bee-4c57-87cb-529f66bf5860 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:50:25 user nova-compute[71113]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:50:25 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b73e7f4-4bee-4c57-87cb-529f66bf5860 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:50:25 user nova-compute[71113]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:50:25 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-9b73e7f4-4bee-4c57-87cb-529f66bf5860 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.377s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b73e7f4-4bee-4c57-87cb-529f66bf5860 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-9b73e7f4-4bee-4c57-87cb-529f66bf5860 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-9b73e7f4-4bee-4c57-87cb-529f66bf5860 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.026s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac4b91e-afe7-4ed6-816c-ca9dff2fbb1e]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-9b73e7f4-4bee-4c57-87cb-529f66bf5860 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 09:50:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b73e7f4-4bee-4c57-87cb-529f66bf5860 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FGERQMJC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-9b73e7f4-4bee-4c57-87cb-529f66bf5860 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.421s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b73e7f4-4bee-4c57-87cb-529f66bf5860 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] <== connect_volume: return (1423ms) {'type': 'block', 'scsi_wwn': '23236323632636636', 'path': '/dev/sdc'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b73e7f4-4bee-4c57-87cb-529f66bf5860 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236323632636636', 'path': '/dev/sdc'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-584dae72-2c59-49aa-a4eb-d29e1615d7c9 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.265s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:50:26 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-584dae72-2c59-49aa-a4eb-d29e1615d7c9 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:50:26 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-584dae72-2c59-49aa-a4eb-d29e1615d7c9 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-584dae72-2c59-49aa-a4eb-d29e1615d7c9 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:50:26 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-584dae72-2c59-49aa-a4eb-d29e1615d7c9 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 09:50:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0 -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG nova.objects.instance [None req-9b73e7f4-4bee-4c57-87cb-529f66bf5860 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lazy-loading 'flavor' on Instance uuid efa311a0-fe2e-4c0f-af66-09c3eb38fbf1 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b07eb7-bec0-449b-a493-dbfda86003e3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-584dae72-2c59-49aa-a4eb-d29e1615d7c9 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 09:50:26 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0 -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-9b73e7f4-4bee-4c57-87cb-529f66bf5860 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 09:50:26 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:50:26 user nova-compute[71113]:   <source dev="/dev/sdc"/>
Jul 31 09:50:26 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 09:50:26 user nova-compute[71113]:   <serial>dc7c0a40-0540-43ec-8a1d-7dd80d222f2c</serial>
Jul 31 09:50:26 user nova-compute[71113]: </disk>
Jul 31 09:50:26 user nova-compute[71113]:  {{(pid=71113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba2005d-3c18-4a4c-aa30-8ff06c28f391]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-584dae72-2c59-49aa-a4eb-d29e1615d7c9 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0] added
Jul 31 09:50:26 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG nova.compute.manager [req-ef38b971-e6b6-4e59-a8ba-b0fa3ca77e38 req-60df2d2a-7444-4a9e-997f-1264450623e4 service nova] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Received event network-vif-plugged-647f984e-a9e3-4e49-9877-75ad4826e467 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ef38b971-e6b6-4e59-a8ba-b0fa3ca77e38 req-60df2d2a-7444-4a9e-997f-1264450623e4 service nova] Acquiring lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ef38b971-e6b6-4e59-a8ba-b0fa3ca77e38 req-60df2d2a-7444-4a9e-997f-1264450623e4 service nova] Lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ef38b971-e6b6-4e59-a8ba-b0fa3ca77e38 req-60df2d2a-7444-4a9e-997f-1264450623e4 service nova] Lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG nova.compute.manager [req-ef38b971-e6b6-4e59-a8ba-b0fa3ca77e38 req-60df2d2a-7444-4a9e-997f-1264450623e4 service nova] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] No waiting events found dispatching network-vif-plugged-647f984e-a9e3-4e49-9877-75ad4826e467 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:50:26 user nova-compute[71113]: WARNING nova.compute.manager [req-ef38b971-e6b6-4e59-a8ba-b0fa3ca77e38 req-60df2d2a-7444-4a9e-997f-1264450623e4 service nova] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Received unexpected event network-vif-plugged-647f984e-a9e3-4e49-9877-75ad4826e467 for instance with vm_state stopped and task_state powering-on.
Jul 31 09:50:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc75c356-6fdd-4607-bb7c-477f7f9bae86]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-584dae72-2c59-49aa-a4eb-d29e1615d7c9 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3913f4c1-4b88-4ef2-a0bd-ab380b6c4e5c]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-584dae72-2c59-49aa-a4eb-d29e1615d7c9 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oOVGxhdF {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oOVGxhdF" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6b25ce-75b9-46fc-a9d8-81d59268d1a2]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-584dae72-2c59-49aa-a4eb-d29e1615d7c9 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oOVGxhdF'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5e99b9-a17e-436e-8c94-f10c480dd15e]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-584dae72-2c59-49aa-a4eb-d29e1615d7c9 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cae352c-efe4-4900-8ba8-1a2aa5bb71cd]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-584dae72-2c59-49aa-a4eb-d29e1615d7c9 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:50:26 user nova-compute[71113]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:50:26 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-584dae72-2c59-49aa-a4eb-d29e1615d7c9 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:50:26 user nova-compute[71113]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:50:26 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0 -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e91f47-1d71-45c8-b487-6839eb02b326]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-584dae72-2c59-49aa-a4eb-d29e1615d7c9 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0, portal: 172.16.0.220,3260]
Jul 31 09:50:26 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0, portal: 172.16.0.220,3260] successful.
Jul 31 09:50:26 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f972d843-28ae-48ad-9ee0-0d566d5b1a54]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-584dae72-2c59-49aa-a4eb-d29e1615d7c9 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cae6c32-97f9-4a06-a93a-aaf74b359d29]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-584dae72-2c59-49aa-a4eb-d29e1615d7c9 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:50:26 user nova-compute[71113]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:50:26 user nova-compute[71113]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0 (non-flash)
Jul 31 09:50:26 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-584dae72-2c59-49aa-a4eb-d29e1615d7c9 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:50:26 user nova-compute[71113]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:50:26 user nova-compute[71113]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0 (non-flash)
Jul 31 09:50:26 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-584dae72-2c59-49aa-a4eb-d29e1615d7c9 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-584dae72-2c59-49aa-a4eb-d29e1615d7c9 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-584dae72-2c59-49aa-a4eb-d29e1615d7c9 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] HCTL ('35', '-', '-', 0) found on session 15 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-584dae72-2c59-49aa-a4eb-d29e1615d7c9 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c9fb15-9a89-4123-97b5-323d9b4ebbcf]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-584dae72-2c59-49aa-a4eb-d29e1615d7c9 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Searching for a device in session 15 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-584dae72-2c59-49aa-a4eb-d29e1615d7c9 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oOVGxhdF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:27 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-9b73e7f4-4bee-4c57-87cb-529f66bf5860 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:50:27 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-9b73e7f4-4bee-4c57-87cb-529f66bf5860 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:50:27 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-9b73e7f4-4bee-4c57-87cb-529f66bf5860 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] No VIF found with MAC fa:16:3e:16:bb:aa, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 09:50:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9b73e7f4-4bee-4c57-87cb-529f66bf5860 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.467s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:50:27 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-584dae72-2c59-49aa-a4eb-d29e1615d7c9 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:50:27 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-584dae72-2c59-49aa-a4eb-d29e1615d7c9 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] <== connect_volume: return (2620ms) {'type': 'block', 'scsi_wwn': '23036393065633431', 'path': '/dev/sdd'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:50:27 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-584dae72-2c59-49aa-a4eb-d29e1615d7c9 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036393065633431', 'path': '/dev/sdd'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 09:50:27 user nova-compute[71113]: DEBUG nova.objects.instance [None req-584dae72-2c59-49aa-a4eb-d29e1615d7c9 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lazy-loading 'flavor' on Instance uuid 8d033eac-23ea-417a-981c-578328f1c3ac {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:50:27 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-584dae72-2c59-49aa-a4eb-d29e1615d7c9 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 09:50:27 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:50:27 user nova-compute[71113]:   <source dev="/dev/sdd"/>
Jul 31 09:50:27 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 09:50:27 user nova-compute[71113]:   <serial>a1d87956-535e-4821-88d6-6947e9c926a0</serial>
Jul 31 09:50:27 user nova-compute[71113]: </disk>
Jul 31 09:50:27 user nova-compute[71113]:  {{(pid=71113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 09:50:28 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-584dae72-2c59-49aa-a4eb-d29e1615d7c9 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:50:28 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-584dae72-2c59-49aa-a4eb-d29e1615d7c9 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:50:28 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-584dae72-2c59-49aa-a4eb-d29e1615d7c9 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] No VIF found with MAC fa:16:3e:04:98:ca, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 09:50:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-584dae72-2c59-49aa-a4eb-d29e1615d7c9 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "8d033eac-23ea-417a-981c-578328f1c3ac" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.749s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:50:28 user nova-compute[71113]: DEBUG nova.compute.manager [req-56d51cc8-46ac-4820-9bce-3a90aa98d4d6 req-cbb21abe-9023-44ef-90b1-cb6a579218ca service nova] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Received event network-vif-plugged-647f984e-a9e3-4e49-9877-75ad4826e467 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:50:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-56d51cc8-46ac-4820-9bce-3a90aa98d4d6 req-cbb21abe-9023-44ef-90b1-cb6a579218ca service nova] Acquiring lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:50:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-56d51cc8-46ac-4820-9bce-3a90aa98d4d6 req-cbb21abe-9023-44ef-90b1-cb6a579218ca service nova] Lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:50:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-56d51cc8-46ac-4820-9bce-3a90aa98d4d6 req-cbb21abe-9023-44ef-90b1-cb6a579218ca service nova] Lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:50:28 user nova-compute[71113]: DEBUG nova.compute.manager [req-56d51cc8-46ac-4820-9bce-3a90aa98d4d6 req-cbb21abe-9023-44ef-90b1-cb6a579218ca service nova] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] No waiting events found dispatching network-vif-plugged-647f984e-a9e3-4e49-9877-75ad4826e467 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:50:28 user nova-compute[71113]: WARNING nova.compute.manager [req-56d51cc8-46ac-4820-9bce-3a90aa98d4d6 req-cbb21abe-9023-44ef-90b1-cb6a579218ca service nova] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Received unexpected event network-vif-plugged-647f984e-a9e3-4e49-9877-75ad4826e467 for instance with vm_state stopped and task_state powering-on.
Jul 31 09:50:28 user nova-compute[71113]: DEBUG nova.compute.manager [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Stashing vm_state: active {{(pid=71113) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Jul 31 09:50:29 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797029.0148118, 1112a49d-27bd-4fc8-bae6-ec1decbb47db => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:50:29 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] VM Resumed (Lifecycle Event)
Jul 31 09:50:29 user nova-compute[71113]: DEBUG nova.compute.manager [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 09:50:29 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Instance rebooted successfully.
Jul 31 09:50:29 user nova-compute[71113]: DEBUG nova.compute.manager [None req-b9595efb-4b0c-4897-9e82-77b576599263 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:50:29 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:50:29 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:50:29 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] During sync_power_state the instance has a pending task (powering-on). Skip.
Jul 31 09:50:29 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797029.0150275, 1112a49d-27bd-4fc8-bae6-ec1decbb47db => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:50:29 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] VM Started (Lifecycle Event)
Jul 31 09:50:29 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:50:29 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:50:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:50:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:50:29 user nova-compute[71113]: DEBUG nova.objects.instance [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lazy-loading 'pci_requests' on Instance uuid efa311a0-fe2e-4c0f-af66-09c3eb38fbf1 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:50:29 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 09:50:29 user nova-compute[71113]: INFO nova.compute.claims [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Claim successful on node user
Jul 31 09:50:29 user nova-compute[71113]: DEBUG nova.objects.instance [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lazy-loading 'resources' on Instance uuid efa311a0-fe2e-4c0f-af66-09c3eb38fbf1 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:50:29 user nova-compute[71113]: DEBUG nova.objects.instance [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lazy-loading 'pci_devices' on Instance uuid efa311a0-fe2e-4c0f-af66-09c3eb38fbf1 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:50:29 user nova-compute[71113]: INFO nova.compute.resource_tracker [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Updating resource usage from migration dfc38b1b-b9d8-47ae-afa0-33da541a44c8
Jul 31 09:50:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:29 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:50:29 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:50:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.516s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:50:29 user nova-compute[71113]: INFO nova.compute.manager [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Migrating
Jul 31 09:50:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:50:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Acquired lock "compute-rpcapi-router" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:50:29 user nova-compute[71113]: INFO nova.compute.rpcapi [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Jul 31 09:50:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Releasing lock "compute-rpcapi-router" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:50:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Acquiring lock "refresh_cache-efa311a0-fe2e-4c0f-af66-09c3eb38fbf1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:50:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Acquired lock "refresh_cache-efa311a0-fe2e-4c0f-af66-09c3eb38fbf1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:50:29 user nova-compute[71113]: DEBUG nova.network.neutron [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 09:50:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:30 user nova-compute[71113]: DEBUG nova.network.neutron [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Updating instance_info_cache with network_info: [{"id": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "address": "fa:16:3e:16:bb:aa", "network": {"id": "4f2ea02a-9b26-4f2a-af23-39c060703ff3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-725518740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5bb5c0790e54702b881dc5e45641be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b5a493-47", "ovs_interfaceid": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:50:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Releasing lock "refresh_cache-efa311a0-fe2e-4c0f-af66-09c3eb38fbf1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:50:31 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Starting migrate_disk_and_power_off {{(pid=71113) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Jul 31 09:50:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:31 user nova-compute[71113]: DEBUG nova.compute.manager [req-c9bf8195-33bf-4a93-9cc6-34c668ba1fc4 req-bfcf7081-9bf1-4f92-9298-daacad02fb03 service nova] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Received event network-vif-unplugged-39b5a493-47bd-4599-9a9f-bb80c93fb332 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:50:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-c9bf8195-33bf-4a93-9cc6-34c668ba1fc4 req-bfcf7081-9bf1-4f92-9298-daacad02fb03 service nova] Acquiring lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:50:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-c9bf8195-33bf-4a93-9cc6-34c668ba1fc4 req-bfcf7081-9bf1-4f92-9298-daacad02fb03 service nova] Lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:50:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-c9bf8195-33bf-4a93-9cc6-34c668ba1fc4 req-bfcf7081-9bf1-4f92-9298-daacad02fb03 service nova] Lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:50:31 user nova-compute[71113]: DEBUG nova.compute.manager [req-c9bf8195-33bf-4a93-9cc6-34c668ba1fc4 req-bfcf7081-9bf1-4f92-9298-daacad02fb03 service nova] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] No waiting events found dispatching network-vif-unplugged-39b5a493-47bd-4599-9a9f-bb80c93fb332 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:50:31 user nova-compute[71113]: WARNING nova.compute.manager [req-c9bf8195-33bf-4a93-9cc6-34c668ba1fc4 req-bfcf7081-9bf1-4f92-9298-daacad02fb03 service nova] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Received unexpected event network-vif-unplugged-39b5a493-47bd-4599-9a9f-bb80c93fb332 for instance with vm_state active and task_state resize_migrating.
Jul 31 09:50:31 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e26f223c-c0af-4377-9056-fbf1be0a6d48 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 09:50:31 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f223c-c0af-4377-9056-fbf1be0a6d48 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WYQKoxNw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:50:31 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-e26f223c-c0af-4377-9056-fbf1be0a6d48 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:50:31 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-e26f223c-c0af-4377-9056-fbf1be0a6d48 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:50:31 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-e26f223c-c0af-4377-9056-fbf1be0a6d48 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:50:31 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-e26f223c-c0af-4377-9056-fbf1be0a6d48 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:50:31 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-e26f223c-c0af-4377-9056-fbf1be0a6d48 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:50:31 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-e26f223c-c0af-4377-9056-fbf1be0a6d48 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:50:32 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-e26f223c-c0af-4377-9056-fbf1be0a6d48 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 09:50:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7 -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[04389768-ad9a-4ce4-be7a-9e53ec371b57]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f223c-c0af-4377-9056-fbf1be0a6d48 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 09:50:32 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7 -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b0a286-230d-4599-8087-edc0a04baa07]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f223c-c0af-4377-9056-fbf1be0a6d48 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7] added
Jul 31 09:50:32 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:32 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Instance destroyed successfully.
Jul 31 09:50:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:46:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1025510923',display_name='tempest-ServerActionsTestOtherB-server-1025510923',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1025510923',id=3,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJo+xi4tu0GGLLf+2/4AMwJN8W9HV5KOFul5csHl5tHCHdJymtchsdGYmiKLfCyzN953/rO7ubVJnctaNhLzLpYKjY5Z2Nn1cEvYAzU5x1ZT5edLumoNfJjhx0wRkZgiEQ==',key_name='tempest-keypair-947034726',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:46:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a5bb5c0790e54702b881dc5e45641be8',ramdisk_id='',reservation_id='r-o5vysyfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1778056817',owner_user_name='tempest-ServerActionsTestOtherB-1778056817-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:50:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b5f449e8b1948cf914daef537aea164',uuid=efa311a0-fe2e-4c0f-af66-09c3eb38fbf1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "address": "fa:16:3e:16:bb:aa", "network": {"id": "4f2ea02a-9b26-4f2a-af23-39c060703ff3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-725518740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-725518740-network", "vif_mac": "fa:16:3e:16:bb:aa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5bb5c0790e54702b881dc5e45641be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b5a493-47", "ovs_interfaceid": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Converting VIF {"id": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "address": "fa:16:3e:16:bb:aa", "network": {"id": "4f2ea02a-9b26-4f2a-af23-39c060703ff3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-725518740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-725518740-network", "vif_mac": "fa:16:3e:16:bb:aa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5bb5c0790e54702b881dc5e45641be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b5a493-47", "ovs_interfaceid": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:bb:aa,bridge_name='br-int',has_traffic_filtering=True,id=39b5a493-47bd-4599-9a9f-bb80c93fb332,network=Network(4f2ea02a-9b26-4f2a-af23-39c060703ff3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39b5a493-47') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG os_vif [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:bb:aa,bridge_name='br-int',has_traffic_filtering=True,id=39b5a493-47bd-4599-9a9f-bb80c93fb332,network=Network(4f2ea02a-9b26-4f2a-af23-39c060703ff3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39b5a493-47') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap39b5a493-47, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:32 user nova-compute[71113]: INFO os_vif [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:bb:aa,bridge_name='br-int',has_traffic_filtering=True,id=39b5a493-47bd-4599-9a9f-bb80c93fb332,network=Network(4f2ea02a-9b26-4f2a-af23-39c060703ff3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39b5a493-47')
Jul 31 09:50:32 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FGERQMJC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:50:32 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:50:32 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac2a9ac-9c24-4900-be0e-08a2227da451]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f223c-c0af-4377-9056-fbf1be0a6d48 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c19457-2075-49d5-b8ba-40d7ca1dae5c]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f223c-c0af-4377-9056-fbf1be0a6d48 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WYQKoxNw {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WYQKoxNw" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2ec5c2-6888-46a6-8645-6e40049fa493]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f223c-c0af-4377-9056-fbf1be0a6d48 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WYQKoxNw'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cf3044-dc6c-4aa1-9bc6-eba32820d43c]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f223c-c0af-4377-9056-fbf1be0a6d48 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc3a267-5823-415b-971c-b33507c1da9b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f223c-c0af-4377-9056-fbf1be0a6d48 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:50:32 user nova-compute[71113]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:50:32 user nova-compute[71113]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0 (non-flash)
Jul 31 09:50:32 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f223c-c0af-4377-9056-fbf1be0a6d48 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:50:32 user nova-compute[71113]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:50:32 user nova-compute[71113]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0 (non-flash)
Jul 31 09:50:32 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7 -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf38f3d2-ddb3-4457-ae80-1f9e3c27ffcc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f223c-c0af-4377-9056-fbf1be0a6d48 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7, portal: 172.16.0.220,3260]
Jul 31 09:50:32 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7, portal: 172.16.0.220,3260] successful.
Jul 31 09:50:32 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[682e6e92-9b19-4b4a-9540-e29a2732fca6]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f223c-c0af-4377-9056-fbf1be0a6d48 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[704d2e24-8267-4c5c-8945-c2045f746cc1]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f223c-c0af-4377-9056-fbf1be0a6d48 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:50:32 user nova-compute[71113]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:50:32 user nova-compute[71113]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0 (non-flash)
Jul 31 09:50:32 user nova-compute[71113]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7 (non-flash)
Jul 31 09:50:32 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f223c-c0af-4377-9056-fbf1be0a6d48 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:50:32 user nova-compute[71113]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:50:32 user nova-compute[71113]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0 (non-flash)
Jul 31 09:50:32 user nova-compute[71113]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7 (non-flash)
Jul 31 09:50:32 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-e26f223c-c0af-4377-9056-fbf1be0a6d48 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f223c-c0af-4377-9056-fbf1be0a6d48 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-e26f223c-c0af-4377-9056-fbf1be0a6d48 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] HCTL ('36', '-', '-', 0) found on session 16 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-e26f223c-c0af-4377-9056-fbf1be0a6d48 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6141973-8433-4227-9d34-f6bb9e1b41b7]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-e26f223c-c0af-4377-9056-fbf1be0a6d48 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Searching for a device in session 16 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 09:50:32 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f223c-c0af-4377-9056-fbf1be0a6d48 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WYQKoxNw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-e26f223c-c0af-4377-9056-fbf1be0a6d48 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f223c-c0af-4377-9056-fbf1be0a6d48 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '26162626134666162', 'path': '/dev/sde'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e26f223c-c0af-4377-9056-fbf1be0a6d48 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162626134666162', 'path': '/dev/sde'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.290s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG nova.objects.instance [None req-e26f223c-c0af-4377-9056-fbf1be0a6d48 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lazy-loading 'flavor' on Instance uuid 9a4b47dd-b335-4c2f-9dee-5421357a0ee1 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc04631b-8cc7-45c5-b38b-b740540730b1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-e26f223c-c0af-4377-9056-fbf1be0a6d48 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 09:50:33 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:50:33 user nova-compute[71113]:   <source dev="/dev/sde"/>
Jul 31 09:50:33 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 09:50:33 user nova-compute[71113]:   <serial>1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7</serial>
Jul 31 09:50:33 user nova-compute[71113]: </disk>
Jul 31 09:50:33 user nova-compute[71113]:  {{(pid=71113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a8ea7a-1b25-4753-a2ac-a6cfa93a2c93]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:50:33 user nova-compute[71113]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:50:33 user nova-compute[71113]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0 (non-flash)
Jul 31 09:50:33 user nova-compute[71113]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7 (non-flash)
Jul 31 09:50:33 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:50:33 user nova-compute[71113]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:50:33 user nova-compute[71113]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0 (non-flash)
Jul 31 09:50:33 user nova-compute[71113]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7 (non-flash)
Jul 31 09:50:33 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7908392320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c'): ({'sdc'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Removing single pathed devices sdc {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[53242f24-e089-4efc-b710-f4d43404d3c7]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f3983f-d631-4369-9010-f78738f7236b]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Flushing IO for device /dev/sdc {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e852a8-2eac-4d1f-943f-9bd5ad038e38]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be0f4ad-9323-45d9-82d6-6db9611d2223]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] SCSI volumes sdc have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9f1521-839f-4fca-85d0-a1be59efb34d]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG nova.compute.manager [req-7a0265d7-14da-485c-9dab-32e28f5a24f7 req-faae6add-6a7d-4305-bbcf-53acbfb7bf56 service nova] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Received event network-vif-plugged-39b5a493-47bd-4599-9a9f-bb80c93fb332 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7a0265d7-14da-485c-9dab-32e28f5a24f7 req-faae6add-6a7d-4305-bbcf-53acbfb7bf56 service nova] Acquiring lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7a0265d7-14da-485c-9dab-32e28f5a24f7 req-faae6add-6a7d-4305-bbcf-53acbfb7bf56 service nova] Lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7a0265d7-14da-485c-9dab-32e28f5a24f7 req-faae6add-6a7d-4305-bbcf-53acbfb7bf56 service nova] Lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG nova.compute.manager [req-7a0265d7-14da-485c-9dab-32e28f5a24f7 req-faae6add-6a7d-4305-bbcf-53acbfb7bf56 service nova] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] No waiting events found dispatching network-vif-plugged-39b5a493-47bd-4599-9a9f-bb80c93fb332 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:50:33 user nova-compute[71113]: WARNING nova.compute.manager [req-7a0265d7-14da-485c-9dab-32e28f5a24f7 req-faae6add-6a7d-4305-bbcf-53acbfb7bf56 service nova] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Received unexpected event network-vif-plugged-39b5a493-47bd-4599-9a9f-bb80c93fb332 for instance with vm_state active and task_state resize_migrating.
Jul 31 09:50:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfbc40a2-f224-4bf2-a26d-e9d0bac3fa8a]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c, portal: 172.16.0.220,3260]
Jul 31 09:50:33 user nova-compute[71113]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c, portal: 172.16.0.220,3260] successful.
Jul 31 09:50:33 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c7e5d1-eeda-42d6-9a02-8b86eca565f3]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] <== disconnect_volume: return (1652ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-e26f223c-c0af-4377-9056-fbf1be0a6d48 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-e26f223c-c0af-4377-9056-fbf1be0a6d48 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:50:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-e26f223c-c0af-4377-9056-fbf1be0a6d48 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] No VIF found with MAC fa:16:3e:16:25:0d, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 09:50:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:34 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 09:50:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1_resize/disk /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-e26f223c-c0af-4377-9056-fbf1be0a6d48 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "9a4b47dd-b335-4c2f-9dee-5421357a0ee1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.725s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:50:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:34 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 09:50:34 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Creating image(s)
Jul 31 09:50:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Acquiring lock "/opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:50:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "/opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:50:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "/opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:50:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] CMD "cp -r /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1_resize/disk /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk" returned: 0 in 0.448s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1_resize/disk.info /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk.info {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] CMD "cp -r /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1_resize/disk.info /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk.info" returned: 0 in 0.040s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.154s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Acquiring lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:50:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:50:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.165s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk 1073741824 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk 1073741824" returned: 0 in 0.049s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:50:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.155s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk. size=1073741824 {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Cannot resize image /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk to a smaller size. {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Created local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Ensure instance console log exists: /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Start _get_guest_xml network_info=[{"id": "5408a169-bdde-42da-be35-24006f474bc6", "address": "fa:16:3e:77:a3:62", "network": {"id": "cc84435f-b983-425d-bad0-36039e592e25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1662840158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f7a5479fd014325b8790a80b2405d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5408a169-bd", "ovs_interfaceid": "5408a169-bdde-42da-be35-24006f474bc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'image_id': '078646fe-b504-41ed-a147-61072e903e51'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '7986d5fe-ef90-43fa-91d9-597c27ce7504', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HDmVwAzh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0ea0401b-26c2-4655-956b-1bc000debd53', 'attached_at': '', 'detached_at': '', 'volume_id': '61fe7a42-4e7b-4473-abe6-29802c3614be', 'serial': '61fe7a42-4e7b-4473-abe6-29802c3614be'}, 'boot_index': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 09:50:35 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 31 09:50:35 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 31 09:50:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG nova.objects.instance [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0ea0401b-26c2-4655-956b-1bc000debd53 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HDmVwAzh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:50:35 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 31 09:50:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:50:35 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 31 09:50:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:50:35 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 09:50:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[57cbf7b3-bfb3-4cbd-bed9-afd73b95034e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 09:50:35 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3861ab7f-98a5-489a-bf49-5df2a74b47ec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be] added
Jul 31 09:50:35 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa9b2a3-f2a6-4009-8c76-01d882bb021a]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[58578737-b828-487b-aa90-a1a2512bc8cc]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HDmVwAzh {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HDmVwAzh" returned: 0 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[de70d4ec-b1d3-4749-b3f7-2c876257f41e]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HDmVwAzh'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.049s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33d9fe6-c9db-4eaa-a0b7-277b571463e0]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[389e4c57-812f-4b3a-8109-73e6506b66c5]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:50:35 user nova-compute[71113]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0 (non-flash)
Jul 31 09:50:35 user nova-compute[71113]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7 (non-flash)
Jul 31 09:50:35 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:50:35 user nova-compute[71113]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0 (non-flash)
Jul 31 09:50:35 user nova-compute[71113]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7 (non-flash)
Jul 31 09:50:35 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[067661a7-6965-4849-9c85-ed94a09992f8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be, portal: 172.16.0.220,3260]
Jul 31 09:50:35 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be, portal: 172.16.0.220,3260] successful.
Jul 31 09:50:35 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b12f7c-4054-4352-b39d-a5660f142231]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0d4cc0-72c4-4f91-ae78-567a405c68cb]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:50:35 user nova-compute[71113]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0 (non-flash)
Jul 31 09:50:35 user nova-compute[71113]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7 (non-flash)
Jul 31 09:50:35 user nova-compute[71113]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be (non-flash)
Jul 31 09:50:35 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:50:35 user nova-compute[71113]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0 (non-flash)
Jul 31 09:50:35 user nova-compute[71113]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7 (non-flash)
Jul 31 09:50:35 user nova-compute[71113]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be (non-flash)
Jul 31 09:50:35 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.368s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c35af1d-01e2-4e4a-a51b-d5e09195c61c]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HDmVwAzh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG nova.network.neutron [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Port 39b5a493-47bd-4599-9a9f-bb80c93fb332 binding to destination host user is already ACTIVE {{(pid=71113) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Acquiring lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:50:35 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:50:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Acquiring lock "refresh_cache-efa311a0-fe2e-4c0f-af66-09c3eb38fbf1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:50:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Acquired lock "refresh_cache-efa311a0-fe2e-4c0f-af66-09c3eb38fbf1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:50:36 user nova-compute[71113]: DEBUG nova.network.neutron [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 09:50:36 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690797021.4608922, 0ea0401b-26c2-4655-956b-1bc000debd53 => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:50:36 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] VM Stopped (Lifecycle Event)
Jul 31 09:50:36 user nova-compute[71113]: DEBUG nova.compute.manager [None req-c99e754d-dd50-4de9-bfe9-111f5a1847a4 None None] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:50:36 user nova-compute[71113]: DEBUG nova.network.neutron [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Updating instance_info_cache with network_info: [{"id": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "address": "fa:16:3e:16:bb:aa", "network": {"id": "4f2ea02a-9b26-4f2a-af23-39c060703ff3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-725518740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5bb5c0790e54702b881dc5e45641be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b5a493-47", "ovs_interfaceid": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:50:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.408s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:50:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] <== connect_volume: return (1410ms) {'type': 'block', 'scsi_wwn': '23932336161356265', 'path': '/dev/sdc'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:50:36 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932336161356265', 'path': '/dev/sdc'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 09:50:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Releasing lock "refresh_cache-efa311a0-fe2e-4c0f-af66-09c3eb38fbf1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:50:36 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T09:46:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-554499227',display_name='tempest-ServerActionsTestOtherA-server-682149866',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-554499227',id=2,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5EE1xUvLRoodLjDMpmYpiUOpJ4L9wfbpJsZ+HUVFxXJGKbpzcG8jQIKPQ0cQElq3F/Fhyr7R6+c9C8jzz21FzCpd/o9T+iI7W2nanWOzhB0iUhT1vp4Ko8/FdZGlABXg==',key_name='tempest-keypair-58057469',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:46:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9f7a5479fd014325b8790a80b2405d1d',ramdisk_id='',reservation_id='r-119yz4q0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2065923437',owner_user_name='tempest-ServerActionsTestOtherA-2065923437-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:50:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7029dd8d775d4c14bb349b72b1171d5f',uuid=0ea0401b-26c2-4655-956b-1bc000debd53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5408a169-bdde-42da-be35-24006f474bc6", "address": "fa:16:3e:77:a3:62", "network": {"id": "cc84435f-b983-425d-bad0-36039e592e25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1662840158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f7a5479fd014325b8790a80b2405d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5408a169-bd", "ovs_interfaceid": "5408a169-bdde-42da-be35-24006f474bc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 09:50:36 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Converting VIF {"id": "5408a169-bdde-42da-be35-24006f474bc6", "address": "fa:16:3e:77:a3:62", "network": {"id": "cc84435f-b983-425d-bad0-36039e592e25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1662840158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f7a5479fd014325b8790a80b2405d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5408a169-bd", "ovs_interfaceid": "5408a169-bdde-42da-be35-24006f474bc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:50:36 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:a3:62,bridge_name='br-int',has_traffic_filtering=True,id=5408a169-bdde-42da-be35-24006f474bc6,network=Network(cc84435f-b983-425d-bad0-36039e592e25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5408a169-bd') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:50:36 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] End _get_guest_xml xml=<domain type="kvm">
Jul 31 09:50:36 user nova-compute[71113]:   <uuid>0ea0401b-26c2-4655-956b-1bc000debd53</uuid>
Jul 31 09:50:36 user nova-compute[71113]:   <name>instance-00000002</name>
Jul 31 09:50:36 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 09:50:36 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 09:50:36 user nova-compute[71113]:   <metadata>
Jul 31 09:50:36 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 09:50:36 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 09:50:36 user nova-compute[71113]:       <nova:name>tempest-ServerActionsTestOtherA-server-682149866</nova:name>
Jul 31 09:50:36 user nova-compute[71113]:       <nova:creationTime>2023-07-31 09:50:35</nova:creationTime>
Jul 31 09:50:36 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 09:50:36 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 09:50:36 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 09:50:36 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 09:50:36 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 09:50:36 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 09:50:36 user nova-compute[71113]:       </nova:flavor>
Jul 31 09:50:36 user nova-compute[71113]:       <nova:owner>
Jul 31 09:50:36 user nova-compute[71113]:         <nova:user uuid="7029dd8d775d4c14bb349b72b1171d5f">tempest-ServerActionsTestOtherA-2065923437-project-member</nova:user>
Jul 31 09:50:36 user nova-compute[71113]:         <nova:project uuid="9f7a5479fd014325b8790a80b2405d1d">tempest-ServerActionsTestOtherA-2065923437</nova:project>
Jul 31 09:50:36 user nova-compute[71113]:       </nova:owner>
Jul 31 09:50:36 user nova-compute[71113]:       <nova:root type="image" uuid="078646fe-b504-41ed-a147-61072e903e51"/>
Jul 31 09:50:36 user nova-compute[71113]:       <nova:ports>
Jul 31 09:50:36 user nova-compute[71113]:         <nova:port uuid="5408a169-bdde-42da-be35-24006f474bc6">
Jul 31 09:50:36 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 31 09:50:36 user nova-compute[71113]:         </nova:port>
Jul 31 09:50:36 user nova-compute[71113]:       </nova:ports>
Jul 31 09:50:36 user nova-compute[71113]:     </nova:instance>
Jul 31 09:50:36 user nova-compute[71113]:   </metadata>
Jul 31 09:50:36 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 09:50:36 user nova-compute[71113]:     <system>
Jul 31 09:50:36 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 09:50:36 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 09:50:36 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 09:50:36 user nova-compute[71113]:       <entry name="serial">0ea0401b-26c2-4655-956b-1bc000debd53</entry>
Jul 31 09:50:36 user nova-compute[71113]:       <entry name="uuid">0ea0401b-26c2-4655-956b-1bc000debd53</entry>
Jul 31 09:50:36 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 09:50:36 user nova-compute[71113]:     </system>
Jul 31 09:50:36 user nova-compute[71113]:   </sysinfo>
Jul 31 09:50:36 user nova-compute[71113]:   <os>
Jul 31 09:50:36 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 09:50:36 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 09:50:36 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 09:50:36 user nova-compute[71113]:   </os>
Jul 31 09:50:36 user nova-compute[71113]:   <features>
Jul 31 09:50:36 user nova-compute[71113]:     <acpi/>
Jul 31 09:50:36 user nova-compute[71113]:     <apic/>
Jul 31 09:50:36 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 09:50:36 user nova-compute[71113]:   </features>
Jul 31 09:50:36 user nova-compute[71113]:   <clock offset="utc">
Jul 31 09:50:36 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 09:50:36 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 09:50:36 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 09:50:36 user nova-compute[71113]:   </clock>
Jul 31 09:50:36 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 09:50:36 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 09:50:36 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 09:50:36 user nova-compute[71113]:   </cpu>
Jul 31 09:50:36 user nova-compute[71113]:   <devices>
Jul 31 09:50:36 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 09:50:36 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 09:50:36 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk"/>
Jul 31 09:50:36 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 09:50:36 user nova-compute[71113]:     </disk>
Jul 31 09:50:36 user nova-compute[71113]:     <disk type="block" device="disk">
Jul 31 09:50:36 user nova-compute[71113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:50:36 user nova-compute[71113]:       <source dev="/dev/sdc"/>
Jul 31 09:50:36 user nova-compute[71113]:       <target dev="vdb" bus="virtio"/>
Jul 31 09:50:36 user nova-compute[71113]:       <serial>61fe7a42-4e7b-4473-abe6-29802c3614be</serial>
Jul 31 09:50:36 user nova-compute[71113]:     </disk>
Jul 31 09:50:36 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 09:50:36 user nova-compute[71113]:       <mac address="fa:16:3e:77:a3:62"/>
Jul 31 09:50:36 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:50:36 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 09:50:36 user nova-compute[71113]:       <target dev="tap5408a169-bd"/>
Jul 31 09:50:36 user nova-compute[71113]:     </interface>
Jul 31 09:50:36 user nova-compute[71113]:     <serial type="pty">
Jul 31 09:50:36 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/console.log" append="off"/>
Jul 31 09:50:36 user nova-compute[71113]:     </serial>
Jul 31 09:50:36 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 09:50:36 user nova-compute[71113]:     <video>
Jul 31 09:50:36 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:50:36 user nova-compute[71113]:     </video>
Jul 31 09:50:36 user nova-compute[71113]:     <rng model="virtio">
Jul 31 09:50:36 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 09:50:36 user nova-compute[71113]:     </rng>
Jul 31 09:50:36 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 09:50:36 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 09:50:36 user nova-compute[71113]:       <stats period="10"/>
Jul 31 09:50:36 user nova-compute[71113]:     </memballoon>
Jul 31 09:50:36 user nova-compute[71113]:   </devices>
Jul 31 09:50:36 user nova-compute[71113]: </domain>
Jul 31 09:50:36 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 09:50:36 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T09:46:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-554499227',display_name='tempest-ServerActionsTestOtherA-server-682149866',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-554499227',id=2,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5EE1xUvLRoodLjDMpmYpiUOpJ4L9wfbpJsZ+HUVFxXJGKbpzcG8jQIKPQ0cQElq3F/Fhyr7R6+c9C8jzz21FzCpd/o9T+iI7W2nanWOzhB0iUhT1vp4Ko8/FdZGlABXg==',key_name='tempest-keypair-58057469',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:46:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9f7a5479fd014325b8790a80b2405d1d',ramdisk_id='',reservation_id='r-119yz4q0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2065923437',owner_user_name='tempest-ServerActionsTestOtherA-2065923437-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:50:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7029dd8d775d4c14bb349b72b1171d5f',uuid=0ea0401b-26c2-4655-956b-1bc000debd53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5408a169-bdde-42da-be35-24006f474bc6", "address": "fa:16:3e:77:a3:62", "network": {"id": "cc84435f-b983-425d-bad0-36039e592e25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1662840158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f7a5479fd014325b8790a80b2405d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5408a169-bd", "ovs_interfaceid": "5408a169-bdde-42da-be35-24006f474bc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 09:50:36 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Converting VIF {"id": "5408a169-bdde-42da-be35-24006f474bc6", "address": "fa:16:3e:77:a3:62", "network": {"id": "cc84435f-b983-425d-bad0-36039e592e25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1662840158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f7a5479fd014325b8790a80b2405d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5408a169-bd", "ovs_interfaceid": "5408a169-bdde-42da-be35-24006f474bc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:50:36 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:a3:62,bridge_name='br-int',has_traffic_filtering=True,id=5408a169-bdde-42da-be35-24006f474bc6,network=Network(cc84435f-b983-425d-bad0-36039e592e25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5408a169-bd') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:50:36 user nova-compute[71113]: DEBUG os_vif [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:a3:62,bridge_name='br-int',has_traffic_filtering=True,id=5408a169-bdde-42da-be35-24006f474bc6,network=Network(cc84435f-b983-425d-bad0-36039e592e25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5408a169-bd') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 09:50:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:50:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 09:50:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5408a169-bd, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:50:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5408a169-bd, col_values=(('external_ids', {'iface-id': '5408a169-bdde-42da-be35-24006f474bc6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:a3:62', 'vm-uuid': '0ea0401b-26c2-4655-956b-1bc000debd53'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:50:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:50:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0add6ecd-70ad-45a7-b44b-b3665a715ed6 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Acquiring lock "9a4b47dd-b335-4c2f-9dee-5421357a0ee1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:50:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0add6ecd-70ad-45a7-b44b-b3665a715ed6 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "9a4b47dd-b335-4c2f-9dee-5421357a0ee1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:50:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:36 user nova-compute[71113]: INFO os_vif [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:a3:62,bridge_name='br-int',has_traffic_filtering=True,id=5408a169-bdde-42da-be35-24006f474bc6,network=Network(cc84435f-b983-425d-bad0-36039e592e25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5408a169-bd')
Jul 31 09:50:36 user nova-compute[71113]: INFO nova.compute.manager [None req-0add6ecd-70ad-45a7-b44b-b3665a715ed6 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Detaching volume 1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7
Jul 31 09:50:36 user nova-compute[71113]: INFO nova.virt.block_device [None req-0add6ecd-70ad-45a7-b44b-b3665a715ed6 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Attempting to driver detach volume 1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7 from mountpoint /dev/vdb
Jul 31 09:50:36 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0add6ecd-70ad-45a7-b44b-b3665a715ed6 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Attempting to detach device vdb from instance 9a4b47dd-b335-4c2f-9dee-5421357a0ee1 from the persistent domain config. {{(pid=71113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 09:50:36 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-0add6ecd-70ad-45a7-b44b-b3665a715ed6 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 09:50:36 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:50:36 user nova-compute[71113]:   <source dev="/dev/sde"/>
Jul 31 09:50:36 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 09:50:36 user nova-compute[71113]:   <serial>1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7</serial>
Jul 31 09:50:36 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 09:50:36 user nova-compute[71113]: </disk>
Jul 31 09:50:36 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 09:50:36 user nova-compute[71113]: DEBUG os_brick.utils [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:50:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:36 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-0add6ecd-70ad-45a7-b44b-b3665a715ed6 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Successfully detached device vdb from instance 9a4b47dd-b335-4c2f-9dee-5421357a0ee1 from the persistent domain config.
Jul 31 09:50:36 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0add6ecd-70ad-45a7-b44b-b3665a715ed6 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9a4b47dd-b335-4c2f-9dee-5421357a0ee1 from the live domain config. {{(pid=71113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 09:50:36 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-0add6ecd-70ad-45a7-b44b-b3665a715ed6 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 09:50:36 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:50:36 user nova-compute[71113]:   <source dev="/dev/sde"/>
Jul 31 09:50:36 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 09:50:36 user nova-compute[71113]:   <serial>1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7</serial>
Jul 31 09:50:36 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 09:50:36 user nova-compute[71113]: </disk>
Jul 31 09:50:36 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 09:50:36 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:50:36 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:50:36 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] No VIF found with MAC fa:16:3e:77:a3:62, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 09:50:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:36 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75c83b1-fcf1-44d1-8ea2-1b5a1186c2f6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.034s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:36 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2094a07f-4086-4f63-9e91-4fca48cc8aae]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:37 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[81229ba4-cd31-4e97-b6f8-f6ddf4f41bce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:37 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6bb6281-85af-4800-aa65-d17d4c2445f1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:50:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 09:50:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:50:37 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 09:50:37 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb74c08-8c14-4077-8e44-0d62bd343857]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 09:50:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 09:50:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 09:50:37 user nova-compute[71113]: DEBUG os_brick.utils [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:50:37 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Received event <DeviceRemovedEvent: 1690797037.9876695, 9a4b47dd-b335-4c2f-9dee-5421357a0ee1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71113) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 09:50:37 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0add6ecd-70ad-45a7-b44b-b3665a715ed6 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9a4b47dd-b335-4c2f-9dee-5421357a0ee1 {{(pid=71113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 09:50:38 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-0add6ecd-70ad-45a7-b44b-b3665a715ed6 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Successfully detached device vdb from instance 9a4b47dd-b335-4c2f-9dee-5421357a0ee1 from the live domain config.
Jul 31 09:50:38 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0add6ecd-70ad-45a7-b44b-b3665a715ed6 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 09:50:38 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0add6ecd-70ad-45a7-b44b-b3665a715ed6 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WYQKoxNw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:50:38 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-0add6ecd-70ad-45a7-b44b-b3665a715ed6 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:50:38 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-0add6ecd-70ad-45a7-b44b-b3665a715ed6 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:50:38 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-0add6ecd-70ad-45a7-b44b-b3665a715ed6 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:50:38 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0add6ecd-70ad-45a7-b44b-b3665a715ed6 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 09:50:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:38 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4cb544-a1ab-4698-806e-8a7d71d95089]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:38 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9545112-d5b9-45d7-8e86-eafa4edaa9f5]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:38 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0add6ecd-70ad-45a7-b44b-b3665a715ed6 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:50:38 user nova-compute[71113]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0 (non-flash)
Jul 31 09:50:38 user nova-compute[71113]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7 (non-flash)
Jul 31 09:50:38 user nova-compute[71113]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be (non-flash)
Jul 31 09:50:38 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:50:38 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0add6ecd-70ad-45a7-b44b-b3665a715ed6 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:50:38 user nova-compute[71113]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0 (non-flash)
Jul 31 09:50:38 user nova-compute[71113]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7 (non-flash)
Jul 31 09:50:38 user nova-compute[71113]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be (non-flash)
Jul 31 09:50:38 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:50:38 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0add6ecd-70ad-45a7-b44b-b3665a715ed6 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f790821dc60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7'): ({'sde'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 09:50:38 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-0add6ecd-70ad-45a7-b44b-b3665a715ed6 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Removing single pathed devices sde {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 09:50:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:38 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b563263c-47b3-428d-b2e8-750b6062596d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:38 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ecbf27f-d821-493d-9f9a-4df0b9ea98bf]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:38 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-0add6ecd-70ad-45a7-b44b-b3665a715ed6 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Flushing IO for device /dev/sde {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 09:50:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:38 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[19416573-7397-4ebd-a131-cbdc2c6c7ef9]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:38 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-0add6ecd-70ad-45a7-b44b-b3665a715ed6 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 09:50:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.160s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:38 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ab2dc4-4970-472e-8c56-1fb53190fe35]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:38 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-0add6ecd-70ad-45a7-b44b-b3665a715ed6 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 09:50:38 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-0add6ecd-70ad-45a7-b44b-b3665a715ed6 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] SCSI volumes sde have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 09:50:38 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0add6ecd-70ad-45a7-b44b-b3665a715ed6 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 09:50:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:38 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ae2f81-7019-45e2-bec5-6b2745c69bc2]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:38 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0add6ecd-70ad-45a7-b44b-b3665a715ed6 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7 -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.110s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:38 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0473b3e3-195a-401f-90e8-21c59a950d23]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:38 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0add6ecd-70ad-45a7-b44b-b3665a715ed6 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7, portal: 172.16.0.220,3260]
Jul 31 09:50:38 user nova-compute[71113]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7, portal: 172.16.0.220,3260] successful.
Jul 31 09:50:38 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7 -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ddb8ec8-e3e9-470e-bf3c-0c6a90bf81e7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:38 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba16a1a7-09c6-4f96-b9ad-2fde15b76367]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:38 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0add6ecd-70ad-45a7-b44b-b3665a715ed6 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:38 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-0add6ecd-70ad-45a7-b44b-b3665a715ed6 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.473s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:50:38 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0add6ecd-70ad-45a7-b44b-b3665a715ed6 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] <== disconnect_volume: return (475ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:50:38 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0add6ecd-70ad-45a7-b44b-b3665a715ed6 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 09:50:38 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:38 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:38 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:38 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:39 user nova-compute[71113]: DEBUG nova.compute.manager [req-d0f69319-c66e-4d4c-93c8-bb5c6e8ae6e2 req-2a9e3464-d077-408e-a0a6-b9d79e90b904 service nova] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Received event network-vif-plugged-5408a169-bdde-42da-be35-24006f474bc6 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:50:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-d0f69319-c66e-4d4c-93c8-bb5c6e8ae6e2 req-2a9e3464-d077-408e-a0a6-b9d79e90b904 service nova] Acquiring lock "0ea0401b-26c2-4655-956b-1bc000debd53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:50:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-d0f69319-c66e-4d4c-93c8-bb5c6e8ae6e2 req-2a9e3464-d077-408e-a0a6-b9d79e90b904 service nova] Lock "0ea0401b-26c2-4655-956b-1bc000debd53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:50:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-d0f69319-c66e-4d4c-93c8-bb5c6e8ae6e2 req-2a9e3464-d077-408e-a0a6-b9d79e90b904 service nova] Lock "0ea0401b-26c2-4655-956b-1bc000debd53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:50:39 user nova-compute[71113]: DEBUG nova.compute.manager [req-d0f69319-c66e-4d4c-93c8-bb5c6e8ae6e2 req-2a9e3464-d077-408e-a0a6-b9d79e90b904 service nova] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] No waiting events found dispatching network-vif-plugged-5408a169-bdde-42da-be35-24006f474bc6 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:50:39 user nova-compute[71113]: WARNING nova.compute.manager [req-d0f69319-c66e-4d4c-93c8-bb5c6e8ae6e2 req-2a9e3464-d077-408e-a0a6-b9d79e90b904 service nova] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Received unexpected event network-vif-plugged-5408a169-bdde-42da-be35-24006f474bc6 for instance with vm_state active and task_state rebuild_spawning.
Jul 31 09:50:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:41 user nova-compute[71113]: DEBUG nova.compute.manager [req-3e79e6a3-d65a-42b3-a4d4-16eca0792bcf req-4c019f48-32f9-414a-9596-05deb7c7c880 service nova] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Received event network-vif-plugged-5408a169-bdde-42da-be35-24006f474bc6 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:50:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3e79e6a3-d65a-42b3-a4d4-16eca0792bcf req-4c019f48-32f9-414a-9596-05deb7c7c880 service nova] Acquiring lock "0ea0401b-26c2-4655-956b-1bc000debd53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:50:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3e79e6a3-d65a-42b3-a4d4-16eca0792bcf req-4c019f48-32f9-414a-9596-05deb7c7c880 service nova] Lock "0ea0401b-26c2-4655-956b-1bc000debd53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:50:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3e79e6a3-d65a-42b3-a4d4-16eca0792bcf req-4c019f48-32f9-414a-9596-05deb7c7c880 service nova] Lock "0ea0401b-26c2-4655-956b-1bc000debd53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:50:41 user nova-compute[71113]: DEBUG nova.compute.manager [req-3e79e6a3-d65a-42b3-a4d4-16eca0792bcf req-4c019f48-32f9-414a-9596-05deb7c7c880 service nova] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] No waiting events found dispatching network-vif-plugged-5408a169-bdde-42da-be35-24006f474bc6 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:50:41 user nova-compute[71113]: WARNING nova.compute.manager [req-3e79e6a3-d65a-42b3-a4d4-16eca0792bcf req-4c019f48-32f9-414a-9596-05deb7c7c880 service nova] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Received unexpected event network-vif-plugged-5408a169-bdde-42da-be35-24006f474bc6 for instance with vm_state active and task_state rebuild_spawning.
Jul 31 09:50:41 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797041.151802, 0ea0401b-26c2-4655-956b-1bc000debd53 => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:50:41 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] VM Resumed (Lifecycle Event)
Jul 31 09:50:41 user nova-compute[71113]: DEBUG nova.compute.manager [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 09:50:41 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 09:50:41 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Instance spawned successfully.
Jul 31 09:50:41 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 09:50:41 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:50:41 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:50:41 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Found default for hw_cdrom_bus of ide {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:50:41 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Found default for hw_disk_bus of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:50:41 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Found default for hw_input_bus of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:50:41 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Found default for hw_pointer_model of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:50:41 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Found default for hw_video_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:50:41 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Found default for hw_vif_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:50:41 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 31 09:50:41 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797041.1529005, 0ea0401b-26c2-4655-956b-1bc000debd53 => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:50:41 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] VM Started (Lifecycle Event)
Jul 31 09:50:41 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:50:41 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:50:41 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 31 09:50:41 user nova-compute[71113]: DEBUG nova.compute.manager [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:50:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:50:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:50:41 user nova-compute[71113]: DEBUG nova.objects.instance [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71113) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Jul 31 09:50:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f85d64ae-b172-4080-a9ec-306fc4f6a334 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.152s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:50:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:45 user nova-compute[71113]: DEBUG nova.objects.instance [None req-0add6ecd-70ad-45a7-b44b-b3665a715ed6 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lazy-loading 'flavor' on Instance uuid 9a4b47dd-b335-4c2f-9dee-5421357a0ee1 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:50:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0add6ecd-70ad-45a7-b44b-b3665a715ed6 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "9a4b47dd-b335-4c2f-9dee-5421357a0ee1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 9.013s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Starting finish_migration {{(pid=71113) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Instance directory exists: not creating {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 31 09:50:46 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Creating image(s)
Jul 31 09:50:46 user nova-compute[71113]: DEBUG nova.objects.instance [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lazy-loading 'trusted_certs' on Instance uuid efa311a0-fe2e-4c0f-af66-09c3eb38fbf1 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.167s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Checking if we can resize image /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk. size=21474836480 {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk 21474836480 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk 21474836480" returned: 0 in 0.061s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Did not create local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Ensure instance console log exists: /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Start _get_guest_xml network_info=[{"id": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "address": "fa:16:3e:16:bb:aa", "network": {"id": "4f2ea02a-9b26-4f2a-af23-39c060703ff3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-725518740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-725518740-network", "vif_mac": "fa:16:3e:16:bb:aa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5bb5c0790e54702b881dc5e45641be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b5a493-47", "ovs_interfaceid": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'image_id': '078646fe-b504-41ed-a147-61072e903e51'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '0b85fcec-26ad-40bc-b519-d08b992515f7', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FGERQMJC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'efa311a0-fe2e-4c0f-af66-09c3eb38fbf1', 'attached_at': '2023-07-31T09:50:46.000000', 'detached_at': '', 'volume_id': 'dc7c0a40-0540-43ec-8a1d-7dd80d222f2c', 'serial': 'dc7c0a40-0540-43ec-8a1d-7dd80d222f2c'}, 'boot_index': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 09:50:46 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:50:46 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:50:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG nova.objects.instance [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lazy-loading 'vcpu_model' on Instance uuid efa311a0-fe2e-4c0f-af66-09c3eb38fbf1 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FGERQMJC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:50:46 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:50:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:50:46 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:50:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:50:46 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 09:50:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eee259a-a090-4985-8d39-fd5d98ec66f3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 09:50:46 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[51cc5abc-37fc-4e3a-ae40-b9ed1935c621]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c] added
Jul 31 09:50:46 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3608b19a-1bb3-4945-9adc-dbac4bd35666]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[90df1502-8cfb-4779-98a1-084adbe90906]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FGERQMJC {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FGERQMJC" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2adbbfc-b3b2-455e-95d1-8ec7864b25f6]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FGERQMJC'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0794aebe-357b-4cc6-8bb4-b458a1cf271c]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b07c10-41a0-488e-90da-cf9e05127b3a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:50:46 user nova-compute[71113]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0 (non-flash)
Jul 31 09:50:46 user nova-compute[71113]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be (non-flash)
Jul 31 09:50:46 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:50:46 user nova-compute[71113]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0 (non-flash)
Jul 31 09:50:46 user nova-compute[71113]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be (non-flash)
Jul 31 09:50:46 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f950ac-c1fe-403b-a5b3-ae2a435e4b45]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c, portal: 172.16.0.220,3260]
Jul 31 09:50:46 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c, portal: 172.16.0.220,3260] successful.
Jul 31 09:50:46 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1efe5802-ad62-43ba-9278-f272fc7fc9fe]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[fddb89dc-3140-4f3b-89f0-a5874f933c6e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:50:46 user nova-compute[71113]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0 (non-flash)
Jul 31 09:50:46 user nova-compute[71113]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be (non-flash)
Jul 31 09:50:46 user nova-compute[71113]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:50:46 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:50:46 user nova-compute[71113]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0 (non-flash)
Jul 31 09:50:46 user nova-compute[71113]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be (non-flash)
Jul 31 09:50:46 user nova-compute[71113]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:50:46 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] HCTL ('36', '-', '-', 0) found on session 18 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbbf86d9-c042-42e7-8914-34fb99d7b518]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:46 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Searching for a device in session 18 and hctl ['36', '*', '*', 0] yield: None {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 09:50:47 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690797032.0556748, efa311a0-fe2e-4c0f-af66-09c3eb38fbf1 => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:50:47 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] VM Stopped (Lifecycle Event)
Jul 31 09:50:47 user nova-compute[71113]: DEBUG nova.compute.manager [None req-285ec5c9-a494-45c7-bfbb-b8ea9bd6e9f7 None None] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:50:47 user nova-compute[71113]: DEBUG nova.compute.manager [None req-285ec5c9-a494-45c7-bfbb-b8ea9bd6e9f7 None None] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:50:47 user nova-compute[71113]: INFO nova.compute.manager [None req-285ec5c9-a494-45c7-bfbb-b8ea9bd6e9f7 None None] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 31 09:50:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:47 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Searching for a device in session 18 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 09:50:47 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FGERQMJC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 09:50:47 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:50:47 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23236323632636636', 'path': '/dev/sde'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:50:47 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236323632636636', 'path': '/dev/sde'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 09:50:47 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:46:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1025510923',display_name='tempest-ServerActionsTestOtherB-server-1025510923',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1025510923',id=3,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJo+xi4tu0GGLLf+2/4AMwJN8W9HV5KOFul5csHl5tHCHdJymtchsdGYmiKLfCyzN953/rO7ubVJnctaNhLzLpYKjY5Z2Nn1cEvYAzU5x1ZT5edLumoNfJjhx0wRkZgiEQ==',key_name='tempest-keypair-947034726',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:46:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a5bb5c0790e54702b881dc5e45641be8',ramdisk_id='',reservation_id='r-o5vysyfg',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1778056817',owner_user_name='tempest-ServerActionsTestOtherB-1778056817-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:50:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b5f449e8b1948cf914daef537aea164',uuid=efa311a0-fe2e-4c0f-af66-09c3eb38fbf1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "address": "fa:16:3e:16:bb:aa", "network": {"id": "4f2ea02a-9b26-4f2a-af23-39c060703ff3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-725518740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-725518740-network", "vif_mac": "fa:16:3e:16:bb:aa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5bb5c0790e54702b881dc5e45641be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b5a493-47", "ovs_interfaceid": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 09:50:47 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Converting VIF {"id": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "address": "fa:16:3e:16:bb:aa", "network": {"id": "4f2ea02a-9b26-4f2a-af23-39c060703ff3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-725518740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-725518740-network", "vif_mac": "fa:16:3e:16:bb:aa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5bb5c0790e54702b881dc5e45641be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b5a493-47", "ovs_interfaceid": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:50:47 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:bb:aa,bridge_name='br-int',has_traffic_filtering=True,id=39b5a493-47bd-4599-9a9f-bb80c93fb332,network=Network(4f2ea02a-9b26-4f2a-af23-39c060703ff3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39b5a493-47') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:50:47 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] End _get_guest_xml xml=<domain type="kvm">
Jul 31 09:50:47 user nova-compute[71113]:   <uuid>efa311a0-fe2e-4c0f-af66-09c3eb38fbf1</uuid>
Jul 31 09:50:47 user nova-compute[71113]:   <name>instance-00000003</name>
Jul 31 09:50:47 user nova-compute[71113]:   <memory>2097152</memory>
Jul 31 09:50:47 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 09:50:47 user nova-compute[71113]:   <metadata>
Jul 31 09:50:47 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 09:50:47 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 09:50:47 user nova-compute[71113]:       <nova:name>tempest-ServerActionsTestOtherB-server-1025510923</nova:name>
Jul 31 09:50:47 user nova-compute[71113]:       <nova:creationTime>2023-07-31 09:50:46</nova:creationTime>
Jul 31 09:50:47 user nova-compute[71113]:       <nova:flavor name="m1.small">
Jul 31 09:50:47 user nova-compute[71113]:         <nova:memory>2048</nova:memory>
Jul 31 09:50:47 user nova-compute[71113]:         <nova:disk>20</nova:disk>
Jul 31 09:50:47 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 09:50:47 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 09:50:47 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 09:50:47 user nova-compute[71113]:       </nova:flavor>
Jul 31 09:50:47 user nova-compute[71113]:       <nova:owner>
Jul 31 09:50:47 user nova-compute[71113]:         <nova:user uuid="0b5f449e8b1948cf914daef537aea164">tempest-ServerActionsTestOtherB-1778056817-project-member</nova:user>
Jul 31 09:50:47 user nova-compute[71113]:         <nova:project uuid="a5bb5c0790e54702b881dc5e45641be8">tempest-ServerActionsTestOtherB-1778056817</nova:project>
Jul 31 09:50:47 user nova-compute[71113]:       </nova:owner>
Jul 31 09:50:47 user nova-compute[71113]:       <nova:root type="image" uuid="078646fe-b504-41ed-a147-61072e903e51"/>
Jul 31 09:50:47 user nova-compute[71113]:       <nova:ports>
Jul 31 09:50:47 user nova-compute[71113]:         <nova:port uuid="39b5a493-47bd-4599-9a9f-bb80c93fb332">
Jul 31 09:50:47 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 31 09:50:47 user nova-compute[71113]:         </nova:port>
Jul 31 09:50:47 user nova-compute[71113]:       </nova:ports>
Jul 31 09:50:47 user nova-compute[71113]:     </nova:instance>
Jul 31 09:50:47 user nova-compute[71113]:   </metadata>
Jul 31 09:50:47 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 09:50:47 user nova-compute[71113]:     <system>
Jul 31 09:50:47 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 09:50:47 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 09:50:47 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 09:50:47 user nova-compute[71113]:       <entry name="serial">efa311a0-fe2e-4c0f-af66-09c3eb38fbf1</entry>
Jul 31 09:50:47 user nova-compute[71113]:       <entry name="uuid">efa311a0-fe2e-4c0f-af66-09c3eb38fbf1</entry>
Jul 31 09:50:47 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 09:50:47 user nova-compute[71113]:     </system>
Jul 31 09:50:47 user nova-compute[71113]:   </sysinfo>
Jul 31 09:50:47 user nova-compute[71113]:   <os>
Jul 31 09:50:47 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 09:50:47 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 09:50:47 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 09:50:47 user nova-compute[71113]:   </os>
Jul 31 09:50:47 user nova-compute[71113]:   <features>
Jul 31 09:50:47 user nova-compute[71113]:     <acpi/>
Jul 31 09:50:47 user nova-compute[71113]:     <apic/>
Jul 31 09:50:47 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 09:50:47 user nova-compute[71113]:   </features>
Jul 31 09:50:47 user nova-compute[71113]:   <clock offset="utc">
Jul 31 09:50:47 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 09:50:47 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 09:50:47 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 09:50:47 user nova-compute[71113]:   </clock>
Jul 31 09:50:47 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 09:50:47 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 09:50:47 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 09:50:47 user nova-compute[71113]:   </cpu>
Jul 31 09:50:47 user nova-compute[71113]:   <devices>
Jul 31 09:50:47 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 09:50:47 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 09:50:47 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk"/>
Jul 31 09:50:47 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 09:50:47 user nova-compute[71113]:     </disk>
Jul 31 09:50:47 user nova-compute[71113]:     <disk type="block" device="disk">
Jul 31 09:50:47 user nova-compute[71113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:50:47 user nova-compute[71113]:       <source dev="/dev/sde"/>
Jul 31 09:50:47 user nova-compute[71113]:       <target dev="vdb" bus="virtio"/>
Jul 31 09:50:47 user nova-compute[71113]:       <serial>dc7c0a40-0540-43ec-8a1d-7dd80d222f2c</serial>
Jul 31 09:50:47 user nova-compute[71113]:     </disk>
Jul 31 09:50:47 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 09:50:47 user nova-compute[71113]:       <mac address="fa:16:3e:16:bb:aa"/>
Jul 31 09:50:47 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:50:47 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 09:50:47 user nova-compute[71113]:       <target dev="tap39b5a493-47"/>
Jul 31 09:50:47 user nova-compute[71113]:     </interface>
Jul 31 09:50:47 user nova-compute[71113]:     <serial type="pty">
Jul 31 09:50:47 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/console.log" append="off"/>
Jul 31 09:50:47 user nova-compute[71113]:     </serial>
Jul 31 09:50:47 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 09:50:47 user nova-compute[71113]:     <video>
Jul 31 09:50:47 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:50:47 user nova-compute[71113]:     </video>
Jul 31 09:50:47 user nova-compute[71113]:     <rng model="virtio">
Jul 31 09:50:47 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 09:50:47 user nova-compute[71113]:     </rng>
Jul 31 09:50:47 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 09:50:47 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 09:50:47 user nova-compute[71113]:       <stats period="10"/>
Jul 31 09:50:47 user nova-compute[71113]:     </memballoon>
Jul 31 09:50:47 user nova-compute[71113]:   </devices>
Jul 31 09:50:47 user nova-compute[71113]: </domain>
Jul 31 09:50:47 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 09:50:47 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:46:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1025510923',display_name='tempest-ServerActionsTestOtherB-server-1025510923',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1025510923',id=3,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJo+xi4tu0GGLLf+2/4AMwJN8W9HV5KOFul5csHl5tHCHdJymtchsdGYmiKLfCyzN953/rO7ubVJnctaNhLzLpYKjY5Z2Nn1cEvYAzU5x1ZT5edLumoNfJjhx0wRkZgiEQ==',key_name='tempest-keypair-947034726',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:46:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a5bb5c0790e54702b881dc5e45641be8',ramdisk_id='',reservation_id='r-o5vysyfg',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1778056817',owner_user_name='tempest-ServerActionsTestOtherB-1778056817-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:50:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b5f449e8b1948cf914daef537aea164',uuid=efa311a0-fe2e-4c0f-af66-09c3eb38fbf1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "address": "fa:16:3e:16:bb:aa", "network": {"id": "4f2ea02a-9b26-4f2a-af23-39c060703ff3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-725518740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-725518740-network", "vif_mac": "fa:16:3e:16:bb:aa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5bb5c0790e54702b881dc5e45641be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b5a493-47", "ovs_interfaceid": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 09:50:47 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Converting VIF {"id": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "address": "fa:16:3e:16:bb:aa", "network": {"id": "4f2ea02a-9b26-4f2a-af23-39c060703ff3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-725518740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-725518740-network", "vif_mac": "fa:16:3e:16:bb:aa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5bb5c0790e54702b881dc5e45641be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b5a493-47", "ovs_interfaceid": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:50:47 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:bb:aa,bridge_name='br-int',has_traffic_filtering=True,id=39b5a493-47bd-4599-9a9f-bb80c93fb332,network=Network(4f2ea02a-9b26-4f2a-af23-39c060703ff3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39b5a493-47') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:50:47 user nova-compute[71113]: DEBUG os_vif [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:bb:aa,bridge_name='br-int',has_traffic_filtering=True,id=39b5a493-47bd-4599-9a9f-bb80c93fb332,network=Network(4f2ea02a-9b26-4f2a-af23-39c060703ff3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39b5a493-47') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 09:50:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:50:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 09:50:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap39b5a493-47, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:50:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap39b5a493-47, col_values=(('external_ids', {'iface-id': '39b5a493-47bd-4599-9a9f-bb80c93fb332', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:bb:aa', 'vm-uuid': 'efa311a0-fe2e-4c0f-af66-09c3eb38fbf1'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:50:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:50:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:47 user nova-compute[71113]: INFO os_vif [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:bb:aa,bridge_name='br-int',has_traffic_filtering=True,id=39b5a493-47bd-4599-9a9f-bb80c93fb332,network=Network(4f2ea02a-9b26-4f2a-af23-39c060703ff3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39b5a493-47')
Jul 31 09:50:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:50:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:50:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] No VIF found with MAC fa:16:3e:16:bb:aa, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 09:50:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:49 user nova-compute[71113]: DEBUG nova.compute.manager [req-77497dde-96fd-4730-9960-eca38b24106d req-0c872fa0-19da-4f63-8608-256dec0624fa service nova] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Received event network-vif-plugged-39b5a493-47bd-4599-9a9f-bb80c93fb332 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:50:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-77497dde-96fd-4730-9960-eca38b24106d req-0c872fa0-19da-4f63-8608-256dec0624fa service nova] Acquiring lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:50:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-77497dde-96fd-4730-9960-eca38b24106d req-0c872fa0-19da-4f63-8608-256dec0624fa service nova] Lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:50:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-77497dde-96fd-4730-9960-eca38b24106d req-0c872fa0-19da-4f63-8608-256dec0624fa service nova] Lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:50:49 user nova-compute[71113]: DEBUG nova.compute.manager [req-77497dde-96fd-4730-9960-eca38b24106d req-0c872fa0-19da-4f63-8608-256dec0624fa service nova] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] No waiting events found dispatching network-vif-plugged-39b5a493-47bd-4599-9a9f-bb80c93fb332 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:50:49 user nova-compute[71113]: WARNING nova.compute.manager [req-77497dde-96fd-4730-9960-eca38b24106d req-0c872fa0-19da-4f63-8608-256dec0624fa service nova] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Received unexpected event network-vif-plugged-39b5a493-47bd-4599-9a9f-bb80c93fb332 for instance with vm_state active and task_state resize_finish.
Jul 31 09:50:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:51 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797051.6724186, efa311a0-fe2e-4c0f-af66-09c3eb38fbf1 => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:50:51 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] VM Resumed (Lifecycle Event)
Jul 31 09:50:51 user nova-compute[71113]: DEBUG nova.compute.manager [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 09:50:51 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Instance running successfully.
Jul 31 09:50:51 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Failed to set time: agent not configured {{(pid=71113) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Jul 31 09:50:51 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-61a5dcc0-d371-400f-9cac-7d8244082cab tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] finish_migration finished successfully. {{(pid=71113) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Jul 31 09:50:51 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:50:51 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:50:51 user nova-compute[71113]: DEBUG nova.compute.manager [req-c5e4bace-2633-4ad1-a75c-faaba27e4f92 req-de12ed13-557c-46a3-a923-d9bb88649450 service nova] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Received event network-vif-plugged-39b5a493-47bd-4599-9a9f-bb80c93fb332 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:50:51 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-c5e4bace-2633-4ad1-a75c-faaba27e4f92 req-de12ed13-557c-46a3-a923-d9bb88649450 service nova] Acquiring lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:50:51 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-c5e4bace-2633-4ad1-a75c-faaba27e4f92 req-de12ed13-557c-46a3-a923-d9bb88649450 service nova] Lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:50:51 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-c5e4bace-2633-4ad1-a75c-faaba27e4f92 req-de12ed13-557c-46a3-a923-d9bb88649450 service nova] Lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:50:51 user nova-compute[71113]: DEBUG nova.compute.manager [req-c5e4bace-2633-4ad1-a75c-faaba27e4f92 req-de12ed13-557c-46a3-a923-d9bb88649450 service nova] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] No waiting events found dispatching network-vif-plugged-39b5a493-47bd-4599-9a9f-bb80c93fb332 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:50:51 user nova-compute[71113]: WARNING nova.compute.manager [req-c5e4bace-2633-4ad1-a75c-faaba27e4f92 req-de12ed13-557c-46a3-a923-d9bb88649450 service nova] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Received unexpected event network-vif-plugged-39b5a493-47bd-4599-9a9f-bb80c93fb332 for instance with vm_state active and task_state resize_finish.
Jul 31 09:50:51 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 31 09:50:51 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797051.673837, efa311a0-fe2e-4c0f-af66-09c3eb38fbf1 => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:50:51 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] VM Started (Lifecycle Event)
Jul 31 09:50:51 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:50:51 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:50:51 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 31 09:50:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquiring lock "3157a7a6-b8a9-4e2d-a157-360bce4c625d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:50:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "3157a7a6-b8a9-4e2d-a157-360bce4c625d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:50:52 user nova-compute[71113]: DEBUG nova.compute.manager [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Starting instance... {{(pid=71113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 09:50:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:50:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:50:52 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 09:50:52 user nova-compute[71113]: INFO nova.compute.claims [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Claim successful on node user
Jul 31 09:50:52 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:50:52 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:50:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.616s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:50:52 user nova-compute[71113]: DEBUG nova.compute.manager [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Start building networks asynchronously for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 09:50:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:53 user nova-compute[71113]: DEBUG nova.compute.manager [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Allocating IP information in the background. {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 09:50:53 user nova-compute[71113]: DEBUG nova.network.neutron [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] allocate_for_instance() {{(pid=71113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 09:50:53 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 09:50:53 user nova-compute[71113]: DEBUG nova.compute.manager [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Start building block device mappings for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 09:50:53 user nova-compute[71113]: DEBUG nova.policy [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f4f505d5eddc4df48ec267f6f69a01f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88bbf2636f6248fcbe644af4eab0c823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71113) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 09:50:53 user nova-compute[71113]: DEBUG nova.compute.manager [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Start spawning the instance on the hypervisor. {{(pid=71113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 09:50:53 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 09:50:53 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Creating image(s)
Jul 31 09:50:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquiring lock "/opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:50:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "/opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:50:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "/opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:50:53 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:53 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.221s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquiring lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:50:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:50:53 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:53 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.190s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:53 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk 1073741824 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:53 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk 1073741824" returned: 0 in 0.067s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:50:53 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:53 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:53 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.201s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:53 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk. size=1073741824 {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 09:50:53 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:54 user nova-compute[71113]: DEBUG nova.network.neutron [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Successfully created port: 179480f5-30b9-4a11-9771-95d88f21574f {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 09:50:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:54 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Cannot resize image /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk to a smaller size. {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 09:50:54 user nova-compute[71113]: DEBUG nova.objects.instance [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lazy-loading 'migration_context' on Instance uuid 3157a7a6-b8a9-4e2d-a157-360bce4c625d {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:50:54 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Created local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 09:50:54 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Ensure instance console log exists: /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 09:50:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:50:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:50:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:50:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-775607a7-04b9-4c2b-8894-f6f43873d9fa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Acquiring lock "8d033eac-23ea-417a-981c-578328f1c3ac" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:50:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-775607a7-04b9-4c2b-8894-f6f43873d9fa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "8d033eac-23ea-417a-981c-578328f1c3ac" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:50:55 user nova-compute[71113]: INFO nova.compute.manager [None req-775607a7-04b9-4c2b-8894-f6f43873d9fa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Detaching volume a1d87956-535e-4821-88d6-6947e9c926a0
Jul 31 09:50:55 user nova-compute[71113]: INFO nova.virt.block_device [None req-775607a7-04b9-4c2b-8894-f6f43873d9fa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Attempting to driver detach volume a1d87956-535e-4821-88d6-6947e9c926a0 from mountpoint /dev/vdb
Jul 31 09:50:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-2923f750-18c5-4878-b688-282218bf404b tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Acquiring lock "8d033eac-23ea-417a-981c-578328f1c3ac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:50:55 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-775607a7-04b9-4c2b-8894-f6f43873d9fa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Attempting to detach device vdb from instance 8d033eac-23ea-417a-981c-578328f1c3ac from the persistent domain config. {{(pid=71113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 09:50:55 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-775607a7-04b9-4c2b-8894-f6f43873d9fa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 09:50:55 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:50:55 user nova-compute[71113]:   <source dev="/dev/sdd"/>
Jul 31 09:50:55 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 09:50:55 user nova-compute[71113]:   <serial>a1d87956-535e-4821-88d6-6947e9c926a0</serial>
Jul 31 09:50:55 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 09:50:55 user nova-compute[71113]: </disk>
Jul 31 09:50:55 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 09:50:55 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-775607a7-04b9-4c2b-8894-f6f43873d9fa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Successfully detached device vdb from instance 8d033eac-23ea-417a-981c-578328f1c3ac from the persistent domain config.
Jul 31 09:50:55 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-775607a7-04b9-4c2b-8894-f6f43873d9fa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8d033eac-23ea-417a-981c-578328f1c3ac from the live domain config. {{(pid=71113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 09:50:55 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-775607a7-04b9-4c2b-8894-f6f43873d9fa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 09:50:55 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:50:55 user nova-compute[71113]:   <source dev="/dev/sdd"/>
Jul 31 09:50:55 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 09:50:55 user nova-compute[71113]:   <serial>a1d87956-535e-4821-88d6-6947e9c926a0</serial>
Jul 31 09:50:55 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 09:50:55 user nova-compute[71113]: </disk>
Jul 31 09:50:55 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 09:50:55 user nova-compute[71113]: DEBUG nova.network.neutron [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Successfully updated port: 179480f5-30b9-4a11-9771-95d88f21574f {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 09:50:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquiring lock "refresh_cache-3157a7a6-b8a9-4e2d-a157-360bce4c625d" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:50:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquired lock "refresh_cache-3157a7a6-b8a9-4e2d-a157-360bce4c625d" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:50:55 user nova-compute[71113]: DEBUG nova.network.neutron [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 09:50:55 user nova-compute[71113]: DEBUG nova.compute.manager [req-5ae219db-0165-4f10-b101-3af5316a59e4 req-eabfa9d8-9154-4768-af04-4fd7c3001784 service nova] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Received event network-changed-179480f5-30b9-4a11-9771-95d88f21574f {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:50:55 user nova-compute[71113]: DEBUG nova.compute.manager [req-5ae219db-0165-4f10-b101-3af5316a59e4 req-eabfa9d8-9154-4768-af04-4fd7c3001784 service nova] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Refreshing instance network info cache due to event network-changed-179480f5-30b9-4a11-9771-95d88f21574f. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:50:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-5ae219db-0165-4f10-b101-3af5316a59e4 req-eabfa9d8-9154-4768-af04-4fd7c3001784 service nova] Acquiring lock "refresh_cache-3157a7a6-b8a9-4e2d-a157-360bce4c625d" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:50:55 user nova-compute[71113]: DEBUG nova.network.neutron [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 09:50:55 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Received event <DeviceRemovedEvent: 1690797055.8777936, 8d033eac-23ea-417a-981c-578328f1c3ac => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71113) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 09:50:55 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-775607a7-04b9-4c2b-8894-f6f43873d9fa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8d033eac-23ea-417a-981c-578328f1c3ac {{(pid=71113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 09:50:55 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-775607a7-04b9-4c2b-8894-f6f43873d9fa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Successfully detached device vdb from instance 8d033eac-23ea-417a-981c-578328f1c3ac from the live domain config.
Jul 31 09:50:55 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-775607a7-04b9-4c2b-8894-f6f43873d9fa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 09:50:55 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-775607a7-04b9-4c2b-8894-f6f43873d9fa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oOVGxhdF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:50:55 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-775607a7-04b9-4c2b-8894-f6f43873d9fa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:50:55 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-775607a7-04b9-4c2b-8894-f6f43873d9fa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:50:55 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-775607a7-04b9-4c2b-8894-f6f43873d9fa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:50:55 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-775607a7-04b9-4c2b-8894-f6f43873d9fa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 09:50:55 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:55 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:55 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6da4b9-750b-4405-ab62-3160ada006be]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:55 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:55 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:55 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8e6dfd-9066-4585-ab36-c13218baa1a8]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:55 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-775607a7-04b9-4c2b-8894-f6f43873d9fa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:50:55 user nova-compute[71113]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0 (non-flash)
Jul 31 09:50:55 user nova-compute[71113]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be (non-flash)
Jul 31 09:50:55 user nova-compute[71113]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:50:55 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:50:55 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-775607a7-04b9-4c2b-8894-f6f43873d9fa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:50:55 user nova-compute[71113]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0 (non-flash)
Jul 31 09:50:55 user nova-compute[71113]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be (non-flash)
Jul 31 09:50:55 user nova-compute[71113]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:50:55 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:50:55 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-775607a7-04b9-4c2b-8894-f6f43873d9fa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7916f9b1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0'): ({'sdd'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 09:50:55 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-775607a7-04b9-4c2b-8894-f6f43873d9fa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Removing single pathed devices sdd {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 09:50:55 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:55 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:55 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0261ebd-ab2b-4433-af9b-3b685e064346]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:55 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[704153ea-9556-4fb7-88a7-365feba9f6d0]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-775607a7-04b9-4c2b-8894-f6f43873d9fa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Flushing IO for device /dev/sdd {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f89d7e4-cb5f-4544-bf90-f6b589ea0dbb]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-775607a7-04b9-4c2b-8894-f6f43873d9fa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG nova.network.neutron [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Updating instance_info_cache with network_info: [{"id": "179480f5-30b9-4a11-9771-95d88f21574f", "address": "fa:16:3e:42:ea:05", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap179480f5-30", "ovs_interfaceid": "179480f5-30b9-4a11-9771-95d88f21574f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce4b231-2f96-4b35-9653-a9553bb21563]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-775607a7-04b9-4c2b-8894-f6f43873d9fa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-775607a7-04b9-4c2b-8894-f6f43873d9fa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] SCSI volumes sdd have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-775607a7-04b9-4c2b-8894-f6f43873d9fa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.110s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a7edd3-cb28-4d1a-b3fe-c3ddcbdd6e35]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-775607a7-04b9-4c2b-8894-f6f43873d9fa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Releasing lock "refresh_cache-3157a7a6-b8a9-4e2d-a157-360bce4c625d" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG nova.compute.manager [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Instance network_info: |[{"id": "179480f5-30b9-4a11-9771-95d88f21574f", "address": "fa:16:3e:42:ea:05", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap179480f5-30", "ovs_interfaceid": "179480f5-30b9-4a11-9771-95d88f21574f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0 -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-5ae219db-0165-4f10-b101-3af5316a59e4 req-eabfa9d8-9154-4768-af04-4fd7c3001784 service nova] Acquired lock "refresh_cache-3157a7a6-b8a9-4e2d-a157-360bce4c625d" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG nova.network.neutron [req-5ae219db-0165-4f10-b101-3af5316a59e4 req-eabfa9d8-9154-4768-af04-4fd7c3001784 service nova] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Refreshing network info cache for port 179480f5-30b9-4a11-9771-95d88f21574f {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Start _get_guest_xml network_info=[{"id": "179480f5-30b9-4a11-9771-95d88f21574f", "address": "fa:16:3e:42:ea:05", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap179480f5-30", "ovs_interfaceid": "179480f5-30b9-4a11-9771-95d88f21574f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'image_id': '078646fe-b504-41ed-a147-61072e903e51'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 09:50:56 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:50:56 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:50:56 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:50:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1017207621',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1017207621',id=16,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88bbf2636f6248fcbe644af4eab0c823',ramdisk_id='',reservation_id='r-z062qlau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1194948978',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:50:53Z,user_data=None,user_id='f4f505d5eddc4df48ec267f6f69a01f9',uuid=3157a7a6-b8a9-4e2d-a157-360bce4c625d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "179480f5-30b9-4a11-9771-95d88f21574f", "address": "fa:16:3e:42:ea:05", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap179480f5-30", "ovs_interfaceid": "179480f5-30b9-4a11-9771-95d88f21574f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Converting VIF {"id": "179480f5-30b9-4a11-9771-95d88f21574f", "address": "fa:16:3e:42:ea:05", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap179480f5-30", "ovs_interfaceid": "179480f5-30b9-4a11-9771-95d88f21574f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:ea:05,bridge_name='br-int',has_traffic_filtering=True,id=179480f5-30b9-4a11-9771-95d88f21574f,network=Network(6f88bfaa-d58d-4ac2-b43d-0689d50456ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap179480f5-30') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG nova.objects.instance [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lazy-loading 'pci_devices' on Instance uuid 3157a7a6-b8a9-4e2d-a157-360bce4c625d {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb8ec32-2440-46dc-b398-e7503dc670ca]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-775607a7-04b9-4c2b-8894-f6f43873d9fa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0, portal: 172.16.0.220,3260]
Jul 31 09:50:56 user nova-compute[71113]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0, portal: 172.16.0.220,3260] successful.
Jul 31 09:50:56 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0 -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] End _get_guest_xml xml=<domain type="kvm">
Jul 31 09:50:56 user nova-compute[71113]:   <uuid>3157a7a6-b8a9-4e2d-a157-360bce4c625d</uuid>
Jul 31 09:50:56 user nova-compute[71113]:   <name>instance-00000010</name>
Jul 31 09:50:56 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 09:50:56 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 09:50:56 user nova-compute[71113]:   <metadata>
Jul 31 09:50:56 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 09:50:56 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 09:50:56 user nova-compute[71113]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1017207621</nova:name>
Jul 31 09:50:56 user nova-compute[71113]:       <nova:creationTime>2023-07-31 09:50:56</nova:creationTime>
Jul 31 09:50:56 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 09:50:56 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 09:50:56 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 09:50:56 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 09:50:56 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 09:50:56 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 09:50:56 user nova-compute[71113]:       </nova:flavor>
Jul 31 09:50:56 user nova-compute[71113]:       <nova:owner>
Jul 31 09:50:56 user nova-compute[71113]:         <nova:user uuid="f4f505d5eddc4df48ec267f6f69a01f9">tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member</nova:user>
Jul 31 09:50:56 user nova-compute[71113]:         <nova:project uuid="88bbf2636f6248fcbe644af4eab0c823">tempest-ServerBootFromVolumeStableRescueTest-1194948978</nova:project>
Jul 31 09:50:56 user nova-compute[71113]:       </nova:owner>
Jul 31 09:50:56 user nova-compute[71113]:       <nova:root type="image" uuid="078646fe-b504-41ed-a147-61072e903e51"/>
Jul 31 09:50:56 user nova-compute[71113]:       <nova:ports>
Jul 31 09:50:56 user nova-compute[71113]:         <nova:port uuid="179480f5-30b9-4a11-9771-95d88f21574f">
Jul 31 09:50:56 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 31 09:50:56 user nova-compute[71113]:         </nova:port>
Jul 31 09:50:56 user nova-compute[71113]:       </nova:ports>
Jul 31 09:50:56 user nova-compute[71113]:     </nova:instance>
Jul 31 09:50:56 user nova-compute[71113]:   </metadata>
Jul 31 09:50:56 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 09:50:56 user nova-compute[71113]:     <system>
Jul 31 09:50:56 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 09:50:56 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 09:50:56 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 09:50:56 user nova-compute[71113]:       <entry name="serial">3157a7a6-b8a9-4e2d-a157-360bce4c625d</entry>
Jul 31 09:50:56 user nova-compute[71113]:       <entry name="uuid">3157a7a6-b8a9-4e2d-a157-360bce4c625d</entry>
Jul 31 09:50:56 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 09:50:56 user nova-compute[71113]:     </system>
Jul 31 09:50:56 user nova-compute[71113]:   </sysinfo>
Jul 31 09:50:56 user nova-compute[71113]:   <os>
Jul 31 09:50:56 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 09:50:56 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 09:50:56 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 09:50:56 user nova-compute[71113]:   </os>
Jul 31 09:50:56 user nova-compute[71113]:   <features>
Jul 31 09:50:56 user nova-compute[71113]:     <acpi/>
Jul 31 09:50:56 user nova-compute[71113]:     <apic/>
Jul 31 09:50:56 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 09:50:56 user nova-compute[71113]:   </features>
Jul 31 09:50:56 user nova-compute[71113]:   <clock offset="utc">
Jul 31 09:50:56 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 09:50:56 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 09:50:56 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 09:50:56 user nova-compute[71113]:   </clock>
Jul 31 09:50:56 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 09:50:56 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 09:50:56 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 09:50:56 user nova-compute[71113]:   </cpu>
Jul 31 09:50:56 user nova-compute[71113]:   <devices>
Jul 31 09:50:56 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 09:50:56 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 09:50:56 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk"/>
Jul 31 09:50:56 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 09:50:56 user nova-compute[71113]:     </disk>
Jul 31 09:50:56 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 09:50:56 user nova-compute[71113]:       <mac address="fa:16:3e:42:ea:05"/>
Jul 31 09:50:56 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:50:56 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 09:50:56 user nova-compute[71113]:       <target dev="tap179480f5-30"/>
Jul 31 09:50:56 user nova-compute[71113]:     </interface>
Jul 31 09:50:56 user nova-compute[71113]:     <serial type="pty">
Jul 31 09:50:56 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/console.log" append="off"/>
Jul 31 09:50:56 user nova-compute[71113]:     </serial>
Jul 31 09:50:56 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 09:50:56 user nova-compute[71113]:     <video>
Jul 31 09:50:56 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:50:56 user nova-compute[71113]:     </video>
Jul 31 09:50:56 user nova-compute[71113]:     <rng model="virtio">
Jul 31 09:50:56 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 09:50:56 user nova-compute[71113]:     </rng>
Jul 31 09:50:56 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 09:50:56 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 09:50:56 user nova-compute[71113]:       <stats period="10"/>
Jul 31 09:50:56 user nova-compute[71113]:     </memballoon>
Jul 31 09:50:56 user nova-compute[71113]:   </devices>
Jul 31 09:50:56 user nova-compute[71113]: </domain>
Jul 31 09:50:56 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:50:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1017207621',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1017207621',id=16,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88bbf2636f6248fcbe644af4eab0c823',ramdisk_id='',reservation_id='r-z062qlau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1194948978',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:50:53Z,user_data=None,user_id='f4f505d5eddc4df48ec267f6f69a01f9',uuid=3157a7a6-b8a9-4e2d-a157-360bce4c625d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "179480f5-30b9-4a11-9771-95d88f21574f", "address": "fa:16:3e:42:ea:05", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap179480f5-30", "ovs_interfaceid": "179480f5-30b9-4a11-9771-95d88f21574f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Converting VIF {"id": "179480f5-30b9-4a11-9771-95d88f21574f", "address": "fa:16:3e:42:ea:05", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap179480f5-30", "ovs_interfaceid": "179480f5-30b9-4a11-9771-95d88f21574f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:ea:05,bridge_name='br-int',has_traffic_filtering=True,id=179480f5-30b9-4a11-9771-95d88f21574f,network=Network(6f88bfaa-d58d-4ac2-b43d-0689d50456ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap179480f5-30') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG os_vif [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:ea:05,bridge_name='br-int',has_traffic_filtering=True,id=179480f5-30b9-4a11-9771-95d88f21574f,network=Network(6f88bfaa-d58d-4ac2-b43d-0689d50456ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap179480f5-30') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap179480f5-30, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap179480f5-30, col_values=(('external_ids', {'iface-id': '179480f5-30b9-4a11-9771-95d88f21574f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:ea:05', 'vm-uuid': '3157a7a6-b8a9-4e2d-a157-360bce4c625d'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a807f0b2-bb71-45ca-9f6d-39aa55e908be]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-775607a7-04b9-4c2b-8894-f6f43873d9fa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-775607a7-04b9-4c2b-8894-f6f43873d9fa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.437s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-775607a7-04b9-4c2b-8894-f6f43873d9fa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] <== disconnect_volume: return (439ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-775607a7-04b9-4c2b-8894-f6f43873d9fa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:56 user nova-compute[71113]: INFO os_vif [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:ea:05,bridge_name='br-int',has_traffic_filtering=True,id=179480f5-30b9-4a11-9771-95d88f21574f,network=Network(6f88bfaa-d58d-4ac2-b43d-0689d50456ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap179480f5-30')
Jul 31 09:50:56 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] No VIF found with MAC fa:16:3e:42:ea:05, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG nova.network.neutron [req-5ae219db-0165-4f10-b101-3af5316a59e4 req-eabfa9d8-9154-4768-af04-4fd7c3001784 service nova] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Updated VIF entry in instance network info cache for port 179480f5-30b9-4a11-9771-95d88f21574f. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG nova.network.neutron [req-5ae219db-0165-4f10-b101-3af5316a59e4 req-eabfa9d8-9154-4768-af04-4fd7c3001784 service nova] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Updating instance_info_cache with network_info: [{"id": "179480f5-30b9-4a11-9771-95d88f21574f", "address": "fa:16:3e:42:ea:05", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap179480f5-30", "ovs_interfaceid": "179480f5-30b9-4a11-9771-95d88f21574f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:50:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-5ae219db-0165-4f10-b101-3af5316a59e4 req-eabfa9d8-9154-4768-af04-4fd7c3001784 service nova] Releasing lock "refresh_cache-3157a7a6-b8a9-4e2d-a157-360bce4c625d" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:50:57 user nova-compute[71113]: DEBUG nova.objects.instance [None req-775607a7-04b9-4c2b-8894-f6f43873d9fa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lazy-loading 'flavor' on Instance uuid 8d033eac-23ea-417a-981c-578328f1c3ac {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:50:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-775607a7-04b9-4c2b-8894-f6f43873d9fa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "8d033eac-23ea-417a-981c-578328f1c3ac" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.263s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:50:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-2923f750-18c5-4878-b688-282218bf404b tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "8d033eac-23ea-417a-981c-578328f1c3ac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 2.107s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:50:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-2923f750-18c5-4878-b688-282218bf404b tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Acquiring lock "8d033eac-23ea-417a-981c-578328f1c3ac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:50:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-2923f750-18c5-4878-b688-282218bf404b tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "8d033eac-23ea-417a-981c-578328f1c3ac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:50:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-2923f750-18c5-4878-b688-282218bf404b tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "8d033eac-23ea-417a-981c-578328f1c3ac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:50:57 user nova-compute[71113]: INFO nova.compute.manager [None req-2923f750-18c5-4878-b688-282218bf404b tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Terminating instance
Jul 31 09:50:57 user nova-compute[71113]: DEBUG nova.compute.manager [None req-2923f750-18c5-4878-b688-282218bf404b tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Start destroying the instance on the hypervisor. {{(pid=71113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 09:50:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:57 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:50:57 user nova-compute[71113]: DEBUG nova.compute.manager [req-c7991cd0-3f94-4f1b-a880-0fe69a67e2b1 req-67ed1a0c-0ed2-4803-8117-1a2ac23786fd service nova] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Received event network-vif-unplugged-a9e62527-eba5-484a-9b2d-6ff8fdead8e9 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:50:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-c7991cd0-3f94-4f1b-a880-0fe69a67e2b1 req-67ed1a0c-0ed2-4803-8117-1a2ac23786fd service nova] Acquiring lock "8d033eac-23ea-417a-981c-578328f1c3ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:50:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-c7991cd0-3f94-4f1b-a880-0fe69a67e2b1 req-67ed1a0c-0ed2-4803-8117-1a2ac23786fd service nova] Lock "8d033eac-23ea-417a-981c-578328f1c3ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:50:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-c7991cd0-3f94-4f1b-a880-0fe69a67e2b1 req-67ed1a0c-0ed2-4803-8117-1a2ac23786fd service nova] Lock "8d033eac-23ea-417a-981c-578328f1c3ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:50:57 user nova-compute[71113]: DEBUG nova.compute.manager [req-c7991cd0-3f94-4f1b-a880-0fe69a67e2b1 req-67ed1a0c-0ed2-4803-8117-1a2ac23786fd service nova] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] No waiting events found dispatching network-vif-unplugged-a9e62527-eba5-484a-9b2d-6ff8fdead8e9 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:50:57 user nova-compute[71113]: DEBUG nova.compute.manager [req-c7991cd0-3f94-4f1b-a880-0fe69a67e2b1 req-67ed1a0c-0ed2-4803-8117-1a2ac23786fd service nova] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Received event network-vif-unplugged-a9e62527-eba5-484a-9b2d-6ff8fdead8e9 for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 09:50:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:58 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:58 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:58 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:58 user nova-compute[71113]: DEBUG nova.compute.manager [req-4fd32326-5798-4046-844e-68c3943f4fb8 req-8a0414b1-cf07-49d9-a729-7e71c0cdfc8e service nova] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Received event network-vif-plugged-179480f5-30b9-4a11-9771-95d88f21574f {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:50:58 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-4fd32326-5798-4046-844e-68c3943f4fb8 req-8a0414b1-cf07-49d9-a729-7e71c0cdfc8e service nova] Acquiring lock "3157a7a6-b8a9-4e2d-a157-360bce4c625d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:50:58 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-4fd32326-5798-4046-844e-68c3943f4fb8 req-8a0414b1-cf07-49d9-a729-7e71c0cdfc8e service nova] Lock "3157a7a6-b8a9-4e2d-a157-360bce4c625d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:50:58 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-4fd32326-5798-4046-844e-68c3943f4fb8 req-8a0414b1-cf07-49d9-a729-7e71c0cdfc8e service nova] Lock "3157a7a6-b8a9-4e2d-a157-360bce4c625d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:50:58 user nova-compute[71113]: DEBUG nova.compute.manager [req-4fd32326-5798-4046-844e-68c3943f4fb8 req-8a0414b1-cf07-49d9-a729-7e71c0cdfc8e service nova] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] No waiting events found dispatching network-vif-plugged-179480f5-30b9-4a11-9771-95d88f21574f {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:50:58 user nova-compute[71113]: WARNING nova.compute.manager [req-4fd32326-5798-4046-844e-68c3943f4fb8 req-8a0414b1-cf07-49d9-a729-7e71c0cdfc8e service nova] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Received unexpected event network-vif-plugged-179480f5-30b9-4a11-9771-95d88f21574f for instance with vm_state building and task_state spawning.
Jul 31 09:50:58 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Instance destroyed successfully.
Jul 31 09:50:58 user nova-compute[71113]: DEBUG nova.objects.instance [None req-2923f750-18c5-4878-b688-282218bf404b tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lazy-loading 'resources' on Instance uuid 8d033eac-23ea-417a-981c-578328f1c3ac {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:50:58 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:58 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-2923f750-18c5-4878-b688-282218bf404b tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:48:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1395689819',display_name='tempest-VolumesSnapshotTestJSON-instance-1395689819',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1395689819',id=10,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBM68OHMA/jy9YdMp/DCJ+Up8xJwSip5H1pkoGQlX8MBodT5uqjpAyYMuOgadOnE+4/5VngPbBYaoJPsrKZAeD1A9tG8iPlticCkV9M0OtB4+6kpePx2gtYkCDLjoSSFaw==',key_name='tempest-keypair-559321023',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:48:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b02dfb26bc2472baef63892ab5b2492',ramdisk_id='',reservation_id='r-msu08b01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1215488088',owner_user_name='tempest-VolumesSnapshotTestJSON-1215488088-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:48:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e57ba3fd2d7a4d21a7653020def3f884',uuid=8d033eac-23ea-417a-981c-578328f1c3ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a9e62527-eba5-484a-9b2d-6ff8fdead8e9", "address": "fa:16:3e:04:98:ca", "network": {"id": "2ce9c333-b413-4073-af8c-2e583872df61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1283872978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b02dfb26bc2472baef63892ab5b2492", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e62527-eb", "ovs_interfaceid": "a9e62527-eba5-484a-9b2d-6ff8fdead8e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 09:50:58 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-2923f750-18c5-4878-b688-282218bf404b tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Converting VIF {"id": "a9e62527-eba5-484a-9b2d-6ff8fdead8e9", "address": "fa:16:3e:04:98:ca", "network": {"id": "2ce9c333-b413-4073-af8c-2e583872df61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1283872978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b02dfb26bc2472baef63892ab5b2492", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e62527-eb", "ovs_interfaceid": "a9e62527-eba5-484a-9b2d-6ff8fdead8e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:50:58 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-2923f750-18c5-4878-b688-282218bf404b tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:98:ca,bridge_name='br-int',has_traffic_filtering=True,id=a9e62527-eba5-484a-9b2d-6ff8fdead8e9,network=Network(2ce9c333-b413-4073-af8c-2e583872df61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9e62527-eb') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:50:58 user nova-compute[71113]: DEBUG os_vif [None req-2923f750-18c5-4878-b688-282218bf404b tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:98:ca,bridge_name='br-int',has_traffic_filtering=True,id=a9e62527-eba5-484a-9b2d-6ff8fdead8e9,network=Network(2ce9c333-b413-4073-af8c-2e583872df61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9e62527-eb') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 09:50:58 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:58 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa9e62527-eb, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:50:58 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:58 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:50:58 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:58 user nova-compute[71113]: INFO os_vif [None req-2923f750-18c5-4878-b688-282218bf404b tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:98:ca,bridge_name='br-int',has_traffic_filtering=True,id=a9e62527-eba5-484a-9b2d-6ff8fdead8e9,network=Network(2ce9c333-b413-4073-af8c-2e583872df61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9e62527-eb')
Jul 31 09:50:58 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2923f750-18c5-4878-b688-282218bf404b tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 09:50:58 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2923f750-18c5-4878-b688-282218bf404b tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oOVGxhdF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:50:58 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-2923f750-18c5-4878-b688-282218bf404b tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:50:58 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-2923f750-18c5-4878-b688-282218bf404b tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:50:58 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-2923f750-18c5-4878-b688-282218bf404b tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:50:58 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2923f750-18c5-4878-b688-282218bf404b tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1d87956-535e-4821-88d6-6947e9c926a0', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 09:50:58 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:58 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:58 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a560095-b927-4a8f-a8a5-5f8bea7cb575]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:58 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:50:58 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:50:58 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66b5249-a14b-4abb-a054-c2cba05bec27]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:50:58 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2923f750-18c5-4878-b688-282218bf404b tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:50:58 user nova-compute[71113]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be (non-flash)
Jul 31 09:50:58 user nova-compute[71113]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:50:58 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:50:58 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2923f750-18c5-4878-b688-282218bf404b tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:50:58 user nova-compute[71113]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be (non-flash)
Jul 31 09:50:58 user nova-compute[71113]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:50:58 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:50:58 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2923f750-18c5-4878-b688-282218bf404b tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f78f07925f0>, {}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 09:50:58 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2923f750-18c5-4878-b688-282218bf404b tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Disconnecting from: [] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 09:50:58 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-2923f750-18c5-4878-b688-282218bf404b tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.057s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:50:58 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2923f750-18c5-4878-b688-282218bf404b tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] <== disconnect_volume: return (58ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:50:58 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2923f750-18c5-4878-b688-282218bf404b tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 09:50:58 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-2923f750-18c5-4878-b688-282218bf404b tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Deleting instance files /opt/stack/data/nova/instances/8d033eac-23ea-417a-981c-578328f1c3ac_del
Jul 31 09:50:58 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-2923f750-18c5-4878-b688-282218bf404b tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Deletion of /opt/stack/data/nova/instances/8d033eac-23ea-417a-981c-578328f1c3ac_del complete
Jul 31 09:50:58 user nova-compute[71113]: INFO nova.compute.manager [None req-2923f750-18c5-4878-b688-282218bf404b tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Took 1.47 seconds to destroy the instance on the hypervisor.
Jul 31 09:50:58 user nova-compute[71113]: DEBUG oslo.service.loopingcall [None req-2923f750-18c5-4878-b688-282218bf404b tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71113) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 09:50:58 user nova-compute[71113]: DEBUG nova.compute.manager [-] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Deallocating network for instance {{(pid=71113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 09:50:58 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] deallocate_for_instance() {{(pid=71113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 09:50:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:50:59 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:50:59 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:50:59 user nova-compute[71113]: DEBUG nova.compute.manager [req-609abb20-298a-4bfa-9529-7ed4712fa852 req-1ffa2dde-c53e-4215-a055-5eee8c71a559 service nova] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Received event network-vif-plugged-a9e62527-eba5-484a-9b2d-6ff8fdead8e9 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:50:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-609abb20-298a-4bfa-9529-7ed4712fa852 req-1ffa2dde-c53e-4215-a055-5eee8c71a559 service nova] Acquiring lock "8d033eac-23ea-417a-981c-578328f1c3ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:50:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-609abb20-298a-4bfa-9529-7ed4712fa852 req-1ffa2dde-c53e-4215-a055-5eee8c71a559 service nova] Lock "8d033eac-23ea-417a-981c-578328f1c3ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:50:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-609abb20-298a-4bfa-9529-7ed4712fa852 req-1ffa2dde-c53e-4215-a055-5eee8c71a559 service nova] Lock "8d033eac-23ea-417a-981c-578328f1c3ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:50:59 user nova-compute[71113]: DEBUG nova.compute.manager [req-609abb20-298a-4bfa-9529-7ed4712fa852 req-1ffa2dde-c53e-4215-a055-5eee8c71a559 service nova] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] No waiting events found dispatching network-vif-plugged-a9e62527-eba5-484a-9b2d-6ff8fdead8e9 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:50:59 user nova-compute[71113]: WARNING nova.compute.manager [req-609abb20-298a-4bfa-9529-7ed4712fa852 req-1ffa2dde-c53e-4215-a055-5eee8c71a559 service nova] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Received unexpected event network-vif-plugged-a9e62527-eba5-484a-9b2d-6ff8fdead8e9 for instance with vm_state active and task_state deleting.
Jul 31 09:50:59 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:50:59 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Took 1.03 seconds to deallocate network for instance.
Jul 31 09:50:59 user nova-compute[71113]: WARNING nova.volume.cinder [None req-2923f750-18c5-4878-b688-282218bf404b tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Attachment e831c32a-0099-4957-a828-0d644ceceab7 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = e831c32a-0099-4957-a828-0d644ceceab7. (HTTP 404) (Request-ID: req-1bf12c16-f922-4ea0-9e21-9b730bb92a5a)
Jul 31 09:50:59 user nova-compute[71113]: INFO nova.compute.manager [None req-2923f750-18c5-4878-b688-282218bf404b tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Took 0.03 seconds to detach 1 volumes for instance.
Jul 31 09:51:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-2923f750-18c5-4878-b688-282218bf404b tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:51:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-2923f750-18c5-4878-b688-282218bf404b tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:51:00 user nova-compute[71113]: DEBUG nova.compute.manager [req-a11addd2-e1c8-4964-b82b-fe4783a82e4a req-7d74cfd2-c405-4c9b-977c-754ead437353 service nova] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Received event network-vif-plugged-179480f5-30b9-4a11-9771-95d88f21574f {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:51:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-a11addd2-e1c8-4964-b82b-fe4783a82e4a req-7d74cfd2-c405-4c9b-977c-754ead437353 service nova] Acquiring lock "3157a7a6-b8a9-4e2d-a157-360bce4c625d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:51:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-a11addd2-e1c8-4964-b82b-fe4783a82e4a req-7d74cfd2-c405-4c9b-977c-754ead437353 service nova] Lock "3157a7a6-b8a9-4e2d-a157-360bce4c625d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:51:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-a11addd2-e1c8-4964-b82b-fe4783a82e4a req-7d74cfd2-c405-4c9b-977c-754ead437353 service nova] Lock "3157a7a6-b8a9-4e2d-a157-360bce4c625d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:51:00 user nova-compute[71113]: DEBUG nova.compute.manager [req-a11addd2-e1c8-4964-b82b-fe4783a82e4a req-7d74cfd2-c405-4c9b-977c-754ead437353 service nova] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] No waiting events found dispatching network-vif-plugged-179480f5-30b9-4a11-9771-95d88f21574f {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:51:00 user nova-compute[71113]: WARNING nova.compute.manager [req-a11addd2-e1c8-4964-b82b-fe4783a82e4a req-7d74cfd2-c405-4c9b-977c-754ead437353 service nova] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Received unexpected event network-vif-plugged-179480f5-30b9-4a11-9771-95d88f21574f for instance with vm_state building and task_state spawning.
Jul 31 09:51:00 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-2923f750-18c5-4878-b688-282218bf404b tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:51:00 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-2923f750-18c5-4878-b688-282218bf404b tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:51:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-2923f750-18c5-4878-b688-282218bf404b tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.417s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:51:00 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-2923f750-18c5-4878-b688-282218bf404b tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Deleted allocations for instance 8d033eac-23ea-417a-981c-578328f1c3ac
Jul 31 09:51:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-2923f750-18c5-4878-b688-282218bf404b tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "8d033eac-23ea-417a-981c-578328f1c3ac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.176s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:51:00 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797060.6423728, 3157a7a6-b8a9-4e2d-a157-360bce4c625d => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:51:00 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] VM Resumed (Lifecycle Event)
Jul 31 09:51:00 user nova-compute[71113]: DEBUG nova.compute.manager [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 09:51:00 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 09:51:00 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Instance spawned successfully.
Jul 31 09:51:00 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 09:51:00 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:51:00 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:51:00 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Found default for hw_cdrom_bus of ide {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:51:00 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Found default for hw_disk_bus of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:51:00 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Found default for hw_input_bus of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:51:00 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Found default for hw_pointer_model of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:51:00 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Found default for hw_video_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:51:00 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Found default for hw_vif_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:51:00 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:51:00 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797060.6436713, 3157a7a6-b8a9-4e2d-a157-360bce4c625d => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:51:00 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] VM Started (Lifecycle Event)
Jul 31 09:51:00 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:51:00 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:51:00 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:51:00 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:51:00 user nova-compute[71113]: INFO nova.compute.manager [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Took 7.56 seconds to spawn the instance on the hypervisor.
Jul 31 09:51:00 user nova-compute[71113]: DEBUG nova.compute.manager [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:51:00 user nova-compute[71113]: INFO nova.compute.manager [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Took 8.60 seconds to build instance.
Jul 31 09:51:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8ff121e2-6020-4a31-a127-aaf9e3708b27 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "3157a7a6-b8a9-4e2d-a157-360bce4c625d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.709s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:51:01 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:51:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:51:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:51:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:51:01 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 09:51:01 user nova-compute[71113]: DEBUG nova.compute.manager [req-56a8caab-75c5-43f7-9a90-4b2184195b49 req-2e86cb20-248e-4881-9a2f-3aa37601b9ae service nova] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Received event network-vif-deleted-a9e62527-eba5-484a-9b2d-6ff8fdead8e9 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:51:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4df9380-7882-48a6-ba64-bb17429e54ac/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:51:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4df9380-7882-48a6-ba64-bb17429e54ac/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:51:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4df9380-7882-48a6-ba64-bb17429e54ac/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:51:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4df9380-7882-48a6-ba64-bb17429e54ac/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:51:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caac13d2-ceb3-4fee-84ad-5376c1c2cc23/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:51:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caac13d2-ceb3-4fee-84ad-5376c1c2cc23/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:51:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caac13d2-ceb3-4fee-84ad-5376c1c2cc23/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:51:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caac13d2-ceb3-4fee-84ad-5376c1c2cc23/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:51:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae982ade-8b51-4948-879a-f308be7eb685/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:51:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae982ade-8b51-4948-879a-f308be7eb685/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:51:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae982ade-8b51-4948-879a-f308be7eb685/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:51:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae982ade-8b51-4948-879a-f308be7eb685/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:51:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a4b47dd-b335-4c2f-9dee-5421357a0ee1/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:51:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a4b47dd-b335-4c2f-9dee-5421357a0ee1/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:51:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a4b47dd-b335-4c2f-9dee-5421357a0ee1/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:51:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a4b47dd-b335-4c2f-9dee-5421357a0ee1/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:51:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:51:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:51:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:51:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:51:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 09:51:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:51:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:51:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:51:03 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:51:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 09:51:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d2948be-3ebb-4067-a0c8-e2ca884814ff/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:51:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d2948be-3ebb-4067-a0c8-e2ca884814ff/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:51:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d2948be-3ebb-4067-a0c8-e2ca884814ff/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:51:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d2948be-3ebb-4067-a0c8-e2ca884814ff/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:51:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:51:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:51:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:51:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:51:04 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 09:51:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f88bc35b-4996-400e-88ba-5d0f2c3f6c4a/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:51:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f88bc35b-4996-400e-88ba-5d0f2c3f6c4a/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:51:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f88bc35b-4996-400e-88ba-5d0f2c3f6c4a/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:51:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f88bc35b-4996-400e-88ba-5d0f2c3f6c4a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:51:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:51:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:51:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:51:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:51:05 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:51:05 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:51:05 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=7302MB free_disk=25.602535247802734GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 09:51:05 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:51:05 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.003s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:51:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:05 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Applying migration context for instance efa311a0-fe2e-4c0f-af66-09c3eb38fbf1 as it has an incoming, in-progress migration dfc38b1b-b9d8-47ae-afa0-33da541a44c8. Migration status is finished {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Jul 31 09:51:05 user nova-compute[71113]: INFO nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Updating resource usage from migration dfc38b1b-b9d8-47ae-afa0-33da541a44c8
Jul 31 09:51:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 0ea0401b-26c2-4655-956b-1bc000debd53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:51:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 1112a49d-27bd-4fc8-bae6-ec1decbb47db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:51:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance caac13d2-ceb3-4fee-84ad-5376c1c2cc23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:51:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 9a4b47dd-b335-4c2f-9dee-5421357a0ee1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:51:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 8d2948be-3ebb-4067-a0c8-e2ca884814ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:51:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance f88bc35b-4996-400e-88ba-5d0f2c3f6c4a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:51:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance ae982ade-8b51-4948-879a-f308be7eb685 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:51:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance f4df9380-7882-48a6-ba64-bb17429e54ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:51:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Migration dfc38b1b-b9d8-47ae-afa0-33da541a44c8 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Jul 31 09:51:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance efa311a0-fe2e-4c0f-af66-09c3eb38fbf1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:51:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 3157a7a6-b8a9-4e2d-a157-360bce4c625d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:51:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 09:51:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 09:51:06 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:51:06 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:51:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 09:51:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.618s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:51:07 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:51:07 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:51:07 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 09:51:07 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "refresh_cache-caac13d2-ceb3-4fee-84ad-5376c1c2cc23" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:51:07 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquired lock "refresh_cache-caac13d2-ceb3-4fee-84ad-5376c1c2cc23" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:51:07 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Forcefully refreshing network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 09:51:08 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:08 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Updating instance_info_cache with network_info: [{"id": "1bdc8450-11f3-4a96-b68b-42f57ed9dcd9", "address": "fa:16:3e:e8:e4:f6", "network": {"id": "5f0b75d1-03eb-4e68-85fd-8b27d4fda660", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-726146587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "025b7e2f3e894690b9cade6b6df70a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bdc8450-11", "ovs_interfaceid": "1bdc8450-11f3-4a96-b68b-42f57ed9dcd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:51:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Releasing lock "refresh_cache-caac13d2-ceb3-4fee-84ad-5376c1c2cc23" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:51:08 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Updated the network info_cache for instance {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 09:51:08 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:51:08 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:51:08 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 09:51:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:10 user nova-compute[71113]: DEBUG nova.compute.manager [req-c7995fea-e77a-43fc-82f4-e58035ccbac0 req-a6103515-6703-4986-bc5b-c0ccf65ce5c3 service nova] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Received event network-changed-f3560f1f-45f9-4ab3-b7a9-338b0483a656 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:51:10 user nova-compute[71113]: DEBUG nova.compute.manager [req-c7995fea-e77a-43fc-82f4-e58035ccbac0 req-a6103515-6703-4986-bc5b-c0ccf65ce5c3 service nova] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Refreshing instance network info cache due to event network-changed-f3560f1f-45f9-4ab3-b7a9-338b0483a656. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:51:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-c7995fea-e77a-43fc-82f4-e58035ccbac0 req-a6103515-6703-4986-bc5b-c0ccf65ce5c3 service nova] Acquiring lock "refresh_cache-8d2948be-3ebb-4067-a0c8-e2ca884814ff" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:51:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-c7995fea-e77a-43fc-82f4-e58035ccbac0 req-a6103515-6703-4986-bc5b-c0ccf65ce5c3 service nova] Acquired lock "refresh_cache-8d2948be-3ebb-4067-a0c8-e2ca884814ff" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:51:10 user nova-compute[71113]: DEBUG nova.network.neutron [req-c7995fea-e77a-43fc-82f4-e58035ccbac0 req-a6103515-6703-4986-bc5b-c0ccf65ce5c3 service nova] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Refreshing network info cache for port f3560f1f-45f9-4ab3-b7a9-338b0483a656 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:51:11 user nova-compute[71113]: DEBUG nova.network.neutron [req-c7995fea-e77a-43fc-82f4-e58035ccbac0 req-a6103515-6703-4986-bc5b-c0ccf65ce5c3 service nova] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Updated VIF entry in instance network info cache for port f3560f1f-45f9-4ab3-b7a9-338b0483a656. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:51:11 user nova-compute[71113]: DEBUG nova.network.neutron [req-c7995fea-e77a-43fc-82f4-e58035ccbac0 req-a6103515-6703-4986-bc5b-c0ccf65ce5c3 service nova] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Updating instance_info_cache with network_info: [{"id": "f3560f1f-45f9-4ab3-b7a9-338b0483a656", "address": "fa:16:3e:91:a4:b3", "network": {"id": "e498d93a-703d-4d19-9adf-61469f37d4da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1320431580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4461b48e5470471d8fe1b61fb8af9c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3560f1f-45", "ovs_interfaceid": "f3560f1f-45f9-4ab3-b7a9-338b0483a656", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:51:11 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-c7995fea-e77a-43fc-82f4-e58035ccbac0 req-a6103515-6703-4986-bc5b-c0ccf65ce5c3 service nova] Releasing lock "refresh_cache-8d2948be-3ebb-4067-a0c8-e2ca884814ff" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:51:13 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690797058.6209016, 8d033eac-23ea-417a-981c-578328f1c3ac => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:51:13 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] VM Stopped (Lifecycle Event)
Jul 31 09:51:13 user nova-compute[71113]: DEBUG nova.compute.manager [None req-d7d05547-bcea-498d-a4a2-24ebebf0bc49 None None] [instance: 8d033eac-23ea-417a-981c-578328f1c3ac] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:51:13 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-4987326e-5fc5-465d-9ca3-b31266ff3e99 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Acquiring lock "8d2948be-3ebb-4067-a0c8-e2ca884814ff" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:51:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-4987326e-5fc5-465d-9ca3-b31266ff3e99 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "8d2948be-3ebb-4067-a0c8-e2ca884814ff" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:51:15 user nova-compute[71113]: INFO nova.compute.manager [None req-4987326e-5fc5-465d-9ca3-b31266ff3e99 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Shelving
Jul 31 09:51:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:15 user nova-compute[71113]: DEBUG nova.compute.manager [req-03be2f4f-9687-491b-99af-aead8abfbec7 req-e204a4d5-a7bf-4477-bdc6-90608b559596 service nova] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Received event network-vif-unplugged-f3560f1f-45f9-4ab3-b7a9-338b0483a656 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:51:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-03be2f4f-9687-491b-99af-aead8abfbec7 req-e204a4d5-a7bf-4477-bdc6-90608b559596 service nova] Acquiring lock "8d2948be-3ebb-4067-a0c8-e2ca884814ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:51:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-03be2f4f-9687-491b-99af-aead8abfbec7 req-e204a4d5-a7bf-4477-bdc6-90608b559596 service nova] Lock "8d2948be-3ebb-4067-a0c8-e2ca884814ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:51:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-03be2f4f-9687-491b-99af-aead8abfbec7 req-e204a4d5-a7bf-4477-bdc6-90608b559596 service nova] Lock "8d2948be-3ebb-4067-a0c8-e2ca884814ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:51:15 user nova-compute[71113]: DEBUG nova.compute.manager [req-03be2f4f-9687-491b-99af-aead8abfbec7 req-e204a4d5-a7bf-4477-bdc6-90608b559596 service nova] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] No waiting events found dispatching network-vif-unplugged-f3560f1f-45f9-4ab3-b7a9-338b0483a656 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:51:15 user nova-compute[71113]: WARNING nova.compute.manager [req-03be2f4f-9687-491b-99af-aead8abfbec7 req-e204a4d5-a7bf-4477-bdc6-90608b559596 service nova] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Received unexpected event network-vif-unplugged-f3560f1f-45f9-4ab3-b7a9-338b0483a656 for instance with vm_state active and task_state shelving.
Jul 31 09:51:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:16 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Instance destroyed successfully.
Jul 31 09:51:16 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-4987326e-5fc5-465d-9ca3-b31266ff3e99 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Beginning cold snapshot process
Jul 31 09:51:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:16 user nova-compute[71113]: DEBUG nova.privsep.utils [None req-4987326e-5fc5-465d-9ca3-b31266ff3e99 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71113) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 09:51:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-4987326e-5fc5-465d-9ca3-b31266ff3e99 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/8d2948be-3ebb-4067-a0c8-e2ca884814ff/disk /opt/stack/data/nova/instances/snapshots/tmprm4iaj9e/727360d4510f49ad92cec66cc3a4cf0d {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:51:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-4987326e-5fc5-465d-9ca3-b31266ff3e99 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/8d2948be-3ebb-4067-a0c8-e2ca884814ff/disk /opt/stack/data/nova/instances/snapshots/tmprm4iaj9e/727360d4510f49ad92cec66cc3a4cf0d" returned: 0 in 0.983s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:51:17 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-4987326e-5fc5-465d-9ca3-b31266ff3e99 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Snapshot extracted, beginning image upload
Jul 31 09:51:18 user nova-compute[71113]: DEBUG nova.compute.manager [req-b9a69920-ac1d-4896-9ded-6b10cdbe96e6 req-826c9c4b-b2bd-4ab9-86fb-2c9afc3cb69d service nova] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Received event network-vif-plugged-f3560f1f-45f9-4ab3-b7a9-338b0483a656 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:51:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-b9a69920-ac1d-4896-9ded-6b10cdbe96e6 req-826c9c4b-b2bd-4ab9-86fb-2c9afc3cb69d service nova] Acquiring lock "8d2948be-3ebb-4067-a0c8-e2ca884814ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:51:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-b9a69920-ac1d-4896-9ded-6b10cdbe96e6 req-826c9c4b-b2bd-4ab9-86fb-2c9afc3cb69d service nova] Lock "8d2948be-3ebb-4067-a0c8-e2ca884814ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:51:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-b9a69920-ac1d-4896-9ded-6b10cdbe96e6 req-826c9c4b-b2bd-4ab9-86fb-2c9afc3cb69d service nova] Lock "8d2948be-3ebb-4067-a0c8-e2ca884814ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:51:18 user nova-compute[71113]: DEBUG nova.compute.manager [req-b9a69920-ac1d-4896-9ded-6b10cdbe96e6 req-826c9c4b-b2bd-4ab9-86fb-2c9afc3cb69d service nova] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] No waiting events found dispatching network-vif-plugged-f3560f1f-45f9-4ab3-b7a9-338b0483a656 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:51:18 user nova-compute[71113]: WARNING nova.compute.manager [req-b9a69920-ac1d-4896-9ded-6b10cdbe96e6 req-826c9c4b-b2bd-4ab9-86fb-2c9afc3cb69d service nova] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Received unexpected event network-vif-plugged-f3560f1f-45f9-4ab3-b7a9-338b0483a656 for instance with vm_state active and task_state shelving_image_uploading.
Jul 31 09:51:18 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:20 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-4987326e-5fc5-465d-9ca3-b31266ff3e99 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Snapshot image upload complete
Jul 31 09:51:20 user nova-compute[71113]: DEBUG nova.compute.manager [None req-4987326e-5fc5-465d-9ca3-b31266ff3e99 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:51:20 user nova-compute[71113]: INFO nova.compute.manager [None req-4987326e-5fc5-465d-9ca3-b31266ff3e99 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Shelve offloading
Jul 31 09:51:20 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Instance destroyed successfully.
Jul 31 09:51:20 user nova-compute[71113]: DEBUG nova.compute.manager [None req-4987326e-5fc5-465d-9ca3-b31266ff3e99 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:51:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-4987326e-5fc5-465d-9ca3-b31266ff3e99 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Acquiring lock "refresh_cache-8d2948be-3ebb-4067-a0c8-e2ca884814ff" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:51:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-4987326e-5fc5-465d-9ca3-b31266ff3e99 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Acquired lock "refresh_cache-8d2948be-3ebb-4067-a0c8-e2ca884814ff" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:51:20 user nova-compute[71113]: DEBUG nova.network.neutron [None req-4987326e-5fc5-465d-9ca3-b31266ff3e99 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 09:51:21 user nova-compute[71113]: DEBUG nova.network.neutron [None req-4987326e-5fc5-465d-9ca3-b31266ff3e99 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Updating instance_info_cache with network_info: [{"id": "f3560f1f-45f9-4ab3-b7a9-338b0483a656", "address": "fa:16:3e:91:a4:b3", "network": {"id": "e498d93a-703d-4d19-9adf-61469f37d4da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1320431580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4461b48e5470471d8fe1b61fb8af9c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3560f1f-45", "ovs_interfaceid": "f3560f1f-45f9-4ab3-b7a9-338b0483a656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:51:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-4987326e-5fc5-465d-9ca3-b31266ff3e99 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Releasing lock "refresh_cache-8d2948be-3ebb-4067-a0c8-e2ca884814ff" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:51:21 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Instance destroyed successfully.
Jul 31 09:51:21 user nova-compute[71113]: DEBUG nova.objects.instance [None req-4987326e-5fc5-465d-9ca3-b31266ff3e99 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lazy-loading 'resources' on Instance uuid 8d2948be-3ebb-4067-a0c8-e2ca884814ff {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:51:21 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-4987326e-5fc5-465d-9ca3-b31266ff3e99 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:49:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-185195530',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-185195530',id=12,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPiftDuIkWFAIfzl0BTVm1LhY7q40iWz84gStK4DPV8cFJDmAmFDRgF+Fymadhnr5qIGHF7r0Tfo5uKpEAywooFh/gX7i9sx0LkpEaQXIt1KTEtZ1669nicWOlZ3zvT41w==',key_name='tempest-keypair-404775333',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:49:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='4461b48e5470471d8fe1b61fb8af9c8d',ramdisk_id='',reservation_id='r-v0gpv3qp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-960167684',owner_user_name='tempest-AttachVolumeShelveTestJSON-960167684-project-member',shelved_at='2023-07-31T09:51:20.475226',shelved_host='user',shelved_image_id='480e16ff-6e8c-4dc9-ac02-d0bb76cf595e'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:51:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5199c7da0634b6e8111782122adcf70',uuid=8d2948be-3ebb-4067-a0c8-e2ca884814ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "f3560f1f-45f9-4ab3-b7a9-338b0483a656", "address": "fa:16:3e:91:a4:b3", "network": {"id": "e498d93a-703d-4d19-9adf-61469f37d4da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1320431580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4461b48e5470471d8fe1b61fb8af9c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3560f1f-45", "ovs_interfaceid": "f3560f1f-45f9-4ab3-b7a9-338b0483a656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 09:51:21 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-4987326e-5fc5-465d-9ca3-b31266ff3e99 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Converting VIF {"id": "f3560f1f-45f9-4ab3-b7a9-338b0483a656", "address": "fa:16:3e:91:a4:b3", "network": {"id": "e498d93a-703d-4d19-9adf-61469f37d4da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1320431580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4461b48e5470471d8fe1b61fb8af9c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3560f1f-45", "ovs_interfaceid": "f3560f1f-45f9-4ab3-b7a9-338b0483a656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:51:21 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-4987326e-5fc5-465d-9ca3-b31266ff3e99 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:a4:b3,bridge_name='br-int',has_traffic_filtering=True,id=f3560f1f-45f9-4ab3-b7a9-338b0483a656,network=Network(e498d93a-703d-4d19-9adf-61469f37d4da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3560f1f-45') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:51:21 user nova-compute[71113]: DEBUG os_vif [None req-4987326e-5fc5-465d-9ca3-b31266ff3e99 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:a4:b3,bridge_name='br-int',has_traffic_filtering=True,id=f3560f1f-45f9-4ab3-b7a9-338b0483a656,network=Network(e498d93a-703d-4d19-9adf-61469f37d4da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3560f1f-45') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 09:51:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf3560f1f-45, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:51:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:51:21 user nova-compute[71113]: DEBUG nova.compute.manager [req-af3d9908-4cb6-4a73-b296-8b1d922c2176 req-5a3fc499-8668-4487-8098-7fd8fefaf5ce service nova] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Received event network-changed-f3560f1f-45f9-4ab3-b7a9-338b0483a656 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:51:21 user nova-compute[71113]: DEBUG nova.compute.manager [req-af3d9908-4cb6-4a73-b296-8b1d922c2176 req-5a3fc499-8668-4487-8098-7fd8fefaf5ce service nova] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Refreshing instance network info cache due to event network-changed-f3560f1f-45f9-4ab3-b7a9-338b0483a656. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:51:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-af3d9908-4cb6-4a73-b296-8b1d922c2176 req-5a3fc499-8668-4487-8098-7fd8fefaf5ce service nova] Acquiring lock "refresh_cache-8d2948be-3ebb-4067-a0c8-e2ca884814ff" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:51:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-af3d9908-4cb6-4a73-b296-8b1d922c2176 req-5a3fc499-8668-4487-8098-7fd8fefaf5ce service nova] Acquired lock "refresh_cache-8d2948be-3ebb-4067-a0c8-e2ca884814ff" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:51:21 user nova-compute[71113]: DEBUG nova.network.neutron [req-af3d9908-4cb6-4a73-b296-8b1d922c2176 req-5a3fc499-8668-4487-8098-7fd8fefaf5ce service nova] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Refreshing network info cache for port f3560f1f-45f9-4ab3-b7a9-338b0483a656 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:51:21 user nova-compute[71113]: INFO os_vif [None req-4987326e-5fc5-465d-9ca3-b31266ff3e99 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:a4:b3,bridge_name='br-int',has_traffic_filtering=True,id=f3560f1f-45f9-4ab3-b7a9-338b0483a656,network=Network(e498d93a-703d-4d19-9adf-61469f37d4da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3560f1f-45')
Jul 31 09:51:21 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-4987326e-5fc5-465d-9ca3-b31266ff3e99 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Deleting instance files /opt/stack/data/nova/instances/8d2948be-3ebb-4067-a0c8-e2ca884814ff_del
Jul 31 09:51:21 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-4987326e-5fc5-465d-9ca3-b31266ff3e99 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Deletion of /opt/stack/data/nova/instances/8d2948be-3ebb-4067-a0c8-e2ca884814ff_del complete
Jul 31 09:51:21 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-4987326e-5fc5-465d-9ca3-b31266ff3e99 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Deleted allocations for instance 8d2948be-3ebb-4067-a0c8-e2ca884814ff
Jul 31 09:51:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-4987326e-5fc5-465d-9ca3-b31266ff3e99 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:51:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-4987326e-5fc5-465d-9ca3-b31266ff3e99 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:51:21 user nova-compute[71113]: DEBUG nova.objects.instance [None req-4987326e-5fc5-465d-9ca3-b31266ff3e99 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lazy-loading 'numa_topology' on Instance uuid 8d2948be-3ebb-4067-a0c8-e2ca884814ff {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:51:22 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-4987326e-5fc5-465d-9ca3-b31266ff3e99 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:51:22 user nova-compute[71113]: DEBUG nova.network.neutron [req-af3d9908-4cb6-4a73-b296-8b1d922c2176 req-5a3fc499-8668-4487-8098-7fd8fefaf5ce service nova] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Updated VIF entry in instance network info cache for port f3560f1f-45f9-4ab3-b7a9-338b0483a656. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:51:22 user nova-compute[71113]: DEBUG nova.network.neutron [req-af3d9908-4cb6-4a73-b296-8b1d922c2176 req-5a3fc499-8668-4487-8098-7fd8fefaf5ce service nova] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Updating instance_info_cache with network_info: [{"id": "f3560f1f-45f9-4ab3-b7a9-338b0483a656", "address": "fa:16:3e:91:a4:b3", "network": {"id": "e498d93a-703d-4d19-9adf-61469f37d4da", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1320431580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4461b48e5470471d8fe1b61fb8af9c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapf3560f1f-45", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:51:22 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-4987326e-5fc5-465d-9ca3-b31266ff3e99 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:51:22 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-af3d9908-4cb6-4a73-b296-8b1d922c2176 req-5a3fc499-8668-4487-8098-7fd8fefaf5ce service nova] Releasing lock "refresh_cache-8d2948be-3ebb-4067-a0c8-e2ca884814ff" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:51:22 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-4987326e-5fc5-465d-9ca3-b31266ff3e99 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.350s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:51:22 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-4987326e-5fc5-465d-9ca3-b31266ff3e99 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "8d2948be-3ebb-4067-a0c8-e2ca884814ff" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.662s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:51:22 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-21e385d7-0e28-40db-b437-82ff51ddaa03 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Acquiring lock "f88bc35b-4996-400e-88ba-5d0f2c3f6c4a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:51:22 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-21e385d7-0e28-40db-b437-82ff51ddaa03 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Lock "f88bc35b-4996-400e-88ba-5d0f2c3f6c4a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:51:22 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-21e385d7-0e28-40db-b437-82ff51ddaa03 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Acquiring lock "f88bc35b-4996-400e-88ba-5d0f2c3f6c4a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:51:22 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-21e385d7-0e28-40db-b437-82ff51ddaa03 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Lock "f88bc35b-4996-400e-88ba-5d0f2c3f6c4a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:51:22 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-21e385d7-0e28-40db-b437-82ff51ddaa03 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Lock "f88bc35b-4996-400e-88ba-5d0f2c3f6c4a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:51:22 user nova-compute[71113]: INFO nova.compute.manager [None req-21e385d7-0e28-40db-b437-82ff51ddaa03 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Terminating instance
Jul 31 09:51:22 user nova-compute[71113]: DEBUG nova.compute.manager [None req-21e385d7-0e28-40db-b437-82ff51ddaa03 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Start destroying the instance on the hypervisor. {{(pid=71113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 09:51:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:23 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:23 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:23 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Instance destroyed successfully.
Jul 31 09:51:23 user nova-compute[71113]: DEBUG nova.objects.instance [None req-21e385d7-0e28-40db-b437-82ff51ddaa03 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Lazy-loading 'resources' on Instance uuid f88bc35b-4996-400e-88ba-5d0f2c3f6c4a {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:51:23 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-21e385d7-0e28-40db-b437-82ff51ddaa03 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:49:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2058367283',display_name='tempest-VolumesAdminNegativeTest-server-2058367283',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2058367283',id=13,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:49:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='025b7e2f3e894690b9cade6b6df70a22',ramdisk_id='',reservation_id='r-xpkoq6hk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-553928296',owner_user_name='tempest-VolumesAdminNegativeTest-553928296-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:49:31Z,user_data=None,user_id='68ed00ac1dba433fb6ff7281a066d55f',uuid=f88bc35b-4996-400e-88ba-5d0f2c3f6c4a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eac2770c-4df8-41f5-9643-bb0980f0777e", "address": "fa:16:3e:7e:c0:f1", "network": {"id": "5f0b75d1-03eb-4e68-85fd-8b27d4fda660", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-726146587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "025b7e2f3e894690b9cade6b6df70a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac2770c-4d", "ovs_interfaceid": "eac2770c-4df8-41f5-9643-bb0980f0777e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 09:51:23 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-21e385d7-0e28-40db-b437-82ff51ddaa03 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Converting VIF {"id": "eac2770c-4df8-41f5-9643-bb0980f0777e", "address": "fa:16:3e:7e:c0:f1", "network": {"id": "5f0b75d1-03eb-4e68-85fd-8b27d4fda660", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-726146587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "025b7e2f3e894690b9cade6b6df70a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac2770c-4d", "ovs_interfaceid": "eac2770c-4df8-41f5-9643-bb0980f0777e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:51:23 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-21e385d7-0e28-40db-b437-82ff51ddaa03 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:c0:f1,bridge_name='br-int',has_traffic_filtering=True,id=eac2770c-4df8-41f5-9643-bb0980f0777e,network=Network(5f0b75d1-03eb-4e68-85fd-8b27d4fda660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac2770c-4d') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:51:23 user nova-compute[71113]: DEBUG os_vif [None req-21e385d7-0e28-40db-b437-82ff51ddaa03 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:c0:f1,bridge_name='br-int',has_traffic_filtering=True,id=eac2770c-4df8-41f5-9643-bb0980f0777e,network=Network(5f0b75d1-03eb-4e68-85fd-8b27d4fda660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac2770c-4d') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 09:51:23 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:23 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeac2770c-4d, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:51:23 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:51:23 user nova-compute[71113]: INFO os_vif [None req-21e385d7-0e28-40db-b437-82ff51ddaa03 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:c0:f1,bridge_name='br-int',has_traffic_filtering=True,id=eac2770c-4df8-41f5-9643-bb0980f0777e,network=Network(5f0b75d1-03eb-4e68-85fd-8b27d4fda660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac2770c-4d')
Jul 31 09:51:23 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-21e385d7-0e28-40db-b437-82ff51ddaa03 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Deleting instance files /opt/stack/data/nova/instances/f88bc35b-4996-400e-88ba-5d0f2c3f6c4a_del
Jul 31 09:51:23 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-21e385d7-0e28-40db-b437-82ff51ddaa03 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Deletion of /opt/stack/data/nova/instances/f88bc35b-4996-400e-88ba-5d0f2c3f6c4a_del complete
Jul 31 09:51:23 user nova-compute[71113]: INFO nova.compute.manager [None req-21e385d7-0e28-40db-b437-82ff51ddaa03 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Took 0.74 seconds to destroy the instance on the hypervisor.
Jul 31 09:51:23 user nova-compute[71113]: DEBUG oslo.service.loopingcall [None req-21e385d7-0e28-40db-b437-82ff51ddaa03 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71113) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 09:51:23 user nova-compute[71113]: DEBUG nova.compute.manager [-] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Deallocating network for instance {{(pid=71113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 09:51:23 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] deallocate_for_instance() {{(pid=71113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 09:51:23 user nova-compute[71113]: DEBUG nova.compute.manager [req-aae978c7-9adb-45f8-be3b-669f6cd30b7d req-f280cd5a-d7a1-4bad-b372-b13bfa5e422b service nova] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Received event network-vif-unplugged-eac2770c-4df8-41f5-9643-bb0980f0777e {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:51:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-aae978c7-9adb-45f8-be3b-669f6cd30b7d req-f280cd5a-d7a1-4bad-b372-b13bfa5e422b service nova] Acquiring lock "f88bc35b-4996-400e-88ba-5d0f2c3f6c4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:51:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-aae978c7-9adb-45f8-be3b-669f6cd30b7d req-f280cd5a-d7a1-4bad-b372-b13bfa5e422b service nova] Lock "f88bc35b-4996-400e-88ba-5d0f2c3f6c4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:51:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-aae978c7-9adb-45f8-be3b-669f6cd30b7d req-f280cd5a-d7a1-4bad-b372-b13bfa5e422b service nova] Lock "f88bc35b-4996-400e-88ba-5d0f2c3f6c4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:51:23 user nova-compute[71113]: DEBUG nova.compute.manager [req-aae978c7-9adb-45f8-be3b-669f6cd30b7d req-f280cd5a-d7a1-4bad-b372-b13bfa5e422b service nova] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] No waiting events found dispatching network-vif-unplugged-eac2770c-4df8-41f5-9643-bb0980f0777e {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:51:23 user nova-compute[71113]: DEBUG nova.compute.manager [req-aae978c7-9adb-45f8-be3b-669f6cd30b7d req-f280cd5a-d7a1-4bad-b372-b13bfa5e422b service nova] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Received event network-vif-unplugged-eac2770c-4df8-41f5-9643-bb0980f0777e for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 09:51:23 user nova-compute[71113]: DEBUG nova.compute.manager [req-aae978c7-9adb-45f8-be3b-669f6cd30b7d req-f280cd5a-d7a1-4bad-b372-b13bfa5e422b service nova] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Received event network-vif-plugged-eac2770c-4df8-41f5-9643-bb0980f0777e {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:51:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-aae978c7-9adb-45f8-be3b-669f6cd30b7d req-f280cd5a-d7a1-4bad-b372-b13bfa5e422b service nova] Acquiring lock "f88bc35b-4996-400e-88ba-5d0f2c3f6c4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:51:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-aae978c7-9adb-45f8-be3b-669f6cd30b7d req-f280cd5a-d7a1-4bad-b372-b13bfa5e422b service nova] Lock "f88bc35b-4996-400e-88ba-5d0f2c3f6c4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:51:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-aae978c7-9adb-45f8-be3b-669f6cd30b7d req-f280cd5a-d7a1-4bad-b372-b13bfa5e422b service nova] Lock "f88bc35b-4996-400e-88ba-5d0f2c3f6c4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:51:23 user nova-compute[71113]: DEBUG nova.compute.manager [req-aae978c7-9adb-45f8-be3b-669f6cd30b7d req-f280cd5a-d7a1-4bad-b372-b13bfa5e422b service nova] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] No waiting events found dispatching network-vif-plugged-eac2770c-4df8-41f5-9643-bb0980f0777e {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:51:23 user nova-compute[71113]: WARNING nova.compute.manager [req-aae978c7-9adb-45f8-be3b-669f6cd30b7d req-f280cd5a-d7a1-4bad-b372-b13bfa5e422b service nova] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Received unexpected event network-vif-plugged-eac2770c-4df8-41f5-9643-bb0980f0777e for instance with vm_state active and task_state deleting.
Jul 31 09:51:23 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:51:23 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:24 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Took 0.56 seconds to deallocate network for instance.
Jul 31 09:51:24 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-21e385d7-0e28-40db-b437-82ff51ddaa03 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:51:24 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-21e385d7-0e28-40db-b437-82ff51ddaa03 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:51:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:24 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-21e385d7-0e28-40db-b437-82ff51ddaa03 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:51:24 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-21e385d7-0e28-40db-b437-82ff51ddaa03 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:51:24 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-21e385d7-0e28-40db-b437-82ff51ddaa03 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.380s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:51:24 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-21e385d7-0e28-40db-b437-82ff51ddaa03 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Deleted allocations for instance f88bc35b-4996-400e-88ba-5d0f2c3f6c4a
Jul 31 09:51:24 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-21e385d7-0e28-40db-b437-82ff51ddaa03 tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Lock "f88bc35b-4996-400e-88ba-5d0f2c3f6c4a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.970s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:51:25 user nova-compute[71113]: DEBUG nova.compute.manager [req-0afb0e38-2d57-4d38-bbbe-252ac2d5c173 req-1d478ef3-b780-4359-9c30-4068c32702b4 service nova] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Received event network-vif-deleted-eac2770c-4df8-41f5-9643-bb0980f0777e {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:51:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:28 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-08f63343-594e-44a0-8fd6-3b1a47966a66 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Acquiring lock "ae982ade-8b51-4948-879a-f308be7eb685" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:51:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-08f63343-594e-44a0-8fd6-3b1a47966a66 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Lock "ae982ade-8b51-4948-879a-f308be7eb685" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:51:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-08f63343-594e-44a0-8fd6-3b1a47966a66 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Acquiring lock "ae982ade-8b51-4948-879a-f308be7eb685-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:51:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-08f63343-594e-44a0-8fd6-3b1a47966a66 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Lock "ae982ade-8b51-4948-879a-f308be7eb685-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:51:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-08f63343-594e-44a0-8fd6-3b1a47966a66 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Lock "ae982ade-8b51-4948-879a-f308be7eb685-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:51:31 user nova-compute[71113]: INFO nova.compute.manager [None req-08f63343-594e-44a0-8fd6-3b1a47966a66 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Terminating instance
Jul 31 09:51:31 user nova-compute[71113]: DEBUG nova.compute.manager [None req-08f63343-594e-44a0-8fd6-3b1a47966a66 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Start destroying the instance on the hypervisor. {{(pid=71113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 09:51:31 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690797076.4941056, 8d2948be-3ebb-4067-a0c8-e2ca884814ff => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:51:31 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] VM Stopped (Lifecycle Event)
Jul 31 09:51:31 user nova-compute[71113]: DEBUG nova.compute.manager [None req-82bd85be-650a-4dd0-8185-be8334b74a75 None None] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:51:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:31 user nova-compute[71113]: DEBUG nova.compute.manager [req-dd74cd9f-1a21-467a-a4a7-ff1d42168cb4 req-e9d5424a-73b2-40bf-99be-9784ae1cb424 service nova] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Received event network-vif-unplugged-73aab5d1-7549-4c59-852d-4e2935c772ef {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:51:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-dd74cd9f-1a21-467a-a4a7-ff1d42168cb4 req-e9d5424a-73b2-40bf-99be-9784ae1cb424 service nova] Acquiring lock "ae982ade-8b51-4948-879a-f308be7eb685-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:51:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-dd74cd9f-1a21-467a-a4a7-ff1d42168cb4 req-e9d5424a-73b2-40bf-99be-9784ae1cb424 service nova] Lock "ae982ade-8b51-4948-879a-f308be7eb685-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:51:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-dd74cd9f-1a21-467a-a4a7-ff1d42168cb4 req-e9d5424a-73b2-40bf-99be-9784ae1cb424 service nova] Lock "ae982ade-8b51-4948-879a-f308be7eb685-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:51:31 user nova-compute[71113]: DEBUG nova.compute.manager [req-dd74cd9f-1a21-467a-a4a7-ff1d42168cb4 req-e9d5424a-73b2-40bf-99be-9784ae1cb424 service nova] [instance: ae982ade-8b51-4948-879a-f308be7eb685] No waiting events found dispatching network-vif-unplugged-73aab5d1-7549-4c59-852d-4e2935c772ef {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:51:31 user nova-compute[71113]: DEBUG nova.compute.manager [req-dd74cd9f-1a21-467a-a4a7-ff1d42168cb4 req-e9d5424a-73b2-40bf-99be-9784ae1cb424 service nova] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Received event network-vif-unplugged-73aab5d1-7549-4c59-852d-4e2935c772ef for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 09:51:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:32 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Instance destroyed successfully.
Jul 31 09:51:32 user nova-compute[71113]: DEBUG nova.objects.instance [None req-08f63343-594e-44a0-8fd6-3b1a47966a66 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Lazy-loading 'resources' on Instance uuid ae982ade-8b51-4948-879a-f308be7eb685 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:51:32 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-08f63343-594e-44a0-8fd6-3b1a47966a66 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:49:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-173670159',display_name='tempest-VolumesActionsTest-instance-173670159',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-173670159',id=14,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:49:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3fc8b3757a845ad89068797348d02bd',ramdisk_id='',reservation_id='r-1c9jjbgu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1052619025',owner_user_name='tempest-VolumesActionsTest-1052619025-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:49:48Z,user_data=None,user_id='201cdf33fbd74e77877dd1342b33aedc',uuid=ae982ade-8b51-4948-879a-f308be7eb685,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73aab5d1-7549-4c59-852d-4e2935c772ef", "address": "fa:16:3e:db:5b:1f", "network": {"id": "19009bbc-db2c-4a99-aef8-bc8cb7ce0608", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2005545678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fc8b3757a845ad89068797348d02bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73aab5d1-75", "ovs_interfaceid": "73aab5d1-7549-4c59-852d-4e2935c772ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 09:51:32 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-08f63343-594e-44a0-8fd6-3b1a47966a66 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Converting VIF {"id": "73aab5d1-7549-4c59-852d-4e2935c772ef", "address": "fa:16:3e:db:5b:1f", "network": {"id": "19009bbc-db2c-4a99-aef8-bc8cb7ce0608", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2005545678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fc8b3757a845ad89068797348d02bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73aab5d1-75", "ovs_interfaceid": "73aab5d1-7549-4c59-852d-4e2935c772ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:51:32 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-08f63343-594e-44a0-8fd6-3b1a47966a66 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:5b:1f,bridge_name='br-int',has_traffic_filtering=True,id=73aab5d1-7549-4c59-852d-4e2935c772ef,network=Network(19009bbc-db2c-4a99-aef8-bc8cb7ce0608),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73aab5d1-75') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:51:32 user nova-compute[71113]: DEBUG os_vif [None req-08f63343-594e-44a0-8fd6-3b1a47966a66 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:5b:1f,bridge_name='br-int',has_traffic_filtering=True,id=73aab5d1-7549-4c59-852d-4e2935c772ef,network=Network(19009bbc-db2c-4a99-aef8-bc8cb7ce0608),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73aab5d1-75') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 09:51:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap73aab5d1-75, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:51:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:51:32 user nova-compute[71113]: INFO os_vif [None req-08f63343-594e-44a0-8fd6-3b1a47966a66 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:5b:1f,bridge_name='br-int',has_traffic_filtering=True,id=73aab5d1-7549-4c59-852d-4e2935c772ef,network=Network(19009bbc-db2c-4a99-aef8-bc8cb7ce0608),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73aab5d1-75')
Jul 31 09:51:32 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-08f63343-594e-44a0-8fd6-3b1a47966a66 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Deleting instance files /opt/stack/data/nova/instances/ae982ade-8b51-4948-879a-f308be7eb685_del
Jul 31 09:51:32 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-08f63343-594e-44a0-8fd6-3b1a47966a66 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Deletion of /opt/stack/data/nova/instances/ae982ade-8b51-4948-879a-f308be7eb685_del complete
Jul 31 09:51:32 user nova-compute[71113]: INFO nova.compute.manager [None req-08f63343-594e-44a0-8fd6-3b1a47966a66 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Took 0.80 seconds to destroy the instance on the hypervisor.
Jul 31 09:51:32 user nova-compute[71113]: DEBUG oslo.service.loopingcall [None req-08f63343-594e-44a0-8fd6-3b1a47966a66 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71113) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 09:51:32 user nova-compute[71113]: DEBUG nova.compute.manager [-] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Deallocating network for instance {{(pid=71113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 09:51:32 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: ae982ade-8b51-4948-879a-f308be7eb685] deallocate_for_instance() {{(pid=71113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 09:51:32 user nova-compute[71113]: DEBUG nova.compute.manager [None req-8b6f2037-f524-4b67-9c58-699feb564c26 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:51:32 user nova-compute[71113]: INFO nova.compute.manager [None req-8b6f2037-f524-4b67-9c58-699feb564c26 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] instance snapshotting
Jul 31 09:51:32 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-8b6f2037-f524-4b67-9c58-699feb564c26 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Beginning live snapshot process
Jul 31 09:51:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-8b6f2037-f524-4b67-9c58-699feb564c26 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a4b47dd-b335-4c2f-9dee-5421357a0ee1/disk --force-share --output=json -f qcow2 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:51:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-8b6f2037-f524-4b67-9c58-699feb564c26 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a4b47dd-b335-4c2f-9dee-5421357a0ee1/disk --force-share --output=json -f qcow2" returned: 0 in 0.133s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:51:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-8b6f2037-f524-4b67-9c58-699feb564c26 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a4b47dd-b335-4c2f-9dee-5421357a0ee1/disk --force-share --output=json -f qcow2 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:51:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-8b6f2037-f524-4b67-9c58-699feb564c26 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a4b47dd-b335-4c2f-9dee-5421357a0ee1/disk --force-share --output=json -f qcow2" returned: 0 in 0.132s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:51:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-8b6f2037-f524-4b67-9c58-699feb564c26 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:51:33 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:51:33 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Took 0.86 seconds to deallocate network for instance.
Jul 31 09:51:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-8b6f2037-f524-4b67-9c58-699feb564c26 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.142s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:51:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-8b6f2037-f524-4b67-9c58-699feb564c26 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpworb8xl1/acafa0d808624f1d9dd2032ea8cbccae.delta 1073741824 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:51:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-08f63343-594e-44a0-8fd6-3b1a47966a66 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:51:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-08f63343-594e-44a0-8fd6-3b1a47966a66 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:51:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-8b6f2037-f524-4b67-9c58-699feb564c26 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpworb8xl1/acafa0d808624f1d9dd2032ea8cbccae.delta 1073741824" returned: 0 in 0.058s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:51:33 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-8b6f2037-f524-4b67-9c58-699feb564c26 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 31 09:51:33 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-08f63343-594e-44a0-8fd6-3b1a47966a66 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:51:33 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-08f63343-594e-44a0-8fd6-3b1a47966a66 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:51:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-08f63343-594e-44a0-8fd6-3b1a47966a66 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.315s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:51:33 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-08f63343-594e-44a0-8fd6-3b1a47966a66 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Deleted allocations for instance ae982ade-8b51-4948-879a-f308be7eb685
Jul 31 09:51:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-08f63343-594e-44a0-8fd6-3b1a47966a66 tempest-VolumesActionsTest-1052619025 tempest-VolumesActionsTest-1052619025-project-member] Lock "ae982ade-8b51-4948-879a-f308be7eb685" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.187s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:51:33 user nova-compute[71113]: DEBUG nova.compute.manager [req-aa16b2e4-1196-4d5e-8cfa-32b20e6223e4 req-35b3affe-73ac-449d-bac9-11446021df6b service nova] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Received event network-vif-plugged-73aab5d1-7549-4c59-852d-4e2935c772ef {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:51:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-aa16b2e4-1196-4d5e-8cfa-32b20e6223e4 req-35b3affe-73ac-449d-bac9-11446021df6b service nova] Acquiring lock "ae982ade-8b51-4948-879a-f308be7eb685-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:51:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-aa16b2e4-1196-4d5e-8cfa-32b20e6223e4 req-35b3affe-73ac-449d-bac9-11446021df6b service nova] Lock "ae982ade-8b51-4948-879a-f308be7eb685-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:51:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-aa16b2e4-1196-4d5e-8cfa-32b20e6223e4 req-35b3affe-73ac-449d-bac9-11446021df6b service nova] Lock "ae982ade-8b51-4948-879a-f308be7eb685-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:51:33 user nova-compute[71113]: DEBUG nova.compute.manager [req-aa16b2e4-1196-4d5e-8cfa-32b20e6223e4 req-35b3affe-73ac-449d-bac9-11446021df6b service nova] [instance: ae982ade-8b51-4948-879a-f308be7eb685] No waiting events found dispatching network-vif-plugged-73aab5d1-7549-4c59-852d-4e2935c772ef {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:51:33 user nova-compute[71113]: WARNING nova.compute.manager [req-aa16b2e4-1196-4d5e-8cfa-32b20e6223e4 req-35b3affe-73ac-449d-bac9-11446021df6b service nova] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Received unexpected event network-vif-plugged-73aab5d1-7549-4c59-852d-4e2935c772ef for instance with vm_state deleted and task_state None.
Jul 31 09:51:33 user nova-compute[71113]: DEBUG nova.compute.manager [req-aa16b2e4-1196-4d5e-8cfa-32b20e6223e4 req-35b3affe-73ac-449d-bac9-11446021df6b service nova] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Received event network-vif-deleted-73aab5d1-7549-4c59-852d-4e2935c772ef {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:51:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-8b6f2037-f524-4b67-9c58-699feb564c26 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=71113) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 09:51:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:34 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-8b6f2037-f524-4b67-9c58-699feb564c26 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] COPY block job progress, current cursor: 40632320 final cursor: 75563008 {{(pid=71113) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 09:51:34 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-8b6f2037-f524-4b67-9c58-699feb564c26 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=71113) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 09:51:34 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-8b6f2037-f524-4b67-9c58-699feb564c26 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 31 09:51:35 user nova-compute[71113]: DEBUG nova.privsep.utils [None req-8b6f2037-f524-4b67-9c58-699feb564c26 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71113) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 09:51:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-8b6f2037-f524-4b67-9c58-699feb564c26 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpworb8xl1/acafa0d808624f1d9dd2032ea8cbccae.delta /opt/stack/data/nova/instances/snapshots/tmpworb8xl1/acafa0d808624f1d9dd2032ea8cbccae {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:51:35 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Acquiring lock "af1f4e7c-b336-457a-94cc-3df3c3203370" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:51:35 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Lock "af1f4e7c-b336-457a-94cc-3df3c3203370" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:51:35 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Starting instance... {{(pid=71113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 09:51:35 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:51:35 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:51:35 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 09:51:35 user nova-compute[71113]: INFO nova.compute.claims [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Claim successful on node user
Jul 31 09:51:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-8b6f2037-f524-4b67-9c58-699feb564c26 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpworb8xl1/acafa0d808624f1d9dd2032ea8cbccae.delta /opt/stack/data/nova/instances/snapshots/tmpworb8xl1/acafa0d808624f1d9dd2032ea8cbccae" returned: 0 in 0.629s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:51:35 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-8b6f2037-f524-4b67-9c58-699feb564c26 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Snapshot extracted, beginning image upload
Jul 31 09:51:35 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:51:35 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:51:35 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.526s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:51:35 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Start building networks asynchronously for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 09:51:35 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Allocating IP information in the background. {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 09:51:35 user nova-compute[71113]: DEBUG nova.network.neutron [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] allocate_for_instance() {{(pid=71113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 09:51:35 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 09:51:35 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Start building block device mappings for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 09:51:36 user nova-compute[71113]: DEBUG nova.policy [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '21f1d14ad39e4cd0b19e8484f1635344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a3ec2098864e8797f77f70e1784acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71113) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 09:51:36 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Start spawning the instance on the hypervisor. {{(pid=71113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 09:51:36 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 09:51:36 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Creating image(s)
Jul 31 09:51:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Acquiring lock "/opt/stack/data/nova/instances/af1f4e7c-b336-457a-94cc-3df3c3203370/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:51:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Lock "/opt/stack/data/nova/instances/af1f4e7c-b336-457a-94cc-3df3c3203370/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:51:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Lock "/opt/stack/data/nova/instances/af1f4e7c-b336-457a-94cc-3df3c3203370/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:51:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:51:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.136s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:51:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Acquiring lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:51:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:51:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:51:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.140s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:51:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/af1f4e7c-b336-457a-94cc-3df3c3203370/disk 1073741824 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:51:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/af1f4e7c-b336-457a-94cc-3df3c3203370/disk 1073741824" returned: 0 in 0.050s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:51:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:51:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:51:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.151s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:51:36 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Checking if we can resize image /opt/stack/data/nova/instances/af1f4e7c-b336-457a-94cc-3df3c3203370/disk. size=1073741824 {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 09:51:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af1f4e7c-b336-457a-94cc-3df3c3203370/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:51:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af1f4e7c-b336-457a-94cc-3df3c3203370/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:51:36 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Cannot resize image /opt/stack/data/nova/instances/af1f4e7c-b336-457a-94cc-3df3c3203370/disk to a smaller size. {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 09:51:36 user nova-compute[71113]: DEBUG nova.objects.instance [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Lazy-loading 'migration_context' on Instance uuid af1f4e7c-b336-457a-94cc-3df3c3203370 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:51:36 user nova-compute[71113]: DEBUG nova.network.neutron [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Successfully created port: b57ab83c-c78e-424e-889b-b0156de15bfe {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 09:51:36 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Created local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 09:51:36 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Ensure instance console log exists: /opt/stack/data/nova/instances/af1f4e7c-b336-457a-94cc-3df3c3203370/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 09:51:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:51:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:51:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:51:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:37 user nova-compute[71113]: DEBUG nova.network.neutron [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Successfully updated port: b57ab83c-c78e-424e-889b-b0156de15bfe {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 09:51:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Acquiring lock "refresh_cache-af1f4e7c-b336-457a-94cc-3df3c3203370" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:51:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Acquired lock "refresh_cache-af1f4e7c-b336-457a-94cc-3df3c3203370" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:51:37 user nova-compute[71113]: DEBUG nova.network.neutron [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 09:51:37 user nova-compute[71113]: DEBUG nova.compute.manager [req-c963dbcb-52e0-44f2-a57a-90386d18468e req-7c358b55-34f8-4e24-b04c-8c0ca6ffdbef service nova] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Received event network-changed-b57ab83c-c78e-424e-889b-b0156de15bfe {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:51:37 user nova-compute[71113]: DEBUG nova.compute.manager [req-c963dbcb-52e0-44f2-a57a-90386d18468e req-7c358b55-34f8-4e24-b04c-8c0ca6ffdbef service nova] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Refreshing instance network info cache due to event network-changed-b57ab83c-c78e-424e-889b-b0156de15bfe. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:51:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-c963dbcb-52e0-44f2-a57a-90386d18468e req-7c358b55-34f8-4e24-b04c-8c0ca6ffdbef service nova] Acquiring lock "refresh_cache-af1f4e7c-b336-457a-94cc-3df3c3203370" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:51:37 user nova-compute[71113]: DEBUG nova.network.neutron [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 09:51:38 user nova-compute[71113]: DEBUG nova.network.neutron [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Updating instance_info_cache with network_info: [{"id": "b57ab83c-c78e-424e-889b-b0156de15bfe", "address": "fa:16:3e:64:ce:90", "network": {"id": "2eebe293-45a3-4f39-bfa2-404813801391", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1697211995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8a3ec2098864e8797f77f70e1784acd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb57ab83c-c7", "ovs_interfaceid": "b57ab83c-c78e-424e-889b-b0156de15bfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:51:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Releasing lock "refresh_cache-af1f4e7c-b336-457a-94cc-3df3c3203370" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:51:38 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Instance network_info: |[{"id": "b57ab83c-c78e-424e-889b-b0156de15bfe", "address": "fa:16:3e:64:ce:90", "network": {"id": "2eebe293-45a3-4f39-bfa2-404813801391", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1697211995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8a3ec2098864e8797f77f70e1784acd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb57ab83c-c7", "ovs_interfaceid": "b57ab83c-c78e-424e-889b-b0156de15bfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 09:51:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-c963dbcb-52e0-44f2-a57a-90386d18468e req-7c358b55-34f8-4e24-b04c-8c0ca6ffdbef service nova] Acquired lock "refresh_cache-af1f4e7c-b336-457a-94cc-3df3c3203370" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:51:38 user nova-compute[71113]: DEBUG nova.network.neutron [req-c963dbcb-52e0-44f2-a57a-90386d18468e req-7c358b55-34f8-4e24-b04c-8c0ca6ffdbef service nova] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Refreshing network info cache for port b57ab83c-c78e-424e-889b-b0156de15bfe {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:51:38 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Start _get_guest_xml network_info=[{"id": "b57ab83c-c78e-424e-889b-b0156de15bfe", "address": "fa:16:3e:64:ce:90", "network": {"id": "2eebe293-45a3-4f39-bfa2-404813801391", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1697211995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8a3ec2098864e8797f77f70e1784acd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb57ab83c-c7", "ovs_interfaceid": "b57ab83c-c78e-424e-889b-b0156de15bfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'image_id': '078646fe-b504-41ed-a147-61072e903e51'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 09:51:38 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-8b6f2037-f524-4b67-9c58-699feb564c26 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Snapshot image upload complete
Jul 31 09:51:38 user nova-compute[71113]: INFO nova.compute.manager [None req-8b6f2037-f524-4b67-9c58-699feb564c26 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Took 5.59 seconds to snapshot the instance on the hypervisor.
Jul 31 09:51:38 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:51:38 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:51:38 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 09:51:38 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 09:51:38 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 09:51:38 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 09:51:38 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 09:51:38 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 09:51:38 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 09:51:38 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 09:51:38 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 09:51:38 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 09:51:38 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 09:51:38 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 09:51:38 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 09:51:38 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 09:51:38 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 09:51:38 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 09:51:38 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T09:51:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-601671640',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-601671640',id=17,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrt/0N3rqkgPN6SuyXfpoCTkV9Bk0pcEdYe3hmzwwFIugD3ohq+ljDgxWA2owuO7ncn48ukAgrCkpv3bs19B971Yw7oJwFLv7z/1GwjZIhoKmL+3YWqpkWzV2dkY74VfA==',key_name='tempest-keypair-341346334',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8a3ec2098864e8797f77f70e1784acd',ramdisk_id='',reservation_id='r-sijnqnb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-740569977',owner_user_name='tempest-TaggedAttachmentsTest-740569977-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:51:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21f1d14ad39e4cd0b19e8484f1635344',uuid=af1f4e7c-b336-457a-94cc-3df3c3203370,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b57ab83c-c78e-424e-889b-b0156de15bfe", "address": "fa:16:3e:64:ce:90", "network": {"id": "2eebe293-45a3-4f39-bfa2-404813801391", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1697211995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8a3ec2098864e8797f77f70e1784acd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb57ab83c-c7", "ovs_interfaceid": "b57ab83c-c78e-424e-889b-b0156de15bfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 09:51:38 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Converting VIF {"id": "b57ab83c-c78e-424e-889b-b0156de15bfe", "address": "fa:16:3e:64:ce:90", "network": {"id": "2eebe293-45a3-4f39-bfa2-404813801391", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1697211995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8a3ec2098864e8797f77f70e1784acd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb57ab83c-c7", "ovs_interfaceid": "b57ab83c-c78e-424e-889b-b0156de15bfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:51:38 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:ce:90,bridge_name='br-int',has_traffic_filtering=True,id=b57ab83c-c78e-424e-889b-b0156de15bfe,network=Network(2eebe293-45a3-4f39-bfa2-404813801391),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb57ab83c-c7') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:51:38 user nova-compute[71113]: DEBUG nova.objects.instance [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Lazy-loading 'pci_devices' on Instance uuid af1f4e7c-b336-457a-94cc-3df3c3203370 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:51:38 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] End _get_guest_xml xml=<domain type="kvm">
Jul 31 09:51:38 user nova-compute[71113]:   <uuid>af1f4e7c-b336-457a-94cc-3df3c3203370</uuid>
Jul 31 09:51:38 user nova-compute[71113]:   <name>instance-00000011</name>
Jul 31 09:51:38 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 09:51:38 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 09:51:38 user nova-compute[71113]:   <metadata>
Jul 31 09:51:38 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 09:51:38 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 09:51:38 user nova-compute[71113]:       <nova:name>tempest-device-tagging-server-601671640</nova:name>
Jul 31 09:51:38 user nova-compute[71113]:       <nova:creationTime>2023-07-31 09:51:38</nova:creationTime>
Jul 31 09:51:38 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 09:51:38 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 09:51:38 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 09:51:38 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 09:51:38 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 09:51:38 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 09:51:38 user nova-compute[71113]:       </nova:flavor>
Jul 31 09:51:38 user nova-compute[71113]:       <nova:owner>
Jul 31 09:51:38 user nova-compute[71113]:         <nova:user uuid="21f1d14ad39e4cd0b19e8484f1635344">tempest-TaggedAttachmentsTest-740569977-project-member</nova:user>
Jul 31 09:51:38 user nova-compute[71113]:         <nova:project uuid="c8a3ec2098864e8797f77f70e1784acd">tempest-TaggedAttachmentsTest-740569977</nova:project>
Jul 31 09:51:38 user nova-compute[71113]:       </nova:owner>
Jul 31 09:51:38 user nova-compute[71113]:       <nova:root type="image" uuid="078646fe-b504-41ed-a147-61072e903e51"/>
Jul 31 09:51:38 user nova-compute[71113]:       <nova:ports>
Jul 31 09:51:38 user nova-compute[71113]:         <nova:port uuid="b57ab83c-c78e-424e-889b-b0156de15bfe">
Jul 31 09:51:38 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 31 09:51:38 user nova-compute[71113]:         </nova:port>
Jul 31 09:51:38 user nova-compute[71113]:       </nova:ports>
Jul 31 09:51:38 user nova-compute[71113]:     </nova:instance>
Jul 31 09:51:38 user nova-compute[71113]:   </metadata>
Jul 31 09:51:38 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 09:51:38 user nova-compute[71113]:     <system>
Jul 31 09:51:38 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 09:51:38 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 09:51:38 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 09:51:38 user nova-compute[71113]:       <entry name="serial">af1f4e7c-b336-457a-94cc-3df3c3203370</entry>
Jul 31 09:51:38 user nova-compute[71113]:       <entry name="uuid">af1f4e7c-b336-457a-94cc-3df3c3203370</entry>
Jul 31 09:51:38 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 09:51:38 user nova-compute[71113]:     </system>
Jul 31 09:51:38 user nova-compute[71113]:   </sysinfo>
Jul 31 09:51:38 user nova-compute[71113]:   <os>
Jul 31 09:51:38 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 09:51:38 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 09:51:38 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 09:51:38 user nova-compute[71113]:   </os>
Jul 31 09:51:38 user nova-compute[71113]:   <features>
Jul 31 09:51:38 user nova-compute[71113]:     <acpi/>
Jul 31 09:51:38 user nova-compute[71113]:     <apic/>
Jul 31 09:51:38 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 09:51:38 user nova-compute[71113]:   </features>
Jul 31 09:51:38 user nova-compute[71113]:   <clock offset="utc">
Jul 31 09:51:38 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 09:51:38 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 09:51:38 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 09:51:38 user nova-compute[71113]:   </clock>
Jul 31 09:51:38 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 09:51:38 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 09:51:38 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 09:51:38 user nova-compute[71113]:   </cpu>
Jul 31 09:51:38 user nova-compute[71113]:   <devices>
Jul 31 09:51:38 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 09:51:38 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 09:51:38 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/af1f4e7c-b336-457a-94cc-3df3c3203370/disk"/>
Jul 31 09:51:38 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 09:51:38 user nova-compute[71113]:     </disk>
Jul 31 09:51:38 user nova-compute[71113]:     <disk type="file" device="cdrom">
Jul 31 09:51:38 user nova-compute[71113]:       <driver name="qemu" type="raw" cache="none"/>
Jul 31 09:51:38 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/af1f4e7c-b336-457a-94cc-3df3c3203370/disk.config"/>
Jul 31 09:51:38 user nova-compute[71113]:       <target dev="hda" bus="ide"/>
Jul 31 09:51:38 user nova-compute[71113]:     </disk>
Jul 31 09:51:38 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 09:51:38 user nova-compute[71113]:       <mac address="fa:16:3e:64:ce:90"/>
Jul 31 09:51:38 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:51:38 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 09:51:38 user nova-compute[71113]:       <target dev="tapb57ab83c-c7"/>
Jul 31 09:51:38 user nova-compute[71113]:     </interface>
Jul 31 09:51:38 user nova-compute[71113]:     <serial type="pty">
Jul 31 09:51:38 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/af1f4e7c-b336-457a-94cc-3df3c3203370/console.log" append="off"/>
Jul 31 09:51:38 user nova-compute[71113]:     </serial>
Jul 31 09:51:38 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 09:51:38 user nova-compute[71113]:     <video>
Jul 31 09:51:38 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:51:38 user nova-compute[71113]:     </video>
Jul 31 09:51:38 user nova-compute[71113]:     <rng model="virtio">
Jul 31 09:51:38 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 09:51:38 user nova-compute[71113]:     </rng>
Jul 31 09:51:38 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 09:51:38 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 09:51:38 user nova-compute[71113]:       <stats period="10"/>
Jul 31 09:51:38 user nova-compute[71113]:     </memballoon>
Jul 31 09:51:38 user nova-compute[71113]:   </devices>
Jul 31 09:51:38 user nova-compute[71113]: </domain>
Jul 31 09:51:38 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 09:51:38 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T09:51:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-601671640',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-601671640',id=17,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrt/0N3rqkgPN6SuyXfpoCTkV9Bk0pcEdYe3hmzwwFIugD3ohq+ljDgxWA2owuO7ncn48ukAgrCkpv3bs19B971Yw7oJwFLv7z/1GwjZIhoKmL+3YWqpkWzV2dkY74VfA==',key_name='tempest-keypair-341346334',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8a3ec2098864e8797f77f70e1784acd',ramdisk_id='',reservation_id='r-sijnqnb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-740569977',owner_user_name='tempest-TaggedAttachmentsTest-740569977-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:51:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21f1d14ad39e4cd0b19e8484f1635344',uuid=af1f4e7c-b336-457a-94cc-3df3c3203370,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b57ab83c-c78e-424e-889b-b0156de15bfe", "address": "fa:16:3e:64:ce:90", "network": {"id": "2eebe293-45a3-4f39-bfa2-404813801391", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1697211995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8a3ec2098864e8797f77f70e1784acd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb57ab83c-c7", "ovs_interfaceid": "b57ab83c-c78e-424e-889b-b0156de15bfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 09:51:38 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Converting VIF {"id": "b57ab83c-c78e-424e-889b-b0156de15bfe", "address": "fa:16:3e:64:ce:90", "network": {"id": "2eebe293-45a3-4f39-bfa2-404813801391", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1697211995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8a3ec2098864e8797f77f70e1784acd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb57ab83c-c7", "ovs_interfaceid": "b57ab83c-c78e-424e-889b-b0156de15bfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:51:38 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:ce:90,bridge_name='br-int',has_traffic_filtering=True,id=b57ab83c-c78e-424e-889b-b0156de15bfe,network=Network(2eebe293-45a3-4f39-bfa2-404813801391),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb57ab83c-c7') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:51:38 user nova-compute[71113]: DEBUG os_vif [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:ce:90,bridge_name='br-int',has_traffic_filtering=True,id=b57ab83c-c78e-424e-889b-b0156de15bfe,network=Network(2eebe293-45a3-4f39-bfa2-404813801391),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb57ab83c-c7') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 09:51:38 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:38 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:51:38 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 09:51:38 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:38 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb57ab83c-c7, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:51:38 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb57ab83c-c7, col_values=(('external_ids', {'iface-id': 'b57ab83c-c78e-424e-889b-b0156de15bfe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:ce:90', 'vm-uuid': 'af1f4e7c-b336-457a-94cc-3df3c3203370'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:51:38 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:38 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:51:38 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:38 user nova-compute[71113]: INFO os_vif [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:ce:90,bridge_name='br-int',has_traffic_filtering=True,id=b57ab83c-c78e-424e-889b-b0156de15bfe,network=Network(2eebe293-45a3-4f39-bfa2-404813801391),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb57ab83c-c7')
Jul 31 09:51:38 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:51:38 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] No BDM found with device name hda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:51:38 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] No VIF found with MAC fa:16:3e:64:ce:90, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 09:51:38 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Using config drive
Jul 31 09:51:38 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690797083.3223898, f88bc35b-4996-400e-88ba-5d0f2c3f6c4a => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:51:38 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] VM Stopped (Lifecycle Event)
Jul 31 09:51:38 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ac58cb26-fbcc-462d-8575-560d0f3a173b None None] [instance: f88bc35b-4996-400e-88ba-5d0f2c3f6c4a] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:51:38 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Creating config drive at /opt/stack/data/nova/instances/af1f4e7c-b336-457a-94cc-3df3c3203370/disk.config
Jul 31 09:51:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/af1f4e7c-b336-457a-94cc-3df3c3203370/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpp5025j29 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:51:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/af1f4e7c-b336-457a-94cc-3df3c3203370/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpp5025j29" returned: 0 in 0.060s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:51:38 user nova-compute[71113]: DEBUG nova.network.neutron [req-c963dbcb-52e0-44f2-a57a-90386d18468e req-7c358b55-34f8-4e24-b04c-8c0ca6ffdbef service nova] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Updated VIF entry in instance network info cache for port b57ab83c-c78e-424e-889b-b0156de15bfe. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:51:38 user nova-compute[71113]: DEBUG nova.network.neutron [req-c963dbcb-52e0-44f2-a57a-90386d18468e req-7c358b55-34f8-4e24-b04c-8c0ca6ffdbef service nova] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Updating instance_info_cache with network_info: [{"id": "b57ab83c-c78e-424e-889b-b0156de15bfe", "address": "fa:16:3e:64:ce:90", "network": {"id": "2eebe293-45a3-4f39-bfa2-404813801391", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1697211995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8a3ec2098864e8797f77f70e1784acd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb57ab83c-c7", "ovs_interfaceid": "b57ab83c-c78e-424e-889b-b0156de15bfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:51:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-c963dbcb-52e0-44f2-a57a-90386d18468e req-7c358b55-34f8-4e24-b04c-8c0ca6ffdbef service nova] Releasing lock "refresh_cache-af1f4e7c-b336-457a-94cc-3df3c3203370" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:51:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:39 user nova-compute[71113]: DEBUG nova.compute.manager [req-2e504055-530b-4e51-b874-031757b00071 req-ea50e6f7-19a8-4ff8-90f2-1feb2453da0f service nova] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Received event network-vif-plugged-b57ab83c-c78e-424e-889b-b0156de15bfe {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:51:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-2e504055-530b-4e51-b874-031757b00071 req-ea50e6f7-19a8-4ff8-90f2-1feb2453da0f service nova] Acquiring lock "af1f4e7c-b336-457a-94cc-3df3c3203370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:51:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-2e504055-530b-4e51-b874-031757b00071 req-ea50e6f7-19a8-4ff8-90f2-1feb2453da0f service nova] Lock "af1f4e7c-b336-457a-94cc-3df3c3203370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:51:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-2e504055-530b-4e51-b874-031757b00071 req-ea50e6f7-19a8-4ff8-90f2-1feb2453da0f service nova] Lock "af1f4e7c-b336-457a-94cc-3df3c3203370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:51:39 user nova-compute[71113]: DEBUG nova.compute.manager [req-2e504055-530b-4e51-b874-031757b00071 req-ea50e6f7-19a8-4ff8-90f2-1feb2453da0f service nova] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] No waiting events found dispatching network-vif-plugged-b57ab83c-c78e-424e-889b-b0156de15bfe {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:51:39 user nova-compute[71113]: WARNING nova.compute.manager [req-2e504055-530b-4e51-b874-031757b00071 req-ea50e6f7-19a8-4ff8-90f2-1feb2453da0f service nova] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Received unexpected event network-vif-plugged-b57ab83c-c78e-424e-889b-b0156de15bfe for instance with vm_state building and task_state spawning.
Jul 31 09:51:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Acquiring lock "6d92f7e3-6f70-4344-9f15-9815d51024b6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:51:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "6d92f7e3-6f70-4344-9f15-9815d51024b6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:51:40 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Starting instance... {{(pid=71113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 09:51:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:51:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:51:40 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 09:51:40 user nova-compute[71113]: INFO nova.compute.claims [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Claim successful on node user
Jul 31 09:51:40 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:40 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:40 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:51:40 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:51:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.656s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:51:40 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Start building networks asynchronously for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 09:51:41 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Allocating IP information in the background. {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 09:51:41 user nova-compute[71113]: DEBUG nova.network.neutron [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] allocate_for_instance() {{(pid=71113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 09:51:41 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 09:51:41 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Start building block device mappings for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 09:51:41 user nova-compute[71113]: DEBUG nova.policy [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a414c37ab0384024821d33e393b711af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60e95a8fd2446d5bd5308f10caa6930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71113) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 09:51:41 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Start spawning the instance on the hypervisor. {{(pid=71113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 09:51:41 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 09:51:41 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Creating image(s)
Jul 31 09:51:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Acquiring lock "/opt/stack/data/nova/instances/6d92f7e3-6f70-4344-9f15-9815d51024b6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:51:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "/opt/stack/data/nova/instances/6d92f7e3-6f70-4344-9f15-9815d51024b6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:51:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "/opt/stack/data/nova/instances/6d92f7e3-6f70-4344-9f15-9815d51024b6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:51:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Acquiring lock "afb72aa9f76cf488ce2c1bb26a7aa16329c2961b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:51:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "afb72aa9f76cf488ce2c1bb26a7aa16329c2961b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:51:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/afb72aa9f76cf488ce2c1bb26a7aa16329c2961b.part --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:51:42 user nova-compute[71113]: DEBUG nova.network.neutron [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Successfully created port: 72cf4ec9-ac91-4f38-a4f5-9859bb5138bf {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 09:51:42 user nova-compute[71113]: DEBUG nova.compute.manager [req-89d5c2d2-0e01-4664-8d43-f258ecf240ea req-7f38ce49-db49-46d3-a5a9-3725d18b80ec service nova] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Received event network-vif-plugged-b57ab83c-c78e-424e-889b-b0156de15bfe {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:51:42 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-89d5c2d2-0e01-4664-8d43-f258ecf240ea req-7f38ce49-db49-46d3-a5a9-3725d18b80ec service nova] Acquiring lock "af1f4e7c-b336-457a-94cc-3df3c3203370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:51:42 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-89d5c2d2-0e01-4664-8d43-f258ecf240ea req-7f38ce49-db49-46d3-a5a9-3725d18b80ec service nova] Lock "af1f4e7c-b336-457a-94cc-3df3c3203370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:51:42 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-89d5c2d2-0e01-4664-8d43-f258ecf240ea req-7f38ce49-db49-46d3-a5a9-3725d18b80ec service nova] Lock "af1f4e7c-b336-457a-94cc-3df3c3203370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:51:42 user nova-compute[71113]: DEBUG nova.compute.manager [req-89d5c2d2-0e01-4664-8d43-f258ecf240ea req-7f38ce49-db49-46d3-a5a9-3725d18b80ec service nova] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] No waiting events found dispatching network-vif-plugged-b57ab83c-c78e-424e-889b-b0156de15bfe {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:51:42 user nova-compute[71113]: WARNING nova.compute.manager [req-89d5c2d2-0e01-4664-8d43-f258ecf240ea req-7f38ce49-db49-46d3-a5a9-3725d18b80ec service nova] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Received unexpected event network-vif-plugged-b57ab83c-c78e-424e-889b-b0156de15bfe for instance with vm_state building and task_state spawning.
Jul 31 09:51:42 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797102.0940588, af1f4e7c-b336-457a-94cc-3df3c3203370 => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:51:42 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] VM Resumed (Lifecycle Event)
Jul 31 09:51:42 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 09:51:42 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 09:51:42 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Instance spawned successfully.
Jul 31 09:51:42 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 09:51:42 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:51:42 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:51:42 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Found default for hw_cdrom_bus of ide {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:51:42 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Found default for hw_disk_bus of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:51:42 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Found default for hw_input_bus of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:51:42 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Found default for hw_pointer_model of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:51:42 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Found default for hw_video_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:51:42 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Found default for hw_vif_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:51:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/afb72aa9f76cf488ce2c1bb26a7aa16329c2961b.part --force-share --output=json" returned: 0 in 0.136s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:51:42 user nova-compute[71113]: DEBUG nova.virt.images [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] bb8cda9d-fc71-4cd9-84f5-a118a86c8336 was qcow2, converting to raw {{(pid=71113) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 31 09:51:42 user nova-compute[71113]: DEBUG nova.privsep.utils [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71113) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 09:51:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/afb72aa9f76cf488ce2c1bb26a7aa16329c2961b.part /opt/stack/data/nova/instances/_base/afb72aa9f76cf488ce2c1bb26a7aa16329c2961b.converted {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:51:42 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:51:42 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797102.0959613, af1f4e7c-b336-457a-94cc-3df3c3203370 => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:51:42 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] VM Started (Lifecycle Event)
Jul 31 09:51:42 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:51:42 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:51:42 user nova-compute[71113]: INFO nova.compute.manager [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Took 6.36 seconds to spawn the instance on the hypervisor.
Jul 31 09:51:42 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:51:42 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:51:42 user nova-compute[71113]: INFO nova.compute.manager [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Took 7.64 seconds to build instance.
Jul 31 09:51:42 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ba76cad2-cff9-47a4-810e-74dc90bef19d tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Lock "af1f4e7c-b336-457a-94cc-3df3c3203370" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.802s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/afb72aa9f76cf488ce2c1bb26a7aa16329c2961b.part /opt/stack/data/nova/instances/_base/afb72aa9f76cf488ce2c1bb26a7aa16329c2961b.converted" returned: 0 in 0.924s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/afb72aa9f76cf488ce2c1bb26a7aa16329c2961b.converted --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/afb72aa9f76cf488ce2c1bb26a7aa16329c2961b.converted --force-share --output=json" returned: 0 in 0.156s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "afb72aa9f76cf488ce2c1bb26a7aa16329c2961b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.095s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/afb72aa9f76cf488ce2c1bb26a7aa16329c2961b --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/afb72aa9f76cf488ce2c1bb26a7aa16329c2961b --force-share --output=json" returned: 0 in 0.130s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Acquiring lock "afb72aa9f76cf488ce2c1bb26a7aa16329c2961b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "afb72aa9f76cf488ce2c1bb26a7aa16329c2961b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/afb72aa9f76cf488ce2c1bb26a7aa16329c2961b --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG nova.network.neutron [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Successfully updated port: 72cf4ec9-ac91-4f38-a4f5-9859bb5138bf {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Acquiring lock "refresh_cache-6d92f7e3-6f70-4344-9f15-9815d51024b6" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Acquired lock "refresh_cache-6d92f7e3-6f70-4344-9f15-9815d51024b6" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG nova.network.neutron [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG nova.compute.manager [req-f02ca8bd-4313-427e-ab19-bbc48aa72e93 req-0266d956-f88c-4b91-b3b4-ce8b1994e4d5 service nova] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Received event network-changed-72cf4ec9-ac91-4f38-a4f5-9859bb5138bf {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG nova.compute.manager [req-f02ca8bd-4313-427e-ab19-bbc48aa72e93 req-0266d956-f88c-4b91-b3b4-ce8b1994e4d5 service nova] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Refreshing instance network info cache due to event network-changed-72cf4ec9-ac91-4f38-a4f5-9859bb5138bf. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f02ca8bd-4313-427e-ab19-bbc48aa72e93 req-0266d956-f88c-4b91-b3b4-ce8b1994e4d5 service nova] Acquiring lock "refresh_cache-6d92f7e3-6f70-4344-9f15-9815d51024b6" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG nova.network.neutron [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/afb72aa9f76cf488ce2c1bb26a7aa16329c2961b --force-share --output=json" returned: 0 in 0.139s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/afb72aa9f76cf488ce2c1bb26a7aa16329c2961b,backing_fmt=raw /opt/stack/data/nova/instances/6d92f7e3-6f70-4344-9f15-9815d51024b6/disk 1073741824 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/afb72aa9f76cf488ce2c1bb26a7aa16329c2961b,backing_fmt=raw /opt/stack/data/nova/instances/6d92f7e3-6f70-4344-9f15-9815d51024b6/disk 1073741824" returned: 0 in 0.048s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "afb72aa9f76cf488ce2c1bb26a7aa16329c2961b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/afb72aa9f76cf488ce2c1bb26a7aa16329c2961b --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/afb72aa9f76cf488ce2c1bb26a7aa16329c2961b --force-share --output=json" returned: 0 in 0.133s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG nova.objects.instance [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lazy-loading 'migration_context' on Instance uuid 6d92f7e3-6f70-4344-9f15-9815d51024b6 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Created local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Ensure instance console log exists: /opt/stack/data/nova/instances/6d92f7e3-6f70-4344-9f15-9815d51024b6/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG nova.network.neutron [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Updating instance_info_cache with network_info: [{"id": "72cf4ec9-ac91-4f38-a4f5-9859bb5138bf", "address": "fa:16:3e:07:7b:f4", "network": {"id": "8c75ddf2-700c-4f01-b8cf-af57bdab7d37", "bridge": "br-int", "label": "tempest-TestStampPattern-1367141606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60e95a8fd2446d5bd5308f10caa6930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72cf4ec9-ac", "ovs_interfaceid": "72cf4ec9-ac91-4f38-a4f5-9859bb5138bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Releasing lock "refresh_cache-6d92f7e3-6f70-4344-9f15-9815d51024b6" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Instance network_info: |[{"id": "72cf4ec9-ac91-4f38-a4f5-9859bb5138bf", "address": "fa:16:3e:07:7b:f4", "network": {"id": "8c75ddf2-700c-4f01-b8cf-af57bdab7d37", "bridge": "br-int", "label": "tempest-TestStampPattern-1367141606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60e95a8fd2446d5bd5308f10caa6930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72cf4ec9-ac", "ovs_interfaceid": "72cf4ec9-ac91-4f38-a4f5-9859bb5138bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f02ca8bd-4313-427e-ab19-bbc48aa72e93 req-0266d956-f88c-4b91-b3b4-ce8b1994e4d5 service nova] Acquired lock "refresh_cache-6d92f7e3-6f70-4344-9f15-9815d51024b6" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG nova.network.neutron [req-f02ca8bd-4313-427e-ab19-bbc48aa72e93 req-0266d956-f88c-4b91-b3b4-ce8b1994e4d5 service nova] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Refreshing network info cache for port 72cf4ec9-ac91-4f38-a4f5-9859bb5138bf {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Start _get_guest_xml network_info=[{"id": "72cf4ec9-ac91-4f38-a4f5-9859bb5138bf", "address": "fa:16:3e:07:7b:f4", "network": {"id": "8c75ddf2-700c-4f01-b8cf-af57bdab7d37", "bridge": "br-int", "label": "tempest-TestStampPattern-1367141606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60e95a8fd2446d5bd5308f10caa6930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72cf4ec9-ac", "ovs_interfaceid": "72cf4ec9-ac91-4f38-a4f5-9859bb5138bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c416e6f19a86c4f4104da84cf8a521cd',container_format='bare',created_at=2023-07-31T09:51:32Z,direct_url=<?>,disk_format='qcow2',id=bb8cda9d-fc71-4cd9-84f5-a118a86c8336,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1710800436',owner='f60e95a8fd2446d5bd5308f10caa6930',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-31T09:51:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'image_id': 'bb8cda9d-fc71-4cd9-84f5-a118a86c8336'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 09:51:43 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:51:43 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:51:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c416e6f19a86c4f4104da84cf8a521cd',container_format='bare',created_at=2023-07-31T09:51:32Z,direct_url=<?>,disk_format='qcow2',id=bb8cda9d-fc71-4cd9-84f5-a118a86c8336,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1710800436',owner='f60e95a8fd2446d5bd5308f10caa6930',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-31T09:51:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:51:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1747166891',display_name='tempest-TestStampPattern-server-1747166891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1747166891',id=18,image_ref='bb8cda9d-fc71-4cd9-84f5-a118a86c8336',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrIg8Re0SPL90KGI/7mfKXKiutrisvPKJSJwI2GyIKoRN6YbCL8gOrKsaFBkaHBzRjOk6oMjoGJtW64C2f48/NDQKl52ZNucPGtAtvZuIzC2XttPHjvBX5TLIsYhRNoTA==',key_name='tempest-TestStampPattern-211360877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f60e95a8fd2446d5bd5308f10caa6930',ramdisk_id='',reservation_id='r-dhcn2cxh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='9a4b47dd-b335-4c2f-9dee-5421357a0ee1',image_min_disk='1',image_min_ram='0',image_owner_id='f60e95a8fd2446d5bd5308f10caa6930',image_owner_project_name='tempest-TestStampPattern-12160385',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-12160385-project-member',image_user_id='a414c37ab0384024821d33e393b711af',network_allocated='True',owner_project_name='tempest-TestStampPattern-12160385',owner_user_name='tempest-TestStampPattern-12160385-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:51:41Z,user_data=None,user_id='a414c37ab0384024821d33e393b711af',uuid=6d92f7e3-6f70-4344-9f15-9815d51024b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72cf4ec9-ac91-4f38-a4f5-9859bb5138bf", "address": "fa:16:3e:07:7b:f4", "network": {"id": "8c75ddf2-700c-4f01-b8cf-af57bdab7d37", "bridge": "br-int", "label": "tempest-TestStampPattern-1367141606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60e95a8fd2446d5bd5308f10caa6930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72cf4ec9-ac", "ovs_interfaceid": "72cf4ec9-ac91-4f38-a4f5-9859bb5138bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Converting VIF {"id": "72cf4ec9-ac91-4f38-a4f5-9859bb5138bf", "address": "fa:16:3e:07:7b:f4", "network": {"id": "8c75ddf2-700c-4f01-b8cf-af57bdab7d37", "bridge": "br-int", "label": "tempest-TestStampPattern-1367141606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60e95a8fd2446d5bd5308f10caa6930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72cf4ec9-ac", "ovs_interfaceid": "72cf4ec9-ac91-4f38-a4f5-9859bb5138bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:7b:f4,bridge_name='br-int',has_traffic_filtering=True,id=72cf4ec9-ac91-4f38-a4f5-9859bb5138bf,network=Network(8c75ddf2-700c-4f01-b8cf-af57bdab7d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72cf4ec9-ac') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG nova.objects.instance [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lazy-loading 'pci_devices' on Instance uuid 6d92f7e3-6f70-4344-9f15-9815d51024b6 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] End _get_guest_xml xml=<domain type="kvm">
Jul 31 09:51:43 user nova-compute[71113]:   <uuid>6d92f7e3-6f70-4344-9f15-9815d51024b6</uuid>
Jul 31 09:51:43 user nova-compute[71113]:   <name>instance-00000012</name>
Jul 31 09:51:43 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 09:51:43 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 09:51:43 user nova-compute[71113]:   <metadata>
Jul 31 09:51:43 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 09:51:43 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 09:51:43 user nova-compute[71113]:       <nova:name>tempest-TestStampPattern-server-1747166891</nova:name>
Jul 31 09:51:43 user nova-compute[71113]:       <nova:creationTime>2023-07-31 09:51:43</nova:creationTime>
Jul 31 09:51:43 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 09:51:43 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 09:51:43 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 09:51:43 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 09:51:43 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 09:51:43 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 09:51:43 user nova-compute[71113]:       </nova:flavor>
Jul 31 09:51:43 user nova-compute[71113]:       <nova:owner>
Jul 31 09:51:43 user nova-compute[71113]:         <nova:user uuid="a414c37ab0384024821d33e393b711af">tempest-TestStampPattern-12160385-project-member</nova:user>
Jul 31 09:51:43 user nova-compute[71113]:         <nova:project uuid="f60e95a8fd2446d5bd5308f10caa6930">tempest-TestStampPattern-12160385</nova:project>
Jul 31 09:51:43 user nova-compute[71113]:       </nova:owner>
Jul 31 09:51:43 user nova-compute[71113]:       <nova:root type="image" uuid="bb8cda9d-fc71-4cd9-84f5-a118a86c8336"/>
Jul 31 09:51:43 user nova-compute[71113]:       <nova:ports>
Jul 31 09:51:43 user nova-compute[71113]:         <nova:port uuid="72cf4ec9-ac91-4f38-a4f5-9859bb5138bf">
Jul 31 09:51:43 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 31 09:51:43 user nova-compute[71113]:         </nova:port>
Jul 31 09:51:43 user nova-compute[71113]:       </nova:ports>
Jul 31 09:51:43 user nova-compute[71113]:     </nova:instance>
Jul 31 09:51:43 user nova-compute[71113]:   </metadata>
Jul 31 09:51:43 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 09:51:43 user nova-compute[71113]:     <system>
Jul 31 09:51:43 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 09:51:43 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 09:51:43 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 09:51:43 user nova-compute[71113]:       <entry name="serial">6d92f7e3-6f70-4344-9f15-9815d51024b6</entry>
Jul 31 09:51:43 user nova-compute[71113]:       <entry name="uuid">6d92f7e3-6f70-4344-9f15-9815d51024b6</entry>
Jul 31 09:51:43 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 09:51:43 user nova-compute[71113]:     </system>
Jul 31 09:51:43 user nova-compute[71113]:   </sysinfo>
Jul 31 09:51:43 user nova-compute[71113]:   <os>
Jul 31 09:51:43 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 09:51:43 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 09:51:43 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 09:51:43 user nova-compute[71113]:   </os>
Jul 31 09:51:43 user nova-compute[71113]:   <features>
Jul 31 09:51:43 user nova-compute[71113]:     <acpi/>
Jul 31 09:51:43 user nova-compute[71113]:     <apic/>
Jul 31 09:51:43 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 09:51:43 user nova-compute[71113]:   </features>
Jul 31 09:51:43 user nova-compute[71113]:   <clock offset="utc">
Jul 31 09:51:43 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 09:51:43 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 09:51:43 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 09:51:43 user nova-compute[71113]:   </clock>
Jul 31 09:51:43 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 09:51:43 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 09:51:43 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 09:51:43 user nova-compute[71113]:   </cpu>
Jul 31 09:51:43 user nova-compute[71113]:   <devices>
Jul 31 09:51:43 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 09:51:43 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 09:51:43 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/6d92f7e3-6f70-4344-9f15-9815d51024b6/disk"/>
Jul 31 09:51:43 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 09:51:43 user nova-compute[71113]:     </disk>
Jul 31 09:51:43 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 09:51:43 user nova-compute[71113]:       <mac address="fa:16:3e:07:7b:f4"/>
Jul 31 09:51:43 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:51:43 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 09:51:43 user nova-compute[71113]:       <target dev="tap72cf4ec9-ac"/>
Jul 31 09:51:43 user nova-compute[71113]:     </interface>
Jul 31 09:51:43 user nova-compute[71113]:     <serial type="pty">
Jul 31 09:51:43 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/6d92f7e3-6f70-4344-9f15-9815d51024b6/console.log" append="off"/>
Jul 31 09:51:43 user nova-compute[71113]:     </serial>
Jul 31 09:51:43 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 09:51:43 user nova-compute[71113]:     <video>
Jul 31 09:51:43 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:51:43 user nova-compute[71113]:     </video>
Jul 31 09:51:43 user nova-compute[71113]:     <rng model="virtio">
Jul 31 09:51:43 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 09:51:43 user nova-compute[71113]:     </rng>
Jul 31 09:51:43 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 09:51:43 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 09:51:43 user nova-compute[71113]:       <stats period="10"/>
Jul 31 09:51:43 user nova-compute[71113]:     </memballoon>
Jul 31 09:51:43 user nova-compute[71113]:   </devices>
Jul 31 09:51:43 user nova-compute[71113]: </domain>
Jul 31 09:51:43 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:51:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1747166891',display_name='tempest-TestStampPattern-server-1747166891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1747166891',id=18,image_ref='bb8cda9d-fc71-4cd9-84f5-a118a86c8336',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrIg8Re0SPL90KGI/7mfKXKiutrisvPKJSJwI2GyIKoRN6YbCL8gOrKsaFBkaHBzRjOk6oMjoGJtW64C2f48/NDQKl52ZNucPGtAtvZuIzC2XttPHjvBX5TLIsYhRNoTA==',key_name='tempest-TestStampPattern-211360877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f60e95a8fd2446d5bd5308f10caa6930',ramdisk_id='',reservation_id='r-dhcn2cxh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='9a4b47dd-b335-4c2f-9dee-5421357a0ee1',image_min_disk='1',image_min_ram='0',image_owner_id='f60e95a8fd2446d5bd5308f10caa6930',image_owner_project_name='tempest-TestStampPattern-12160385',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-12160385-project-member',image_user_id='a414c37ab0384024821d33e393b711af',network_allocated='True',owner_project_name='tempest-TestStampPattern-12160385',owner_user_name='tempest-TestStampPattern-12160385-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:51:41Z,user_data=None,user_id='a414c37ab0384024821d33e393b711af',uuid=6d92f7e3-6f70-4344-9f15-9815d51024b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72cf4ec9-ac91-4f38-a4f5-9859bb5138bf", "address": "fa:16:3e:07:7b:f4", "network": {"id": "8c75ddf2-700c-4f01-b8cf-af57bdab7d37", "bridge": "br-int", "label": "tempest-TestStampPattern-1367141606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60e95a8fd2446d5bd5308f10caa6930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72cf4ec9-ac", "ovs_interfaceid": "72cf4ec9-ac91-4f38-a4f5-9859bb5138bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Converting VIF {"id": "72cf4ec9-ac91-4f38-a4f5-9859bb5138bf", "address": "fa:16:3e:07:7b:f4", "network": {"id": "8c75ddf2-700c-4f01-b8cf-af57bdab7d37", "bridge": "br-int", "label": "tempest-TestStampPattern-1367141606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60e95a8fd2446d5bd5308f10caa6930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72cf4ec9-ac", "ovs_interfaceid": "72cf4ec9-ac91-4f38-a4f5-9859bb5138bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:7b:f4,bridge_name='br-int',has_traffic_filtering=True,id=72cf4ec9-ac91-4f38-a4f5-9859bb5138bf,network=Network(8c75ddf2-700c-4f01-b8cf-af57bdab7d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72cf4ec9-ac') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG os_vif [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:7b:f4,bridge_name='br-int',has_traffic_filtering=True,id=72cf4ec9-ac91-4f38-a4f5-9859bb5138bf,network=Network(8c75ddf2-700c-4f01-b8cf-af57bdab7d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72cf4ec9-ac') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap72cf4ec9-ac, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap72cf4ec9-ac, col_values=(('external_ids', {'iface-id': '72cf4ec9-ac91-4f38-a4f5-9859bb5138bf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:7b:f4', 'vm-uuid': '6d92f7e3-6f70-4344-9f15-9815d51024b6'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:51:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:43 user nova-compute[71113]: INFO os_vif [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:7b:f4,bridge_name='br-int',has_traffic_filtering=True,id=72cf4ec9-ac91-4f38-a4f5-9859bb5138bf,network=Network(8c75ddf2-700c-4f01-b8cf-af57bdab7d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72cf4ec9-ac')
Jul 31 09:51:44 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:51:44 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] No VIF found with MAC fa:16:3e:07:7b:f4, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 09:51:44 user nova-compute[71113]: DEBUG nova.network.neutron [req-f02ca8bd-4313-427e-ab19-bbc48aa72e93 req-0266d956-f88c-4b91-b3b4-ce8b1994e4d5 service nova] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Updated VIF entry in instance network info cache for port 72cf4ec9-ac91-4f38-a4f5-9859bb5138bf. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:51:44 user nova-compute[71113]: DEBUG nova.network.neutron [req-f02ca8bd-4313-427e-ab19-bbc48aa72e93 req-0266d956-f88c-4b91-b3b4-ce8b1994e4d5 service nova] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Updating instance_info_cache with network_info: [{"id": "72cf4ec9-ac91-4f38-a4f5-9859bb5138bf", "address": "fa:16:3e:07:7b:f4", "network": {"id": "8c75ddf2-700c-4f01-b8cf-af57bdab7d37", "bridge": "br-int", "label": "tempest-TestStampPattern-1367141606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60e95a8fd2446d5bd5308f10caa6930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72cf4ec9-ac", "ovs_interfaceid": "72cf4ec9-ac91-4f38-a4f5-9859bb5138bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:51:44 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f02ca8bd-4313-427e-ab19-bbc48aa72e93 req-0266d956-f88c-4b91-b3b4-ce8b1994e4d5 service nova] Releasing lock "refresh_cache-6d92f7e3-6f70-4344-9f15-9815d51024b6" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:51:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:45 user nova-compute[71113]: DEBUG nova.compute.manager [req-179382db-4f3b-4c9c-8744-2ad480ddb1bf req-a54009f9-b24d-4aa4-9548-b8d64cb38eb2 service nova] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Received event network-vif-plugged-72cf4ec9-ac91-4f38-a4f5-9859bb5138bf {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:51:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-179382db-4f3b-4c9c-8744-2ad480ddb1bf req-a54009f9-b24d-4aa4-9548-b8d64cb38eb2 service nova] Acquiring lock "6d92f7e3-6f70-4344-9f15-9815d51024b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:51:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-179382db-4f3b-4c9c-8744-2ad480ddb1bf req-a54009f9-b24d-4aa4-9548-b8d64cb38eb2 service nova] Lock "6d92f7e3-6f70-4344-9f15-9815d51024b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:51:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-179382db-4f3b-4c9c-8744-2ad480ddb1bf req-a54009f9-b24d-4aa4-9548-b8d64cb38eb2 service nova] Lock "6d92f7e3-6f70-4344-9f15-9815d51024b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:51:45 user nova-compute[71113]: DEBUG nova.compute.manager [req-179382db-4f3b-4c9c-8744-2ad480ddb1bf req-a54009f9-b24d-4aa4-9548-b8d64cb38eb2 service nova] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] No waiting events found dispatching network-vif-plugged-72cf4ec9-ac91-4f38-a4f5-9859bb5138bf {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:51:45 user nova-compute[71113]: WARNING nova.compute.manager [req-179382db-4f3b-4c9c-8744-2ad480ddb1bf req-a54009f9-b24d-4aa4-9548-b8d64cb38eb2 service nova] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Received unexpected event network-vif-plugged-72cf4ec9-ac91-4f38-a4f5-9859bb5138bf for instance with vm_state building and task_state spawning.
Jul 31 09:51:47 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690797092.049004, ae982ade-8b51-4948-879a-f308be7eb685 => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:51:47 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: ae982ade-8b51-4948-879a-f308be7eb685] VM Stopped (Lifecycle Event)
Jul 31 09:51:47 user nova-compute[71113]: DEBUG nova.compute.manager [None req-bf80b9a0-423a-4220-ba79-74dd697b5752 None None] [instance: ae982ade-8b51-4948-879a-f308be7eb685] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:51:47 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797107.7335117, 6d92f7e3-6f70-4344-9f15-9815d51024b6 => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:51:47 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] VM Resumed (Lifecycle Event)
Jul 31 09:51:47 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 09:51:47 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 09:51:47 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Instance spawned successfully.
Jul 31 09:51:47 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 09:51:47 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:51:47 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Found default for hw_input_bus of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:51:47 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Found default for hw_pointer_model of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:51:47 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:51:47 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:51:47 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797107.736443, 6d92f7e3-6f70-4344-9f15-9815d51024b6 => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:51:47 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] VM Started (Lifecycle Event)
Jul 31 09:51:47 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:51:47 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:51:47 user nova-compute[71113]: INFO nova.compute.manager [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Took 6.64 seconds to spawn the instance on the hypervisor.
Jul 31 09:51:47 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:51:47 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:51:47 user nova-compute[71113]: INFO nova.compute.manager [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Took 7.65 seconds to build instance.
Jul 31 09:51:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ddffbb5a-47c6-4fcc-a325-bca677bce2ae tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "6d92f7e3-6f70-4344-9f15-9815d51024b6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.758s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:51:47 user nova-compute[71113]: DEBUG nova.compute.manager [req-0b4ca557-66e1-4e89-9a15-f898a9d6f268 req-e8b7b5b7-7a5f-4779-834a-50f79ad88f0e service nova] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Received event network-vif-plugged-72cf4ec9-ac91-4f38-a4f5-9859bb5138bf {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:51:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-0b4ca557-66e1-4e89-9a15-f898a9d6f268 req-e8b7b5b7-7a5f-4779-834a-50f79ad88f0e service nova] Acquiring lock "6d92f7e3-6f70-4344-9f15-9815d51024b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:51:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-0b4ca557-66e1-4e89-9a15-f898a9d6f268 req-e8b7b5b7-7a5f-4779-834a-50f79ad88f0e service nova] Lock "6d92f7e3-6f70-4344-9f15-9815d51024b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:51:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-0b4ca557-66e1-4e89-9a15-f898a9d6f268 req-e8b7b5b7-7a5f-4779-834a-50f79ad88f0e service nova] Lock "6d92f7e3-6f70-4344-9f15-9815d51024b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:51:47 user nova-compute[71113]: DEBUG nova.compute.manager [req-0b4ca557-66e1-4e89-9a15-f898a9d6f268 req-e8b7b5b7-7a5f-4779-834a-50f79ad88f0e service nova] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] No waiting events found dispatching network-vif-plugged-72cf4ec9-ac91-4f38-a4f5-9859bb5138bf {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:51:47 user nova-compute[71113]: WARNING nova.compute.manager [req-0b4ca557-66e1-4e89-9a15-f898a9d6f268 req-e8b7b5b7-7a5f-4779-834a-50f79ad88f0e service nova] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Received unexpected event network-vif-plugged-72cf4ec9-ac91-4f38-a4f5-9859bb5138bf for instance with vm_state active and task_state None.
Jul 31 09:51:48 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Acquiring lock "e133dba2-7426-493b-8282-ed18f3ca0a4a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:51:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Lock "e133dba2-7426-493b-8282-ed18f3ca0a4a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:51:52 user nova-compute[71113]: DEBUG nova.compute.manager [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Starting instance... {{(pid=71113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 09:51:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:51:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:51:52 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 09:51:52 user nova-compute[71113]: INFO nova.compute.claims [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Claim successful on node user
Jul 31 09:51:52 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:51:52 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:51:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.465s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:51:53 user nova-compute[71113]: DEBUG nova.compute.manager [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Start building networks asynchronously for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 09:51:53 user nova-compute[71113]: DEBUG nova.compute.manager [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Allocating IP information in the background. {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 09:51:53 user nova-compute[71113]: DEBUG nova.network.neutron [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] allocate_for_instance() {{(pid=71113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 09:51:53 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 09:51:53 user nova-compute[71113]: DEBUG nova.compute.manager [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Start building block device mappings for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 09:51:53 user nova-compute[71113]: DEBUG nova.policy [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7b3fa9245be64500b9879cf4624ecdc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88c00df40f46178f46c09cf14b88d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71113) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 09:51:53 user nova-compute[71113]: DEBUG nova.compute.manager [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Start spawning the instance on the hypervisor. {{(pid=71113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 09:51:53 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 09:51:53 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Creating image(s)
Jul 31 09:51:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Acquiring lock "/opt/stack/data/nova/instances/e133dba2-7426-493b-8282-ed18f3ca0a4a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:51:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Lock "/opt/stack/data/nova/instances/e133dba2-7426-493b-8282-ed18f3ca0a4a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:51:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Lock "/opt/stack/data/nova/instances/e133dba2-7426-493b-8282-ed18f3ca0a4a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:51:53 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:51:53 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.152s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:51:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Acquiring lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:51:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:51:53 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:51:53 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.180s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:51:53 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/e133dba2-7426-493b-8282-ed18f3ca0a4a/disk 1073741824 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:51:53 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/e133dba2-7426-493b-8282-ed18f3ca0a4a/disk 1073741824" returned: 0 in 0.059s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:51:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:51:53 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:51:53 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.170s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:51:53 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e133dba2-7426-493b-8282-ed18f3ca0a4a/disk. size=1073741824 {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 09:51:53 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e133dba2-7426-493b-8282-ed18f3ca0a4a/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:51:53 user nova-compute[71113]: DEBUG nova.network.neutron [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Successfully created port: a56e7fa6-233e-4350-a592-69ecda6dc74e {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 09:51:53 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:53 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e133dba2-7426-493b-8282-ed18f3ca0a4a/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:51:54 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Cannot resize image /opt/stack/data/nova/instances/e133dba2-7426-493b-8282-ed18f3ca0a4a/disk to a smaller size. {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 09:51:54 user nova-compute[71113]: DEBUG nova.objects.instance [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Lazy-loading 'migration_context' on Instance uuid e133dba2-7426-493b-8282-ed18f3ca0a4a {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:51:54 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Created local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 09:51:54 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Ensure instance console log exists: /opt/stack/data/nova/instances/e133dba2-7426-493b-8282-ed18f3ca0a4a/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 09:51:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:51:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:51:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:51:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:54 user nova-compute[71113]: DEBUG nova.network.neutron [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Successfully updated port: a56e7fa6-233e-4350-a592-69ecda6dc74e {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 09:51:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Acquiring lock "refresh_cache-e133dba2-7426-493b-8282-ed18f3ca0a4a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:51:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Acquired lock "refresh_cache-e133dba2-7426-493b-8282-ed18f3ca0a4a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:51:54 user nova-compute[71113]: DEBUG nova.network.neutron [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 09:51:54 user nova-compute[71113]: DEBUG nova.compute.manager [req-f66afa79-be31-465e-bafa-f1e375652445 req-744cf61a-7080-4e53-8e4f-86c95b413533 service nova] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Received event network-changed-a56e7fa6-233e-4350-a592-69ecda6dc74e {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:51:54 user nova-compute[71113]: DEBUG nova.compute.manager [req-f66afa79-be31-465e-bafa-f1e375652445 req-744cf61a-7080-4e53-8e4f-86c95b413533 service nova] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Refreshing instance network info cache due to event network-changed-a56e7fa6-233e-4350-a592-69ecda6dc74e. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:51:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f66afa79-be31-465e-bafa-f1e375652445 req-744cf61a-7080-4e53-8e4f-86c95b413533 service nova] Acquiring lock "refresh_cache-e133dba2-7426-493b-8282-ed18f3ca0a4a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:51:54 user nova-compute[71113]: DEBUG nova.network.neutron [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 09:51:55 user nova-compute[71113]: DEBUG nova.network.neutron [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Updating instance_info_cache with network_info: [{"id": "a56e7fa6-233e-4350-a592-69ecda6dc74e", "address": "fa:16:3e:8c:85:ff", "network": {"id": "4ab5c9f4-e78f-4bf2-bc82-ef698b714952", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1047934668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f88c00df40f46178f46c09cf14b88d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa56e7fa6-23", "ovs_interfaceid": "a56e7fa6-233e-4350-a592-69ecda6dc74e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:51:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Releasing lock "refresh_cache-e133dba2-7426-493b-8282-ed18f3ca0a4a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:51:55 user nova-compute[71113]: DEBUG nova.compute.manager [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Instance network_info: |[{"id": "a56e7fa6-233e-4350-a592-69ecda6dc74e", "address": "fa:16:3e:8c:85:ff", "network": {"id": "4ab5c9f4-e78f-4bf2-bc82-ef698b714952", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1047934668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f88c00df40f46178f46c09cf14b88d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa56e7fa6-23", "ovs_interfaceid": "a56e7fa6-233e-4350-a592-69ecda6dc74e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 09:51:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f66afa79-be31-465e-bafa-f1e375652445 req-744cf61a-7080-4e53-8e4f-86c95b413533 service nova] Acquired lock "refresh_cache-e133dba2-7426-493b-8282-ed18f3ca0a4a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:51:55 user nova-compute[71113]: DEBUG nova.network.neutron [req-f66afa79-be31-465e-bafa-f1e375652445 req-744cf61a-7080-4e53-8e4f-86c95b413533 service nova] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Refreshing network info cache for port a56e7fa6-233e-4350-a592-69ecda6dc74e {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:51:55 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Start _get_guest_xml network_info=[{"id": "a56e7fa6-233e-4350-a592-69ecda6dc74e", "address": "fa:16:3e:8c:85:ff", "network": {"id": "4ab5c9f4-e78f-4bf2-bc82-ef698b714952", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1047934668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f88c00df40f46178f46c09cf14b88d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa56e7fa6-23", "ovs_interfaceid": "a56e7fa6-233e-4350-a592-69ecda6dc74e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'image_id': '078646fe-b504-41ed-a147-61072e903e51'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 09:51:55 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:51:55 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:51:55 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 09:51:55 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 09:51:55 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 09:51:55 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 09:51:55 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 09:51:55 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 09:51:55 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 09:51:55 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 09:51:55 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 09:51:55 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 09:51:55 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 09:51:55 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 09:51:55 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 09:51:55 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 09:51:55 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 09:51:55 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 09:51:55 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:51:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-736446436',display_name='tempest-ServersNegativeTestJSON-server-736446436',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-736446436',id=19,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f88c00df40f46178f46c09cf14b88d7',ramdisk_id='',reservation_id='r-y9bunrrv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1314085245',owner_user_name='tempest-ServersNegativeTestJSON-1314085245-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:51:53Z,user_data=None,user_id='7b3fa9245be64500b9879cf4624ecdc9',uuid=e133dba2-7426-493b-8282-ed18f3ca0a4a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a56e7fa6-233e-4350-a592-69ecda6dc74e", "address": "fa:16:3e:8c:85:ff", "network": {"id": "4ab5c9f4-e78f-4bf2-bc82-ef698b714952", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1047934668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f88c00df40f46178f46c09cf14b88d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa56e7fa6-23", "ovs_interfaceid": "a56e7fa6-233e-4350-a592-69ecda6dc74e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 09:51:55 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Converting VIF {"id": "a56e7fa6-233e-4350-a592-69ecda6dc74e", "address": "fa:16:3e:8c:85:ff", "network": {"id": "4ab5c9f4-e78f-4bf2-bc82-ef698b714952", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1047934668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f88c00df40f46178f46c09cf14b88d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa56e7fa6-23", "ovs_interfaceid": "a56e7fa6-233e-4350-a592-69ecda6dc74e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:51:55 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:85:ff,bridge_name='br-int',has_traffic_filtering=True,id=a56e7fa6-233e-4350-a592-69ecda6dc74e,network=Network(4ab5c9f4-e78f-4bf2-bc82-ef698b714952),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa56e7fa6-23') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:51:55 user nova-compute[71113]: DEBUG nova.objects.instance [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Lazy-loading 'pci_devices' on Instance uuid e133dba2-7426-493b-8282-ed18f3ca0a4a {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:51:55 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] End _get_guest_xml xml=<domain type="kvm">
Jul 31 09:51:55 user nova-compute[71113]:   <uuid>e133dba2-7426-493b-8282-ed18f3ca0a4a</uuid>
Jul 31 09:51:55 user nova-compute[71113]:   <name>instance-00000013</name>
Jul 31 09:51:55 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 09:51:55 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 09:51:55 user nova-compute[71113]:   <metadata>
Jul 31 09:51:55 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 09:51:55 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 09:51:55 user nova-compute[71113]:       <nova:name>tempest-ServersNegativeTestJSON-server-736446436</nova:name>
Jul 31 09:51:55 user nova-compute[71113]:       <nova:creationTime>2023-07-31 09:51:55</nova:creationTime>
Jul 31 09:51:55 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 09:51:55 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 09:51:55 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 09:51:55 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 09:51:55 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 09:51:55 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 09:51:55 user nova-compute[71113]:       </nova:flavor>
Jul 31 09:51:55 user nova-compute[71113]:       <nova:owner>
Jul 31 09:51:55 user nova-compute[71113]:         <nova:user uuid="7b3fa9245be64500b9879cf4624ecdc9">tempest-ServersNegativeTestJSON-1314085245-project-member</nova:user>
Jul 31 09:51:55 user nova-compute[71113]:         <nova:project uuid="8f88c00df40f46178f46c09cf14b88d7">tempest-ServersNegativeTestJSON-1314085245</nova:project>
Jul 31 09:51:55 user nova-compute[71113]:       </nova:owner>
Jul 31 09:51:55 user nova-compute[71113]:       <nova:root type="image" uuid="078646fe-b504-41ed-a147-61072e903e51"/>
Jul 31 09:51:55 user nova-compute[71113]:       <nova:ports>
Jul 31 09:51:55 user nova-compute[71113]:         <nova:port uuid="a56e7fa6-233e-4350-a592-69ecda6dc74e">
Jul 31 09:51:55 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 31 09:51:55 user nova-compute[71113]:         </nova:port>
Jul 31 09:51:55 user nova-compute[71113]:       </nova:ports>
Jul 31 09:51:55 user nova-compute[71113]:     </nova:instance>
Jul 31 09:51:55 user nova-compute[71113]:   </metadata>
Jul 31 09:51:55 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 09:51:55 user nova-compute[71113]:     <system>
Jul 31 09:51:55 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 09:51:55 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 09:51:55 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 09:51:55 user nova-compute[71113]:       <entry name="serial">e133dba2-7426-493b-8282-ed18f3ca0a4a</entry>
Jul 31 09:51:55 user nova-compute[71113]:       <entry name="uuid">e133dba2-7426-493b-8282-ed18f3ca0a4a</entry>
Jul 31 09:51:55 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 09:51:55 user nova-compute[71113]:     </system>
Jul 31 09:51:55 user nova-compute[71113]:   </sysinfo>
Jul 31 09:51:55 user nova-compute[71113]:   <os>
Jul 31 09:51:55 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 09:51:55 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 09:51:55 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 09:51:55 user nova-compute[71113]:   </os>
Jul 31 09:51:55 user nova-compute[71113]:   <features>
Jul 31 09:51:55 user nova-compute[71113]:     <acpi/>
Jul 31 09:51:55 user nova-compute[71113]:     <apic/>
Jul 31 09:51:55 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 09:51:55 user nova-compute[71113]:   </features>
Jul 31 09:51:55 user nova-compute[71113]:   <clock offset="utc">
Jul 31 09:51:55 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 09:51:55 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 09:51:55 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 09:51:55 user nova-compute[71113]:   </clock>
Jul 31 09:51:55 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 09:51:55 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 09:51:55 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 09:51:55 user nova-compute[71113]:   </cpu>
Jul 31 09:51:55 user nova-compute[71113]:   <devices>
Jul 31 09:51:55 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 09:51:55 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 09:51:55 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/e133dba2-7426-493b-8282-ed18f3ca0a4a/disk"/>
Jul 31 09:51:55 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 09:51:55 user nova-compute[71113]:     </disk>
Jul 31 09:51:55 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 09:51:55 user nova-compute[71113]:       <mac address="fa:16:3e:8c:85:ff"/>
Jul 31 09:51:55 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:51:55 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 09:51:55 user nova-compute[71113]:       <target dev="tapa56e7fa6-23"/>
Jul 31 09:51:55 user nova-compute[71113]:     </interface>
Jul 31 09:51:55 user nova-compute[71113]:     <serial type="pty">
Jul 31 09:51:55 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/e133dba2-7426-493b-8282-ed18f3ca0a4a/console.log" append="off"/>
Jul 31 09:51:55 user nova-compute[71113]:     </serial>
Jul 31 09:51:55 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 09:51:55 user nova-compute[71113]:     <video>
Jul 31 09:51:55 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:51:55 user nova-compute[71113]:     </video>
Jul 31 09:51:55 user nova-compute[71113]:     <rng model="virtio">
Jul 31 09:51:55 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 09:51:55 user nova-compute[71113]:     </rng>
Jul 31 09:51:55 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 09:51:55 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 09:51:55 user nova-compute[71113]:       <stats period="10"/>
Jul 31 09:51:55 user nova-compute[71113]:     </memballoon>
Jul 31 09:51:55 user nova-compute[71113]:   </devices>
Jul 31 09:51:55 user nova-compute[71113]: </domain>
Jul 31 09:51:55 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 09:51:55 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:51:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-736446436',display_name='tempest-ServersNegativeTestJSON-server-736446436',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-736446436',id=19,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f88c00df40f46178f46c09cf14b88d7',ramdisk_id='',reservation_id='r-y9bunrrv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1314085245',owner_user_name='tempest-ServersNegativeTestJSON-1314085245-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:51:53Z,user_data=None,user_id='7b3fa9245be64500b9879cf4624ecdc9',uuid=e133dba2-7426-493b-8282-ed18f3ca0a4a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a56e7fa6-233e-4350-a592-69ecda6dc74e", "address": "fa:16:3e:8c:85:ff", "network": {"id": "4ab5c9f4-e78f-4bf2-bc82-ef698b714952", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1047934668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f88c00df40f46178f46c09cf14b88d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa56e7fa6-23", "ovs_interfaceid": "a56e7fa6-233e-4350-a592-69ecda6dc74e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 09:51:55 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Converting VIF {"id": "a56e7fa6-233e-4350-a592-69ecda6dc74e", "address": "fa:16:3e:8c:85:ff", "network": {"id": "4ab5c9f4-e78f-4bf2-bc82-ef698b714952", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1047934668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f88c00df40f46178f46c09cf14b88d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa56e7fa6-23", "ovs_interfaceid": "a56e7fa6-233e-4350-a592-69ecda6dc74e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:51:55 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:85:ff,bridge_name='br-int',has_traffic_filtering=True,id=a56e7fa6-233e-4350-a592-69ecda6dc74e,network=Network(4ab5c9f4-e78f-4bf2-bc82-ef698b714952),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa56e7fa6-23') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:51:55 user nova-compute[71113]: DEBUG os_vif [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:85:ff,bridge_name='br-int',has_traffic_filtering=True,id=a56e7fa6-233e-4350-a592-69ecda6dc74e,network=Network(4ab5c9f4-e78f-4bf2-bc82-ef698b714952),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa56e7fa6-23') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 09:51:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:51:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 09:51:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa56e7fa6-23, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:51:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa56e7fa6-23, col_values=(('external_ids', {'iface-id': 'a56e7fa6-233e-4350-a592-69ecda6dc74e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:85:ff', 'vm-uuid': 'e133dba2-7426-493b-8282-ed18f3ca0a4a'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:51:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:51:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:55 user nova-compute[71113]: INFO os_vif [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:85:ff,bridge_name='br-int',has_traffic_filtering=True,id=a56e7fa6-233e-4350-a592-69ecda6dc74e,network=Network(4ab5c9f4-e78f-4bf2-bc82-ef698b714952),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa56e7fa6-23')
Jul 31 09:51:55 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:51:55 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] No VIF found with MAC fa:16:3e:8c:85:ff, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 09:51:56 user nova-compute[71113]: DEBUG nova.network.neutron [req-f66afa79-be31-465e-bafa-f1e375652445 req-744cf61a-7080-4e53-8e4f-86c95b413533 service nova] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Updated VIF entry in instance network info cache for port a56e7fa6-233e-4350-a592-69ecda6dc74e. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:51:56 user nova-compute[71113]: DEBUG nova.network.neutron [req-f66afa79-be31-465e-bafa-f1e375652445 req-744cf61a-7080-4e53-8e4f-86c95b413533 service nova] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Updating instance_info_cache with network_info: [{"id": "a56e7fa6-233e-4350-a592-69ecda6dc74e", "address": "fa:16:3e:8c:85:ff", "network": {"id": "4ab5c9f4-e78f-4bf2-bc82-ef698b714952", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1047934668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f88c00df40f46178f46c09cf14b88d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa56e7fa6-23", "ovs_interfaceid": "a56e7fa6-233e-4350-a592-69ecda6dc74e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:51:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f66afa79-be31-465e-bafa-f1e375652445 req-744cf61a-7080-4e53-8e4f-86c95b413533 service nova] Releasing lock "refresh_cache-e133dba2-7426-493b-8282-ed18f3ca0a4a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:51:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:57 user nova-compute[71113]: DEBUG nova.compute.manager [req-2e7300f5-8426-4f52-86ca-efda8d72f202 req-69850b93-34aa-4b7f-8900-c2605c8e48b8 service nova] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Received event network-vif-plugged-a56e7fa6-233e-4350-a592-69ecda6dc74e {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:51:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-2e7300f5-8426-4f52-86ca-efda8d72f202 req-69850b93-34aa-4b7f-8900-c2605c8e48b8 service nova] Acquiring lock "e133dba2-7426-493b-8282-ed18f3ca0a4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:51:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-2e7300f5-8426-4f52-86ca-efda8d72f202 req-69850b93-34aa-4b7f-8900-c2605c8e48b8 service nova] Lock "e133dba2-7426-493b-8282-ed18f3ca0a4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:51:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-2e7300f5-8426-4f52-86ca-efda8d72f202 req-69850b93-34aa-4b7f-8900-c2605c8e48b8 service nova] Lock "e133dba2-7426-493b-8282-ed18f3ca0a4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:51:57 user nova-compute[71113]: DEBUG nova.compute.manager [req-2e7300f5-8426-4f52-86ca-efda8d72f202 req-69850b93-34aa-4b7f-8900-c2605c8e48b8 service nova] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] No waiting events found dispatching network-vif-plugged-a56e7fa6-233e-4350-a592-69ecda6dc74e {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:51:57 user nova-compute[71113]: WARNING nova.compute.manager [req-2e7300f5-8426-4f52-86ca-efda8d72f202 req-69850b93-34aa-4b7f-8900-c2605c8e48b8 service nova] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Received unexpected event network-vif-plugged-a56e7fa6-233e-4350-a592-69ecda6dc74e for instance with vm_state building and task_state spawning.
Jul 31 09:51:57 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:51:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:51:59 user nova-compute[71113]: DEBUG nova.compute.manager [req-c6bc2bcc-7108-484c-b5a0-402caa651cf7 req-80259d1b-b234-4845-b6d7-1e944d3b4503 service nova] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Received event network-vif-plugged-a56e7fa6-233e-4350-a592-69ecda6dc74e {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:51:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-c6bc2bcc-7108-484c-b5a0-402caa651cf7 req-80259d1b-b234-4845-b6d7-1e944d3b4503 service nova] Acquiring lock "e133dba2-7426-493b-8282-ed18f3ca0a4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:51:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-c6bc2bcc-7108-484c-b5a0-402caa651cf7 req-80259d1b-b234-4845-b6d7-1e944d3b4503 service nova] Lock "e133dba2-7426-493b-8282-ed18f3ca0a4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:51:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-c6bc2bcc-7108-484c-b5a0-402caa651cf7 req-80259d1b-b234-4845-b6d7-1e944d3b4503 service nova] Lock "e133dba2-7426-493b-8282-ed18f3ca0a4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:51:59 user nova-compute[71113]: DEBUG nova.compute.manager [req-c6bc2bcc-7108-484c-b5a0-402caa651cf7 req-80259d1b-b234-4845-b6d7-1e944d3b4503 service nova] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] No waiting events found dispatching network-vif-plugged-a56e7fa6-233e-4350-a592-69ecda6dc74e {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:51:59 user nova-compute[71113]: WARNING nova.compute.manager [req-c6bc2bcc-7108-484c-b5a0-402caa651cf7 req-80259d1b-b234-4845-b6d7-1e944d3b4503 service nova] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Received unexpected event network-vif-plugged-a56e7fa6-233e-4350-a592-69ecda6dc74e for instance with vm_state building and task_state spawning.
Jul 31 09:51:59 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797119.673536, e133dba2-7426-493b-8282-ed18f3ca0a4a => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:51:59 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] VM Resumed (Lifecycle Event)
Jul 31 09:51:59 user nova-compute[71113]: DEBUG nova.compute.manager [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 09:51:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 09:51:59 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:51:59 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Instance spawned successfully.
Jul 31 09:51:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 09:51:59 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:51:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Found default for hw_cdrom_bus of ide {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:51:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Found default for hw_disk_bus of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:51:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Found default for hw_input_bus of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:51:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Found default for hw_pointer_model of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:51:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Found default for hw_video_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:51:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Found default for hw_vif_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:51:59 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:51:59 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797119.6740723, e133dba2-7426-493b-8282-ed18f3ca0a4a => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:51:59 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] VM Started (Lifecycle Event)
Jul 31 09:51:59 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:51:59 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:51:59 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:51:59 user nova-compute[71113]: INFO nova.compute.manager [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Took 6.55 seconds to spawn the instance on the hypervisor.
Jul 31 09:51:59 user nova-compute[71113]: DEBUG nova.compute.manager [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:51:59 user nova-compute[71113]: INFO nova.compute.manager [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Took 7.39 seconds to build instance.
Jul 31 09:51:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7776809f-70e6-4437-b3c4-adf63fb3b1a7 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Lock "e133dba2-7426-493b-8282-ed18f3ca0a4a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.539s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:52:00 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:00 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:52:00 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:52:01 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:52:01 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:52:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:52:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:52:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:52:01 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 09:52:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4df9380-7882-48a6-ba64-bb17429e54ac/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4df9380-7882-48a6-ba64-bb17429e54ac/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4df9380-7882-48a6-ba64-bb17429e54ac/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4df9380-7882-48a6-ba64-bb17429e54ac/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caac13d2-ceb3-4fee-84ad-5376c1c2cc23/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caac13d2-ceb3-4fee-84ad-5376c1c2cc23/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caac13d2-ceb3-4fee-84ad-5376c1c2cc23/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/caac13d2-ceb3-4fee-84ad-5376c1c2cc23/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e133dba2-7426-493b-8282-ed18f3ca0a4a/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e133dba2-7426-493b-8282-ed18f3ca0a4a/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e133dba2-7426-493b-8282-ed18f3ca0a4a/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e133dba2-7426-493b-8282-ed18f3ca0a4a/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a4b47dd-b335-4c2f-9dee-5421357a0ee1/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a4b47dd-b335-4c2f-9dee-5421357a0ee1/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a4b47dd-b335-4c2f-9dee-5421357a0ee1/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a4b47dd-b335-4c2f-9dee-5421357a0ee1/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 09:52:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 09:52:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af1f4e7c-b336-457a-94cc-3df3c3203370/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af1f4e7c-b336-457a-94cc-3df3c3203370/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af1f4e7c-b336-457a-94cc-3df3c3203370/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af1f4e7c-b336-457a-94cc-3df3c3203370/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:04 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 09:52:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d92f7e3-6f70-4344-9f15-9815d51024b6/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d92f7e3-6f70-4344-9f15-9815d51024b6/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d92f7e3-6f70-4344-9f15-9815d51024b6/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d92f7e3-6f70-4344-9f15-9815d51024b6/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:05 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:52:05 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:52:05 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=7319MB free_disk=25.420883178710938GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 09:52:05 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:52:05 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:52:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:05 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Applying migration context for instance efa311a0-fe2e-4c0f-af66-09c3eb38fbf1 as it has an incoming, in-progress migration dfc38b1b-b9d8-47ae-afa0-33da541a44c8. Migration status is finished {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Jul 31 09:52:05 user nova-compute[71113]: INFO nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Updating resource usage from migration dfc38b1b-b9d8-47ae-afa0-33da541a44c8
Jul 31 09:52:05 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 0ea0401b-26c2-4655-956b-1bc000debd53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:52:05 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 1112a49d-27bd-4fc8-bae6-ec1decbb47db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:52:05 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance caac13d2-ceb3-4fee-84ad-5376c1c2cc23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:52:05 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 9a4b47dd-b335-4c2f-9dee-5421357a0ee1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:52:05 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance f4df9380-7882-48a6-ba64-bb17429e54ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:52:05 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Migration dfc38b1b-b9d8-47ae-afa0-33da541a44c8 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Jul 31 09:52:05 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance efa311a0-fe2e-4c0f-af66-09c3eb38fbf1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:52:05 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 3157a7a6-b8a9-4e2d-a157-360bce4c625d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:52:05 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance af1f4e7c-b336-457a-94cc-3df3c3203370 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:52:05 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 6d92f7e3-6f70-4344-9f15-9815d51024b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:52:05 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance e133dba2-7426-493b-8282-ed18f3ca0a4a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:52:05 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 09:52:05 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 09:52:05 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:52:05 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:52:05 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 09:52:05 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.480s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:52:05 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:52:06 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:52:06 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:52:06 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:52:06 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 09:52:06 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Didn't find any instances for network info cache update. {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 09:52:06 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:52:06 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:52:06 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 09:52:06 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:52:06 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71113) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 31 09:52:07 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Acquiring lock "225aca75-f3cc-4fc9-a3a3-52be185e9c42" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:52:07 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "225aca75-f3cc-4fc9-a3a3-52be185e9c42" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:52:07 user nova-compute[71113]: DEBUG nova.compute.manager [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Starting instance... {{(pid=71113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 09:52:07 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:52:07 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:52:07 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 09:52:07 user nova-compute[71113]: INFO nova.compute.claims [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Claim successful on node user
Jul 31 09:52:07 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Refreshing inventories for resource provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 31 09:52:07 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Updating ProviderTree inventory for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 31 09:52:07 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Updating inventory in ProviderTree for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 31 09:52:07 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Refreshing aggregate associations for resource provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05, aggregates: None {{(pid=71113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 31 09:52:07 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Refreshing trait associations for resource provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE2,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS {{(pid=71113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 31 09:52:08 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:52:08 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:52:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.566s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:52:08 user nova-compute[71113]: DEBUG nova.compute.manager [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Start building networks asynchronously for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 09:52:08 user nova-compute[71113]: DEBUG nova.compute.manager [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Allocating IP information in the background. {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 09:52:08 user nova-compute[71113]: DEBUG nova.network.neutron [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] allocate_for_instance() {{(pid=71113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 09:52:08 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 09:52:08 user nova-compute[71113]: DEBUG nova.compute.manager [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Start building block device mappings for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 09:52:08 user nova-compute[71113]: DEBUG nova.policy [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e57ba3fd2d7a4d21a7653020def3f884', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b02dfb26bc2472baef63892ab5b2492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71113) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 09:52:08 user nova-compute[71113]: DEBUG nova.compute.manager [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Start spawning the instance on the hypervisor. {{(pid=71113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 09:52:08 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 09:52:08 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Creating image(s)
Jul 31 09:52:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Acquiring lock "/opt/stack/data/nova/instances/225aca75-f3cc-4fc9-a3a3-52be185e9c42/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:52:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "/opt/stack/data/nova/instances/225aca75-f3cc-4fc9-a3a3-52be185e9c42/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:52:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "/opt/stack/data/nova/instances/225aca75-f3cc-4fc9-a3a3-52be185e9c42/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:52:08 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:08 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.130s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Acquiring lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:52:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:52:08 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:08 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.134s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:08 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/225aca75-f3cc-4fc9-a3a3-52be185e9c42/disk 1073741824 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:08 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/225aca75-f3cc-4fc9-a3a3-52be185e9c42/disk 1073741824" returned: 0 in 0.050s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:52:08 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:08 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.138s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:08 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Checking if we can resize image /opt/stack/data/nova/instances/225aca75-f3cc-4fc9-a3a3-52be185e9c42/disk. size=1073741824 {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 09:52:08 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/225aca75-f3cc-4fc9-a3a3-52be185e9c42/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:08 user nova-compute[71113]: DEBUG nova.network.neutron [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Successfully created port: da9f4dda-8c5c-4af8-9b15-7572a9e66f9f {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 09:52:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/225aca75-f3cc-4fc9-a3a3-52be185e9c42/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:09 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Cannot resize image /opt/stack/data/nova/instances/225aca75-f3cc-4fc9-a3a3-52be185e9c42/disk to a smaller size. {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 09:52:09 user nova-compute[71113]: DEBUG nova.objects.instance [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lazy-loading 'migration_context' on Instance uuid 225aca75-f3cc-4fc9-a3a3-52be185e9c42 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:52:09 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Created local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 09:52:09 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Ensure instance console log exists: /opt/stack/data/nova/instances/225aca75-f3cc-4fc9-a3a3-52be185e9c42/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 09:52:09 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:52:09 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:52:09 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:52:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:09 user nova-compute[71113]: DEBUG nova.network.neutron [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Successfully updated port: da9f4dda-8c5c-4af8-9b15-7572a9e66f9f {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 09:52:09 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Acquiring lock "refresh_cache-225aca75-f3cc-4fc9-a3a3-52be185e9c42" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:52:09 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Acquired lock "refresh_cache-225aca75-f3cc-4fc9-a3a3-52be185e9c42" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:52:09 user nova-compute[71113]: DEBUG nova.network.neutron [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 09:52:09 user nova-compute[71113]: DEBUG nova.compute.manager [req-3d5d030b-0184-4a3c-bdcf-131894b34fe7 req-edce7079-5d36-4b67-929f-aab0fc5305a1 service nova] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Received event network-changed-da9f4dda-8c5c-4af8-9b15-7572a9e66f9f {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:52:09 user nova-compute[71113]: DEBUG nova.compute.manager [req-3d5d030b-0184-4a3c-bdcf-131894b34fe7 req-edce7079-5d36-4b67-929f-aab0fc5305a1 service nova] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Refreshing instance network info cache due to event network-changed-da9f4dda-8c5c-4af8-9b15-7572a9e66f9f. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:52:09 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3d5d030b-0184-4a3c-bdcf-131894b34fe7 req-edce7079-5d36-4b67-929f-aab0fc5305a1 service nova] Acquiring lock "refresh_cache-225aca75-f3cc-4fc9-a3a3-52be185e9c42" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:52:09 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:52:09 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Cleaning up deleted instances {{(pid=71113) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 31 09:52:09 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] There are 0 instances to clean {{(pid=71113) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 31 09:52:09 user nova-compute[71113]: DEBUG nova.network.neutron [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 09:52:10 user nova-compute[71113]: DEBUG nova.network.neutron [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Updating instance_info_cache with network_info: [{"id": "da9f4dda-8c5c-4af8-9b15-7572a9e66f9f", "address": "fa:16:3e:72:f1:32", "network": {"id": "2ce9c333-b413-4073-af8c-2e583872df61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1283872978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b02dfb26bc2472baef63892ab5b2492", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda9f4dda-8c", "ovs_interfaceid": "da9f4dda-8c5c-4af8-9b15-7572a9e66f9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:52:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Releasing lock "refresh_cache-225aca75-f3cc-4fc9-a3a3-52be185e9c42" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:52:10 user nova-compute[71113]: DEBUG nova.compute.manager [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Instance network_info: |[{"id": "da9f4dda-8c5c-4af8-9b15-7572a9e66f9f", "address": "fa:16:3e:72:f1:32", "network": {"id": "2ce9c333-b413-4073-af8c-2e583872df61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1283872978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b02dfb26bc2472baef63892ab5b2492", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda9f4dda-8c", "ovs_interfaceid": "da9f4dda-8c5c-4af8-9b15-7572a9e66f9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 09:52:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3d5d030b-0184-4a3c-bdcf-131894b34fe7 req-edce7079-5d36-4b67-929f-aab0fc5305a1 service nova] Acquired lock "refresh_cache-225aca75-f3cc-4fc9-a3a3-52be185e9c42" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:52:10 user nova-compute[71113]: DEBUG nova.network.neutron [req-3d5d030b-0184-4a3c-bdcf-131894b34fe7 req-edce7079-5d36-4b67-929f-aab0fc5305a1 service nova] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Refreshing network info cache for port da9f4dda-8c5c-4af8-9b15-7572a9e66f9f {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:52:10 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Start _get_guest_xml network_info=[{"id": "da9f4dda-8c5c-4af8-9b15-7572a9e66f9f", "address": "fa:16:3e:72:f1:32", "network": {"id": "2ce9c333-b413-4073-af8c-2e583872df61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1283872978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b02dfb26bc2472baef63892ab5b2492", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda9f4dda-8c", "ovs_interfaceid": "da9f4dda-8c5c-4af8-9b15-7572a9e66f9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'image_id': '078646fe-b504-41ed-a147-61072e903e51'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 09:52:10 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:52:10 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:52:10 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 09:52:10 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 09:52:10 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 09:52:10 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 09:52:10 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 09:52:10 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 09:52:10 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 09:52:10 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 09:52:10 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 09:52:10 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 09:52:10 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 09:52:10 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 09:52:10 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 09:52:10 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 09:52:10 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 09:52:10 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 09:52:10 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:52:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-728911026',display_name='tempest-VolumesSnapshotTestJSON-instance-728911026',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-728911026',id=20,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDBH6DBXrEhSmt5MEU1VmCkITtMm02hcrsipt07/2h6S10jMtjkytv2bzqvT6WgzV9hSptbNwV4eD+5izpdPIxsjelUlnn3BKXW71unBBXEyDT8sRNeE9jvrWyvL84XBQ==',key_name='tempest-keypair-114753483',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b02dfb26bc2472baef63892ab5b2492',ramdisk_id='',reservation_id='r-fwtg3k92',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1215488088',owner_user_name='tempest-VolumesSnapshotTestJSON-1215488088-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:52:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e57ba3fd2d7a4d21a7653020def3f884',uuid=225aca75-f3cc-4fc9-a3a3-52be185e9c42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da9f4dda-8c5c-4af8-9b15-7572a9e66f9f", "address": "fa:16:3e:72:f1:32", "network": {"id": "2ce9c333-b413-4073-af8c-2e583872df61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1283872978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b02dfb26bc2472baef63892ab5b2492", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda9f4dda-8c", "ovs_interfaceid": "da9f4dda-8c5c-4af8-9b15-7572a9e66f9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 09:52:10 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Converting VIF {"id": "da9f4dda-8c5c-4af8-9b15-7572a9e66f9f", "address": "fa:16:3e:72:f1:32", "network": {"id": "2ce9c333-b413-4073-af8c-2e583872df61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1283872978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b02dfb26bc2472baef63892ab5b2492", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda9f4dda-8c", "ovs_interfaceid": "da9f4dda-8c5c-4af8-9b15-7572a9e66f9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:52:10 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:f1:32,bridge_name='br-int',has_traffic_filtering=True,id=da9f4dda-8c5c-4af8-9b15-7572a9e66f9f,network=Network(2ce9c333-b413-4073-af8c-2e583872df61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda9f4dda-8c') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:52:10 user nova-compute[71113]: DEBUG nova.objects.instance [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lazy-loading 'pci_devices' on Instance uuid 225aca75-f3cc-4fc9-a3a3-52be185e9c42 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:52:10 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] End _get_guest_xml xml=<domain type="kvm">
Jul 31 09:52:10 user nova-compute[71113]:   <uuid>225aca75-f3cc-4fc9-a3a3-52be185e9c42</uuid>
Jul 31 09:52:10 user nova-compute[71113]:   <name>instance-00000014</name>
Jul 31 09:52:10 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 09:52:10 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 09:52:10 user nova-compute[71113]:   <metadata>
Jul 31 09:52:10 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 09:52:10 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 09:52:10 user nova-compute[71113]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-728911026</nova:name>
Jul 31 09:52:10 user nova-compute[71113]:       <nova:creationTime>2023-07-31 09:52:10</nova:creationTime>
Jul 31 09:52:10 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 09:52:10 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 09:52:10 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 09:52:10 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 09:52:10 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 09:52:10 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 09:52:10 user nova-compute[71113]:       </nova:flavor>
Jul 31 09:52:10 user nova-compute[71113]:       <nova:owner>
Jul 31 09:52:10 user nova-compute[71113]:         <nova:user uuid="e57ba3fd2d7a4d21a7653020def3f884">tempest-VolumesSnapshotTestJSON-1215488088-project-member</nova:user>
Jul 31 09:52:10 user nova-compute[71113]:         <nova:project uuid="6b02dfb26bc2472baef63892ab5b2492">tempest-VolumesSnapshotTestJSON-1215488088</nova:project>
Jul 31 09:52:10 user nova-compute[71113]:       </nova:owner>
Jul 31 09:52:10 user nova-compute[71113]:       <nova:root type="image" uuid="078646fe-b504-41ed-a147-61072e903e51"/>
Jul 31 09:52:10 user nova-compute[71113]:       <nova:ports>
Jul 31 09:52:10 user nova-compute[71113]:         <nova:port uuid="da9f4dda-8c5c-4af8-9b15-7572a9e66f9f">
Jul 31 09:52:10 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 31 09:52:10 user nova-compute[71113]:         </nova:port>
Jul 31 09:52:10 user nova-compute[71113]:       </nova:ports>
Jul 31 09:52:10 user nova-compute[71113]:     </nova:instance>
Jul 31 09:52:10 user nova-compute[71113]:   </metadata>
Jul 31 09:52:10 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 09:52:10 user nova-compute[71113]:     <system>
Jul 31 09:52:10 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 09:52:10 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 09:52:10 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 09:52:10 user nova-compute[71113]:       <entry name="serial">225aca75-f3cc-4fc9-a3a3-52be185e9c42</entry>
Jul 31 09:52:10 user nova-compute[71113]:       <entry name="uuid">225aca75-f3cc-4fc9-a3a3-52be185e9c42</entry>
Jul 31 09:52:10 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 09:52:10 user nova-compute[71113]:     </system>
Jul 31 09:52:10 user nova-compute[71113]:   </sysinfo>
Jul 31 09:52:10 user nova-compute[71113]:   <os>
Jul 31 09:52:10 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 09:52:10 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 09:52:10 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 09:52:10 user nova-compute[71113]:   </os>
Jul 31 09:52:10 user nova-compute[71113]:   <features>
Jul 31 09:52:10 user nova-compute[71113]:     <acpi/>
Jul 31 09:52:10 user nova-compute[71113]:     <apic/>
Jul 31 09:52:10 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 09:52:10 user nova-compute[71113]:   </features>
Jul 31 09:52:10 user nova-compute[71113]:   <clock offset="utc">
Jul 31 09:52:10 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 09:52:10 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 09:52:10 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 09:52:10 user nova-compute[71113]:   </clock>
Jul 31 09:52:10 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 09:52:10 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 09:52:10 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 09:52:10 user nova-compute[71113]:   </cpu>
Jul 31 09:52:10 user nova-compute[71113]:   <devices>
Jul 31 09:52:10 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 09:52:10 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 09:52:10 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/225aca75-f3cc-4fc9-a3a3-52be185e9c42/disk"/>
Jul 31 09:52:10 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 09:52:10 user nova-compute[71113]:     </disk>
Jul 31 09:52:10 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 09:52:10 user nova-compute[71113]:       <mac address="fa:16:3e:72:f1:32"/>
Jul 31 09:52:10 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:52:10 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 09:52:10 user nova-compute[71113]:       <target dev="tapda9f4dda-8c"/>
Jul 31 09:52:10 user nova-compute[71113]:     </interface>
Jul 31 09:52:10 user nova-compute[71113]:     <serial type="pty">
Jul 31 09:52:10 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/225aca75-f3cc-4fc9-a3a3-52be185e9c42/console.log" append="off"/>
Jul 31 09:52:10 user nova-compute[71113]:     </serial>
Jul 31 09:52:10 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 09:52:10 user nova-compute[71113]:     <video>
Jul 31 09:52:10 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:52:10 user nova-compute[71113]:     </video>
Jul 31 09:52:10 user nova-compute[71113]:     <rng model="virtio">
Jul 31 09:52:10 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 09:52:10 user nova-compute[71113]:     </rng>
Jul 31 09:52:10 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 09:52:10 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 09:52:10 user nova-compute[71113]:       <stats period="10"/>
Jul 31 09:52:10 user nova-compute[71113]:     </memballoon>
Jul 31 09:52:10 user nova-compute[71113]:   </devices>
Jul 31 09:52:10 user nova-compute[71113]: </domain>
Jul 31 09:52:10 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 09:52:10 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:52:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-728911026',display_name='tempest-VolumesSnapshotTestJSON-instance-728911026',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-728911026',id=20,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDBH6DBXrEhSmt5MEU1VmCkITtMm02hcrsipt07/2h6S10jMtjkytv2bzqvT6WgzV9hSptbNwV4eD+5izpdPIxsjelUlnn3BKXW71unBBXEyDT8sRNeE9jvrWyvL84XBQ==',key_name='tempest-keypair-114753483',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b02dfb26bc2472baef63892ab5b2492',ramdisk_id='',reservation_id='r-fwtg3k92',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1215488088',owner_user_name='tempest-VolumesSnapshotTestJSON-1215488088-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:52:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e57ba3fd2d7a4d21a7653020def3f884',uuid=225aca75-f3cc-4fc9-a3a3-52be185e9c42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da9f4dda-8c5c-4af8-9b15-7572a9e66f9f", "address": "fa:16:3e:72:f1:32", "network": {"id": "2ce9c333-b413-4073-af8c-2e583872df61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1283872978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b02dfb26bc2472baef63892ab5b2492", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda9f4dda-8c", "ovs_interfaceid": "da9f4dda-8c5c-4af8-9b15-7572a9e66f9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 09:52:10 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Converting VIF {"id": "da9f4dda-8c5c-4af8-9b15-7572a9e66f9f", "address": "fa:16:3e:72:f1:32", "network": {"id": "2ce9c333-b413-4073-af8c-2e583872df61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1283872978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b02dfb26bc2472baef63892ab5b2492", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda9f4dda-8c", "ovs_interfaceid": "da9f4dda-8c5c-4af8-9b15-7572a9e66f9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:52:10 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:f1:32,bridge_name='br-int',has_traffic_filtering=True,id=da9f4dda-8c5c-4af8-9b15-7572a9e66f9f,network=Network(2ce9c333-b413-4073-af8c-2e583872df61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda9f4dda-8c') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:52:10 user nova-compute[71113]: DEBUG os_vif [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:f1:32,bridge_name='br-int',has_traffic_filtering=True,id=da9f4dda-8c5c-4af8-9b15-7572a9e66f9f,network=Network(2ce9c333-b413-4073-af8c-2e583872df61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda9f4dda-8c') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 09:52:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:52:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 09:52:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda9f4dda-8c, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:52:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapda9f4dda-8c, col_values=(('external_ids', {'iface-id': 'da9f4dda-8c5c-4af8-9b15-7572a9e66f9f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:f1:32', 'vm-uuid': '225aca75-f3cc-4fc9-a3a3-52be185e9c42'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:52:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:52:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:10 user nova-compute[71113]: INFO os_vif [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:f1:32,bridge_name='br-int',has_traffic_filtering=True,id=da9f4dda-8c5c-4af8-9b15-7572a9e66f9f,network=Network(2ce9c333-b413-4073-af8c-2e583872df61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda9f4dda-8c')
Jul 31 09:52:10 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:52:10 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] No VIF found with MAC fa:16:3e:72:f1:32, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 09:52:10 user nova-compute[71113]: DEBUG nova.network.neutron [req-3d5d030b-0184-4a3c-bdcf-131894b34fe7 req-edce7079-5d36-4b67-929f-aab0fc5305a1 service nova] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Updated VIF entry in instance network info cache for port da9f4dda-8c5c-4af8-9b15-7572a9e66f9f. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:52:10 user nova-compute[71113]: DEBUG nova.network.neutron [req-3d5d030b-0184-4a3c-bdcf-131894b34fe7 req-edce7079-5d36-4b67-929f-aab0fc5305a1 service nova] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Updating instance_info_cache with network_info: [{"id": "da9f4dda-8c5c-4af8-9b15-7572a9e66f9f", "address": "fa:16:3e:72:f1:32", "network": {"id": "2ce9c333-b413-4073-af8c-2e583872df61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1283872978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b02dfb26bc2472baef63892ab5b2492", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda9f4dda-8c", "ovs_interfaceid": "da9f4dda-8c5c-4af8-9b15-7572a9e66f9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:52:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3d5d030b-0184-4a3c-bdcf-131894b34fe7 req-edce7079-5d36-4b67-929f-aab0fc5305a1 service nova] Releasing lock "refresh_cache-225aca75-f3cc-4fc9-a3a3-52be185e9c42" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:52:11 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:11 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:11 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:11 user nova-compute[71113]: DEBUG nova.compute.manager [req-40eba42e-2e47-4072-8aa3-4bd7c6a04895 req-43fecee5-e97d-47a9-a266-24ec13a00692 service nova] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Received event network-vif-plugged-da9f4dda-8c5c-4af8-9b15-7572a9e66f9f {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:52:11 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-40eba42e-2e47-4072-8aa3-4bd7c6a04895 req-43fecee5-e97d-47a9-a266-24ec13a00692 service nova] Acquiring lock "225aca75-f3cc-4fc9-a3a3-52be185e9c42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:52:11 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-40eba42e-2e47-4072-8aa3-4bd7c6a04895 req-43fecee5-e97d-47a9-a266-24ec13a00692 service nova] Lock "225aca75-f3cc-4fc9-a3a3-52be185e9c42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:52:11 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-40eba42e-2e47-4072-8aa3-4bd7c6a04895 req-43fecee5-e97d-47a9-a266-24ec13a00692 service nova] Lock "225aca75-f3cc-4fc9-a3a3-52be185e9c42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:52:11 user nova-compute[71113]: DEBUG nova.compute.manager [req-40eba42e-2e47-4072-8aa3-4bd7c6a04895 req-43fecee5-e97d-47a9-a266-24ec13a00692 service nova] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] No waiting events found dispatching network-vif-plugged-da9f4dda-8c5c-4af8-9b15-7572a9e66f9f {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:52:11 user nova-compute[71113]: WARNING nova.compute.manager [req-40eba42e-2e47-4072-8aa3-4bd7c6a04895 req-43fecee5-e97d-47a9-a266-24ec13a00692 service nova] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Received unexpected event network-vif-plugged-da9f4dda-8c5c-4af8-9b15-7572a9e66f9f for instance with vm_state building and task_state spawning.
Jul 31 09:52:12 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:12 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:12 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:12 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-949e3936-2b15-4427-af12-e8be0b560478 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Acquiring lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:52:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-949e3936-2b15-4427-af12-e8be0b560478 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:52:13 user nova-compute[71113]: INFO nova.compute.manager [None req-949e3936-2b15-4427-af12-e8be0b560478 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Detaching volume 76f6fa14-9162-43ca-9631-6c09fc7f2754
Jul 31 09:52:13 user nova-compute[71113]: INFO nova.virt.block_device [None req-949e3936-2b15-4427-af12-e8be0b560478 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Attempting to driver detach volume 76f6fa14-9162-43ca-9631-6c09fc7f2754 from mountpoint /dev/vdb
Jul 31 09:52:13 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-949e3936-2b15-4427-af12-e8be0b560478 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Attempting to detach device vdb from instance 1112a49d-27bd-4fc8-bae6-ec1decbb47db from the persistent domain config. {{(pid=71113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 09:52:13 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-949e3936-2b15-4427-af12-e8be0b560478 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 09:52:13 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:52:13 user nova-compute[71113]:   <source dev="/dev/sdb"/>
Jul 31 09:52:13 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 09:52:13 user nova-compute[71113]:   <serial>76f6fa14-9162-43ca-9631-6c09fc7f2754</serial>
Jul 31 09:52:13 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 31 09:52:13 user nova-compute[71113]: </disk>
Jul 31 09:52:13 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 09:52:13 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-949e3936-2b15-4427-af12-e8be0b560478 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Successfully detached device vdb from instance 1112a49d-27bd-4fc8-bae6-ec1decbb47db from the persistent domain config.
Jul 31 09:52:13 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-949e3936-2b15-4427-af12-e8be0b560478 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1112a49d-27bd-4fc8-bae6-ec1decbb47db from the live domain config. {{(pid=71113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 09:52:13 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-949e3936-2b15-4427-af12-e8be0b560478 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 09:52:13 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:52:13 user nova-compute[71113]:   <source dev="/dev/sdb"/>
Jul 31 09:52:13 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 09:52:13 user nova-compute[71113]:   <serial>76f6fa14-9162-43ca-9631-6c09fc7f2754</serial>
Jul 31 09:52:13 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 31 09:52:13 user nova-compute[71113]: </disk>
Jul 31 09:52:13 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 09:52:13 user nova-compute[71113]: DEBUG nova.compute.manager [req-d6eaf88e-1a9b-4651-b816-9cfbc1b96b34 req-227dbec8-d555-404a-8c4d-40813c15f2ab service nova] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Received event network-vif-plugged-da9f4dda-8c5c-4af8-9b15-7572a9e66f9f {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:52:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-d6eaf88e-1a9b-4651-b816-9cfbc1b96b34 req-227dbec8-d555-404a-8c4d-40813c15f2ab service nova] Acquiring lock "225aca75-f3cc-4fc9-a3a3-52be185e9c42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:52:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-d6eaf88e-1a9b-4651-b816-9cfbc1b96b34 req-227dbec8-d555-404a-8c4d-40813c15f2ab service nova] Lock "225aca75-f3cc-4fc9-a3a3-52be185e9c42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:52:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-d6eaf88e-1a9b-4651-b816-9cfbc1b96b34 req-227dbec8-d555-404a-8c4d-40813c15f2ab service nova] Lock "225aca75-f3cc-4fc9-a3a3-52be185e9c42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:52:13 user nova-compute[71113]: DEBUG nova.compute.manager [req-d6eaf88e-1a9b-4651-b816-9cfbc1b96b34 req-227dbec8-d555-404a-8c4d-40813c15f2ab service nova] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] No waiting events found dispatching network-vif-plugged-da9f4dda-8c5c-4af8-9b15-7572a9e66f9f {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:52:13 user nova-compute[71113]: WARNING nova.compute.manager [req-d6eaf88e-1a9b-4651-b816-9cfbc1b96b34 req-227dbec8-d555-404a-8c4d-40813c15f2ab service nova] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Received unexpected event network-vif-plugged-da9f4dda-8c5c-4af8-9b15-7572a9e66f9f for instance with vm_state building and task_state spawning.
Jul 31 09:52:13 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797133.9010274, 225aca75-f3cc-4fc9-a3a3-52be185e9c42 => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:52:13 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] VM Resumed (Lifecycle Event)
Jul 31 09:52:13 user nova-compute[71113]: DEBUG nova.compute.manager [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 09:52:13 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 09:52:13 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Instance spawned successfully.
Jul 31 09:52:13 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 09:52:13 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:52:13 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:52:13 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Found default for hw_cdrom_bus of ide {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:52:13 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Found default for hw_disk_bus of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:52:13 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Found default for hw_input_bus of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:52:13 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Found default for hw_pointer_model of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:52:13 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Found default for hw_video_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:52:13 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Found default for hw_vif_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:52:13 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:52:13 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797133.9026823, 225aca75-f3cc-4fc9-a3a3-52be185e9c42 => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:52:13 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] VM Started (Lifecycle Event)
Jul 31 09:52:13 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:52:13 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:52:13 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:52:14 user nova-compute[71113]: INFO nova.compute.manager [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Took 5.56 seconds to spawn the instance on the hypervisor.
Jul 31 09:52:14 user nova-compute[71113]: DEBUG nova.compute.manager [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:52:14 user nova-compute[71113]: INFO nova.compute.manager [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Took 6.51 seconds to build instance.
Jul 31 09:52:14 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-19b0fc59-509f-4180-ac69-9505f6a925a0 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "225aca75-f3cc-4fc9-a3a3-52be185e9c42" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.608s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:52:14 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Received event <DeviceRemovedEvent: 1690797134.2637074, 1112a49d-27bd-4fc8-bae6-ec1decbb47db => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71113) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 09:52:14 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-949e3936-2b15-4427-af12-e8be0b560478 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1112a49d-27bd-4fc8-bae6-ec1decbb47db {{(pid=71113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 09:52:14 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-949e3936-2b15-4427-af12-e8be0b560478 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Successfully detached device vdb from instance 1112a49d-27bd-4fc8-bae6-ec1decbb47db from the live domain config.
Jul 31 09:52:14 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-949e3936-2b15-4427-af12-e8be0b560478 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 09:52:14 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-949e3936-2b15-4427-af12-e8be0b560478 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ogOtdHKG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:52:14 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-949e3936-2b15-4427-af12-e8be0b560478 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:52:14 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-949e3936-2b15-4427-af12-e8be0b560478 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:52:14 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-949e3936-2b15-4427-af12-e8be0b560478 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:52:14 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-949e3936-2b15-4427-af12-e8be0b560478 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 09:52:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:14 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[62015ef3-0499-423a-952c-5f9cf50f9bc8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:52:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:14 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7013c91a-39c3-4b4a-8e56-68dc44564a9d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:52:14 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-949e3936-2b15-4427-af12-e8be0b560478 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:52:14 user nova-compute[71113]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be (non-flash)
Jul 31 09:52:14 user nova-compute[71113]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:52:14 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:52:14 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-949e3936-2b15-4427-af12-e8be0b560478 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 (non-flash)
Jul 31 09:52:14 user nova-compute[71113]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be (non-flash)
Jul 31 09:52:14 user nova-compute[71113]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:52:14 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:52:14 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-949e3936-2b15-4427-af12-e8be0b560478 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f78f07afd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754'): ({'sdb'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 09:52:14 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-949e3936-2b15-4427-af12-e8be0b560478 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Removing single pathed devices sdb {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 09:52:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:14 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc49ee98-66aa-4341-b06f-bc52a4caa3de]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:52:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:14 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d24e12-2bd7-402d-95de-d45099eeab89]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:52:14 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-949e3936-2b15-4427-af12-e8be0b560478 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Flushing IO for device /dev/sdb {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 09:52:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:14 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c06703-ea31-48e8-9220-82b73cb55e68]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:52:14 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-949e3936-2b15-4427-af12-e8be0b560478 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 09:52:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:14 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[da32e9f0-4c4e-4ad7-a123-ed69e324fe6b]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:52:14 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-949e3936-2b15-4427-af12-e8be0b560478 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 09:52:14 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-949e3936-2b15-4427-af12-e8be0b560478 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] SCSI volumes sdb have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 09:52:14 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-949e3936-2b15-4427-af12-e8be0b560478 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 09:52:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:14 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[164c5b0b-d263-4d7e-bdf6-278da3be5c92]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:52:14 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-949e3936-2b15-4427-af12-e8be0b560478 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:52:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:14 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2706eadd-2834-426c-b317-7e17ca22be43]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:52:14 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-949e3936-2b15-4427-af12-e8be0b560478 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754, portal: 172.16.0.220,3260]
Jul 31 09:52:14 user nova-compute[71113]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754, portal: 172.16.0.220,3260] successful.
Jul 31 09:52:14 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:52:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76f6fa14-9162-43ca-9631-6c09fc7f2754 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:14 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[96406a68-0499-49ec-bd61-a515899b3051]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:52:14 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-949e3936-2b15-4427-af12-e8be0b560478 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:52:14 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-949e3936-2b15-4427-af12-e8be0b560478 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:52:14 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-949e3936-2b15-4427-af12-e8be0b560478 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] <== disconnect_volume: return (313ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:52:14 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-949e3936-2b15-4427-af12-e8be0b560478 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 09:52:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:15 user nova-compute[71113]: DEBUG nova.objects.instance [None req-949e3936-2b15-4427-af12-e8be0b560478 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lazy-loading 'flavor' on Instance uuid 1112a49d-27bd-4fc8-bae6-ec1decbb47db {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:52:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-949e3936-2b15-4427-af12-e8be0b560478 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.688s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:52:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-39ae79d9-eb4d-40bd-b86b-11751e40d123 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Acquiring lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:52:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-39ae79d9-eb4d-40bd-b86b-11751e40d123 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:52:15 user nova-compute[71113]: DEBUG nova.compute.manager [None req-39ae79d9-eb4d-40bd-b86b-11751e40d123 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:52:15 user nova-compute[71113]: DEBUG nova.compute.manager [None req-39ae79d9-eb4d-40bd-b86b-11751e40d123 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71113) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Jul 31 09:52:15 user nova-compute[71113]: DEBUG nova.objects.instance [None req-39ae79d9-eb4d-40bd-b86b-11751e40d123 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lazy-loading 'flavor' on Instance uuid 1112a49d-27bd-4fc8-bae6-ec1decbb47db {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:52:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:16 user nova-compute[71113]: DEBUG nova.compute.manager [req-4456ddef-7fc6-458c-bcbc-348ec68703e6 req-d9cbd0dd-fb6b-41d6-9a50-9011ab851938 service nova] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Received event network-vif-unplugged-647f984e-a9e3-4e49-9877-75ad4826e467 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:52:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-4456ddef-7fc6-458c-bcbc-348ec68703e6 req-d9cbd0dd-fb6b-41d6-9a50-9011ab851938 service nova] Acquiring lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:52:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-4456ddef-7fc6-458c-bcbc-348ec68703e6 req-d9cbd0dd-fb6b-41d6-9a50-9011ab851938 service nova] Lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:52:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-4456ddef-7fc6-458c-bcbc-348ec68703e6 req-d9cbd0dd-fb6b-41d6-9a50-9011ab851938 service nova] Lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:52:16 user nova-compute[71113]: DEBUG nova.compute.manager [req-4456ddef-7fc6-458c-bcbc-348ec68703e6 req-d9cbd0dd-fb6b-41d6-9a50-9011ab851938 service nova] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] No waiting events found dispatching network-vif-unplugged-647f984e-a9e3-4e49-9877-75ad4826e467 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:52:16 user nova-compute[71113]: WARNING nova.compute.manager [req-4456ddef-7fc6-458c-bcbc-348ec68703e6 req-d9cbd0dd-fb6b-41d6-9a50-9011ab851938 service nova] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Received unexpected event network-vif-unplugged-647f984e-a9e3-4e49-9877-75ad4826e467 for instance with vm_state active and task_state powering-off.
Jul 31 09:52:16 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Instance destroyed successfully.
Jul 31 09:52:16 user nova-compute[71113]: DEBUG nova.compute.manager [None req-39ae79d9-eb4d-40bd-b86b-11751e40d123 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:52:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-39ae79d9-eb4d-40bd-b86b-11751e40d123 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.855s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:52:18 user nova-compute[71113]: DEBUG nova.compute.manager [req-3bb2cc84-5e89-4a28-ad9c-bcf940c836ab req-d792eba7-9381-4c02-9e8e-7f972d5b16ce service nova] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Received event network-vif-plugged-647f984e-a9e3-4e49-9877-75ad4826e467 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:52:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3bb2cc84-5e89-4a28-ad9c-bcf940c836ab req-d792eba7-9381-4c02-9e8e-7f972d5b16ce service nova] Acquiring lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:52:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3bb2cc84-5e89-4a28-ad9c-bcf940c836ab req-d792eba7-9381-4c02-9e8e-7f972d5b16ce service nova] Lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:52:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3bb2cc84-5e89-4a28-ad9c-bcf940c836ab req-d792eba7-9381-4c02-9e8e-7f972d5b16ce service nova] Lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:52:18 user nova-compute[71113]: DEBUG nova.compute.manager [req-3bb2cc84-5e89-4a28-ad9c-bcf940c836ab req-d792eba7-9381-4c02-9e8e-7f972d5b16ce service nova] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] No waiting events found dispatching network-vif-plugged-647f984e-a9e3-4e49-9877-75ad4826e467 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:52:18 user nova-compute[71113]: WARNING nova.compute.manager [req-3bb2cc84-5e89-4a28-ad9c-bcf940c836ab req-d792eba7-9381-4c02-9e8e-7f972d5b16ce service nova] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Received unexpected event network-vif-plugged-647f984e-a9e3-4e49-9877-75ad4826e467 for instance with vm_state stopped and task_state None.
Jul 31 09:52:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8e83445c-aae9-4556-8834-e323de10bfef tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Acquiring lock "caac13d2-ceb3-4fee-84ad-5376c1c2cc23" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:52:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8e83445c-aae9-4556-8834-e323de10bfef tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Lock "caac13d2-ceb3-4fee-84ad-5376c1c2cc23" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:52:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8e83445c-aae9-4556-8834-e323de10bfef tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Acquiring lock "caac13d2-ceb3-4fee-84ad-5376c1c2cc23-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:52:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8e83445c-aae9-4556-8834-e323de10bfef tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Lock "caac13d2-ceb3-4fee-84ad-5376c1c2cc23-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:52:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8e83445c-aae9-4556-8834-e323de10bfef tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Lock "caac13d2-ceb3-4fee-84ad-5376c1c2cc23-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:52:18 user nova-compute[71113]: INFO nova.compute.manager [None req-8e83445c-aae9-4556-8834-e323de10bfef tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Terminating instance
Jul 31 09:52:18 user nova-compute[71113]: DEBUG nova.compute.manager [None req-8e83445c-aae9-4556-8834-e323de10bfef tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Start destroying the instance on the hypervisor. {{(pid=71113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 09:52:18 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:18 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:18 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:18 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:19 user nova-compute[71113]: DEBUG nova.compute.manager [req-31030af6-87fb-485d-bfef-3eaecfb13650 req-c51ec061-641d-4080-b535-ef5738ea5107 service nova] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Received event network-vif-unplugged-1bdc8450-11f3-4a96-b68b-42f57ed9dcd9 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:52:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-31030af6-87fb-485d-bfef-3eaecfb13650 req-c51ec061-641d-4080-b535-ef5738ea5107 service nova] Acquiring lock "caac13d2-ceb3-4fee-84ad-5376c1c2cc23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:52:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-31030af6-87fb-485d-bfef-3eaecfb13650 req-c51ec061-641d-4080-b535-ef5738ea5107 service nova] Lock "caac13d2-ceb3-4fee-84ad-5376c1c2cc23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:52:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-31030af6-87fb-485d-bfef-3eaecfb13650 req-c51ec061-641d-4080-b535-ef5738ea5107 service nova] Lock "caac13d2-ceb3-4fee-84ad-5376c1c2cc23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:52:19 user nova-compute[71113]: DEBUG nova.compute.manager [req-31030af6-87fb-485d-bfef-3eaecfb13650 req-c51ec061-641d-4080-b535-ef5738ea5107 service nova] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] No waiting events found dispatching network-vif-unplugged-1bdc8450-11f3-4a96-b68b-42f57ed9dcd9 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:52:19 user nova-compute[71113]: DEBUG nova.compute.manager [req-31030af6-87fb-485d-bfef-3eaecfb13650 req-c51ec061-641d-4080-b535-ef5738ea5107 service nova] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Received event network-vif-unplugged-1bdc8450-11f3-4a96-b68b-42f57ed9dcd9 for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 09:52:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:19 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Instance destroyed successfully.
Jul 31 09:52:19 user nova-compute[71113]: DEBUG nova.objects.instance [None req-8e83445c-aae9-4556-8834-e323de10bfef tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Lazy-loading 'resources' on Instance uuid caac13d2-ceb3-4fee-84ad-5376c1c2cc23 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:52:19 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-8e83445c-aae9-4556-8834-e323de10bfef tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:46:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1246119485',display_name='tempest-VolumesAdminNegativeTest-server-1246119485',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1246119485',id=5,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRPU+UVMxguq84ZclnMSN6OFgSwuPRxZNzy8sP8H/G/zX+FmPi3UpCLaw767Fts2a+Bu/j42JVCAvYpYN/ef+PK/q8CgWblEF2VVltWmSwIYvS/5SQ1SRglT2zKQGOOSw==',key_name='tempest-keypair-1677162007',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:46:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='025b7e2f3e894690b9cade6b6df70a22',ramdisk_id='',reservation_id='r-74qmrd4e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-553928296',owner_user_name='tempest-VolumesAdminNegativeTest-553928296-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:46:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68ed00ac1dba433fb6ff7281a066d55f',uuid=caac13d2-ceb3-4fee-84ad-5376c1c2cc23,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1bdc8450-11f3-4a96-b68b-42f57ed9dcd9", "address": "fa:16:3e:e8:e4:f6", "network": {"id": "5f0b75d1-03eb-4e68-85fd-8b27d4fda660", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-726146587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "025b7e2f3e894690b9cade6b6df70a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bdc8450-11", "ovs_interfaceid": "1bdc8450-11f3-4a96-b68b-42f57ed9dcd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 09:52:19 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-8e83445c-aae9-4556-8834-e323de10bfef tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Converting VIF {"id": "1bdc8450-11f3-4a96-b68b-42f57ed9dcd9", "address": "fa:16:3e:e8:e4:f6", "network": {"id": "5f0b75d1-03eb-4e68-85fd-8b27d4fda660", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-726146587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "025b7e2f3e894690b9cade6b6df70a22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bdc8450-11", "ovs_interfaceid": "1bdc8450-11f3-4a96-b68b-42f57ed9dcd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:52:19 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-8e83445c-aae9-4556-8834-e323de10bfef tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:e4:f6,bridge_name='br-int',has_traffic_filtering=True,id=1bdc8450-11f3-4a96-b68b-42f57ed9dcd9,network=Network(5f0b75d1-03eb-4e68-85fd-8b27d4fda660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bdc8450-11') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:52:19 user nova-compute[71113]: DEBUG os_vif [None req-8e83445c-aae9-4556-8834-e323de10bfef tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:e4:f6,bridge_name='br-int',has_traffic_filtering=True,id=1bdc8450-11f3-4a96-b68b-42f57ed9dcd9,network=Network(5f0b75d1-03eb-4e68-85fd-8b27d4fda660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bdc8450-11') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 09:52:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1bdc8450-11, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:52:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:52:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:19 user nova-compute[71113]: INFO os_vif [None req-8e83445c-aae9-4556-8834-e323de10bfef tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:e4:f6,bridge_name='br-int',has_traffic_filtering=True,id=1bdc8450-11f3-4a96-b68b-42f57ed9dcd9,network=Network(5f0b75d1-03eb-4e68-85fd-8b27d4fda660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bdc8450-11')
Jul 31 09:52:19 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-8e83445c-aae9-4556-8834-e323de10bfef tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Deleting instance files /opt/stack/data/nova/instances/caac13d2-ceb3-4fee-84ad-5376c1c2cc23_del
Jul 31 09:52:19 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-8e83445c-aae9-4556-8834-e323de10bfef tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Deletion of /opt/stack/data/nova/instances/caac13d2-ceb3-4fee-84ad-5376c1c2cc23_del complete
Jul 31 09:52:19 user nova-compute[71113]: INFO nova.compute.manager [None req-8e83445c-aae9-4556-8834-e323de10bfef tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Took 0.93 seconds to destroy the instance on the hypervisor.
Jul 31 09:52:19 user nova-compute[71113]: DEBUG oslo.service.loopingcall [None req-8e83445c-aae9-4556-8834-e323de10bfef tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71113) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 09:52:19 user nova-compute[71113]: DEBUG nova.compute.manager [-] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Deallocating network for instance {{(pid=71113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 09:52:19 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] deallocate_for_instance() {{(pid=71113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 09:52:19 user nova-compute[71113]: DEBUG nova.network.neutron [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Port 39b5a493-47bd-4599-9a9f-bb80c93fb332 binding to destination host user is already ACTIVE {{(pid=71113) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 31 09:52:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Acquiring lock "refresh_cache-efa311a0-fe2e-4c0f-af66-09c3eb38fbf1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:52:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Acquired lock "refresh_cache-efa311a0-fe2e-4c0f-af66-09c3eb38fbf1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:52:19 user nova-compute[71113]: DEBUG nova.network.neutron [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 09:52:20 user nova-compute[71113]: DEBUG nova.network.neutron [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Updating instance_info_cache with network_info: [{"id": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "address": "fa:16:3e:16:bb:aa", "network": {"id": "4f2ea02a-9b26-4f2a-af23-39c060703ff3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-725518740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5bb5c0790e54702b881dc5e45641be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b5a493-47", "ovs_interfaceid": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:52:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Releasing lock "refresh_cache-efa311a0-fe2e-4c0f-af66-09c3eb38fbf1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:52:20 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Creating tmpfile /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/tmpqypklaiz to verify with other compute node that the instance is on the same shared storage. {{(pid=71113) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Jul 31 09:52:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:20 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:52:20 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Took 1.02 seconds to deallocate network for instance.
Jul 31 09:52:20 user nova-compute[71113]: DEBUG nova.compute.manager [req-f32e568e-e935-445a-8f85-b5ed28b1c930 req-169a36bc-877b-44f9-94a4-9f508f7f7cf5 service nova] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Received event network-vif-deleted-1bdc8450-11f3-4a96-b68b-42f57ed9dcd9 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:52:20 user nova-compute[71113]: INFO nova.compute.manager [req-f32e568e-e935-445a-8f85-b5ed28b1c930 req-169a36bc-877b-44f9-94a4-9f508f7f7cf5 service nova] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Neutron deleted interface 1bdc8450-11f3-4a96-b68b-42f57ed9dcd9; detaching it from the instance and deleting it from the info cache
Jul 31 09:52:20 user nova-compute[71113]: DEBUG nova.network.neutron [req-f32e568e-e935-445a-8f85-b5ed28b1c930 req-169a36bc-877b-44f9-94a4-9f508f7f7cf5 service nova] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:52:20 user nova-compute[71113]: DEBUG nova.compute.manager [req-f32e568e-e935-445a-8f85-b5ed28b1c930 req-169a36bc-877b-44f9-94a4-9f508f7f7cf5 service nova] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Detach interface failed, port_id=1bdc8450-11f3-4a96-b68b-42f57ed9dcd9, reason: Instance caac13d2-ceb3-4fee-84ad-5376c1c2cc23 could not be found. {{(pid=71113) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 09:52:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8e83445c-aae9-4556-8834-e323de10bfef tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:52:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8e83445c-aae9-4556-8834-e323de10bfef tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:52:21 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Instance destroyed successfully.
Jul 31 09:52:21 user nova-compute[71113]: DEBUG nova.objects.instance [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lazy-loading 'resources' on Instance uuid efa311a0-fe2e-4c0f-af66-09c3eb38fbf1 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:46:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1025510923',display_name='tempest-ServerActionsTestOtherB-server-1025510923',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1025510923',id=3,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJo+xi4tu0GGLLf+2/4AMwJN8W9HV5KOFul5csHl5tHCHdJymtchsdGYmiKLfCyzN953/rO7ubVJnctaNhLzLpYKjY5Z2Nn1cEvYAzU5x1ZT5edLumoNfJjhx0wRkZgiEQ==',key_name='tempest-keypair-947034726',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:50:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a5bb5c0790e54702b881dc5e45641be8',ramdisk_id='',reservation_id='r-o5vysyfg',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1778056817',owner_user_name='tempest-ServerActionsTestOtherB-1778056817-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:50:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b5f449e8b1948cf914daef537aea164',uuid=efa311a0-fe2e-4c0f-af66-09c3eb38fbf1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "address": "fa:16:3e:16:bb:aa", "network": {"id": "4f2ea02a-9b26-4f2a-af23-39c060703ff3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-725518740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5bb5c0790e54702b881dc5e45641be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b5a493-47", "ovs_interfaceid": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Converting VIF {"id": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "address": "fa:16:3e:16:bb:aa", "network": {"id": "4f2ea02a-9b26-4f2a-af23-39c060703ff3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-725518740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5bb5c0790e54702b881dc5e45641be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b5a493-47", "ovs_interfaceid": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:bb:aa,bridge_name='br-int',has_traffic_filtering=True,id=39b5a493-47bd-4599-9a9f-bb80c93fb332,network=Network(4f2ea02a-9b26-4f2a-af23-39c060703ff3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39b5a493-47') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG os_vif [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:bb:aa,bridge_name='br-int',has_traffic_filtering=True,id=39b5a493-47bd-4599-9a9f-bb80c93fb332,network=Network(4f2ea02a-9b26-4f2a-af23-39c060703ff3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39b5a493-47') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap39b5a493-47, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:21 user nova-compute[71113]: INFO os_vif [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:bb:aa,bridge_name='br-int',has_traffic_filtering=True,id=39b5a493-47bd-4599-9a9f-bb80c93fb332,network=Network(4f2ea02a-9b26-4f2a-af23-39c060703ff3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39b5a493-47')
Jul 31 09:52:21 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FGERQMJC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:52:21 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:52:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG nova.compute.manager [req-2324ef99-22b4-4ff9-86ea-a25743b2aa65 req-285ab72a-274b-43c2-b94f-9749fdd005fc service nova] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Received event network-vif-plugged-1bdc8450-11f3-4a96-b68b-42f57ed9dcd9 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-2324ef99-22b4-4ff9-86ea-a25743b2aa65 req-285ab72a-274b-43c2-b94f-9749fdd005fc service nova] Acquiring lock "caac13d2-ceb3-4fee-84ad-5376c1c2cc23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-2324ef99-22b4-4ff9-86ea-a25743b2aa65 req-285ab72a-274b-43c2-b94f-9749fdd005fc service nova] Lock "caac13d2-ceb3-4fee-84ad-5376c1c2cc23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-2324ef99-22b4-4ff9-86ea-a25743b2aa65 req-285ab72a-274b-43c2-b94f-9749fdd005fc service nova] Lock "caac13d2-ceb3-4fee-84ad-5376c1c2cc23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG nova.compute.manager [req-2324ef99-22b4-4ff9-86ea-a25743b2aa65 req-285ab72a-274b-43c2-b94f-9749fdd005fc service nova] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] No waiting events found dispatching network-vif-plugged-1bdc8450-11f3-4a96-b68b-42f57ed9dcd9 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:52:21 user nova-compute[71113]: WARNING nova.compute.manager [req-2324ef99-22b4-4ff9-86ea-a25743b2aa65 req-285ab72a-274b-43c2-b94f-9749fdd005fc service nova] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Received unexpected event network-vif-plugged-1bdc8450-11f3-4a96-b68b-42f57ed9dcd9 for instance with vm_state deleted and task_state None.
Jul 31 09:52:21 user nova-compute[71113]: DEBUG nova.compute.manager [req-2324ef99-22b4-4ff9-86ea-a25743b2aa65 req-285ab72a-274b-43c2-b94f-9749fdd005fc service nova] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Received event network-vif-unplugged-39b5a493-47bd-4599-9a9f-bb80c93fb332 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-2324ef99-22b4-4ff9-86ea-a25743b2aa65 req-285ab72a-274b-43c2-b94f-9749fdd005fc service nova] Acquiring lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-2324ef99-22b4-4ff9-86ea-a25743b2aa65 req-285ab72a-274b-43c2-b94f-9749fdd005fc service nova] Lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-2324ef99-22b4-4ff9-86ea-a25743b2aa65 req-285ab72a-274b-43c2-b94f-9749fdd005fc service nova] Lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG nova.compute.manager [req-2324ef99-22b4-4ff9-86ea-a25743b2aa65 req-285ab72a-274b-43c2-b94f-9749fdd005fc service nova] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] No waiting events found dispatching network-vif-unplugged-39b5a493-47bd-4599-9a9f-bb80c93fb332 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:52:21 user nova-compute[71113]: WARNING nova.compute.manager [req-2324ef99-22b4-4ff9-86ea-a25743b2aa65 req-285ab72a-274b-43c2-b94f-9749fdd005fc service nova] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Received unexpected event network-vif-unplugged-39b5a493-47bd-4599-9a9f-bb80c93fb332 for instance with vm_state resized and task_state resize_reverting.
Jul 31 09:52:21 user nova-compute[71113]: DEBUG nova.compute.manager [req-2324ef99-22b4-4ff9-86ea-a25743b2aa65 req-285ab72a-274b-43c2-b94f-9749fdd005fc service nova] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Received event network-vif-plugged-39b5a493-47bd-4599-9a9f-bb80c93fb332 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-2324ef99-22b4-4ff9-86ea-a25743b2aa65 req-285ab72a-274b-43c2-b94f-9749fdd005fc service nova] Acquiring lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-2324ef99-22b4-4ff9-86ea-a25743b2aa65 req-285ab72a-274b-43c2-b94f-9749fdd005fc service nova] Lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-2324ef99-22b4-4ff9-86ea-a25743b2aa65 req-285ab72a-274b-43c2-b94f-9749fdd005fc service nova] Lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG nova.compute.manager [req-2324ef99-22b4-4ff9-86ea-a25743b2aa65 req-285ab72a-274b-43c2-b94f-9749fdd005fc service nova] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] No waiting events found dispatching network-vif-plugged-39b5a493-47bd-4599-9a9f-bb80c93fb332 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:52:21 user nova-compute[71113]: WARNING nova.compute.manager [req-2324ef99-22b4-4ff9-86ea-a25743b2aa65 req-285ab72a-274b-43c2-b94f-9749fdd005fc service nova] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Received unexpected event network-vif-plugged-39b5a493-47bd-4599-9a9f-bb80c93fb332 for instance with vm_state resized and task_state resize_reverting.
Jul 31 09:52:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-8e83445c-aae9-4556-8834-e323de10bfef tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29ba9d6-d19b-4a75-8db8-67bc7e4e6f7a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-8e83445c-aae9-4556-8834-e323de10bfef tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[51576f99-8e9d-4548-b030-c4112f5ce44f]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be (non-flash)
Jul 31 09:52:21 user nova-compute[71113]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:52:21 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be (non-flash)
Jul 31 09:52:21 user nova-compute[71113]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:52:21 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f78f04b6680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c'): ({'sde'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Removing single pathed devices sde {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8e83445c-aae9-4556-8834-e323de10bfef tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.445s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[463ec39c-9f5d-4218-911b-1729c1c1cdb1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:21 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-8e83445c-aae9-4556-8834-e323de10bfef tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Deleted allocations for instance caac13d2-ceb3-4fee-84ad-5376c1c2cc23
Jul 31 09:52:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc49d161-39b5-416e-838e-1c4f2c44fa7a]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Flushing IO for device /dev/sde {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be7ff3a-94fd-4520-ae4c-130378f519ac]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1125d61b-61bb-457b-8179-ca652a0bd235]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] SCSI volumes sde have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8e83445c-aae9-4556-8834-e323de10bfef tempest-VolumesAdminNegativeTest-553928296 tempest-VolumesAdminNegativeTest-553928296-project-member] Lock "caac13d2-ceb3-4fee-84ad-5376c1c2cc23" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.630s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[59576af8-9167-4395-aedb-b0a9b12b8baf]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[932c385a-bd00-46d8-a9fb-ae7c588cc518]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c, portal: 172.16.0.220,3260]
Jul 31 09:52:21 user nova-compute[71113]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c, portal: 172.16.0.220,3260] successful.
Jul 31 09:52:21 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[257b73ea-0702-487f-a6ad-c690ed671c5b]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] <== disconnect_volume: return (314ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:52:21 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 09:52:22 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:52:22 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:52:22 user nova-compute[71113]: DEBUG nova.objects.instance [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lazy-loading 'migration_context' on Instance uuid efa311a0-fe2e-4c0f-af66-09c3eb38fbf1 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:52:23 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:52:23 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:52:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.449s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:52:23 user nova-compute[71113]: INFO nova.compute.manager [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Swapping old allocation on dict_keys(['fb2d3ce5-7d6f-484d-a45c-524f3c40ea05']) held by migration dfc38b1b-b9d8-47ae-afa0-33da541a44c8 for instance
Jul 31 09:52:23 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Overwriting current allocation {'allocations': {'fb2d3ce5-7d6f-484d-a45c-524f3c40ea05': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 24}}, 'project_id': 'a5bb5c0790e54702b881dc5e45641be8', 'user_id': '0b5f449e8b1948cf914daef537aea164', 'consumer_generation': 1} on consumer efa311a0-fe2e-4c0f-af66-09c3eb38fbf1 {{(pid=71113) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Jul 31 09:52:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Acquiring lock "refresh_cache-efa311a0-fe2e-4c0f-af66-09c3eb38fbf1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:52:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Acquired lock "refresh_cache-efa311a0-fe2e-4c0f-af66-09c3eb38fbf1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:52:23 user nova-compute[71113]: DEBUG nova.network.neutron [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 09:52:23 user nova-compute[71113]: DEBUG nova.network.neutron [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Updating instance_info_cache with network_info: [{"id": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "address": "fa:16:3e:16:bb:aa", "network": {"id": "4f2ea02a-9b26-4f2a-af23-39c060703ff3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-725518740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5bb5c0790e54702b881dc5e45641be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b5a493-47", "ovs_interfaceid": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:52:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Releasing lock "refresh_cache-efa311a0-fe2e-4c0f-af66-09c3eb38fbf1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:52:23 user nova-compute[71113]: DEBUG os_brick.utils [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:52:23 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:24 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e711ca66-111c-445c-8660-d946224c1c52]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:52:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:24 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1038ebf7-8f15-40c8-869b-c64bbf515a7e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:52:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:24 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[79094ade-9b05-454e-886c-e032b300990a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:52:24 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[65324c2e-b7f5-42cb-94a7-f83d2d7dd66c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:52:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:52:24 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 09:52:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:52:24 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 09:52:24 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c94d10-5ef5-4e02-95df-7591e92ecb06]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:52:24 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 09:52:24 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 09:52:24 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 09:52:24 user nova-compute[71113]: DEBUG os_brick.utils [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:52:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:27 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:52:27 user nova-compute[71113]: WARNING nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] While synchronizing instance power states, found 10 instances in the database and 9 instances on the hypervisor.
Jul 31 09:52:27 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Triggering sync for uuid 0ea0401b-26c2-4655-956b-1bc000debd53 {{(pid=71113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 09:52:27 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Triggering sync for uuid efa311a0-fe2e-4c0f-af66-09c3eb38fbf1 {{(pid=71113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 09:52:27 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Triggering sync for uuid 1112a49d-27bd-4fc8-bae6-ec1decbb47db {{(pid=71113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 09:52:27 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Triggering sync for uuid 9a4b47dd-b335-4c2f-9dee-5421357a0ee1 {{(pid=71113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 09:52:27 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Triggering sync for uuid f4df9380-7882-48a6-ba64-bb17429e54ac {{(pid=71113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 09:52:27 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Triggering sync for uuid 3157a7a6-b8a9-4e2d-a157-360bce4c625d {{(pid=71113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 09:52:27 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Triggering sync for uuid af1f4e7c-b336-457a-94cc-3df3c3203370 {{(pid=71113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 09:52:27 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Triggering sync for uuid 6d92f7e3-6f70-4344-9f15-9815d51024b6 {{(pid=71113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 09:52:27 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Triggering sync for uuid e133dba2-7426-493b-8282-ed18f3ca0a4a {{(pid=71113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 09:52:27 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Triggering sync for uuid 225aca75-f3cc-4fc9-a3a3-52be185e9c42 {{(pid=71113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 09:52:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "0ea0401b-26c2-4655-956b-1bc000debd53" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:52:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "0ea0401b-26c2-4655-956b-1bc000debd53" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:52:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:52:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:52:27 user nova-compute[71113]: INFO nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Jul 31 09:52:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:52:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:52:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:52:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "9a4b47dd-b335-4c2f-9dee-5421357a0ee1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:52:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "9a4b47dd-b335-4c2f-9dee-5421357a0ee1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:52:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "f4df9380-7882-48a6-ba64-bb17429e54ac" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:52:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "f4df9380-7882-48a6-ba64-bb17429e54ac" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:52:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "3157a7a6-b8a9-4e2d-a157-360bce4c625d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:52:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "3157a7a6-b8a9-4e2d-a157-360bce4c625d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:52:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "af1f4e7c-b336-457a-94cc-3df3c3203370" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:52:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "af1f4e7c-b336-457a-94cc-3df3c3203370" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:52:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "6d92f7e3-6f70-4344-9f15-9815d51024b6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:52:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "6d92f7e3-6f70-4344-9f15-9815d51024b6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:52:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "e133dba2-7426-493b-8282-ed18f3ca0a4a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:52:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "e133dba2-7426-493b-8282-ed18f3ca0a4a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:52:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "225aca75-f3cc-4fc9-a3a3-52be185e9c42" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:52:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "225aca75-f3cc-4fc9-a3a3-52be185e9c42" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:52:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:52:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "e133dba2-7426-493b-8282-ed18f3ca0a4a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:52:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "3157a7a6-b8a9-4e2d-a157-360bce4c625d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:52:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "0ea0401b-26c2-4655-956b-1bc000debd53" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.092s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:52:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "225aca75-f3cc-4fc9-a3a3-52be185e9c42" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:52:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "f4df9380-7882-48a6-ba64-bb17429e54ac" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.095s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:52:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "af1f4e7c-b336-457a-94cc-3df3c3203370" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.098s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:52:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "9a4b47dd-b335-4c2f-9dee-5421357a0ee1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.106s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:52:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "6d92f7e3-6f70-4344-9f15-9815d51024b6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.104s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:52:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:31 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690797136.740775, 1112a49d-27bd-4fc8-bae6-ec1decbb47db => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:52:31 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] VM Stopped (Lifecycle Event)
Jul 31 09:52:31 user nova-compute[71113]: DEBUG nova.compute.manager [None req-c01adf01-856f-4a7f-9dae-30edbe954602 None None] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:52:31 user nova-compute[71113]: DEBUG nova.compute.manager [None req-c01adf01-856f-4a7f-9dae-30edbe954602 None None] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:52:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:34 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690797139.5509882, caac13d2-ceb3-4fee-84ad-5376c1c2cc23 => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:52:34 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] VM Stopped (Lifecycle Event)
Jul 31 09:52:34 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ef05a05c-6491-44b0-929e-fbc79ebb78a2 None None] [instance: caac13d2-ceb3-4fee-84ad-5376c1c2cc23] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:52:36 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690797141.1063123, efa311a0-fe2e-4c0f-af66-09c3eb38fbf1 => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:52:36 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] VM Stopped (Lifecycle Event)
Jul 31 09:52:36 user nova-compute[71113]: DEBUG nova.compute.manager [None req-fcebdba8-8c30-46cf-9355-f0dfcf3ae1c6 None None] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:52:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Starting finish_revert_migration {{(pid=71113) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Start _get_guest_xml network_info=[{"id": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "address": "fa:16:3e:16:bb:aa", "network": {"id": "4f2ea02a-9b26-4f2a-af23-39c060703ff3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-725518740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5bb5c0790e54702b881dc5e45641be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b5a493-47", "ovs_interfaceid": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'image_id': '078646fe-b504-41ed-a147-61072e903e51'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'f12382a6-27db-4bdc-9753-bfae919d1a8d', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FGERQMJC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'efa311a0-fe2e-4c0f-af66-09c3eb38fbf1', 'attached_at': '2023-07-31T09:52:38.000000', 'detached_at': '', 'volume_id': 'dc7c0a40-0540-43ec-8a1d-7dd80d222f2c', 'serial': 'dc7c0a40-0540-43ec-8a1d-7dd80d222f2c'}, 'boot_index': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 09:52:38 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:52:38 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:52:38 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG nova.objects.instance [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lazy-loading 'vcpu_model' on Instance uuid efa311a0-fe2e-4c0f-af66-09c3eb38fbf1 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FGERQMJC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:52:38 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:52:38 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:52:38 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:52:38 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:52:38 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 09:52:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f93cbc-e3b4-4d46-9fa3-886a84d7b45f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 09:52:38 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7ebc10-a5a4-4a5b-adaa-df32ad7c924b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c] added
Jul 31 09:52:38 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3f2947-8461-4fd5-bbac-638a63c905ef]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[578708b5-2b4c-4afa-89c5-2b616c9223bb]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FGERQMJC {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FGERQMJC" returned: 0 in 0.025s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[05913c9e-e783-4b8c-9b28-38ef6c030f70]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FGERQMJC'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a02f8e0-a66c-409c-b2c2-9ed90b330190]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a76aaa1-4073-4cc8-85b1-debcb0f69c08]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad632806-23bb-4beb-9db3-4e54befd3e04 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be (non-flash)
Jul 31 09:52:38 user nova-compute[71113]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad632806-23bb-4beb-9db3-4e54befd3e04 (non-flash)
Jul 31 09:52:38 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be (non-flash)
Jul 31 09:52:38 user nova-compute[71113]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad632806-23bb-4beb-9db3-4e54befd3e04 (non-flash)
Jul 31 09:52:38 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[045bba8e-5530-4363-970a-1944a1efc4a3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c, portal: 172.16.0.220,3260]
Jul 31 09:52:38 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c, portal: 172.16.0.220,3260] successful.
Jul 31 09:52:38 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad446e32-78fe-45aa-9138-52e4614760f5]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c17513d-ca52-4381-a403-6ec28caf653e]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad632806-23bb-4beb-9db3-4e54befd3e04 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be (non-flash)
Jul 31 09:52:38 user nova-compute[71113]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad632806-23bb-4beb-9db3-4e54befd3e04 (non-flash)
Jul 31 09:52:38 user nova-compute[71113]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:52:38 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be (non-flash)
Jul 31 09:52:38 user nova-compute[71113]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad632806-23bb-4beb-9db3-4e54befd3e04 (non-flash)
Jul 31 09:52:38 user nova-compute[71113]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:52:38 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] HCTL ('35', '-', '-', 0) found on session 20 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[601225a5-7d08-47e3-bc99-6751e57a92fe]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Searching for a device in session 20 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 09:52:38 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FGERQMJC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 09:52:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:39 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:52:39 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23236323632636636', 'path': '/dev/sdd'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:52:39 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236323632636636', 'path': '/dev/sdd'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 09:52:39 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:46:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1025510923',display_name='tempest-ServerActionsTestOtherB-server-1025510923',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1025510923',id=3,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJo+xi4tu0GGLLf+2/4AMwJN8W9HV5KOFul5csHl5tHCHdJymtchsdGYmiKLfCyzN953/rO7ubVJnctaNhLzLpYKjY5Z2Nn1cEvYAzU5x1ZT5edLumoNfJjhx0wRkZgiEQ==',key_name='tempest-keypair-947034726',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:50:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a5bb5c0790e54702b881dc5e45641be8',ramdisk_id='',reservation_id='r-o5vysyfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1778056817',owner_user_name='tempest-ServerActionsTestOtherB-1778056817-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:52:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b5f449e8b1948cf914daef537aea164',uuid=efa311a0-fe2e-4c0f-af66-09c3eb38fbf1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "address": "fa:16:3e:16:bb:aa", "network": {"id": "4f2ea02a-9b26-4f2a-af23-39c060703ff3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-725518740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5bb5c0790e54702b881dc5e45641be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b5a493-47", "ovs_interfaceid": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 09:52:39 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Converting VIF {"id": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "address": "fa:16:3e:16:bb:aa", "network": {"id": "4f2ea02a-9b26-4f2a-af23-39c060703ff3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-725518740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5bb5c0790e54702b881dc5e45641be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b5a493-47", "ovs_interfaceid": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:52:39 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:bb:aa,bridge_name='br-int',has_traffic_filtering=True,id=39b5a493-47bd-4599-9a9f-bb80c93fb332,network=Network(4f2ea02a-9b26-4f2a-af23-39c060703ff3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39b5a493-47') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:52:39 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] End _get_guest_xml xml=<domain type="kvm">
Jul 31 09:52:39 user nova-compute[71113]:   <uuid>efa311a0-fe2e-4c0f-af66-09c3eb38fbf1</uuid>
Jul 31 09:52:39 user nova-compute[71113]:   <name>instance-00000003</name>
Jul 31 09:52:39 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 09:52:39 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 09:52:39 user nova-compute[71113]:   <metadata>
Jul 31 09:52:39 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 09:52:39 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 09:52:39 user nova-compute[71113]:       <nova:name>tempest-ServerActionsTestOtherB-server-1025510923</nova:name>
Jul 31 09:52:39 user nova-compute[71113]:       <nova:creationTime>2023-07-31 09:52:38</nova:creationTime>
Jul 31 09:52:39 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 09:52:39 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 09:52:39 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 09:52:39 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 09:52:39 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 09:52:39 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 09:52:39 user nova-compute[71113]:       </nova:flavor>
Jul 31 09:52:39 user nova-compute[71113]:       <nova:owner>
Jul 31 09:52:39 user nova-compute[71113]:         <nova:user uuid="0b5f449e8b1948cf914daef537aea164">tempest-ServerActionsTestOtherB-1778056817-project-member</nova:user>
Jul 31 09:52:39 user nova-compute[71113]:         <nova:project uuid="a5bb5c0790e54702b881dc5e45641be8">tempest-ServerActionsTestOtherB-1778056817</nova:project>
Jul 31 09:52:39 user nova-compute[71113]:       </nova:owner>
Jul 31 09:52:39 user nova-compute[71113]:       <nova:root type="image" uuid="078646fe-b504-41ed-a147-61072e903e51"/>
Jul 31 09:52:39 user nova-compute[71113]:       <nova:ports>
Jul 31 09:52:39 user nova-compute[71113]:         <nova:port uuid="39b5a493-47bd-4599-9a9f-bb80c93fb332">
Jul 31 09:52:39 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 31 09:52:39 user nova-compute[71113]:         </nova:port>
Jul 31 09:52:39 user nova-compute[71113]:       </nova:ports>
Jul 31 09:52:39 user nova-compute[71113]:     </nova:instance>
Jul 31 09:52:39 user nova-compute[71113]:   </metadata>
Jul 31 09:52:39 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 09:52:39 user nova-compute[71113]:     <system>
Jul 31 09:52:39 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 09:52:39 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 09:52:39 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 09:52:39 user nova-compute[71113]:       <entry name="serial">efa311a0-fe2e-4c0f-af66-09c3eb38fbf1</entry>
Jul 31 09:52:39 user nova-compute[71113]:       <entry name="uuid">efa311a0-fe2e-4c0f-af66-09c3eb38fbf1</entry>
Jul 31 09:52:39 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 09:52:39 user nova-compute[71113]:     </system>
Jul 31 09:52:39 user nova-compute[71113]:   </sysinfo>
Jul 31 09:52:39 user nova-compute[71113]:   <os>
Jul 31 09:52:39 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 09:52:39 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 09:52:39 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 09:52:39 user nova-compute[71113]:   </os>
Jul 31 09:52:39 user nova-compute[71113]:   <features>
Jul 31 09:52:39 user nova-compute[71113]:     <acpi/>
Jul 31 09:52:39 user nova-compute[71113]:     <apic/>
Jul 31 09:52:39 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 09:52:39 user nova-compute[71113]:   </features>
Jul 31 09:52:39 user nova-compute[71113]:   <clock offset="utc">
Jul 31 09:52:39 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 09:52:39 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 09:52:39 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 09:52:39 user nova-compute[71113]:   </clock>
Jul 31 09:52:39 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 09:52:39 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 09:52:39 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 09:52:39 user nova-compute[71113]:   </cpu>
Jul 31 09:52:39 user nova-compute[71113]:   <devices>
Jul 31 09:52:39 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 09:52:39 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 09:52:39 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk"/>
Jul 31 09:52:39 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 09:52:39 user nova-compute[71113]:     </disk>
Jul 31 09:52:39 user nova-compute[71113]:     <disk type="block" device="disk">
Jul 31 09:52:39 user nova-compute[71113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:52:39 user nova-compute[71113]:       <source dev="/dev/sdd"/>
Jul 31 09:52:39 user nova-compute[71113]:       <target dev="vdb" bus="virtio"/>
Jul 31 09:52:39 user nova-compute[71113]:       <serial>dc7c0a40-0540-43ec-8a1d-7dd80d222f2c</serial>
Jul 31 09:52:39 user nova-compute[71113]:     </disk>
Jul 31 09:52:39 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 09:52:39 user nova-compute[71113]:       <mac address="fa:16:3e:16:bb:aa"/>
Jul 31 09:52:39 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:52:39 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 09:52:39 user nova-compute[71113]:       <target dev="tap39b5a493-47"/>
Jul 31 09:52:39 user nova-compute[71113]:     </interface>
Jul 31 09:52:39 user nova-compute[71113]:     <serial type="pty">
Jul 31 09:52:39 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/console.log" append="off"/>
Jul 31 09:52:39 user nova-compute[71113]:     </serial>
Jul 31 09:52:39 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 09:52:39 user nova-compute[71113]:     <video>
Jul 31 09:52:39 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:52:39 user nova-compute[71113]:     </video>
Jul 31 09:52:39 user nova-compute[71113]:     <rng model="virtio">
Jul 31 09:52:39 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 09:52:39 user nova-compute[71113]:     </rng>
Jul 31 09:52:39 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 09:52:39 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 09:52:39 user nova-compute[71113]:       <stats period="10"/>
Jul 31 09:52:39 user nova-compute[71113]:     </memballoon>
Jul 31 09:52:39 user nova-compute[71113]:   </devices>
Jul 31 09:52:39 user nova-compute[71113]: </domain>
Jul 31 09:52:39 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 09:52:39 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:46:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1025510923',display_name='tempest-ServerActionsTestOtherB-server-1025510923',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1025510923',id=3,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJo+xi4tu0GGLLf+2/4AMwJN8W9HV5KOFul5csHl5tHCHdJymtchsdGYmiKLfCyzN953/rO7ubVJnctaNhLzLpYKjY5Z2Nn1cEvYAzU5x1ZT5edLumoNfJjhx0wRkZgiEQ==',key_name='tempest-keypair-947034726',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:50:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a5bb5c0790e54702b881dc5e45641be8',ramdisk_id='',reservation_id='r-o5vysyfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1778056817',owner_user_name='tempest-ServerActionsTestOtherB-1778056817-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:52:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b5f449e8b1948cf914daef537aea164',uuid=efa311a0-fe2e-4c0f-af66-09c3eb38fbf1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "address": "fa:16:3e:16:bb:aa", "network": {"id": "4f2ea02a-9b26-4f2a-af23-39c060703ff3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-725518740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5bb5c0790e54702b881dc5e45641be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b5a493-47", "ovs_interfaceid": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 09:52:39 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Converting VIF {"id": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "address": "fa:16:3e:16:bb:aa", "network": {"id": "4f2ea02a-9b26-4f2a-af23-39c060703ff3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-725518740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5bb5c0790e54702b881dc5e45641be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b5a493-47", "ovs_interfaceid": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:52:39 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:bb:aa,bridge_name='br-int',has_traffic_filtering=True,id=39b5a493-47bd-4599-9a9f-bb80c93fb332,network=Network(4f2ea02a-9b26-4f2a-af23-39c060703ff3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39b5a493-47') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:52:39 user nova-compute[71113]: DEBUG os_vif [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:bb:aa,bridge_name='br-int',has_traffic_filtering=True,id=39b5a493-47bd-4599-9a9f-bb80c93fb332,network=Network(4f2ea02a-9b26-4f2a-af23-39c060703ff3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39b5a493-47') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 09:52:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:52:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 09:52:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap39b5a493-47, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:52:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap39b5a493-47, col_values=(('external_ids', {'iface-id': '39b5a493-47bd-4599-9a9f-bb80c93fb332', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:bb:aa', 'vm-uuid': 'efa311a0-fe2e-4c0f-af66-09c3eb38fbf1'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:52:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:52:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:39 user nova-compute[71113]: INFO os_vif [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:bb:aa,bridge_name='br-int',has_traffic_filtering=True,id=39b5a493-47bd-4599-9a9f-bb80c93fb332,network=Network(4f2ea02a-9b26-4f2a-af23-39c060703ff3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39b5a493-47')
Jul 31 09:52:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:42 user nova-compute[71113]: DEBUG nova.compute.manager [req-a868dfaf-7f49-44fb-9d15-864bd290b968 req-b1ee4934-55c3-4cf7-8b16-46fa593979cd service nova] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Received event network-vif-plugged-39b5a493-47bd-4599-9a9f-bb80c93fb332 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:52:42 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-a868dfaf-7f49-44fb-9d15-864bd290b968 req-b1ee4934-55c3-4cf7-8b16-46fa593979cd service nova] Acquiring lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:52:42 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-a868dfaf-7f49-44fb-9d15-864bd290b968 req-b1ee4934-55c3-4cf7-8b16-46fa593979cd service nova] Lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:52:42 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-a868dfaf-7f49-44fb-9d15-864bd290b968 req-b1ee4934-55c3-4cf7-8b16-46fa593979cd service nova] Lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:52:42 user nova-compute[71113]: DEBUG nova.compute.manager [req-a868dfaf-7f49-44fb-9d15-864bd290b968 req-b1ee4934-55c3-4cf7-8b16-46fa593979cd service nova] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] No waiting events found dispatching network-vif-plugged-39b5a493-47bd-4599-9a9f-bb80c93fb332 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:52:42 user nova-compute[71113]: WARNING nova.compute.manager [req-a868dfaf-7f49-44fb-9d15-864bd290b968 req-b1ee4934-55c3-4cf7-8b16-46fa593979cd service nova] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Received unexpected event network-vif-plugged-39b5a493-47bd-4599-9a9f-bb80c93fb332 for instance with vm_state resized and task_state resize_reverting.
Jul 31 09:52:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:45 user nova-compute[71113]: DEBUG nova.compute.manager [req-735e83cc-b13d-4b76-8b31-e49537c977af req-cda08108-342c-496b-b45e-9c788367f2f1 service nova] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Received event network-vif-plugged-39b5a493-47bd-4599-9a9f-bb80c93fb332 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:52:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-735e83cc-b13d-4b76-8b31-e49537c977af req-cda08108-342c-496b-b45e-9c788367f2f1 service nova] Acquiring lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:52:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-735e83cc-b13d-4b76-8b31-e49537c977af req-cda08108-342c-496b-b45e-9c788367f2f1 service nova] Lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:52:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-735e83cc-b13d-4b76-8b31-e49537c977af req-cda08108-342c-496b-b45e-9c788367f2f1 service nova] Lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:52:45 user nova-compute[71113]: DEBUG nova.compute.manager [req-735e83cc-b13d-4b76-8b31-e49537c977af req-cda08108-342c-496b-b45e-9c788367f2f1 service nova] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] No waiting events found dispatching network-vif-plugged-39b5a493-47bd-4599-9a9f-bb80c93fb332 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:52:45 user nova-compute[71113]: WARNING nova.compute.manager [req-735e83cc-b13d-4b76-8b31-e49537c977af req-cda08108-342c-496b-b45e-9c788367f2f1 service nova] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Received unexpected event network-vif-plugged-39b5a493-47bd-4599-9a9f-bb80c93fb332 for instance with vm_state resized and task_state resize_reverting.
Jul 31 09:52:46 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797166.4495444, efa311a0-fe2e-4c0f-af66-09c3eb38fbf1 => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:52:46 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] VM Resumed (Lifecycle Event)
Jul 31 09:52:46 user nova-compute[71113]: DEBUG nova.compute.manager [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 09:52:46 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Instance running successfully.
Jul 31 09:52:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] finish_revert_migration finished successfully. {{(pid=71113) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Jul 31 09:52:46 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:52:46 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:52:46 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Jul 31 09:52:46 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797166.4530604, efa311a0-fe2e-4c0f-af66-09c3eb38fbf1 => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:52:46 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] VM Started (Lifecycle Event)
Jul 31 09:52:46 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:52:46 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:52:46 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Jul 31 09:52:46 user nova-compute[71113]: DEBUG nova.compute.manager [None req-fb60bdda-0313-45f5-a336-795ce3956c6b tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:52:46 user nova-compute[71113]: INFO nova.compute.manager [None req-fb60bdda-0313-45f5-a336-795ce3956c6b tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] instance snapshotting
Jul 31 09:52:46 user nova-compute[71113]: INFO nova.compute.manager [None req-bf145b6e-a548-4cdc-b869-e882db1412c8 tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Updating instance to original state: 'active'
Jul 31 09:52:46 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-fb60bdda-0313-45f5-a336-795ce3956c6b tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Beginning live snapshot process
Jul 31 09:52:47 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-fb60bdda-0313-45f5-a336-795ce3956c6b tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json -f qcow2 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:47 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-fb60bdda-0313-45f5-a336-795ce3956c6b tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json -f qcow2" returned: 0 in 0.511s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:47 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-fb60bdda-0313-45f5-a336-795ce3956c6b tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json -f qcow2 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:47 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-fb60bdda-0313-45f5-a336-795ce3956c6b tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json -f qcow2" returned: 0 in 0.228s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:47 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-fb60bdda-0313-45f5-a336-795ce3956c6b tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-fb60bdda-0313-45f5-a336-795ce3956c6b tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.198s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-fb60bdda-0313-45f5-a336-795ce3956c6b tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpn3ddla5b/9340cfe3b6fc4cb0a8ecc6ca96f65795.delta 1073741824 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-fb60bdda-0313-45f5-a336-795ce3956c6b tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpn3ddla5b/9340cfe3b6fc4cb0a8ecc6ca96f65795.delta 1073741824" returned: 0 in 0.049s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:48 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-fb60bdda-0313-45f5-a336-795ce3956c6b tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 31 09:52:49 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-fb60bdda-0313-45f5-a336-795ce3956c6b tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=71113) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 09:52:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4876-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:52:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:52:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 09:52:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 09:52:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 09:52:49 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-fb60bdda-0313-45f5-a336-795ce3956c6b tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] COPY block job progress, current cursor: 12386304 final cursor: 75497472 {{(pid=71113) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 09:52:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-fb60bdda-0313-45f5-a336-795ce3956c6b tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=71113) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 09:52:50 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-fb60bdda-0313-45f5-a336-795ce3956c6b tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 31 09:52:50 user nova-compute[71113]: DEBUG nova.privsep.utils [None req-fb60bdda-0313-45f5-a336-795ce3956c6b tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71113) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 09:52:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-fb60bdda-0313-45f5-a336-795ce3956c6b tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpn3ddla5b/9340cfe3b6fc4cb0a8ecc6ca96f65795.delta /opt/stack/data/nova/instances/snapshots/tmpn3ddla5b/9340cfe3b6fc4cb0a8ecc6ca96f65795 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:52:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-fb60bdda-0313-45f5-a336-795ce3956c6b tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpn3ddla5b/9340cfe3b6fc4cb0a8ecc6ca96f65795.delta /opt/stack/data/nova/instances/snapshots/tmpn3ddla5b/9340cfe3b6fc4cb0a8ecc6ca96f65795" returned: 0 in 0.373s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:52:51 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-fb60bdda-0313-45f5-a336-795ce3956c6b tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Snapshot extracted, beginning image upload
Jul 31 09:52:53 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-fb60bdda-0313-45f5-a336-795ce3956c6b tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Snapshot image upload complete
Jul 31 09:52:53 user nova-compute[71113]: INFO nova.compute.manager [None req-fb60bdda-0313-45f5-a336-795ce3956c6b tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Took 6.91 seconds to snapshot the instance on the hypervisor.
Jul 31 09:52:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:52:59 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:53:01 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:01 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:53:02 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:53:02 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:53:02 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:53:02 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:53:02 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:53:02 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 09:53:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4df9380-7882-48a6-ba64-bb17429e54ac/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4df9380-7882-48a6-ba64-bb17429e54ac/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4df9380-7882-48a6-ba64-bb17429e54ac/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4df9380-7882-48a6-ba64-bb17429e54ac/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/225aca75-f3cc-4fc9-a3a3-52be185e9c42/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/225aca75-f3cc-4fc9-a3a3-52be185e9c42/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/225aca75-f3cc-4fc9-a3a3-52be185e9c42/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/225aca75-f3cc-4fc9-a3a3-52be185e9c42/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e133dba2-7426-493b-8282-ed18f3ca0a4a/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:03 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e133dba2-7426-493b-8282-ed18f3ca0a4a/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e133dba2-7426-493b-8282-ed18f3ca0a4a/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e133dba2-7426-493b-8282-ed18f3ca0a4a/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a4b47dd-b335-4c2f-9dee-5421357a0ee1/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a4b47dd-b335-4c2f-9dee-5421357a0ee1/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a4b47dd-b335-4c2f-9dee-5421357a0ee1/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a4b47dd-b335-4c2f-9dee-5421357a0ee1/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:04 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 09:53:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af1f4e7c-b336-457a-94cc-3df3c3203370/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af1f4e7c-b336-457a-94cc-3df3c3203370/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af1f4e7c-b336-457a-94cc-3df3c3203370/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af1f4e7c-b336-457a-94cc-3df3c3203370/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:05 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 09:53:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d92f7e3-6f70-4344-9f15-9815d51024b6/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d92f7e3-6f70-4344-9f15-9815d51024b6/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d92f7e3-6f70-4344-9f15-9815d51024b6/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d92f7e3-6f70-4344-9f15-9815d51024b6/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:06 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:53:06 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:53:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=7337MB free_disk=25.367870330810547GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 09:53:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:53:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:53:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 0ea0401b-26c2-4655-956b-1bc000debd53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:53:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 1112a49d-27bd-4fc8-bae6-ec1decbb47db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:53:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 9a4b47dd-b335-4c2f-9dee-5421357a0ee1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:53:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance f4df9380-7882-48a6-ba64-bb17429e54ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:53:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance efa311a0-fe2e-4c0f-af66-09c3eb38fbf1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:53:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 3157a7a6-b8a9-4e2d-a157-360bce4c625d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:53:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance af1f4e7c-b336-457a-94cc-3df3c3203370 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:53:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 6d92f7e3-6f70-4344-9f15-9815d51024b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:53:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance e133dba2-7426-493b-8282-ed18f3ca0a4a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:53:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 225aca75-f3cc-4fc9-a3a3-52be185e9c42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:53:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 09:53:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 09:53:06 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:53:06 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:53:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 09:53:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.503s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:53:07 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Acquiring lock "8d2948be-3ebb-4067-a0c8-e2ca884814ff" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:53:07 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "8d2948be-3ebb-4067-a0c8-e2ca884814ff" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:53:07 user nova-compute[71113]: INFO nova.compute.manager [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Unshelving
Jul 31 09:53:07 user nova-compute[71113]: INFO nova.virt.block_device [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Booting with volume a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e at /dev/vdc
Jul 31 09:53:07 user nova-compute[71113]: DEBUG os_brick.utils [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:53:07 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:07 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:07 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d790fa-dc1f-406f-a694-8a5da5526d33]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:07 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:07 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:07 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d081181e-d90d-4cf3-9abb-d7bca98a783d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:07 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:07 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:53:07 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:53:07 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:53:07 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:53:07 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 09:53:07 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:07 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[10874aa0-cd32-4631-9cd8-48fc1c52f04d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:07 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e2ebdd-9b10-4adc-bc12-160c79abaf6e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:07 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:08 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:53:08 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 09:53:08 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:08 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:53:08 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 09:53:08 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48f41e0-5b5e-45de-bfa5-997ac7c8f8ae]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:08 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 09:53:08 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 09:53:08 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 09:53:08 user nova-compute[71113]: DEBUG os_brick.utils [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:53:08 user nova-compute[71113]: DEBUG nova.virt.block_device [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Updating existing volume attachment record: 52f97ae6-7449-4824-b544-87a0b0b0947a {{(pid=71113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 09:53:08 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:53:08 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 09:53:08 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Rebuilding the list of instances to heal {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 09:53:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "refresh_cache-0ea0401b-26c2-4655-956b-1bc000debd53" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:53:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquired lock "refresh_cache-0ea0401b-26c2-4655-956b-1bc000debd53" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:53:08 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Forcefully refreshing network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 09:53:08 user nova-compute[71113]: DEBUG nova.objects.instance [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lazy-loading 'info_cache' on Instance uuid 0ea0401b-26c2-4655-956b-1bc000debd53 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:53:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:09 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Updating instance_info_cache with network_info: [{"id": "5408a169-bdde-42da-be35-24006f474bc6", "address": "fa:16:3e:77:a3:62", "network": {"id": "cc84435f-b983-425d-bad0-36039e592e25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1662840158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f7a5479fd014325b8790a80b2405d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5408a169-bd", "ovs_interfaceid": "5408a169-bdde-42da-be35-24006f474bc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:53:09 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Releasing lock "refresh_cache-0ea0401b-26c2-4655-956b-1bc000debd53" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:53:09 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Updated the network info_cache for instance {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 09:53:12 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b4427bdd-bed1-4363-bd21-93f191895a3d tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Acquiring lock "0ea0401b-26c2-4655-956b-1bc000debd53" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:53:12 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b4427bdd-bed1-4363-bd21-93f191895a3d tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "0ea0401b-26c2-4655-956b-1bc000debd53" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:53:12 user nova-compute[71113]: INFO nova.compute.manager [None req-b4427bdd-bed1-4363-bd21-93f191895a3d tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Detaching volume 61fe7a42-4e7b-4473-abe6-29802c3614be
Jul 31 09:53:12 user nova-compute[71113]: INFO nova.virt.block_device [None req-b4427bdd-bed1-4363-bd21-93f191895a3d tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Attempting to driver detach volume 61fe7a42-4e7b-4473-abe6-29802c3614be from mountpoint /dev/vdb
Jul 31 09:53:12 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-b4427bdd-bed1-4363-bd21-93f191895a3d tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Attempting to detach device vdb from instance 0ea0401b-26c2-4655-956b-1bc000debd53 from the persistent domain config. {{(pid=71113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 09:53:12 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-b4427bdd-bed1-4363-bd21-93f191895a3d tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 09:53:12 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:53:12 user nova-compute[71113]:   <source dev="/dev/sdc"/>
Jul 31 09:53:12 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 09:53:12 user nova-compute[71113]:   <serial>61fe7a42-4e7b-4473-abe6-29802c3614be</serial>
Jul 31 09:53:12 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 31 09:53:12 user nova-compute[71113]: </disk>
Jul 31 09:53:12 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 09:53:12 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-b4427bdd-bed1-4363-bd21-93f191895a3d tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Successfully detached device vdb from instance 0ea0401b-26c2-4655-956b-1bc000debd53 from the persistent domain config.
Jul 31 09:53:12 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-b4427bdd-bed1-4363-bd21-93f191895a3d tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0ea0401b-26c2-4655-956b-1bc000debd53 from the live domain config. {{(pid=71113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 09:53:12 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-b4427bdd-bed1-4363-bd21-93f191895a3d tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 09:53:12 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:53:12 user nova-compute[71113]:   <source dev="/dev/sdc"/>
Jul 31 09:53:12 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 09:53:12 user nova-compute[71113]:   <serial>61fe7a42-4e7b-4473-abe6-29802c3614be</serial>
Jul 31 09:53:12 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 31 09:53:12 user nova-compute[71113]: </disk>
Jul 31 09:53:12 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 09:53:12 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:12 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Received event <DeviceRemovedEvent: 1690797192.9141488, 0ea0401b-26c2-4655-956b-1bc000debd53 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71113) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 09:53:12 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-b4427bdd-bed1-4363-bd21-93f191895a3d tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0ea0401b-26c2-4655-956b-1bc000debd53 {{(pid=71113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 09:53:12 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-b4427bdd-bed1-4363-bd21-93f191895a3d tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Successfully detached device vdb from instance 0ea0401b-26c2-4655-956b-1bc000debd53 from the live domain config.
Jul 31 09:53:12 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4427bdd-bed1-4363-bd21-93f191895a3d tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 09:53:12 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4427bdd-bed1-4363-bd21-93f191895a3d tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HDmVwAzh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:53:12 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-b4427bdd-bed1-4363-bd21-93f191895a3d tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:53:12 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-b4427bdd-bed1-4363-bd21-93f191895a3d tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:53:12 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-b4427bdd-bed1-4363-bd21-93f191895a3d tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:53:12 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4427bdd-bed1-4363-bd21-93f191895a3d tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 09:53:12 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:12 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:12 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[423063b3-961a-4e81-83f3-0aea2f92066a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:12 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:12 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:12 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ebb4c1-e483-402d-a584-40197ba9eb00]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:12 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4427bdd-bed1-4363-bd21-93f191895a3d tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be (non-flash)
Jul 31 09:53:12 user nova-compute[71113]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:53:12 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:53:12 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4427bdd-bed1-4363-bd21-93f191895a3d tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be (non-flash)
Jul 31 09:53:12 user nova-compute[71113]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:53:12 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:53:12 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4427bdd-bed1-4363-bd21-93f191895a3d tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f78f05a2ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be'): ({'sdc'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 09:53:12 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-b4427bdd-bed1-4363-bd21-93f191895a3d tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Removing single pathed devices sdc {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 09:53:12 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:13 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01f23ca-8a9f-485f-9c0f-ebd47d86c336]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:13 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48200df-2164-48b5-966e-86d8cc4660c9]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:13 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-b4427bdd-bed1-4363-bd21-93f191895a3d tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Flushing IO for device /dev/sdc {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 09:53:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:13 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[96eca8b5-9743-4c1a-a911-d268478abc6d]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:13 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-b4427bdd-bed1-4363-bd21-93f191895a3d tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 09:53:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:13 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d4835e-5d47-4ffd-a8ae-a9c8c3b80873]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:13 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-b4427bdd-bed1-4363-bd21-93f191895a3d tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 09:53:13 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-b4427bdd-bed1-4363-bd21-93f191895a3d tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] SCSI volumes sdc have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 09:53:13 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4427bdd-bed1-4363-bd21-93f191895a3d tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 09:53:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:13 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e716dfbe-b676-4342-a298-b628f24f1a9b]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:13 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4427bdd-bed1-4363-bd21-93f191895a3d tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:53:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:13 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8515f1-5016-4f69-9d70-fea64609f58c]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:13 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4427bdd-bed1-4363-bd21-93f191895a3d tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be, portal: 172.16.0.220,3260]
Jul 31 09:53:13 user nova-compute[71113]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be, portal: 172.16.0.220,3260] successful.
Jul 31 09:53:13 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:53:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61fe7a42-4e7b-4473-abe6-29802c3614be -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:13 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e98e460-efe9-43bf-a72c-fa396e93905e]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:13 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4427bdd-bed1-4363-bd21-93f191895a3d tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:53:13 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-b4427bdd-bed1-4363-bd21-93f191895a3d tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:53:13 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4427bdd-bed1-4363-bd21-93f191895a3d tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] <== disconnect_volume: return (294ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:53:13 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4427bdd-bed1-4363-bd21-93f191895a3d tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 09:53:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:53:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:53:15 user nova-compute[71113]: DEBUG nova.objects.instance [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lazy-loading 'pci_requests' on Instance uuid 8d2948be-3ebb-4067-a0c8-e2ca884814ff {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:53:15 user nova-compute[71113]: DEBUG nova.objects.instance [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lazy-loading 'numa_topology' on Instance uuid 8d2948be-3ebb-4067-a0c8-e2ca884814ff {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:53:15 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 09:53:15 user nova-compute[71113]: INFO nova.compute.claims [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Claim successful on node user
Jul 31 09:53:16 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:53:16 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:53:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.458s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:53:16 user nova-compute[71113]: INFO nova.network.neutron [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Updating port f3560f1f-45f9-4ab3-b7a9-338b0483a656 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Jul 31 09:53:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Acquiring lock "refresh_cache-8d2948be-3ebb-4067-a0c8-e2ca884814ff" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:53:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Acquired lock "refresh_cache-8d2948be-3ebb-4067-a0c8-e2ca884814ff" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:53:17 user nova-compute[71113]: DEBUG nova.network.neutron [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 09:53:17 user nova-compute[71113]: DEBUG nova.objects.instance [None req-b4427bdd-bed1-4363-bd21-93f191895a3d tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lazy-loading 'flavor' on Instance uuid 0ea0401b-26c2-4655-956b-1bc000debd53 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:53:17 user nova-compute[71113]: DEBUG nova.compute.manager [req-63bb8b71-9773-4ec3-bf90-5d6a1cec2c25 req-d57d2848-0e7f-42cb-8fae-454d3fc466e2 service nova] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Received event network-changed-f3560f1f-45f9-4ab3-b7a9-338b0483a656 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:53:17 user nova-compute[71113]: DEBUG nova.compute.manager [req-63bb8b71-9773-4ec3-bf90-5d6a1cec2c25 req-d57d2848-0e7f-42cb-8fae-454d3fc466e2 service nova] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Refreshing instance network info cache due to event network-changed-f3560f1f-45f9-4ab3-b7a9-338b0483a656. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:53:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-63bb8b71-9773-4ec3-bf90-5d6a1cec2c25 req-d57d2848-0e7f-42cb-8fae-454d3fc466e2 service nova] Acquiring lock "refresh_cache-8d2948be-3ebb-4067-a0c8-e2ca884814ff" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:53:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b4427bdd-bed1-4363-bd21-93f191895a3d tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "0ea0401b-26c2-4655-956b-1bc000debd53" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.928s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:53:17 user nova-compute[71113]: DEBUG nova.network.neutron [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Updating instance_info_cache with network_info: [{"id": "f3560f1f-45f9-4ab3-b7a9-338b0483a656", "address": "fa:16:3e:91:a4:b3", "network": {"id": "e498d93a-703d-4d19-9adf-61469f37d4da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1320431580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4461b48e5470471d8fe1b61fb8af9c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3560f1f-45", "ovs_interfaceid": "f3560f1f-45f9-4ab3-b7a9-338b0483a656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:53:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Releasing lock "refresh_cache-8d2948be-3ebb-4067-a0c8-e2ca884814ff" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:53:17 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 09:53:17 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Creating image(s)
Jul 31 09:53:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Acquiring lock "/opt/stack/data/nova/instances/8d2948be-3ebb-4067-a0c8-e2ca884814ff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:53:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "/opt/stack/data/nova/instances/8d2948be-3ebb-4067-a0c8-e2ca884814ff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:53:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "/opt/stack/data/nova/instances/8d2948be-3ebb-4067-a0c8-e2ca884814ff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:53:17 user nova-compute[71113]: DEBUG nova.objects.instance [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8d2948be-3ebb-4067-a0c8-e2ca884814ff {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:53:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-63bb8b71-9773-4ec3-bf90-5d6a1cec2c25 req-d57d2848-0e7f-42cb-8fae-454d3fc466e2 service nova] Acquired lock "refresh_cache-8d2948be-3ebb-4067-a0c8-e2ca884814ff" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:53:17 user nova-compute[71113]: DEBUG nova.network.neutron [req-63bb8b71-9773-4ec3-bf90-5d6a1cec2c25 req-d57d2848-0e7f-42cb-8fae-454d3fc466e2 service nova] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Refreshing network info cache for port f3560f1f-45f9-4ab3-b7a9-338b0483a656 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:53:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Acquiring lock "3c5522f157e58da6165cf1e4c98f38fb9ba3915a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:53:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "3c5522f157e58da6165cf1e4c98f38fb9ba3915a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:53:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c5522f157e58da6165cf1e4c98f38fb9ba3915a.part --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c5522f157e58da6165cf1e4c98f38fb9ba3915a.part --force-share --output=json" returned: 0 in 0.157s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:18 user nova-compute[71113]: DEBUG nova.virt.images [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] 480e16ff-6e8c-4dc9-ac02-d0bb76cf595e was qcow2, converting to raw {{(pid=71113) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 31 09:53:18 user nova-compute[71113]: DEBUG nova.privsep.utils [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71113) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 09:53:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3c5522f157e58da6165cf1e4c98f38fb9ba3915a.part /opt/stack/data/nova/instances/_base/3c5522f157e58da6165cf1e4c98f38fb9ba3915a.converted {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:19 user nova-compute[71113]: DEBUG nova.network.neutron [req-63bb8b71-9773-4ec3-bf90-5d6a1cec2c25 req-d57d2848-0e7f-42cb-8fae-454d3fc466e2 service nova] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Updated VIF entry in instance network info cache for port f3560f1f-45f9-4ab3-b7a9-338b0483a656. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:53:19 user nova-compute[71113]: DEBUG nova.network.neutron [req-63bb8b71-9773-4ec3-bf90-5d6a1cec2c25 req-d57d2848-0e7f-42cb-8fae-454d3fc466e2 service nova] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Updating instance_info_cache with network_info: [{"id": "f3560f1f-45f9-4ab3-b7a9-338b0483a656", "address": "fa:16:3e:91:a4:b3", "network": {"id": "e498d93a-703d-4d19-9adf-61469f37d4da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1320431580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4461b48e5470471d8fe1b61fb8af9c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3560f1f-45", "ovs_interfaceid": "f3560f1f-45f9-4ab3-b7a9-338b0483a656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:53:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-63bb8b71-9773-4ec3-bf90-5d6a1cec2c25 req-d57d2848-0e7f-42cb-8fae-454d3fc466e2 service nova] Releasing lock "refresh_cache-8d2948be-3ebb-4067-a0c8-e2ca884814ff" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:53:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3c5522f157e58da6165cf1e4c98f38fb9ba3915a.part /opt/stack/data/nova/instances/_base/3c5522f157e58da6165cf1e4c98f38fb9ba3915a.converted" returned: 0 in 0.783s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c5522f157e58da6165cf1e4c98f38fb9ba3915a.converted --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c5522f157e58da6165cf1e4c98f38fb9ba3915a.converted --force-share --output=json" returned: 0 in 0.147s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "3c5522f157e58da6165cf1e4c98f38fb9ba3915a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.119s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:53:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c5522f157e58da6165cf1e4c98f38fb9ba3915a --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c5522f157e58da6165cf1e4c98f38fb9ba3915a --force-share --output=json" returned: 0 in 0.137s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Acquiring lock "3c5522f157e58da6165cf1e4c98f38fb9ba3915a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:53:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "3c5522f157e58da6165cf1e4c98f38fb9ba3915a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:53:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c5522f157e58da6165cf1e4c98f38fb9ba3915a --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c5522f157e58da6165cf1e4c98f38fb9ba3915a --force-share --output=json" returned: 0 in 0.132s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3c5522f157e58da6165cf1e4c98f38fb9ba3915a,backing_fmt=raw /opt/stack/data/nova/instances/8d2948be-3ebb-4067-a0c8-e2ca884814ff/disk 1073741824 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3c5522f157e58da6165cf1e4c98f38fb9ba3915a,backing_fmt=raw /opt/stack/data/nova/instances/8d2948be-3ebb-4067-a0c8-e2ca884814ff/disk 1073741824" returned: 0 in 0.050s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "3c5522f157e58da6165cf1e4c98f38fb9ba3915a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:53:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c5522f157e58da6165cf1e4c98f38fb9ba3915a --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c5522f157e58da6165cf1e4c98f38fb9ba3915a --force-share --output=json" returned: 0 in 0.143s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:20 user nova-compute[71113]: DEBUG nova.objects.instance [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lazy-loading 'migration_context' on Instance uuid 8d2948be-3ebb-4067-a0c8-e2ca884814ff {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:53:20 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Rebasing disk image.
Jul 31 09:53:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.154s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 -F raw /opt/stack/data/nova/instances/8d2948be-3ebb-4067-a0c8-e2ca884814ff/disk {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 -F raw /opt/stack/data/nova/instances/8d2948be-3ebb-4067-a0c8-e2ca884814ff/disk" returned: 0 in 2.155s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Created local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 09:53:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Ensure instance console log exists: /opt/stack/data/nova/instances/8d2948be-3ebb-4067-a0c8-e2ca884814ff/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 09:53:22 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:53:22 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:53:22 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:53:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Start _get_guest_xml network_info=[{"id": "f3560f1f-45f9-4ab3-b7a9-338b0483a656", "address": "fa:16:3e:91:a4:b3", "network": {"id": "e498d93a-703d-4d19-9adf-61469f37d4da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1320431580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4461b48e5470471d8fe1b61fb8af9c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3560f1f-45", "ovs_interfaceid": "f3560f1f-45f9-4ab3-b7a9-338b0483a656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='ad8b5ad63cc077bb4fd4c14375e3b064',container_format='bare',created_at=2023-07-31T09:51:16Z,direct_url=<?>,disk_format='qcow2',id=480e16ff-6e8c-4dc9-ac02-d0bb76cf595e,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-185195530-shelved',owner='4461b48e5470471d8fe1b61fb8af9c8d',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-07-31T09:51:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'image_id': '078646fe-b504-41ed-a147-61072e903e51'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '52f97ae6-7449-4824-b544-87a0b0b0947a', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vXLMNWVl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '8d2948be-3ebb-4067-a0c8-e2ca884814ff', 'attached_at': '', 'detached_at': '', 'volume_id': 'a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e', 'serial': 'a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e'}, 'boot_index': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 09:53:22 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:53:22 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:53:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 09:53:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 09:53:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 09:53:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 09:53:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 09:53:22 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='ad8b5ad63cc077bb4fd4c14375e3b064',container_format='bare',created_at=2023-07-31T09:51:16Z,direct_url=<?>,disk_format='qcow2',id=480e16ff-6e8c-4dc9-ac02-d0bb76cf595e,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-185195530-shelved',owner='4461b48e5470471d8fe1b61fb8af9c8d',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-07-31T09:51:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 09:53:22 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 09:53:22 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 09:53:22 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 09:53:22 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 09:53:22 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 09:53:22 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 09:53:22 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 09:53:22 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 09:53:22 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 09:53:22 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 09:53:22 user nova-compute[71113]: DEBUG nova.objects.instance [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8d2948be-3ebb-4067-a0c8-e2ca884814ff {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:53:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 09:53:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vXLMNWVl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:53:22 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:53:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:53:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:53:22 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:53:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:53:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:53:22 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 09:53:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:22 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e2c5e7-9490-436f-b806-91feff95ba98]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 09:53:22 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:53:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:22 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f8607f-e7df-4b01-ab23-d59581d8db21]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e] added
Jul 31 09:53:22 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:53:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:22 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6370677e-4d5e-47ee-ac64-3bba76240c64]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:53:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:22 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[64865771-8de0-46e3-9066-eb0f19f997b3]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:53:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vXLMNWVl {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vXLMNWVl" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:22 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[080e4691-bd88-474e-91a5-6c59c8183a73]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vXLMNWVl'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:53:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:22 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[33abaf0d-bef8-4c34-b1fe-1a086f5f3ee7]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:53:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:22 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6cb60ec-c9a9-4df4-ba04-a78d028f9a05]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:53:22 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:53:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:53:22 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:53:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:23 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:23 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d780b83-4b96-4d5e-af94-bb7efb344faf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:23 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e, portal: 172.16.0.220,3260]
Jul 31 09:53:23 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e, portal: 172.16.0.220,3260] successful.
Jul 31 09:53:23 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:53:23 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:23 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:23 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b9bb9f-42f1-4a87-9ddd-9d59ad9a65bc]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:23 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:53:23 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:23 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:23 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6855fa29-db5b-41ea-a45d-6e1ad1d23ddb]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:23 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:53:23 user nova-compute[71113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)
Jul 31 09:53:23 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:53:23 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:53:23 user nova-compute[71113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)
Jul 31 09:53:23 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:53:23 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:53:23 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 09:53:23 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 09:53:23 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 09:53:23 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:23 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:23 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e40aba-0ffa-41b7-9e31-a8b1a7cefcd3]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:23 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 09:53:23 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vXLMNWVl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 09:53:23 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:24 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:53:24 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '23932306563363734', 'path': '/dev/sdb'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:53:24 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932306563363734', 'path': '/dev/sdb'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 09:53:24 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T09:49:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-185195530',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-185195530',id=12,image_ref='480e16ff-6e8c-4dc9-ac02-d0bb76cf595e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-404775333',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:49:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='4461b48e5470471d8fe1b61fb8af9c8d',ramdisk_id='',reservation_id='r-v0gpv3qp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-960167684',owner_user_name='tempest-AttachVolumeShelveTestJSON-960167684-project-member',shelved_at='2023-07-31T09:51:20.475226',shelved_host='user',shelved_image_id='480e16ff-6e8c-4dc9-ac02-d0bb76cf595e'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:53:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5199c7da0634b6e8111782122adcf70',uuid=8d2948be-3ebb-4067-a0c8-e2ca884814ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f3560f1f-45f9-4ab3-b7a9-338b0483a656", "address": "fa:16:3e:91:a4:b3", "network": {"id": "e498d93a-703d-4d19-9adf-61469f37d4da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1320431580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4461b48e5470471d8fe1b61fb8af9c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3560f1f-45", "ovs_interfaceid": "f3560f1f-45f9-4ab3-b7a9-338b0483a656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 09:53:24 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Converting VIF {"id": "f3560f1f-45f9-4ab3-b7a9-338b0483a656", "address": "fa:16:3e:91:a4:b3", "network": {"id": "e498d93a-703d-4d19-9adf-61469f37d4da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1320431580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4461b48e5470471d8fe1b61fb8af9c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3560f1f-45", "ovs_interfaceid": "f3560f1f-45f9-4ab3-b7a9-338b0483a656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:53:24 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:a4:b3,bridge_name='br-int',has_traffic_filtering=True,id=f3560f1f-45f9-4ab3-b7a9-338b0483a656,network=Network(e498d93a-703d-4d19-9adf-61469f37d4da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3560f1f-45') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:53:24 user nova-compute[71113]: DEBUG nova.objects.instance [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d2948be-3ebb-4067-a0c8-e2ca884814ff {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:53:24 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] End _get_guest_xml xml=<domain type="kvm">
Jul 31 09:53:24 user nova-compute[71113]:   <uuid>8d2948be-3ebb-4067-a0c8-e2ca884814ff</uuid>
Jul 31 09:53:24 user nova-compute[71113]:   <name>instance-0000000c</name>
Jul 31 09:53:24 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 09:53:24 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 09:53:24 user nova-compute[71113]:   <metadata>
Jul 31 09:53:24 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 09:53:24 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 09:53:24 user nova-compute[71113]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-185195530</nova:name>
Jul 31 09:53:24 user nova-compute[71113]:       <nova:creationTime>2023-07-31 09:53:22</nova:creationTime>
Jul 31 09:53:24 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 09:53:24 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 09:53:24 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 09:53:24 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 09:53:24 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 09:53:24 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 09:53:24 user nova-compute[71113]:       </nova:flavor>
Jul 31 09:53:24 user nova-compute[71113]:       <nova:owner>
Jul 31 09:53:24 user nova-compute[71113]:         <nova:user uuid="b5199c7da0634b6e8111782122adcf70">tempest-AttachVolumeShelveTestJSON-960167684-project-member</nova:user>
Jul 31 09:53:24 user nova-compute[71113]:         <nova:project uuid="4461b48e5470471d8fe1b61fb8af9c8d">tempest-AttachVolumeShelveTestJSON-960167684</nova:project>
Jul 31 09:53:24 user nova-compute[71113]:       </nova:owner>
Jul 31 09:53:24 user nova-compute[71113]:       <nova:root type="image" uuid="480e16ff-6e8c-4dc9-ac02-d0bb76cf595e"/>
Jul 31 09:53:24 user nova-compute[71113]:       <nova:ports>
Jul 31 09:53:24 user nova-compute[71113]:         <nova:port uuid="f3560f1f-45f9-4ab3-b7a9-338b0483a656">
Jul 31 09:53:24 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 31 09:53:24 user nova-compute[71113]:         </nova:port>
Jul 31 09:53:24 user nova-compute[71113]:       </nova:ports>
Jul 31 09:53:24 user nova-compute[71113]:     </nova:instance>
Jul 31 09:53:24 user nova-compute[71113]:   </metadata>
Jul 31 09:53:24 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 09:53:24 user nova-compute[71113]:     <system>
Jul 31 09:53:24 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 09:53:24 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 09:53:24 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 09:53:24 user nova-compute[71113]:       <entry name="serial">8d2948be-3ebb-4067-a0c8-e2ca884814ff</entry>
Jul 31 09:53:24 user nova-compute[71113]:       <entry name="uuid">8d2948be-3ebb-4067-a0c8-e2ca884814ff</entry>
Jul 31 09:53:24 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 09:53:24 user nova-compute[71113]:     </system>
Jul 31 09:53:24 user nova-compute[71113]:   </sysinfo>
Jul 31 09:53:24 user nova-compute[71113]:   <os>
Jul 31 09:53:24 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 09:53:24 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 09:53:24 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 09:53:24 user nova-compute[71113]:   </os>
Jul 31 09:53:24 user nova-compute[71113]:   <features>
Jul 31 09:53:24 user nova-compute[71113]:     <acpi/>
Jul 31 09:53:24 user nova-compute[71113]:     <apic/>
Jul 31 09:53:24 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 09:53:24 user nova-compute[71113]:   </features>
Jul 31 09:53:24 user nova-compute[71113]:   <clock offset="utc">
Jul 31 09:53:24 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 09:53:24 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 09:53:24 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 09:53:24 user nova-compute[71113]:   </clock>
Jul 31 09:53:24 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 09:53:24 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 09:53:24 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 09:53:24 user nova-compute[71113]:   </cpu>
Jul 31 09:53:24 user nova-compute[71113]:   <devices>
Jul 31 09:53:24 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 09:53:24 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 09:53:24 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/8d2948be-3ebb-4067-a0c8-e2ca884814ff/disk"/>
Jul 31 09:53:24 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 09:53:24 user nova-compute[71113]:     </disk>
Jul 31 09:53:24 user nova-compute[71113]:     <disk type="block" device="disk">
Jul 31 09:53:24 user nova-compute[71113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:53:24 user nova-compute[71113]:       <source dev="/dev/sdb"/>
Jul 31 09:53:24 user nova-compute[71113]:       <target dev="vdc" bus="virtio"/>
Jul 31 09:53:24 user nova-compute[71113]:       <serial>a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e</serial>
Jul 31 09:53:24 user nova-compute[71113]:     </disk>
Jul 31 09:53:24 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 09:53:24 user nova-compute[71113]:       <mac address="fa:16:3e:91:a4:b3"/>
Jul 31 09:53:24 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:53:24 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 09:53:24 user nova-compute[71113]:       <target dev="tapf3560f1f-45"/>
Jul 31 09:53:24 user nova-compute[71113]:     </interface>
Jul 31 09:53:24 user nova-compute[71113]:     <serial type="pty">
Jul 31 09:53:24 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/8d2948be-3ebb-4067-a0c8-e2ca884814ff/console.log" append="off"/>
Jul 31 09:53:24 user nova-compute[71113]:     </serial>
Jul 31 09:53:24 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 09:53:24 user nova-compute[71113]:     <video>
Jul 31 09:53:24 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:53:24 user nova-compute[71113]:     </video>
Jul 31 09:53:24 user nova-compute[71113]:     <rng model="virtio">
Jul 31 09:53:24 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 09:53:24 user nova-compute[71113]:     </rng>
Jul 31 09:53:24 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 09:53:24 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 09:53:24 user nova-compute[71113]:       <stats period="10"/>
Jul 31 09:53:24 user nova-compute[71113]:     </memballoon>
Jul 31 09:53:24 user nova-compute[71113]:   </devices>
Jul 31 09:53:24 user nova-compute[71113]: </domain>
Jul 31 09:53:24 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 09:53:24 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T09:49:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-185195530',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-185195530',id=12,image_ref='480e16ff-6e8c-4dc9-ac02-d0bb76cf595e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-404775333',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:49:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='4461b48e5470471d8fe1b61fb8af9c8d',ramdisk_id='',reservation_id='r-v0gpv3qp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-960167684',owner_user_name='tempest-AttachVolumeShelveTestJSON-960167684-project-member',shelved_at='2023-07-31T09:51:20.475226',shelved_host='user',shelved_image_id='480e16ff-6e8c-4dc9-ac02-d0bb76cf595e'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:53:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5199c7da0634b6e8111782122adcf70',uuid=8d2948be-3ebb-4067-a0c8-e2ca884814ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f3560f1f-45f9-4ab3-b7a9-338b0483a656", "address": "fa:16:3e:91:a4:b3", "network": {"id": "e498d93a-703d-4d19-9adf-61469f37d4da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1320431580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4461b48e5470471d8fe1b61fb8af9c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3560f1f-45", "ovs_interfaceid": "f3560f1f-45f9-4ab3-b7a9-338b0483a656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 09:53:24 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Converting VIF {"id": "f3560f1f-45f9-4ab3-b7a9-338b0483a656", "address": "fa:16:3e:91:a4:b3", "network": {"id": "e498d93a-703d-4d19-9adf-61469f37d4da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1320431580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4461b48e5470471d8fe1b61fb8af9c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3560f1f-45", "ovs_interfaceid": "f3560f1f-45f9-4ab3-b7a9-338b0483a656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:53:24 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:a4:b3,bridge_name='br-int',has_traffic_filtering=True,id=f3560f1f-45f9-4ab3-b7a9-338b0483a656,network=Network(e498d93a-703d-4d19-9adf-61469f37d4da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3560f1f-45') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:53:24 user nova-compute[71113]: DEBUG os_vif [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:a4:b3,bridge_name='br-int',has_traffic_filtering=True,id=f3560f1f-45f9-4ab3-b7a9-338b0483a656,network=Network(e498d93a-703d-4d19-9adf-61469f37d4da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3560f1f-45') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 09:53:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:53:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 09:53:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf3560f1f-45, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:53:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf3560f1f-45, col_values=(('external_ids', {'iface-id': 'f3560f1f-45f9-4ab3-b7a9-338b0483a656', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:a4:b3', 'vm-uuid': '8d2948be-3ebb-4067-a0c8-e2ca884814ff'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:53:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:53:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:24 user nova-compute[71113]: INFO os_vif [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:a4:b3,bridge_name='br-int',has_traffic_filtering=True,id=f3560f1f-45f9-4ab3-b7a9-338b0483a656,network=Network(e498d93a-703d-4d19-9adf-61469f37d4da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3560f1f-45')
Jul 31 09:53:24 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:53:24 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:53:24 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] No VIF found with MAC fa:16:3e:91:a4:b3, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 09:53:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:26 user nova-compute[71113]: DEBUG nova.compute.manager [req-1b1eaac1-349c-47df-9403-4d46313b4652 req-b95e9840-0def-46b0-ad3e-0205da048b7b service nova] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Received event network-changed-b57ab83c-c78e-424e-889b-b0156de15bfe {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:53:26 user nova-compute[71113]: DEBUG nova.compute.manager [req-1b1eaac1-349c-47df-9403-4d46313b4652 req-b95e9840-0def-46b0-ad3e-0205da048b7b service nova] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Refreshing instance network info cache due to event network-changed-b57ab83c-c78e-424e-889b-b0156de15bfe. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:53:26 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1b1eaac1-349c-47df-9403-4d46313b4652 req-b95e9840-0def-46b0-ad3e-0205da048b7b service nova] Acquiring lock "refresh_cache-af1f4e7c-b336-457a-94cc-3df3c3203370" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:53:26 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1b1eaac1-349c-47df-9403-4d46313b4652 req-b95e9840-0def-46b0-ad3e-0205da048b7b service nova] Acquired lock "refresh_cache-af1f4e7c-b336-457a-94cc-3df3c3203370" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:53:26 user nova-compute[71113]: DEBUG nova.network.neutron [req-1b1eaac1-349c-47df-9403-4d46313b4652 req-b95e9840-0def-46b0-ad3e-0205da048b7b service nova] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Refreshing network info cache for port b57ab83c-c78e-424e-889b-b0156de15bfe {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:53:26 user nova-compute[71113]: DEBUG nova.compute.manager [req-08006590-afe2-4491-aaca-5395995d0f9b req-9347949c-5240-4f45-9f2c-3b7b082e1368 service nova] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Received event network-vif-plugged-f3560f1f-45f9-4ab3-b7a9-338b0483a656 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:53:26 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-08006590-afe2-4491-aaca-5395995d0f9b req-9347949c-5240-4f45-9f2c-3b7b082e1368 service nova] Acquiring lock "8d2948be-3ebb-4067-a0c8-e2ca884814ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:53:26 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-08006590-afe2-4491-aaca-5395995d0f9b req-9347949c-5240-4f45-9f2c-3b7b082e1368 service nova] Lock "8d2948be-3ebb-4067-a0c8-e2ca884814ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:53:26 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-08006590-afe2-4491-aaca-5395995d0f9b req-9347949c-5240-4f45-9f2c-3b7b082e1368 service nova] Lock "8d2948be-3ebb-4067-a0c8-e2ca884814ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:53:26 user nova-compute[71113]: DEBUG nova.compute.manager [req-08006590-afe2-4491-aaca-5395995d0f9b req-9347949c-5240-4f45-9f2c-3b7b082e1368 service nova] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] No waiting events found dispatching network-vif-plugged-f3560f1f-45f9-4ab3-b7a9-338b0483a656 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:53:26 user nova-compute[71113]: WARNING nova.compute.manager [req-08006590-afe2-4491-aaca-5395995d0f9b req-9347949c-5240-4f45-9f2c-3b7b082e1368 service nova] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Received unexpected event network-vif-plugged-f3560f1f-45f9-4ab3-b7a9-338b0483a656 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 31 09:53:26 user nova-compute[71113]: DEBUG nova.network.neutron [req-1b1eaac1-349c-47df-9403-4d46313b4652 req-b95e9840-0def-46b0-ad3e-0205da048b7b service nova] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Updated VIF entry in instance network info cache for port b57ab83c-c78e-424e-889b-b0156de15bfe. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:53:26 user nova-compute[71113]: DEBUG nova.network.neutron [req-1b1eaac1-349c-47df-9403-4d46313b4652 req-b95e9840-0def-46b0-ad3e-0205da048b7b service nova] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Updating instance_info_cache with network_info: [{"id": "b57ab83c-c78e-424e-889b-b0156de15bfe", "address": "fa:16:3e:64:ce:90", "network": {"id": "2eebe293-45a3-4f39-bfa2-404813801391", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1697211995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8a3ec2098864e8797f77f70e1784acd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb57ab83c-c7", "ovs_interfaceid": "b57ab83c-c78e-424e-889b-b0156de15bfe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:53:26 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1b1eaac1-349c-47df-9403-4d46313b4652 req-b95e9840-0def-46b0-ad3e-0205da048b7b service nova] Releasing lock "refresh_cache-af1f4e7c-b336-457a-94cc-3df3c3203370" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:53:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-33019a73-7c8e-4269-8b03-171a6a466561 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Acquiring lock "interface-af1f4e7c-b336-457a-94cc-3df3c3203370-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:53:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-33019a73-7c8e-4269-8b03-171a6a466561 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Lock "interface-af1f4e7c-b336-457a-94cc-3df3c3203370-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:53:27 user nova-compute[71113]: DEBUG nova.objects.instance [None req-33019a73-7c8e-4269-8b03-171a6a466561 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Lazy-loading 'flavor' on Instance uuid af1f4e7c-b336-457a-94cc-3df3c3203370 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:53:27 user nova-compute[71113]: DEBUG nova.objects.instance [None req-33019a73-7c8e-4269-8b03-171a6a466561 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Lazy-loading 'pci_requests' on Instance uuid af1f4e7c-b336-457a-94cc-3df3c3203370 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:53:27 user nova-compute[71113]: DEBUG nova.network.neutron [None req-33019a73-7c8e-4269-8b03-171a6a466561 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] allocate_for_instance() {{(pid=71113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 09:53:27 user nova-compute[71113]: DEBUG nova.policy [None req-33019a73-7c8e-4269-8b03-171a6a466561 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '21f1d14ad39e4cd0b19e8484f1635344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a3ec2098864e8797f77f70e1784acd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71113) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 09:53:28 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797208.3583615, 8d2948be-3ebb-4067-a0c8-e2ca884814ff => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:53:28 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] VM Resumed (Lifecycle Event)
Jul 31 09:53:28 user nova-compute[71113]: DEBUG nova.compute.manager [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 09:53:28 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 09:53:28 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Instance spawned successfully.
Jul 31 09:53:28 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:53:28 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:53:28 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:53:28 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797208.3602555, 8d2948be-3ebb-4067-a0c8-e2ca884814ff => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:53:28 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] VM Started (Lifecycle Event)
Jul 31 09:53:28 user nova-compute[71113]: DEBUG nova.network.neutron [None req-33019a73-7c8e-4269-8b03-171a6a466561 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Successfully created port: 2fa349d3-4e53-4101-b101-4032d9560dc2 {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 09:53:28 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:53:28 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:53:28 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:53:28 user nova-compute[71113]: DEBUG nova.compute.manager [req-9a07c28c-5897-4062-9711-f883a97ccdf8 req-1c9df183-c017-4dae-861b-a4b03601816d service nova] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Received event network-vif-plugged-f3560f1f-45f9-4ab3-b7a9-338b0483a656 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:53:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9a07c28c-5897-4062-9711-f883a97ccdf8 req-1c9df183-c017-4dae-861b-a4b03601816d service nova] Acquiring lock "8d2948be-3ebb-4067-a0c8-e2ca884814ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:53:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9a07c28c-5897-4062-9711-f883a97ccdf8 req-1c9df183-c017-4dae-861b-a4b03601816d service nova] Lock "8d2948be-3ebb-4067-a0c8-e2ca884814ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:53:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9a07c28c-5897-4062-9711-f883a97ccdf8 req-1c9df183-c017-4dae-861b-a4b03601816d service nova] Lock "8d2948be-3ebb-4067-a0c8-e2ca884814ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:53:28 user nova-compute[71113]: DEBUG nova.compute.manager [req-9a07c28c-5897-4062-9711-f883a97ccdf8 req-1c9df183-c017-4dae-861b-a4b03601816d service nova] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] No waiting events found dispatching network-vif-plugged-f3560f1f-45f9-4ab3-b7a9-338b0483a656 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:53:28 user nova-compute[71113]: WARNING nova.compute.manager [req-9a07c28c-5897-4062-9711-f883a97ccdf8 req-1c9df183-c017-4dae-861b-a4b03601816d service nova] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Received unexpected event network-vif-plugged-f3560f1f-45f9-4ab3-b7a9-338b0483a656 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 31 09:53:28 user nova-compute[71113]: DEBUG nova.compute.manager [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:53:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1c2f0790-7ad0-4e92-9fe0-d4f4ad3ac355 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "8d2948be-3ebb-4067-a0c8-e2ca884814ff" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 20.986s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:53:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:29 user nova-compute[71113]: DEBUG nova.network.neutron [None req-33019a73-7c8e-4269-8b03-171a6a466561 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Successfully updated port: 2fa349d3-4e53-4101-b101-4032d9560dc2 {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 09:53:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-33019a73-7c8e-4269-8b03-171a6a466561 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Acquiring lock "refresh_cache-af1f4e7c-b336-457a-94cc-3df3c3203370" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:53:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-33019a73-7c8e-4269-8b03-171a6a466561 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Acquired lock "refresh_cache-af1f4e7c-b336-457a-94cc-3df3c3203370" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:53:29 user nova-compute[71113]: DEBUG nova.network.neutron [None req-33019a73-7c8e-4269-8b03-171a6a466561 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 09:53:29 user nova-compute[71113]: DEBUG nova.compute.manager [req-3b8f2ca4-82a9-4e1b-a283-8084ca93e887 req-87898979-8696-4c89-b1c4-45cbb5ec4af8 service nova] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Received event network-changed-2fa349d3-4e53-4101-b101-4032d9560dc2 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:53:29 user nova-compute[71113]: DEBUG nova.compute.manager [req-3b8f2ca4-82a9-4e1b-a283-8084ca93e887 req-87898979-8696-4c89-b1c4-45cbb5ec4af8 service nova] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Refreshing instance network info cache due to event network-changed-2fa349d3-4e53-4101-b101-4032d9560dc2. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:53:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3b8f2ca4-82a9-4e1b-a283-8084ca93e887 req-87898979-8696-4c89-b1c4-45cbb5ec4af8 service nova] Acquiring lock "refresh_cache-af1f4e7c-b336-457a-94cc-3df3c3203370" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:53:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:30 user nova-compute[71113]: DEBUG nova.network.neutron [None req-33019a73-7c8e-4269-8b03-171a6a466561 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Updating instance_info_cache with network_info: [{"id": "b57ab83c-c78e-424e-889b-b0156de15bfe", "address": "fa:16:3e:64:ce:90", "network": {"id": "2eebe293-45a3-4f39-bfa2-404813801391", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1697211995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8a3ec2098864e8797f77f70e1784acd", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb57ab83c-c7", "ovs_interfaceid": "b57ab83c-c78e-424e-889b-b0156de15bfe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2fa349d3-4e53-4101-b101-4032d9560dc2", "address": "fa:16:3e:47:64:c0", "network": {"id": "6c6d62a0-47a1-4c17-9ec9-110146a5043b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-803239299", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c8a3ec2098864e8797f77f70e1784acd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fa349d3-4e", "ovs_interfaceid": "2fa349d3-4e53-4101-b101-4032d9560dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:53:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-33019a73-7c8e-4269-8b03-171a6a466561 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Releasing lock "refresh_cache-af1f4e7c-b336-457a-94cc-3df3c3203370" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:53:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3b8f2ca4-82a9-4e1b-a283-8084ca93e887 req-87898979-8696-4c89-b1c4-45cbb5ec4af8 service nova] Acquired lock "refresh_cache-af1f4e7c-b336-457a-94cc-3df3c3203370" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:53:30 user nova-compute[71113]: DEBUG nova.network.neutron [req-3b8f2ca4-82a9-4e1b-a283-8084ca93e887 req-87898979-8696-4c89-b1c4-45cbb5ec4af8 service nova] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Refreshing network info cache for port 2fa349d3-4e53-4101-b101-4032d9560dc2 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:53:30 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-33019a73-7c8e-4269-8b03-171a6a466561 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T09:51:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-601671640',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-601671640',id=17,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrt/0N3rqkgPN6SuyXfpoCTkV9Bk0pcEdYe3hmzwwFIugD3ohq+ljDgxWA2owuO7ncn48ukAgrCkpv3bs19B971Yw7oJwFLv7z/1GwjZIhoKmL+3YWqpkWzV2dkY74VfA==',key_name='tempest-keypair-341346334',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:51:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c8a3ec2098864e8797f77f70e1784acd',ramdisk_id='',reservation_id='r-sijnqnb0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-740569977',owner_user_name='tempest-TaggedAttachmentsTest-740569977-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:51:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21f1d14ad39e4cd0b19e8484f1635344',uuid=af1f4e7c-b336-457a-94cc-3df3c3203370,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2fa349d3-4e53-4101-b101-4032d9560dc2", "address": "fa:16:3e:47:64:c0", "network": {"id": "6c6d62a0-47a1-4c17-9ec9-110146a5043b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-803239299", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c8a3ec2098864e8797f77f70e1784acd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fa349d3-4e", "ovs_interfaceid": "2fa349d3-4e53-4101-b101-4032d9560dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 09:53:30 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-33019a73-7c8e-4269-8b03-171a6a466561 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Converting VIF {"id": "2fa349d3-4e53-4101-b101-4032d9560dc2", "address": "fa:16:3e:47:64:c0", "network": {"id": "6c6d62a0-47a1-4c17-9ec9-110146a5043b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-803239299", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c8a3ec2098864e8797f77f70e1784acd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fa349d3-4e", "ovs_interfaceid": "2fa349d3-4e53-4101-b101-4032d9560dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:53:30 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-33019a73-7c8e-4269-8b03-171a6a466561 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:64:c0,bridge_name='br-int',has_traffic_filtering=True,id=2fa349d3-4e53-4101-b101-4032d9560dc2,network=Network(6c6d62a0-47a1-4c17-9ec9-110146a5043b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fa349d3-4e') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:53:30 user nova-compute[71113]: DEBUG os_vif [None req-33019a73-7c8e-4269-8b03-171a6a466561 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:64:c0,bridge_name='br-int',has_traffic_filtering=True,id=2fa349d3-4e53-4101-b101-4032d9560dc2,network=Network(6c6d62a0-47a1-4c17-9ec9-110146a5043b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fa349d3-4e') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 09:53:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:53:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 09:53:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2fa349d3-4e, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:53:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2fa349d3-4e, col_values=(('external_ids', {'iface-id': '2fa349d3-4e53-4101-b101-4032d9560dc2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:64:c0', 'vm-uuid': 'af1f4e7c-b336-457a-94cc-3df3c3203370'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:53:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:53:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:30 user nova-compute[71113]: INFO os_vif [None req-33019a73-7c8e-4269-8b03-171a6a466561 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:64:c0,bridge_name='br-int',has_traffic_filtering=True,id=2fa349d3-4e53-4101-b101-4032d9560dc2,network=Network(6c6d62a0-47a1-4c17-9ec9-110146a5043b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fa349d3-4e')
Jul 31 09:53:30 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-33019a73-7c8e-4269-8b03-171a6a466561 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T09:51:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-601671640',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-601671640',id=17,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrt/0N3rqkgPN6SuyXfpoCTkV9Bk0pcEdYe3hmzwwFIugD3ohq+ljDgxWA2owuO7ncn48ukAgrCkpv3bs19B971Yw7oJwFLv7z/1GwjZIhoKmL+3YWqpkWzV2dkY74VfA==',key_name='tempest-keypair-341346334',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:51:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c8a3ec2098864e8797f77f70e1784acd',ramdisk_id='',reservation_id='r-sijnqnb0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-740569977',owner_user_name='tempest-TaggedAttachmentsTest-740569977-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:51:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21f1d14ad39e4cd0b19e8484f1635344',uuid=af1f4e7c-b336-457a-94cc-3df3c3203370,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2fa349d3-4e53-4101-b101-4032d9560dc2", "address": "fa:16:3e:47:64:c0", "network": {"id": "6c6d62a0-47a1-4c17-9ec9-110146a5043b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-803239299", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c8a3ec2098864e8797f77f70e1784acd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fa349d3-4e", "ovs_interfaceid": "2fa349d3-4e53-4101-b101-4032d9560dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 09:53:30 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-33019a73-7c8e-4269-8b03-171a6a466561 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Converting VIF {"id": "2fa349d3-4e53-4101-b101-4032d9560dc2", "address": "fa:16:3e:47:64:c0", "network": {"id": "6c6d62a0-47a1-4c17-9ec9-110146a5043b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-803239299", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c8a3ec2098864e8797f77f70e1784acd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fa349d3-4e", "ovs_interfaceid": "2fa349d3-4e53-4101-b101-4032d9560dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:53:30 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-33019a73-7c8e-4269-8b03-171a6a466561 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:64:c0,bridge_name='br-int',has_traffic_filtering=True,id=2fa349d3-4e53-4101-b101-4032d9560dc2,network=Network(6c6d62a0-47a1-4c17-9ec9-110146a5043b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fa349d3-4e') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:53:30 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-33019a73-7c8e-4269-8b03-171a6a466561 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] attach device xml: <interface type="ethernet">
Jul 31 09:53:30 user nova-compute[71113]:   <mac address="fa:16:3e:47:64:c0"/>
Jul 31 09:53:30 user nova-compute[71113]:   <model type="virtio"/>
Jul 31 09:53:30 user nova-compute[71113]:   <mtu size="1442"/>
Jul 31 09:53:30 user nova-compute[71113]:   <target dev="tap2fa349d3-4e"/>
Jul 31 09:53:30 user nova-compute[71113]: </interface>
Jul 31 09:53:30 user nova-compute[71113]:  {{(pid=71113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 09:53:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:30 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-33019a73-7c8e-4269-8b03-171a6a466561 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:53:30 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-33019a73-7c8e-4269-8b03-171a6a466561 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] No BDM found with device name hda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:53:30 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-33019a73-7c8e-4269-8b03-171a6a466561 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] No VIF found with MAC fa:16:3e:64:ce:90, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 09:53:31 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-33019a73-7c8e-4269-8b03-171a6a466561 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 09:53:31 user nova-compute[71113]:   <nova:package version="0.0.0"/>
Jul 31 09:53:31 user nova-compute[71113]:   <nova:name>tempest-device-tagging-server-601671640</nova:name>
Jul 31 09:53:31 user nova-compute[71113]:   <nova:creationTime>2023-07-31 09:53:31</nova:creationTime>
Jul 31 09:53:31 user nova-compute[71113]:   <nova:flavor name="m1.tiny">
Jul 31 09:53:31 user nova-compute[71113]:     <nova:memory>512</nova:memory>
Jul 31 09:53:31 user nova-compute[71113]:     <nova:disk>1</nova:disk>
Jul 31 09:53:31 user nova-compute[71113]:     <nova:swap>0</nova:swap>
Jul 31 09:53:31 user nova-compute[71113]:     <nova:ephemeral>0</nova:ephemeral>
Jul 31 09:53:31 user nova-compute[71113]:     <nova:vcpus>1</nova:vcpus>
Jul 31 09:53:31 user nova-compute[71113]:   </nova:flavor>
Jul 31 09:53:31 user nova-compute[71113]:   <nova:owner>
Jul 31 09:53:31 user nova-compute[71113]:     <nova:user uuid="21f1d14ad39e4cd0b19e8484f1635344">tempest-TaggedAttachmentsTest-740569977-project-member</nova:user>
Jul 31 09:53:31 user nova-compute[71113]:     <nova:project uuid="c8a3ec2098864e8797f77f70e1784acd">tempest-TaggedAttachmentsTest-740569977</nova:project>
Jul 31 09:53:31 user nova-compute[71113]:   </nova:owner>
Jul 31 09:53:31 user nova-compute[71113]:   <nova:root type="image" uuid="078646fe-b504-41ed-a147-61072e903e51"/>
Jul 31 09:53:31 user nova-compute[71113]:   <nova:ports>
Jul 31 09:53:31 user nova-compute[71113]:     <nova:port uuid="b57ab83c-c78e-424e-889b-b0156de15bfe">
Jul 31 09:53:31 user nova-compute[71113]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 31 09:53:31 user nova-compute[71113]:     </nova:port>
Jul 31 09:53:31 user nova-compute[71113]:     <nova:port uuid="2fa349d3-4e53-4101-b101-4032d9560dc2">
Jul 31 09:53:31 user nova-compute[71113]:       <nova:ip type="fixed" address="10.10.10.67" ipVersion="4"/>
Jul 31 09:53:31 user nova-compute[71113]:     </nova:port>
Jul 31 09:53:31 user nova-compute[71113]:   </nova:ports>
Jul 31 09:53:31 user nova-compute[71113]: </nova:instance>
Jul 31 09:53:31 user nova-compute[71113]:  {{(pid=71113) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Jul 31 09:53:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-33019a73-7c8e-4269-8b03-171a6a466561 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Lock "interface-af1f4e7c-b336-457a-94cc-3df3c3203370-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 4.023s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:53:31 user nova-compute[71113]: DEBUG nova.network.neutron [req-3b8f2ca4-82a9-4e1b-a283-8084ca93e887 req-87898979-8696-4c89-b1c4-45cbb5ec4af8 service nova] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Updated VIF entry in instance network info cache for port 2fa349d3-4e53-4101-b101-4032d9560dc2. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:53:31 user nova-compute[71113]: DEBUG nova.network.neutron [req-3b8f2ca4-82a9-4e1b-a283-8084ca93e887 req-87898979-8696-4c89-b1c4-45cbb5ec4af8 service nova] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Updating instance_info_cache with network_info: [{"id": "b57ab83c-c78e-424e-889b-b0156de15bfe", "address": "fa:16:3e:64:ce:90", "network": {"id": "2eebe293-45a3-4f39-bfa2-404813801391", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1697211995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8a3ec2098864e8797f77f70e1784acd", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb57ab83c-c7", "ovs_interfaceid": "b57ab83c-c78e-424e-889b-b0156de15bfe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2fa349d3-4e53-4101-b101-4032d9560dc2", "address": "fa:16:3e:47:64:c0", "network": {"id": "6c6d62a0-47a1-4c17-9ec9-110146a5043b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-803239299", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c8a3ec2098864e8797f77f70e1784acd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fa349d3-4e", "ovs_interfaceid": "2fa349d3-4e53-4101-b101-4032d9560dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:53:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3b8f2ca4-82a9-4e1b-a283-8084ca93e887 req-87898979-8696-4c89-b1c4-45cbb5ec4af8 service nova] Releasing lock "refresh_cache-af1f4e7c-b336-457a-94cc-3df3c3203370" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:53:31 user nova-compute[71113]: DEBUG nova.compute.manager [req-d18733bf-1e62-49bf-b39a-4bdaa3519851 req-8689b893-f199-4bd5-a9f6-13d3dede6ab2 service nova] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Received event network-vif-plugged-2fa349d3-4e53-4101-b101-4032d9560dc2 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:53:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-d18733bf-1e62-49bf-b39a-4bdaa3519851 req-8689b893-f199-4bd5-a9f6-13d3dede6ab2 service nova] Acquiring lock "af1f4e7c-b336-457a-94cc-3df3c3203370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:53:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-d18733bf-1e62-49bf-b39a-4bdaa3519851 req-8689b893-f199-4bd5-a9f6-13d3dede6ab2 service nova] Lock "af1f4e7c-b336-457a-94cc-3df3c3203370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:53:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-d18733bf-1e62-49bf-b39a-4bdaa3519851 req-8689b893-f199-4bd5-a9f6-13d3dede6ab2 service nova] Lock "af1f4e7c-b336-457a-94cc-3df3c3203370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:53:31 user nova-compute[71113]: DEBUG nova.compute.manager [req-d18733bf-1e62-49bf-b39a-4bdaa3519851 req-8689b893-f199-4bd5-a9f6-13d3dede6ab2 service nova] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] No waiting events found dispatching network-vif-plugged-2fa349d3-4e53-4101-b101-4032d9560dc2 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:53:31 user nova-compute[71113]: WARNING nova.compute.manager [req-d18733bf-1e62-49bf-b39a-4bdaa3519851 req-8689b893-f199-4bd5-a9f6-13d3dede6ab2 service nova] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Received unexpected event network-vif-plugged-2fa349d3-4e53-4101-b101-4032d9560dc2 for instance with vm_state active and task_state None.
Jul 31 09:53:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-20616644-b335-4168-a8b7-b90ed30331c1 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Acquiring lock "af1f4e7c-b336-457a-94cc-3df3c3203370" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:53:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-20616644-b335-4168-a8b7-b90ed30331c1 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Lock "af1f4e7c-b336-457a-94cc-3df3c3203370" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:53:31 user nova-compute[71113]: DEBUG nova.objects.instance [None req-20616644-b335-4168-a8b7-b90ed30331c1 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Lazy-loading 'flavor' on Instance uuid af1f4e7c-b336-457a-94cc-3df3c3203370 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:53:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-20616644-b335-4168-a8b7-b90ed30331c1 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Lock "af1f4e7c-b336-457a-94cc-3df3c3203370" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.128s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:53:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-20616644-b335-4168-a8b7-b90ed30331c1 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Acquiring lock "af1f4e7c-b336-457a-94cc-3df3c3203370" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:53:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-20616644-b335-4168-a8b7-b90ed30331c1 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Lock "af1f4e7c-b336-457a-94cc-3df3c3203370" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:53:32 user nova-compute[71113]: INFO nova.compute.manager [None req-20616644-b335-4168-a8b7-b90ed30331c1 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Attaching volume 992a3e11-6a5b-4aa7-810a-137ddac140a6 to /dev/vdb
Jul 31 09:53:32 user nova-compute[71113]: DEBUG os_brick.utils [None req-20616644-b335-4168-a8b7-b90ed30331c1 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:53:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:32 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3748bf47-1a7e-4a92-b548-2ee8186b5f95]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:32 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc456dd2-e0f2-4a40-966c-479538b9ac01]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:32 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8504c1-6779-4bdb-98fe-f70e9203f43f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:32 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5efb28c3-7022-4593-b8e1-c82ea7b93112]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-20616644-b335-4168-a8b7-b90ed30331c1 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-20616644-b335-4168-a8b7-b90ed30331c1 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:53:32 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-20616644-b335-4168-a8b7-b90ed30331c1 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 09:53:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:53:32 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 09:53:32 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[251cd048-c4e2-430b-9827-ca80250c1f44]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:32 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-20616644-b335-4168-a8b7-b90ed30331c1 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 09:53:32 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-20616644-b335-4168-a8b7-b90ed30331c1 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 09:53:32 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-20616644-b335-4168-a8b7-b90ed30331c1 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 09:53:32 user nova-compute[71113]: DEBUG os_brick.utils [None req-20616644-b335-4168-a8b7-b90ed30331c1 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:53:32 user nova-compute[71113]: DEBUG nova.virt.block_device [None req-20616644-b335-4168-a8b7-b90ed30331c1 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Updating existing volume attachment record: 00fdb613-f0e9-4dbc-a166-daf0aa16d6d5 {{(pid=71113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 09:53:33 user nova-compute[71113]: DEBUG nova.compute.manager [req-e5bf9f75-a9c7-46f8-beca-be2199370de9 req-9d96db50-f79e-40d7-b661-cf97649c12b3 service nova] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Received event network-vif-plugged-2fa349d3-4e53-4101-b101-4032d9560dc2 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:53:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e5bf9f75-a9c7-46f8-beca-be2199370de9 req-9d96db50-f79e-40d7-b661-cf97649c12b3 service nova] Acquiring lock "af1f4e7c-b336-457a-94cc-3df3c3203370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:53:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e5bf9f75-a9c7-46f8-beca-be2199370de9 req-9d96db50-f79e-40d7-b661-cf97649c12b3 service nova] Lock "af1f4e7c-b336-457a-94cc-3df3c3203370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:53:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e5bf9f75-a9c7-46f8-beca-be2199370de9 req-9d96db50-f79e-40d7-b661-cf97649c12b3 service nova] Lock "af1f4e7c-b336-457a-94cc-3df3c3203370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:53:33 user nova-compute[71113]: DEBUG nova.compute.manager [req-e5bf9f75-a9c7-46f8-beca-be2199370de9 req-9d96db50-f79e-40d7-b661-cf97649c12b3 service nova] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] No waiting events found dispatching network-vif-plugged-2fa349d3-4e53-4101-b101-4032d9560dc2 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:53:33 user nova-compute[71113]: WARNING nova.compute.manager [req-e5bf9f75-a9c7-46f8-beca-be2199370de9 req-9d96db50-f79e-40d7-b661-cf97649c12b3 service nova] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Received unexpected event network-vif-plugged-2fa349d3-4e53-4101-b101-4032d9560dc2 for instance with vm_state active and task_state None.
Jul 31 09:53:34 user nova-compute[71113]: DEBUG nova.compute.manager [req-30ce8894-7ef1-4144-84b5-ed085bd1f8ee req-3e7cf778-7a35-4e43-97ad-b3b3dee13ded service nova] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Received event network-changed-72cf4ec9-ac91-4f38-a4f5-9859bb5138bf {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:53:34 user nova-compute[71113]: DEBUG nova.compute.manager [req-30ce8894-7ef1-4144-84b5-ed085bd1f8ee req-3e7cf778-7a35-4e43-97ad-b3b3dee13ded service nova] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Refreshing instance network info cache due to event network-changed-72cf4ec9-ac91-4f38-a4f5-9859bb5138bf. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:53:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-30ce8894-7ef1-4144-84b5-ed085bd1f8ee req-3e7cf778-7a35-4e43-97ad-b3b3dee13ded service nova] Acquiring lock "refresh_cache-6d92f7e3-6f70-4344-9f15-9815d51024b6" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:53:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-30ce8894-7ef1-4144-84b5-ed085bd1f8ee req-3e7cf778-7a35-4e43-97ad-b3b3dee13ded service nova] Acquired lock "refresh_cache-6d92f7e3-6f70-4344-9f15-9815d51024b6" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:53:34 user nova-compute[71113]: DEBUG nova.network.neutron [req-30ce8894-7ef1-4144-84b5-ed085bd1f8ee req-3e7cf778-7a35-4e43-97ad-b3b3dee13ded service nova] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Refreshing network info cache for port 72cf4ec9-ac91-4f38-a4f5-9859bb5138bf {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:53:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-e7da77cf-fa8f-4bad-a03e-849d6d1bd0c9 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Acquiring lock "6d92f7e3-6f70-4344-9f15-9815d51024b6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:53:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-e7da77cf-fa8f-4bad-a03e-849d6d1bd0c9 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "6d92f7e3-6f70-4344-9f15-9815d51024b6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:53:34 user nova-compute[71113]: DEBUG nova.objects.instance [None req-e7da77cf-fa8f-4bad-a03e-849d6d1bd0c9 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lazy-loading 'flavor' on Instance uuid 6d92f7e3-6f70-4344-9f15-9815d51024b6 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:53:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-e7da77cf-fa8f-4bad-a03e-849d6d1bd0c9 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "6d92f7e3-6f70-4344-9f15-9815d51024b6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:53:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-e7da77cf-fa8f-4bad-a03e-849d6d1bd0c9 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Acquiring lock "6d92f7e3-6f70-4344-9f15-9815d51024b6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:53:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-e7da77cf-fa8f-4bad-a03e-849d6d1bd0c9 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "6d92f7e3-6f70-4344-9f15-9815d51024b6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:53:34 user nova-compute[71113]: INFO nova.compute.manager [None req-e7da77cf-fa8f-4bad-a03e-849d6d1bd0c9 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Attaching volume 4ea6b7be-5366-487b-934f-2123377c7c29 to /dev/vdb
Jul 31 09:53:34 user nova-compute[71113]: DEBUG os_brick.utils [None req-e7da77cf-fa8f-4bad-a03e-849d6d1bd0c9 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:53:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:34 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5ca968-379e-4f0f-b3d7-0c37abbc81e8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1bbadd0-a58a-489e-bac5-b7cb26c87273]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0d66a6-c08c-4541-8933-b9a48d604e0c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab803bb-eb90-475a-9aef-eec196ef3748]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-e7da77cf-fa8f-4bad-a03e-849d6d1bd0c9 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-e7da77cf-fa8f-4bad-a03e-849d6d1bd0c9 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:53:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e7da77cf-fa8f-4bad-a03e-849d6d1bd0c9 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 09:53:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:53:35 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 09:53:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[97fb4c9d-f5a4-4c5a-b8c9-43ab3ebceb8a]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-e7da77cf-fa8f-4bad-a03e-849d6d1bd0c9 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 09:53:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-e7da77cf-fa8f-4bad-a03e-849d6d1bd0c9 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 09:53:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-e7da77cf-fa8f-4bad-a03e-849d6d1bd0c9 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 09:53:35 user nova-compute[71113]: DEBUG os_brick.utils [None req-e7da77cf-fa8f-4bad-a03e-849d6d1bd0c9 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:53:35 user nova-compute[71113]: DEBUG nova.virt.block_device [None req-e7da77cf-fa8f-4bad-a03e-849d6d1bd0c9 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Updating existing volume attachment record: 63b2580e-0ab3-4271-9fd9-ab2b96a5dd60 {{(pid=71113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 09:53:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:35 user nova-compute[71113]: DEBUG nova.network.neutron [req-30ce8894-7ef1-4144-84b5-ed085bd1f8ee req-3e7cf778-7a35-4e43-97ad-b3b3dee13ded service nova] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Updated VIF entry in instance network info cache for port 72cf4ec9-ac91-4f38-a4f5-9859bb5138bf. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:53:35 user nova-compute[71113]: DEBUG nova.network.neutron [req-30ce8894-7ef1-4144-84b5-ed085bd1f8ee req-3e7cf778-7a35-4e43-97ad-b3b3dee13ded service nova] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Updating instance_info_cache with network_info: [{"id": "72cf4ec9-ac91-4f38-a4f5-9859bb5138bf", "address": "fa:16:3e:07:7b:f4", "network": {"id": "8c75ddf2-700c-4f01-b8cf-af57bdab7d37", "bridge": "br-int", "label": "tempest-TestStampPattern-1367141606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60e95a8fd2446d5bd5308f10caa6930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72cf4ec9-ac", "ovs_interfaceid": "72cf4ec9-ac91-4f38-a4f5-9859bb5138bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:53:35 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-30ce8894-7ef1-4144-84b5-ed085bd1f8ee req-3e7cf778-7a35-4e43-97ad-b3b3dee13ded service nova] Releasing lock "refresh_cache-6d92f7e3-6f70-4344-9f15-9815d51024b6" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:53:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:40 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20616644-b335-4168-a8b7-b90ed30331c1 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 09:53:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-20616644-b335-4168-a8b7-b90ed30331c1 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:992a3e11-6a5b-4aa7-810a-137ddac140a6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZdShqXte', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:53:40 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-20616644-b335-4168-a8b7-b90ed30331c1 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:53:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-20616644-b335-4168-a8b7-b90ed30331c1 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:53:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-20616644-b335-4168-a8b7-b90ed30331c1 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:53:40 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-20616644-b335-4168-a8b7-b90ed30331c1 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:53:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-20616644-b335-4168-a8b7-b90ed30331c1 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:992a3e11-6a5b-4aa7-810a-137ddac140a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:53:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-20616644-b335-4168-a8b7-b90ed30331c1 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:992a3e11-6a5b-4aa7-810a-137ddac140a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:53:40 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-20616644-b335-4168-a8b7-b90ed30331c1 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 09:53:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:992a3e11-6a5b-4aa7-810a-137ddac140a6 -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:992a3e11-6a5b-4aa7-810a-137ddac140a6 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:40 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[32297458-019a-4367-8bf6-c1916d06700d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-20616644-b335-4168-a8b7-b90ed30331c1 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 09:53:40 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:53:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:992a3e11-6a5b-4aa7-810a-137ddac140a6 -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:992a3e11-6a5b-4aa7-810a-137ddac140a6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:40 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec97d8b2-4366-4efe-a30e-b45e3db27dca]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:992a3e11-6a5b-4aa7-810a-137ddac140a6] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-20616644-b335-4168-a8b7-b90ed30331c1 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:992a3e11-6a5b-4aa7-810a-137ddac140a6] added
Jul 31 09:53:40 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:53:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:992a3e11-6a5b-4aa7-810a-137ddac140a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:992a3e11-6a5b-4aa7-810a-137ddac140a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:40 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[302fad47-cc60-4e3a-86d9-eb9bb087b224]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-20616644-b335-4168-a8b7-b90ed30331c1 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:53:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:992a3e11-6a5b-4aa7-810a-137ddac140a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:992a3e11-6a5b-4aa7-810a-137ddac140a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:40 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[69574d49-e6ef-444f-bf32-d06da1675305]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-20616644-b335-4168-a8b7-b90ed30331c1 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:53:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:992a3e11-6a5b-4aa7-810a-137ddac140a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZdShqXte {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:992a3e11-6a5b-4aa7-810a-137ddac140a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZdShqXte" returned: 0 in 0.025s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:40 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b55bc3-1ce4-4e81-94cd-ad0c4e0bf791]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-20616644-b335-4168-a8b7-b90ed30331c1 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZdShqXte'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:53:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:992a3e11-6a5b-4aa7-810a-137ddac140a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:40 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:992a3e11-6a5b-4aa7-810a-137ddac140a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:40 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65cfb2d-fdae-4fd2-a2a4-07da2a003ad1]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-20616644-b335-4168-a8b7-b90ed30331c1 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:53:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:40 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7a4f70-da88-488c-a8a0-385b9c1f9f41]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-20616644-b335-4168-a8b7-b90ed30331c1 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:53:40 user nova-compute[71113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)
Jul 31 09:53:40 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:53:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-20616644-b335-4168-a8b7-b90ed30331c1 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:53:40 user nova-compute[71113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)
Jul 31 09:53:40 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:53:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:992a3e11-6a5b-4aa7-810a-137ddac140a6 -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:992a3e11-6a5b-4aa7-810a-137ddac140a6 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:40 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7411e3-5732-4dd1-ace3-bcfd43b46cfc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:992a3e11-6a5b-4aa7-810a-137ddac140a6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:992a3e11-6a5b-4aa7-810a-137ddac140a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-20616644-b335-4168-a8b7-b90ed30331c1 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:992a3e11-6a5b-4aa7-810a-137ddac140a6, portal: 172.16.0.220,3260]
Jul 31 09:53:40 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:992a3e11-6a5b-4aa7-810a-137ddac140a6, portal: 172.16.0.220,3260] successful.
Jul 31 09:53:40 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:53:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:992a3e11-6a5b-4aa7-810a-137ddac140a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:992a3e11-6a5b-4aa7-810a-137ddac140a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:40 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1248a296-c7b1-47b7-97a1-bf4bb268879a]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-20616644-b335-4168-a8b7-b90ed30331c1 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:53:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:40 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1bc40e-1db4-4a9b-9670-d19404e0fae3]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992a3e11-6a5b-4aa7-810a-137ddac140a6 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-20616644-b335-4168-a8b7-b90ed30331c1 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:53:40 user nova-compute[71113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)
Jul 31 09:53:40 user nova-compute[71113]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992a3e11-6a5b-4aa7-810a-137ddac140a6 (non-flash)
Jul 31 09:53:40 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:53:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-20616644-b335-4168-a8b7-b90ed30331c1 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:53:40 user nova-compute[71113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)
Jul 31 09:53:40 user nova-compute[71113]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992a3e11-6a5b-4aa7-810a-137ddac140a6 (non-flash)
Jul 31 09:53:40 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:53:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-20616644-b335-4168-a8b7-b90ed30331c1 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:992a3e11-6a5b-4aa7-810a-137ddac140a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:53:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-20616644-b335-4168-a8b7-b90ed30331c1 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 09:53:40 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-20616644-b335-4168-a8b7-b90ed30331c1 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 09:53:40 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-20616644-b335-4168-a8b7-b90ed30331c1 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 09:53:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:40 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb2edd9-6448-41fb-8029-4d09cc4db9d3]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:40 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-20616644-b335-4168-a8b7-b90ed30331c1 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 09:53:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-20616644-b335-4168-a8b7-b90ed30331c1 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZdShqXte', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 09:53:41 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-20616644-b335-4168-a8b7-b90ed30331c1 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.391s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:53:41 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-20616644-b335-4168-a8b7-b90ed30331c1 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] <== connect_volume: return (1392ms) {'type': 'block', 'scsi_wwn': '26662333838303537', 'path': '/dev/sdc'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:53:41 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20616644-b335-4168-a8b7-b90ed30331c1 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662333838303537', 'path': '/dev/sdc'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 09:53:41 user nova-compute[71113]: DEBUG nova.objects.instance [None req-20616644-b335-4168-a8b7-b90ed30331c1 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Lazy-loading 'flavor' on Instance uuid af1f4e7c-b336-457a-94cc-3df3c3203370 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:53:41 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-20616644-b335-4168-a8b7-b90ed30331c1 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 09:53:41 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:53:41 user nova-compute[71113]:   <source dev="/dev/sdc"/>
Jul 31 09:53:41 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 09:53:41 user nova-compute[71113]:   <serial>992a3e11-6a5b-4aa7-810a-137ddac140a6</serial>
Jul 31 09:53:41 user nova-compute[71113]: </disk>
Jul 31 09:53:41 user nova-compute[71113]:  {{(pid=71113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 09:53:42 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-20616644-b335-4168-a8b7-b90ed30331c1 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:53:42 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-20616644-b335-4168-a8b7-b90ed30331c1 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] No BDM found with device name hda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:53:42 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-20616644-b335-4168-a8b7-b90ed30331c1 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] No VIF found with MAC fa:16:3e:64:ce:90, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 09:53:42 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-20616644-b335-4168-a8b7-b90ed30331c1 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Lock "af1f4e7c-b336-457a-94cc-3df3c3203370" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.272s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:53:42 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7da77cf-fa8f-4bad-a03e-849d6d1bd0c9 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 09:53:42 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7da77cf-fa8f-4bad-a03e-849d6d1bd0c9 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4ea6b7be-5366-487b-934f-2123377c7c29'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RLGkIuei', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:53:42 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-e7da77cf-fa8f-4bad-a03e-849d6d1bd0c9 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:53:42 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-e7da77cf-fa8f-4bad-a03e-849d6d1bd0c9 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:53:42 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-e7da77cf-fa8f-4bad-a03e-849d6d1bd0c9 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:53:42 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-e7da77cf-fa8f-4bad-a03e-849d6d1bd0c9 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:53:42 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-e7da77cf-fa8f-4bad-a03e-849d6d1bd0c9 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ea6b7be-5366-487b-934f-2123377c7c29" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:53:42 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-e7da77cf-fa8f-4bad-a03e-849d6d1bd0c9 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ea6b7be-5366-487b-934f-2123377c7c29" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:53:42 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-e7da77cf-fa8f-4bad-a03e-849d6d1bd0c9 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 09:53:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ea6b7be-5366-487b-934f-2123377c7c29 -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ea6b7be-5366-487b-934f-2123377c7c29 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:42 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9c6ee1-6765-4332-a11d-8ca6a6557cc4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:42 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7da77cf-fa8f-4bad-a03e-849d6d1bd0c9 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 09:53:42 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:53:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ea6b7be-5366-487b-934f-2123377c7c29 -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ea6b7be-5366-487b-934f-2123377c7c29 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:42 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e9e0a2-79c1-4139-82e0-c91db3620098]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ea6b7be-5366-487b-934f-2123377c7c29] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:42 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7da77cf-fa8f-4bad-a03e-849d6d1bd0c9 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ea6b7be-5366-487b-934f-2123377c7c29] added
Jul 31 09:53:42 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:53:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ea6b7be-5366-487b-934f-2123377c7c29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ea6b7be-5366-487b-934f-2123377c7c29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:42 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c2e9c4-05f9-4a10-9948-2866bc8bdde2]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:42 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7da77cf-fa8f-4bad-a03e-849d6d1bd0c9 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:53:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ea6b7be-5366-487b-934f-2123377c7c29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ea6b7be-5366-487b-934f-2123377c7c29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:42 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca772d0-96a8-468e-91b6-45b3f14f791d]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:42 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7da77cf-fa8f-4bad-a03e-849d6d1bd0c9 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:53:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ea6b7be-5366-487b-934f-2123377c7c29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RLGkIuei {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ea6b7be-5366-487b-934f-2123377c7c29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RLGkIuei" returned: 0 in 0.028s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:42 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9796fe-ed00-4bea-8ea1-0c6e90dfffd2]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:42 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7da77cf-fa8f-4bad-a03e-849d6d1bd0c9 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RLGkIuei'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:53:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ea6b7be-5366-487b-934f-2123377c7c29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ea6b7be-5366-487b-934f-2123377c7c29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:42 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f16193-b13c-4823-a885-f62a55ec2ae3]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:42 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7da77cf-fa8f-4bad-a03e-849d6d1bd0c9 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:53:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:42 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad426a34-e4d4-4198-9ac7-5b94f6ce3e72]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992a3e11-6a5b-4aa7-810a-137ddac140a6 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:42 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7da77cf-fa8f-4bad-a03e-849d6d1bd0c9 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:53:42 user nova-compute[71113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)
Jul 31 09:53:42 user nova-compute[71113]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992a3e11-6a5b-4aa7-810a-137ddac140a6 (non-flash)
Jul 31 09:53:42 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:53:42 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7da77cf-fa8f-4bad-a03e-849d6d1bd0c9 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:53:42 user nova-compute[71113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)
Jul 31 09:53:42 user nova-compute[71113]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992a3e11-6a5b-4aa7-810a-137ddac140a6 (non-flash)
Jul 31 09:53:42 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:53:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ea6b7be-5366-487b-934f-2123377c7c29 -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ea6b7be-5366-487b-934f-2123377c7c29 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:42 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[38deb670-1de9-4238-a5ce-d3e38f462356]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ea6b7be-5366-487b-934f-2123377c7c29, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4ea6b7be-5366-487b-934f-2123377c7c29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:42 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7da77cf-fa8f-4bad-a03e-849d6d1bd0c9 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ea6b7be-5366-487b-934f-2123377c7c29, portal: 172.16.0.220,3260]
Jul 31 09:53:42 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:4ea6b7be-5366-487b-934f-2123377c7c29, portal: 172.16.0.220,3260] successful.
Jul 31 09:53:42 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:53:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ea6b7be-5366-487b-934f-2123377c7c29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ea6b7be-5366-487b-934f-2123377c7c29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:43 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7de73d5-ce64-41a9-9d3b-a1017b44fa56]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:43 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7da77cf-fa8f-4bad-a03e-849d6d1bd0c9 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:53:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:43 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a0dbb1-61b2-4963-b2c4-b3966cbc9355]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992a3e11-6a5b-4aa7-810a-137ddac140a6 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ea6b7be-5366-487b-934f-2123377c7c29 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:43 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7da77cf-fa8f-4bad-a03e-849d6d1bd0c9 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:53:43 user nova-compute[71113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)
Jul 31 09:53:43 user nova-compute[71113]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992a3e11-6a5b-4aa7-810a-137ddac140a6 (non-flash)
Jul 31 09:53:43 user nova-compute[71113]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ea6b7be-5366-487b-934f-2123377c7c29 (non-flash)
Jul 31 09:53:43 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:53:43 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7da77cf-fa8f-4bad-a03e-849d6d1bd0c9 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:53:43 user nova-compute[71113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)
Jul 31 09:53:43 user nova-compute[71113]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992a3e11-6a5b-4aa7-810a-137ddac140a6 (non-flash)
Jul 31 09:53:43 user nova-compute[71113]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ea6b7be-5366-487b-934f-2123377c7c29 (non-flash)
Jul 31 09:53:43 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:53:43 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-e7da77cf-fa8f-4bad-a03e-849d6d1bd0c9 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ea6b7be-5366-487b-934f-2123377c7c29" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:53:43 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7da77cf-fa8f-4bad-a03e-849d6d1bd0c9 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 09:53:43 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-e7da77cf-fa8f-4bad-a03e-849d6d1bd0c9 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] HCTL ('36', '-', '-', 0) found on session 23 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 09:53:43 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-e7da77cf-fa8f-4bad-a03e-849d6d1bd0c9 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 09:53:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:43 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4150a5-f7ce-43a9-af09-270079eac492]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:43 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-e7da77cf-fa8f-4bad-a03e-849d6d1bd0c9 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Searching for a device in session 23 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 09:53:43 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7da77cf-fa8f-4bad-a03e-849d6d1bd0c9 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RLGkIuei', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 09:53:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-17840d4f-d937-4fe7-94ab-ea61da4127c9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Acquiring lock "af1f4e7c-b336-457a-94cc-3df3c3203370" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:53:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-17840d4f-d937-4fe7-94ab-ea61da4127c9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Lock "af1f4e7c-b336-457a-94cc-3df3c3203370" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:53:43 user nova-compute[71113]: INFO nova.compute.manager [None req-17840d4f-d937-4fe7-94ab-ea61da4127c9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Detaching volume 992a3e11-6a5b-4aa7-810a-137ddac140a6
Jul 31 09:53:43 user nova-compute[71113]: INFO nova.virt.block_device [None req-17840d4f-d937-4fe7-94ab-ea61da4127c9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Attempting to driver detach volume 992a3e11-6a5b-4aa7-810a-137ddac140a6 from mountpoint /dev/vdb
Jul 31 09:53:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-17840d4f-d937-4fe7-94ab-ea61da4127c9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Attempting to detach device vdb from instance af1f4e7c-b336-457a-94cc-3df3c3203370 from the persistent domain config. {{(pid=71113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 09:53:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-17840d4f-d937-4fe7-94ab-ea61da4127c9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 09:53:43 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:53:43 user nova-compute[71113]:   <source dev="/dev/sdc"/>
Jul 31 09:53:43 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 09:53:43 user nova-compute[71113]:   <serial>992a3e11-6a5b-4aa7-810a-137ddac140a6</serial>
Jul 31 09:53:43 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 31 09:53:43 user nova-compute[71113]: </disk>
Jul 31 09:53:43 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 09:53:43 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-17840d4f-d937-4fe7-94ab-ea61da4127c9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Successfully detached device vdb from instance af1f4e7c-b336-457a-94cc-3df3c3203370 from the persistent domain config.
Jul 31 09:53:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-17840d4f-d937-4fe7-94ab-ea61da4127c9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance af1f4e7c-b336-457a-94cc-3df3c3203370 from the live domain config. {{(pid=71113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 09:53:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-17840d4f-d937-4fe7-94ab-ea61da4127c9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 09:53:43 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:53:43 user nova-compute[71113]:   <source dev="/dev/sdc"/>
Jul 31 09:53:43 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 09:53:43 user nova-compute[71113]:   <serial>992a3e11-6a5b-4aa7-810a-137ddac140a6</serial>
Jul 31 09:53:43 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 31 09:53:43 user nova-compute[71113]: </disk>
Jul 31 09:53:43 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 09:53:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ab22e226-16b5-4bc8-8044-d839ebf4c4a5 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Acquiring lock "e133dba2-7426-493b-8282-ed18f3ca0a4a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:53:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ab22e226-16b5-4bc8-8044-d839ebf4c4a5 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Lock "e133dba2-7426-493b-8282-ed18f3ca0a4a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:53:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ab22e226-16b5-4bc8-8044-d839ebf4c4a5 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Acquiring lock "e133dba2-7426-493b-8282-ed18f3ca0a4a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:53:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ab22e226-16b5-4bc8-8044-d839ebf4c4a5 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Lock "e133dba2-7426-493b-8282-ed18f3ca0a4a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:53:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ab22e226-16b5-4bc8-8044-d839ebf4c4a5 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Lock "e133dba2-7426-493b-8282-ed18f3ca0a4a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:53:43 user nova-compute[71113]: INFO nova.compute.manager [None req-ab22e226-16b5-4bc8-8044-d839ebf4c4a5 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Terminating instance
Jul 31 09:53:43 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ab22e226-16b5-4bc8-8044-d839ebf4c4a5 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Start destroying the instance on the hypervisor. {{(pid=71113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 09:53:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:43 user nova-compute[71113]: DEBUG nova.compute.manager [req-d7288223-9a71-4f27-a080-4a27c005529f req-765899df-50f1-4f89-8bad-f54455a51ec4 service nova] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Received event network-vif-unplugged-a56e7fa6-233e-4350-a592-69ecda6dc74e {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:53:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-d7288223-9a71-4f27-a080-4a27c005529f req-765899df-50f1-4f89-8bad-f54455a51ec4 service nova] Acquiring lock "e133dba2-7426-493b-8282-ed18f3ca0a4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:53:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-d7288223-9a71-4f27-a080-4a27c005529f req-765899df-50f1-4f89-8bad-f54455a51ec4 service nova] Lock "e133dba2-7426-493b-8282-ed18f3ca0a4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:53:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-d7288223-9a71-4f27-a080-4a27c005529f req-765899df-50f1-4f89-8bad-f54455a51ec4 service nova] Lock "e133dba2-7426-493b-8282-ed18f3ca0a4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:53:43 user nova-compute[71113]: DEBUG nova.compute.manager [req-d7288223-9a71-4f27-a080-4a27c005529f req-765899df-50f1-4f89-8bad-f54455a51ec4 service nova] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] No waiting events found dispatching network-vif-unplugged-a56e7fa6-233e-4350-a592-69ecda6dc74e {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:53:43 user nova-compute[71113]: DEBUG nova.compute.manager [req-d7288223-9a71-4f27-a080-4a27c005529f req-765899df-50f1-4f89-8bad-f54455a51ec4 service nova] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Received event network-vif-unplugged-a56e7fa6-233e-4350-a592-69ecda6dc74e for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 09:53:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Received event <DeviceRemovedEvent: 1690797223.9009333, af1f4e7c-b336-457a-94cc-3df3c3203370 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71113) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 09:53:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-17840d4f-d937-4fe7-94ab-ea61da4127c9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance af1f4e7c-b336-457a-94cc-3df3c3203370 {{(pid=71113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 09:53:43 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-17840d4f-d937-4fe7-94ab-ea61da4127c9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Successfully detached device vdb from instance af1f4e7c-b336-457a-94cc-3df3c3203370 from the live domain config.
Jul 31 09:53:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17840d4f-d937-4fe7-94ab-ea61da4127c9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 09:53:43 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-17840d4f-d937-4fe7-94ab-ea61da4127c9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:992a3e11-6a5b-4aa7-810a-137ddac140a6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZdShqXte', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:53:43 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-17840d4f-d937-4fe7-94ab-ea61da4127c9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:53:43 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-17840d4f-d937-4fe7-94ab-ea61da4127c9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:53:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-e7da77cf-fa8f-4bad-a03e-849d6d1bd0c9 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7da77cf-fa8f-4bad-a03e-849d6d1bd0c9 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23536333362353336', 'path': '/dev/sde'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7da77cf-fa8f-4bad-a03e-849d6d1bd0c9 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23536333362353336', 'path': '/dev/sde'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-17840d4f-d937-4fe7-94ab-ea61da4127c9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.176s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-17840d4f-d937-4fe7-94ab-ea61da4127c9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:992a3e11-6a5b-4aa7-810a-137ddac140a6', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG nova.objects.instance [None req-e7da77cf-fa8f-4bad-a03e-849d6d1bd0c9 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lazy-loading 'flavor' on Instance uuid 6d92f7e3-6f70-4344-9f15-9815d51024b6 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f2d7b4-19c9-413d-a6b2-7933f022e983]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ea6b7be-5366-487b-934f-2123377c7c29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:992a3e11-6a5b-4aa7-810a-137ddac140a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-e7da77cf-fa8f-4bad-a03e-849d6d1bd0c9 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 09:53:44 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:53:44 user nova-compute[71113]:   <source dev="/dev/sde"/>
Jul 31 09:53:44 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 09:53:44 user nova-compute[71113]:   <serial>4ea6b7be-5366-487b-934f-2123377c7c29</serial>
Jul 31 09:53:44 user nova-compute[71113]: </disk>
Jul 31 09:53:44 user nova-compute[71113]:  {{(pid=71113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd7b389-17eb-4afa-bee1-fe7e67f9d2ca]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992a3e11-6a5b-4aa7-810a-137ddac140a6 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ea6b7be-5366-487b-934f-2123377c7c29 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-17840d4f-d937-4fe7-94ab-ea61da4127c9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:53:44 user nova-compute[71113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)
Jul 31 09:53:44 user nova-compute[71113]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992a3e11-6a5b-4aa7-810a-137ddac140a6 (non-flash)
Jul 31 09:53:44 user nova-compute[71113]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ea6b7be-5366-487b-934f-2123377c7c29 (non-flash)
Jul 31 09:53:44 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-17840d4f-d937-4fe7-94ab-ea61da4127c9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:53:44 user nova-compute[71113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)
Jul 31 09:53:44 user nova-compute[71113]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:992a3e11-6a5b-4aa7-810a-137ddac140a6 (non-flash)
Jul 31 09:53:44 user nova-compute[71113]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ea6b7be-5366-487b-934f-2123377c7c29 (non-flash)
Jul 31 09:53:44 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-17840d4f-d937-4fe7-94ab-ea61da4127c9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f78f06528c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:992a3e11-6a5b-4aa7-810a-137ddac140a6'): ({'sdc'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-17840d4f-d937-4fe7-94ab-ea61da4127c9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Removing single pathed devices sdc {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24ff1c4-614d-4ca6-8b2b-7434e586b9de]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf18ee00-70c1-446e-ad75-0d4070c521b7]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-17840d4f-d937-4fe7-94ab-ea61da4127c9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Flushing IO for device /dev/sdc {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ec5302-2563-4ed1-8222-f261b778f235]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-17840d4f-d937-4fe7-94ab-ea61da4127c9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[82106512-a5aa-440d-8bc9-1412c490dc0e]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-17840d4f-d937-4fe7-94ab-ea61da4127c9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-17840d4f-d937-4fe7-94ab-ea61da4127c9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] SCSI volumes sdc have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-17840d4f-d937-4fe7-94ab-ea61da4127c9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:992a3e11-6a5b-4aa7-810a-137ddac140a6')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:992a3e11-6a5b-4aa7-810a-137ddac140a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:992a3e11-6a5b-4aa7-810a-137ddac140a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65e92e1-631c-482b-a63f-3ecb29d2f00d]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-17840d4f-d937-4fe7-94ab-ea61da4127c9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:992a3e11-6a5b-4aa7-810a-137ddac140a6 -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:992a3e11-6a5b-4aa7-810a-137ddac140a6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.094s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c81b7ce-2975-4d4a-a95f-87f6d7e92caa]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:992a3e11-6a5b-4aa7-810a-137ddac140a6, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:992a3e11-6a5b-4aa7-810a-137ddac140a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-17840d4f-d937-4fe7-94ab-ea61da4127c9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:992a3e11-6a5b-4aa7-810a-137ddac140a6, portal: 172.16.0.220,3260]
Jul 31 09:53:44 user nova-compute[71113]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:992a3e11-6a5b-4aa7-810a-137ddac140a6, portal: 172.16.0.220,3260] successful.
Jul 31 09:53:44 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:992a3e11-6a5b-4aa7-810a-137ddac140a6 -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:992a3e11-6a5b-4aa7-810a-137ddac140a6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce6dd44-6431-432a-b08f-300688de353b]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-17840d4f-d937-4fe7-94ab-ea61da4127c9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-17840d4f-d937-4fe7-94ab-ea61da4127c9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-17840d4f-d937-4fe7-94ab-ea61da4127c9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] <== disconnect_volume: return (536ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17840d4f-d937-4fe7-94ab-ea61da4127c9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:44 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Instance destroyed successfully.
Jul 31 09:53:44 user nova-compute[71113]: DEBUG nova.objects.instance [None req-ab22e226-16b5-4bc8-8044-d839ebf4c4a5 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Lazy-loading 'resources' on Instance uuid e133dba2-7426-493b-8282-ed18f3ca0a4a {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-ab22e226-16b5-4bc8-8044-d839ebf4c4a5 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:51:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-736446436',display_name='tempest-ServersNegativeTestJSON-server-736446436',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-736446436',id=19,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:51:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f88c00df40f46178f46c09cf14b88d7',ramdisk_id='',reservation_id='r-y9bunrrv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1314085245',owner_user_name='tempest-ServersNegativeTestJSON-1314085245-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:52:00Z,user_data=None,user_id='7b3fa9245be64500b9879cf4624ecdc9',uuid=e133dba2-7426-493b-8282-ed18f3ca0a4a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a56e7fa6-233e-4350-a592-69ecda6dc74e", "address": "fa:16:3e:8c:85:ff", "network": {"id": "4ab5c9f4-e78f-4bf2-bc82-ef698b714952", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1047934668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f88c00df40f46178f46c09cf14b88d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa56e7fa6-23", "ovs_interfaceid": "a56e7fa6-233e-4350-a592-69ecda6dc74e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-ab22e226-16b5-4bc8-8044-d839ebf4c4a5 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Converting VIF {"id": "a56e7fa6-233e-4350-a592-69ecda6dc74e", "address": "fa:16:3e:8c:85:ff", "network": {"id": "4ab5c9f4-e78f-4bf2-bc82-ef698b714952", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1047934668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f88c00df40f46178f46c09cf14b88d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa56e7fa6-23", "ovs_interfaceid": "a56e7fa6-233e-4350-a592-69ecda6dc74e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-ab22e226-16b5-4bc8-8044-d839ebf4c4a5 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:85:ff,bridge_name='br-int',has_traffic_filtering=True,id=a56e7fa6-233e-4350-a592-69ecda6dc74e,network=Network(4ab5c9f4-e78f-4bf2-bc82-ef698b714952),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa56e7fa6-23') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG os_vif [None req-ab22e226-16b5-4bc8-8044-d839ebf4c4a5 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:85:ff,bridge_name='br-int',has_traffic_filtering=True,id=a56e7fa6-233e-4350-a592-69ecda6dc74e,network=Network(4ab5c9f4-e78f-4bf2-bc82-ef698b714952),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa56e7fa6-23') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa56e7fa6-23, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:44 user nova-compute[71113]: INFO os_vif [None req-ab22e226-16b5-4bc8-8044-d839ebf4c4a5 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:85:ff,bridge_name='br-int',has_traffic_filtering=True,id=a56e7fa6-233e-4350-a592-69ecda6dc74e,network=Network(4ab5c9f4-e78f-4bf2-bc82-ef698b714952),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa56e7fa6-23')
Jul 31 09:53:44 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-ab22e226-16b5-4bc8-8044-d839ebf4c4a5 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Deleting instance files /opt/stack/data/nova/instances/e133dba2-7426-493b-8282-ed18f3ca0a4a_del
Jul 31 09:53:44 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-ab22e226-16b5-4bc8-8044-d839ebf4c4a5 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Deletion of /opt/stack/data/nova/instances/e133dba2-7426-493b-8282-ed18f3ca0a4a_del complete
Jul 31 09:53:44 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-e7da77cf-fa8f-4bad-a03e-849d6d1bd0c9 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-e7da77cf-fa8f-4bad-a03e-849d6d1bd0c9 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-e7da77cf-fa8f-4bad-a03e-849d6d1bd0c9 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] No VIF found with MAC fa:16:3e:07:7b:f4, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 09:53:44 user nova-compute[71113]: INFO nova.compute.manager [None req-ab22e226-16b5-4bc8-8044-d839ebf4c4a5 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Took 1.30 seconds to destroy the instance on the hypervisor.
Jul 31 09:53:44 user nova-compute[71113]: DEBUG oslo.service.loopingcall [None req-ab22e226-16b5-4bc8-8044-d839ebf4c4a5 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71113) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG nova.compute.manager [-] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Deallocating network for instance {{(pid=71113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] deallocate_for_instance() {{(pid=71113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 09:53:44 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-e7da77cf-fa8f-4bad-a03e-849d6d1bd0c9 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "6d92f7e3-6f70-4344-9f15-9815d51024b6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.154s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:53:45 user nova-compute[71113]: DEBUG nova.objects.instance [None req-17840d4f-d937-4fe7-94ab-ea61da4127c9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Lazy-loading 'flavor' on Instance uuid af1f4e7c-b336-457a-94cc-3df3c3203370 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:53:45 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:53:45 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Took 0.52 seconds to deallocate network for instance.
Jul 31 09:53:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-17840d4f-d937-4fe7-94ab-ea61da4127c9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Lock "af1f4e7c-b336-457a-94cc-3df3c3203370" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.094s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:53:45 user nova-compute[71113]: DEBUG nova.compute.manager [req-910df5b1-e58b-4950-a317-46d4d1b9bc50 req-6bb9c97b-74ac-4728-a115-851330e275b1 service nova] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Received event network-vif-deleted-a56e7fa6-233e-4350-a592-69ecda6dc74e {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:53:45 user nova-compute[71113]: INFO nova.compute.manager [req-910df5b1-e58b-4950-a317-46d4d1b9bc50 req-6bb9c97b-74ac-4728-a115-851330e275b1 service nova] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Neutron deleted interface a56e7fa6-233e-4350-a592-69ecda6dc74e; detaching it from the instance and deleting it from the info cache
Jul 31 09:53:45 user nova-compute[71113]: DEBUG nova.network.neutron [req-910df5b1-e58b-4950-a317-46d4d1b9bc50 req-6bb9c97b-74ac-4728-a115-851330e275b1 service nova] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:53:45 user nova-compute[71113]: DEBUG nova.compute.manager [req-910df5b1-e58b-4950-a317-46d4d1b9bc50 req-6bb9c97b-74ac-4728-a115-851330e275b1 service nova] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Detach interface failed, port_id=a56e7fa6-233e-4350-a592-69ecda6dc74e, reason: Instance e133dba2-7426-493b-8282-ed18f3ca0a4a could not be found. {{(pid=71113) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 09:53:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ab22e226-16b5-4bc8-8044-d839ebf4c4a5 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:53:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ab22e226-16b5-4bc8-8044-d839ebf4c4a5 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:53:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-3b9813fe-aecf-4976-bd93-f62f3569c0b9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Acquiring lock "interface-af1f4e7c-b336-457a-94cc-3df3c3203370-2fa349d3-4e53-4101-b101-4032d9560dc2" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:53:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-3b9813fe-aecf-4976-bd93-f62f3569c0b9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Lock "interface-af1f4e7c-b336-457a-94cc-3df3c3203370-2fa349d3-4e53-4101-b101-4032d9560dc2" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:53:45 user nova-compute[71113]: DEBUG nova.objects.instance [None req-3b9813fe-aecf-4976-bd93-f62f3569c0b9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Lazy-loading 'flavor' on Instance uuid af1f4e7c-b336-457a-94cc-3df3c3203370 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:53:45 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-3b9813fe-aecf-4976-bd93-f62f3569c0b9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T09:51:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-601671640',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-601671640',id=17,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrt/0N3rqkgPN6SuyXfpoCTkV9Bk0pcEdYe3hmzwwFIugD3ohq+ljDgxWA2owuO7ncn48ukAgrCkpv3bs19B971Yw7oJwFLv7z/1GwjZIhoKmL+3YWqpkWzV2dkY74VfA==',key_name='tempest-keypair-341346334',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:51:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c8a3ec2098864e8797f77f70e1784acd',ramdisk_id='',reservation_id='r-sijnqnb0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-740569977',owner_user_name='tempest-TaggedAttachmentsTest-740569977-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:51:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21f1d14ad39e4cd0b19e8484f1635344',uuid=af1f4e7c-b336-457a-94cc-3df3c3203370,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2fa349d3-4e53-4101-b101-4032d9560dc2", "address": "fa:16:3e:47:64:c0", "network": {"id": "6c6d62a0-47a1-4c17-9ec9-110146a5043b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-803239299", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c8a3ec2098864e8797f77f70e1784acd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fa349d3-4e", "ovs_interfaceid": "2fa349d3-4e53-4101-b101-4032d9560dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 09:53:45 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-3b9813fe-aecf-4976-bd93-f62f3569c0b9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Converting VIF {"id": "2fa349d3-4e53-4101-b101-4032d9560dc2", "address": "fa:16:3e:47:64:c0", "network": {"id": "6c6d62a0-47a1-4c17-9ec9-110146a5043b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-803239299", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c8a3ec2098864e8797f77f70e1784acd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fa349d3-4e", "ovs_interfaceid": "2fa349d3-4e53-4101-b101-4032d9560dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:53:45 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-3b9813fe-aecf-4976-bd93-f62f3569c0b9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:64:c0,bridge_name='br-int',has_traffic_filtering=True,id=2fa349d3-4e53-4101-b101-4032d9560dc2,network=Network(6c6d62a0-47a1-4c17-9ec9-110146a5043b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fa349d3-4e') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:53:45 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-3b9813fe-aecf-4976-bd93-f62f3569c0b9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:47:64:c0"/><model type="virtio"/><mtu size="1442"/><target dev="tap2fa349d3-4e"/></interface> {{(pid=71113) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 31 09:53:45 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-3b9813fe-aecf-4976-bd93-f62f3569c0b9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:47:64:c0"/><model type="virtio"/><mtu size="1442"/><target dev="tap2fa349d3-4e"/></interface> {{(pid=71113) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 31 09:53:45 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-3b9813fe-aecf-4976-bd93-f62f3569c0b9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Attempting to detach device tap2fa349d3-4e from instance af1f4e7c-b336-457a-94cc-3df3c3203370 from the persistent domain config. {{(pid=71113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 09:53:45 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-3b9813fe-aecf-4976-bd93-f62f3569c0b9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] detach device xml: <interface type="ethernet">
Jul 31 09:53:45 user nova-compute[71113]:   <mac address="fa:16:3e:47:64:c0"/>
Jul 31 09:53:45 user nova-compute[71113]:   <model type="virtio"/>
Jul 31 09:53:45 user nova-compute[71113]:   <mtu size="1442"/>
Jul 31 09:53:45 user nova-compute[71113]:   <target dev="tap2fa349d3-4e"/>
Jul 31 09:53:45 user nova-compute[71113]: </interface>
Jul 31 09:53:45 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 09:53:45 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-3b9813fe-aecf-4976-bd93-f62f3569c0b9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:47:64:c0"/><model type="virtio"/><mtu size="1442"/><target dev="tap2fa349d3-4e"/></interface> {{(pid=71113) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 31 09:53:45 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-3b9813fe-aecf-4976-bd93-f62f3569c0b9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:47:64:c0"/><model type="virtio"/><mtu size="1442"/><target dev="tap2fa349d3-4e"/></interface>not found in domain: <domain type='kvm' id='20'>
Jul 31 09:53:45 user nova-compute[71113]:   <name>instance-00000011</name>
Jul 31 09:53:45 user nova-compute[71113]:   <uuid>af1f4e7c-b336-457a-94cc-3df3c3203370</uuid>
Jul 31 09:53:45 user nova-compute[71113]:   <metadata>
Jul 31 09:53:45 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 09:53:45 user nova-compute[71113]:   <nova:package version="0.0.0"/>
Jul 31 09:53:45 user nova-compute[71113]:   <nova:name>tempest-device-tagging-server-601671640</nova:name>
Jul 31 09:53:45 user nova-compute[71113]:   <nova:creationTime>2023-07-31 09:53:31</nova:creationTime>
Jul 31 09:53:45 user nova-compute[71113]:   <nova:flavor name="m1.tiny">
Jul 31 09:53:45 user nova-compute[71113]:     <nova:memory>512</nova:memory>
Jul 31 09:53:45 user nova-compute[71113]:     <nova:disk>1</nova:disk>
Jul 31 09:53:45 user nova-compute[71113]:     <nova:swap>0</nova:swap>
Jul 31 09:53:45 user nova-compute[71113]:     <nova:ephemeral>0</nova:ephemeral>
Jul 31 09:53:45 user nova-compute[71113]:     <nova:vcpus>1</nova:vcpus>
Jul 31 09:53:45 user nova-compute[71113]:   </nova:flavor>
Jul 31 09:53:45 user nova-compute[71113]:   <nova:owner>
Jul 31 09:53:45 user nova-compute[71113]:     <nova:user uuid="21f1d14ad39e4cd0b19e8484f1635344">tempest-TaggedAttachmentsTest-740569977-project-member</nova:user>
Jul 31 09:53:45 user nova-compute[71113]:     <nova:project uuid="c8a3ec2098864e8797f77f70e1784acd">tempest-TaggedAttachmentsTest-740569977</nova:project>
Jul 31 09:53:45 user nova-compute[71113]:   </nova:owner>
Jul 31 09:53:45 user nova-compute[71113]:   <nova:root type="image" uuid="078646fe-b504-41ed-a147-61072e903e51"/>
Jul 31 09:53:45 user nova-compute[71113]:   <nova:ports>
Jul 31 09:53:45 user nova-compute[71113]:     <nova:port uuid="b57ab83c-c78e-424e-889b-b0156de15bfe">
Jul 31 09:53:45 user nova-compute[71113]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 31 09:53:45 user nova-compute[71113]:     </nova:port>
Jul 31 09:53:45 user nova-compute[71113]:     <nova:port uuid="2fa349d3-4e53-4101-b101-4032d9560dc2">
Jul 31 09:53:45 user nova-compute[71113]:       <nova:ip type="fixed" address="10.10.10.67" ipVersion="4"/>
Jul 31 09:53:45 user nova-compute[71113]:     </nova:port>
Jul 31 09:53:45 user nova-compute[71113]:   </nova:ports>
Jul 31 09:53:45 user nova-compute[71113]: </nova:instance>
Jul 31 09:53:45 user nova-compute[71113]:   </metadata>
Jul 31 09:53:45 user nova-compute[71113]:   <memory unit='KiB'>524288</memory>
Jul 31 09:53:45 user nova-compute[71113]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 31 09:53:45 user nova-compute[71113]:   <vcpu placement='static'>1</vcpu>
Jul 31 09:53:45 user nova-compute[71113]:   <resource>
Jul 31 09:53:45 user nova-compute[71113]:     <partition>/machine</partition>
Jul 31 09:53:45 user nova-compute[71113]:   </resource>
Jul 31 09:53:45 user nova-compute[71113]:   <sysinfo type='smbios'>
Jul 31 09:53:45 user nova-compute[71113]:     <system>
Jul 31 09:53:45 user nova-compute[71113]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 31 09:53:45 user nova-compute[71113]:       <entry name='product'>OpenStack Nova</entry>
Jul 31 09:53:45 user nova-compute[71113]:       <entry name='version'>0.0.0</entry>
Jul 31 09:53:45 user nova-compute[71113]:       <entry name='serial'>af1f4e7c-b336-457a-94cc-3df3c3203370</entry>
Jul 31 09:53:45 user nova-compute[71113]:       <entry name='uuid'>af1f4e7c-b336-457a-94cc-3df3c3203370</entry>
Jul 31 09:53:45 user nova-compute[71113]:       <entry name='family'>Virtual Machine</entry>
Jul 31 09:53:45 user nova-compute[71113]:     </system>
Jul 31 09:53:45 user nova-compute[71113]:   </sysinfo>
Jul 31 09:53:45 user nova-compute[71113]:   <os>
Jul 31 09:53:45 user nova-compute[71113]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 31 09:53:45 user nova-compute[71113]:     <boot dev='hd'/>
Jul 31 09:53:45 user nova-compute[71113]:     <smbios mode='sysinfo'/>
Jul 31 09:53:45 user nova-compute[71113]:   </os>
Jul 31 09:53:45 user nova-compute[71113]:   <features>
Jul 31 09:53:45 user nova-compute[71113]:     <acpi/>
Jul 31 09:53:45 user nova-compute[71113]:     <apic/>
Jul 31 09:53:45 user nova-compute[71113]:     <vmcoreinfo state='on'/>
Jul 31 09:53:45 user nova-compute[71113]:   </features>
Jul 31 09:53:45 user nova-compute[71113]:   <cpu mode='custom' match='exact' check='full'>
Jul 31 09:53:45 user nova-compute[71113]:     <model fallback='forbid'>Nehalem</model>
Jul 31 09:53:45 user nova-compute[71113]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 31 09:53:45 user nova-compute[71113]:     <feature policy='require' name='vme'/>
Jul 31 09:53:45 user nova-compute[71113]:     <feature policy='require' name='x2apic'/>
Jul 31 09:53:45 user nova-compute[71113]:     <feature policy='require' name='hypervisor'/>
Jul 31 09:53:45 user nova-compute[71113]:   </cpu>
Jul 31 09:53:45 user nova-compute[71113]:   <clock offset='utc'>
Jul 31 09:53:45 user nova-compute[71113]:     <timer name='pit' tickpolicy='delay'/>
Jul 31 09:53:45 user nova-compute[71113]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 31 09:53:45 user nova-compute[71113]:     <timer name='hpet' present='no'/>
Jul 31 09:53:45 user nova-compute[71113]:   </clock>
Jul 31 09:53:45 user nova-compute[71113]:   <on_poweroff>destroy</on_poweroff>
Jul 31 09:53:45 user nova-compute[71113]:   <on_reboot>restart</on_reboot>
Jul 31 09:53:45 user nova-compute[71113]:   <on_crash>destroy</on_crash>
Jul 31 09:53:45 user nova-compute[71113]:   <devices>
Jul 31 09:53:45 user nova-compute[71113]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 31 09:53:45 user nova-compute[71113]:     <disk type='file' device='disk'>
Jul 31 09:53:45 user nova-compute[71113]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 31 09:53:45 user nova-compute[71113]:       <source file='/opt/stack/data/nova/instances/af1f4e7c-b336-457a-94cc-3df3c3203370/disk' index='2'/>
Jul 31 09:53:45 user nova-compute[71113]:       <backingStore type='file' index='3'>
Jul 31 09:53:45 user nova-compute[71113]:         <format type='raw'/>
Jul 31 09:53:45 user nova-compute[71113]:         <source file='/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9'/>
Jul 31 09:53:45 user nova-compute[71113]:         <backingStore/>
Jul 31 09:53:45 user nova-compute[71113]:       </backingStore>
Jul 31 09:53:45 user nova-compute[71113]:       <target dev='vda' bus='virtio'/>
Jul 31 09:53:45 user nova-compute[71113]:       <alias name='virtio-disk0'/>
Jul 31 09:53:45 user nova-compute[71113]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 31 09:53:45 user nova-compute[71113]:     </disk>
Jul 31 09:53:45 user nova-compute[71113]:     <disk type='file' device='cdrom'>
Jul 31 09:53:45 user nova-compute[71113]:       <driver name='qemu' type='raw' cache='none'/>
Jul 31 09:53:45 user nova-compute[71113]:       <source file='/opt/stack/data/nova/instances/af1f4e7c-b336-457a-94cc-3df3c3203370/disk.config' index='1'/>
Jul 31 09:53:45 user nova-compute[71113]:       <backingStore/>
Jul 31 09:53:45 user nova-compute[71113]:       <target dev='hda' bus='ide'/>
Jul 31 09:53:45 user nova-compute[71113]:       <readonly/>
Jul 31 09:53:45 user nova-compute[71113]:       <alias name='ide0-0-0'/>
Jul 31 09:53:45 user nova-compute[71113]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 31 09:53:45 user nova-compute[71113]:     </disk>
Jul 31 09:53:45 user nova-compute[71113]:     <controller type='usb' index='0' model='none'>
Jul 31 09:53:45 user nova-compute[71113]:       <alias name='usb'/>
Jul 31 09:53:45 user nova-compute[71113]:     </controller>
Jul 31 09:53:45 user nova-compute[71113]:     <controller type='pci' index='0' model='pci-root'>
Jul 31 09:53:45 user nova-compute[71113]:       <alias name='pci.0'/>
Jul 31 09:53:45 user nova-compute[71113]:     </controller>
Jul 31 09:53:45 user nova-compute[71113]:     <controller type='ide' index='0'>
Jul 31 09:53:45 user nova-compute[71113]:       <alias name='ide'/>
Jul 31 09:53:45 user nova-compute[71113]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 31 09:53:45 user nova-compute[71113]:     </controller>
Jul 31 09:53:45 user nova-compute[71113]:     <interface type='ethernet'>
Jul 31 09:53:45 user nova-compute[71113]:       <mac address='fa:16:3e:64:ce:90'/>
Jul 31 09:53:45 user nova-compute[71113]:       <target dev='tapb57ab83c-c7'/>
Jul 31 09:53:45 user nova-compute[71113]:       <model type='virtio'/>
Jul 31 09:53:45 user nova-compute[71113]:       <mtu size='1442'/>
Jul 31 09:53:45 user nova-compute[71113]:       <alias name='net0'/>
Jul 31 09:53:45 user nova-compute[71113]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 31 09:53:45 user nova-compute[71113]:     </interface>
Jul 31 09:53:45 user nova-compute[71113]:     <interface type='ethernet'>
Jul 31 09:53:45 user nova-compute[71113]:       <mac address='fa:16:3e:47:64:c0'/>
Jul 31 09:53:45 user nova-compute[71113]:       <target dev='tap2fa349d3-4e'/>
Jul 31 09:53:45 user nova-compute[71113]:       <model type='virtio'/>
Jul 31 09:53:45 user nova-compute[71113]:       <mtu size='1442'/>
Jul 31 09:53:45 user nova-compute[71113]:       <alias name='net1'/>
Jul 31 09:53:45 user nova-compute[71113]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Jul 31 09:53:45 user nova-compute[71113]:     </interface>
Jul 31 09:53:45 user nova-compute[71113]:     <serial type='pty'>
Jul 31 09:53:45 user nova-compute[71113]:       <source path='/dev/pts/6'/>
Jul 31 09:53:45 user nova-compute[71113]:       <log file='/opt/stack/data/nova/instances/af1f4e7c-b336-457a-94cc-3df3c3203370/console.log' append='off'/>
Jul 31 09:53:45 user nova-compute[71113]:       <target type='isa-serial' port='0'>
Jul 31 09:53:45 user nova-compute[71113]:         <model name='isa-serial'/>
Jul 31 09:53:45 user nova-compute[71113]:       </target>
Jul 31 09:53:45 user nova-compute[71113]:       <alias name='serial0'/>
Jul 31 09:53:45 user nova-compute[71113]:     </serial>
Jul 31 09:53:45 user nova-compute[71113]:     <console type='pty' tty='/dev/pts/6'>
Jul 31 09:53:45 user nova-compute[71113]:       <source path='/dev/pts/6'/>
Jul 31 09:53:45 user nova-compute[71113]:       <log file='/opt/stack/data/nova/instances/af1f4e7c-b336-457a-94cc-3df3c3203370/console.log' append='off'/>
Jul 31 09:53:45 user nova-compute[71113]:       <target type='serial' port='0'/>
Jul 31 09:53:45 user nova-compute[71113]:       <alias name='serial0'/>
Jul 31 09:53:45 user nova-compute[71113]:     </console>
Jul 31 09:53:45 user nova-compute[71113]:     <input type='mouse' bus='ps2'>
Jul 31 09:53:45 user nova-compute[71113]:       <alias name='input0'/>
Jul 31 09:53:45 user nova-compute[71113]:     </input>
Jul 31 09:53:45 user nova-compute[71113]:     <input type='keyboard' bus='ps2'>
Jul 31 09:53:45 user nova-compute[71113]:       <alias name='input1'/>
Jul 31 09:53:45 user nova-compute[71113]:     </input>
Jul 31 09:53:45 user nova-compute[71113]:     <graphics type='vnc' port='5900' autoport='yes' listen='0.0.0.0'>
Jul 31 09:53:45 user nova-compute[71113]:       <listen type='address' address='0.0.0.0'/>
Jul 31 09:53:45 user nova-compute[71113]:     </graphics>
Jul 31 09:53:45 user nova-compute[71113]:     <audio id='1' type='none'/>
Jul 31 09:53:45 user nova-compute[71113]:     <video>
Jul 31 09:53:45 user nova-compute[71113]:       <model type='virtio' heads='1' primary='yes'/>
Jul 31 09:53:45 user nova-compute[71113]:       <alias name='video0'/>
Jul 31 09:53:45 user nova-compute[71113]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 31 09:53:45 user nova-compute[71113]:     </video>
Jul 31 09:53:45 user nova-compute[71113]:     <memballoon model='virtio'>
Jul 31 09:53:45 user nova-compute[71113]:       <stats period='10'/>
Jul 31 09:53:45 user nova-compute[71113]:       <alias name='balloon0'/>
Jul 31 09:53:45 user nova-compute[71113]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 31 09:53:45 user nova-compute[71113]:     </memballoon>
Jul 31 09:53:45 user nova-compute[71113]:     <rng model='virtio'>
Jul 31 09:53:45 user nova-compute[71113]:       <backend model='random'>/dev/urandom</backend>
Jul 31 09:53:45 user nova-compute[71113]:       <alias name='rng0'/>
Jul 31 09:53:45 user nova-compute[71113]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 31 09:53:45 user nova-compute[71113]:     </rng>
Jul 31 09:53:45 user nova-compute[71113]:   </devices>
Jul 31 09:53:45 user nova-compute[71113]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 31 09:53:45 user nova-compute[71113]:     <label>libvirt-af1f4e7c-b336-457a-94cc-3df3c3203370</label>
Jul 31 09:53:45 user nova-compute[71113]:     <imagelabel>libvirt-af1f4e7c-b336-457a-94cc-3df3c3203370</imagelabel>
Jul 31 09:53:45 user nova-compute[71113]:   </seclabel>
Jul 31 09:53:45 user nova-compute[71113]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 31 09:53:45 user nova-compute[71113]:     <label>+64055:+108</label>
Jul 31 09:53:45 user nova-compute[71113]:     <imagelabel>+64055:+108</imagelabel>
Jul 31 09:53:45 user nova-compute[71113]:   </seclabel>
Jul 31 09:53:45 user nova-compute[71113]: </domain>
Jul 31 09:53:45 user nova-compute[71113]:  {{(pid=71113) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 31 09:53:45 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-3b9813fe-aecf-4976-bd93-f62f3569c0b9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Successfully detached device tap2fa349d3-4e from instance af1f4e7c-b336-457a-94cc-3df3c3203370 from the persistent domain config.
Jul 31 09:53:45 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-3b9813fe-aecf-4976-bd93-f62f3569c0b9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] (1/8): Attempting to detach device tap2fa349d3-4e with device alias net1 from instance af1f4e7c-b336-457a-94cc-3df3c3203370 from the live domain config. {{(pid=71113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 09:53:45 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-3b9813fe-aecf-4976-bd93-f62f3569c0b9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] detach device xml: <interface type="ethernet">
Jul 31 09:53:45 user nova-compute[71113]:   <mac address="fa:16:3e:47:64:c0"/>
Jul 31 09:53:45 user nova-compute[71113]:   <model type="virtio"/>
Jul 31 09:53:45 user nova-compute[71113]:   <mtu size="1442"/>
Jul 31 09:53:45 user nova-compute[71113]:   <target dev="tap2fa349d3-4e"/>
Jul 31 09:53:45 user nova-compute[71113]: </interface>
Jul 31 09:53:45 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 09:53:45 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-ab22e226-16b5-4bc8-8044-d839ebf4c4a5 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:53:45 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-ab22e226-16b5-4bc8-8044-d839ebf4c4a5 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:53:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ab22e226-16b5-4bc8-8044-d839ebf4c4a5 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.473s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:53:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:45 user nova-compute[71113]: DEBUG nova.compute.manager [req-d2dd4e2e-b9d8-4104-8f61-90e3a33f660a req-8038f0af-a684-45e1-bc7f-5b1642ae25e0 service nova] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Received event network-vif-plugged-a56e7fa6-233e-4350-a592-69ecda6dc74e {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:53:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-d2dd4e2e-b9d8-4104-8f61-90e3a33f660a req-8038f0af-a684-45e1-bc7f-5b1642ae25e0 service nova] Acquiring lock "e133dba2-7426-493b-8282-ed18f3ca0a4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:53:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-d2dd4e2e-b9d8-4104-8f61-90e3a33f660a req-8038f0af-a684-45e1-bc7f-5b1642ae25e0 service nova] Lock "e133dba2-7426-493b-8282-ed18f3ca0a4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:53:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-d2dd4e2e-b9d8-4104-8f61-90e3a33f660a req-8038f0af-a684-45e1-bc7f-5b1642ae25e0 service nova] Lock "e133dba2-7426-493b-8282-ed18f3ca0a4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:53:45 user nova-compute[71113]: DEBUG nova.compute.manager [req-d2dd4e2e-b9d8-4104-8f61-90e3a33f660a req-8038f0af-a684-45e1-bc7f-5b1642ae25e0 service nova] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] No waiting events found dispatching network-vif-plugged-a56e7fa6-233e-4350-a592-69ecda6dc74e {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:53:45 user nova-compute[71113]: WARNING nova.compute.manager [req-d2dd4e2e-b9d8-4104-8f61-90e3a33f660a req-8038f0af-a684-45e1-bc7f-5b1642ae25e0 service nova] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Received unexpected event network-vif-plugged-a56e7fa6-233e-4350-a592-69ecda6dc74e for instance with vm_state deleted and task_state None.
Jul 31 09:53:45 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-ab22e226-16b5-4bc8-8044-d839ebf4c4a5 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Deleted allocations for instance e133dba2-7426-493b-8282-ed18f3ca0a4a
Jul 31 09:53:45 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Received event <DeviceRemovedEvent: 1690797225.9516788, af1f4e7c-b336-457a-94cc-3df3c3203370 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71113) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 09:53:45 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-3b9813fe-aecf-4976-bd93-f62f3569c0b9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Start waiting for the detach event from libvirt for device tap2fa349d3-4e with device alias net1 for instance af1f4e7c-b336-457a-94cc-3df3c3203370 {{(pid=71113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 09:53:45 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-3b9813fe-aecf-4976-bd93-f62f3569c0b9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:47:64:c0"/><model type="virtio"/><mtu size="1442"/><target dev="tap2fa349d3-4e"/></interface> {{(pid=71113) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 31 09:53:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:45 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-3b9813fe-aecf-4976-bd93-f62f3569c0b9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:47:64:c0"/><model type="virtio"/><mtu size="1442"/><target dev="tap2fa349d3-4e"/></interface>not found in domain: <domain type='kvm' id='20'>
Jul 31 09:53:45 user nova-compute[71113]:   <name>instance-00000011</name>
Jul 31 09:53:45 user nova-compute[71113]:   <uuid>af1f4e7c-b336-457a-94cc-3df3c3203370</uuid>
Jul 31 09:53:45 user nova-compute[71113]:   <metadata>
Jul 31 09:53:45 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 09:53:45 user nova-compute[71113]:   <nova:package version="0.0.0"/>
Jul 31 09:53:45 user nova-compute[71113]:   <nova:name>tempest-device-tagging-server-601671640</nova:name>
Jul 31 09:53:45 user nova-compute[71113]:   <nova:creationTime>2023-07-31 09:53:31</nova:creationTime>
Jul 31 09:53:45 user nova-compute[71113]:   <nova:flavor name="m1.tiny">
Jul 31 09:53:45 user nova-compute[71113]:     <nova:memory>512</nova:memory>
Jul 31 09:53:45 user nova-compute[71113]:     <nova:disk>1</nova:disk>
Jul 31 09:53:45 user nova-compute[71113]:     <nova:swap>0</nova:swap>
Jul 31 09:53:45 user nova-compute[71113]:     <nova:ephemeral>0</nova:ephemeral>
Jul 31 09:53:45 user nova-compute[71113]:     <nova:vcpus>1</nova:vcpus>
Jul 31 09:53:45 user nova-compute[71113]:   </nova:flavor>
Jul 31 09:53:45 user nova-compute[71113]:   <nova:owner>
Jul 31 09:53:45 user nova-compute[71113]:     <nova:user uuid="21f1d14ad39e4cd0b19e8484f1635344">tempest-TaggedAttachmentsTest-740569977-project-member</nova:user>
Jul 31 09:53:45 user nova-compute[71113]:     <nova:project uuid="c8a3ec2098864e8797f77f70e1784acd">tempest-TaggedAttachmentsTest-740569977</nova:project>
Jul 31 09:53:45 user nova-compute[71113]:   </nova:owner>
Jul 31 09:53:45 user nova-compute[71113]:   <nova:root type="image" uuid="078646fe-b504-41ed-a147-61072e903e51"/>
Jul 31 09:53:45 user nova-compute[71113]:   <nova:ports>
Jul 31 09:53:45 user nova-compute[71113]:     <nova:port uuid="b57ab83c-c78e-424e-889b-b0156de15bfe">
Jul 31 09:53:45 user nova-compute[71113]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 31 09:53:45 user nova-compute[71113]:     </nova:port>
Jul 31 09:53:45 user nova-compute[71113]:     <nova:port uuid="2fa349d3-4e53-4101-b101-4032d9560dc2">
Jul 31 09:53:45 user nova-compute[71113]:       <nova:ip type="fixed" address="10.10.10.67" ipVersion="4"/>
Jul 31 09:53:45 user nova-compute[71113]:     </nova:port>
Jul 31 09:53:45 user nova-compute[71113]:   </nova:ports>
Jul 31 09:53:45 user nova-compute[71113]: </nova:instance>
Jul 31 09:53:45 user nova-compute[71113]:   </metadata>
Jul 31 09:53:45 user nova-compute[71113]:   <memory unit='KiB'>524288</memory>
Jul 31 09:53:45 user nova-compute[71113]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 31 09:53:45 user nova-compute[71113]:   <vcpu placement='static'>1</vcpu>
Jul 31 09:53:45 user nova-compute[71113]:   <resource>
Jul 31 09:53:45 user nova-compute[71113]:     <partition>/machine</partition>
Jul 31 09:53:45 user nova-compute[71113]:   </resource>
Jul 31 09:53:45 user nova-compute[71113]:   <sysinfo type='smbios'>
Jul 31 09:53:45 user nova-compute[71113]:     <system>
Jul 31 09:53:45 user nova-compute[71113]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 31 09:53:45 user nova-compute[71113]:       <entry name='product'>OpenStack Nova</entry>
Jul 31 09:53:45 user nova-compute[71113]:       <entry name='version'>0.0.0</entry>
Jul 31 09:53:45 user nova-compute[71113]:       <entry name='serial'>af1f4e7c-b336-457a-94cc-3df3c3203370</entry>
Jul 31 09:53:45 user nova-compute[71113]:       <entry name='uuid'>af1f4e7c-b336-457a-94cc-3df3c3203370</entry>
Jul 31 09:53:45 user nova-compute[71113]:       <entry name='family'>Virtual Machine</entry>
Jul 31 09:53:45 user nova-compute[71113]:     </system>
Jul 31 09:53:45 user nova-compute[71113]:   </sysinfo>
Jul 31 09:53:45 user nova-compute[71113]:   <os>
Jul 31 09:53:45 user nova-compute[71113]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 31 09:53:45 user nova-compute[71113]:     <boot dev='hd'/>
Jul 31 09:53:45 user nova-compute[71113]:     <smbios mode='sysinfo'/>
Jul 31 09:53:45 user nova-compute[71113]:   </os>
Jul 31 09:53:45 user nova-compute[71113]:   <features>
Jul 31 09:53:45 user nova-compute[71113]:     <acpi/>
Jul 31 09:53:45 user nova-compute[71113]:     <apic/>
Jul 31 09:53:45 user nova-compute[71113]:     <vmcoreinfo state='on'/>
Jul 31 09:53:45 user nova-compute[71113]:   </features>
Jul 31 09:53:45 user nova-compute[71113]:   <cpu mode='custom' match='exact' check='full'>
Jul 31 09:53:45 user nova-compute[71113]:     <model fallback='forbid'>Nehalem</model>
Jul 31 09:53:45 user nova-compute[71113]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 31 09:53:45 user nova-compute[71113]:     <feature policy='require' name='vme'/>
Jul 31 09:53:45 user nova-compute[71113]:     <feature policy='require' name='x2apic'/>
Jul 31 09:53:45 user nova-compute[71113]:     <feature policy='require' name='hypervisor'/>
Jul 31 09:53:45 user nova-compute[71113]:   </cpu>
Jul 31 09:53:45 user nova-compute[71113]:   <clock offset='utc'>
Jul 31 09:53:45 user nova-compute[71113]:     <timer name='pit' tickpolicy='delay'/>
Jul 31 09:53:45 user nova-compute[71113]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 31 09:53:45 user nova-compute[71113]:     <timer name='hpet' present='no'/>
Jul 31 09:53:45 user nova-compute[71113]:   </clock>
Jul 31 09:53:45 user nova-compute[71113]:   <on_poweroff>destroy</on_poweroff>
Jul 31 09:53:45 user nova-compute[71113]:   <on_reboot>restart</on_reboot>
Jul 31 09:53:45 user nova-compute[71113]:   <on_crash>destroy</on_crash>
Jul 31 09:53:45 user nova-compute[71113]:   <devices>
Jul 31 09:53:45 user nova-compute[71113]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 31 09:53:45 user nova-compute[71113]:     <disk type='file' device='disk'>
Jul 31 09:53:45 user nova-compute[71113]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 31 09:53:45 user nova-compute[71113]:       <source file='/opt/stack/data/nova/instances/af1f4e7c-b336-457a-94cc-3df3c3203370/disk' index='2'/>
Jul 31 09:53:45 user nova-compute[71113]:       <backingStore type='file' index='3'>
Jul 31 09:53:45 user nova-compute[71113]:         <format type='raw'/>
Jul 31 09:53:45 user nova-compute[71113]:         <source file='/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9'/>
Jul 31 09:53:45 user nova-compute[71113]:         <backingStore/>
Jul 31 09:53:45 user nova-compute[71113]:       </backingStore>
Jul 31 09:53:45 user nova-compute[71113]:       <target dev='vda' bus='virtio'/>
Jul 31 09:53:45 user nova-compute[71113]:       <alias name='virtio-disk0'/>
Jul 31 09:53:45 user nova-compute[71113]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 31 09:53:45 user nova-compute[71113]:     </disk>
Jul 31 09:53:45 user nova-compute[71113]:     <disk type='file' device='cdrom'>
Jul 31 09:53:45 user nova-compute[71113]:       <driver name='qemu' type='raw' cache='none'/>
Jul 31 09:53:45 user nova-compute[71113]:       <source file='/opt/stack/data/nova/instances/af1f4e7c-b336-457a-94cc-3df3c3203370/disk.config' index='1'/>
Jul 31 09:53:45 user nova-compute[71113]:       <backingStore/>
Jul 31 09:53:45 user nova-compute[71113]:       <target dev='hda' bus='ide'/>
Jul 31 09:53:45 user nova-compute[71113]:       <readonly/>
Jul 31 09:53:45 user nova-compute[71113]:       <alias name='ide0-0-0'/>
Jul 31 09:53:45 user nova-compute[71113]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 31 09:53:45 user nova-compute[71113]:     </disk>
Jul 31 09:53:45 user nova-compute[71113]:     <controller type='usb' index='0' model='none'>
Jul 31 09:53:45 user nova-compute[71113]:       <alias name='usb'/>
Jul 31 09:53:45 user nova-compute[71113]:     </controller>
Jul 31 09:53:45 user nova-compute[71113]:     <controller type='pci' index='0' model='pci-root'>
Jul 31 09:53:45 user nova-compute[71113]:       <alias name='pci.0'/>
Jul 31 09:53:45 user nova-compute[71113]:     </controller>
Jul 31 09:53:45 user nova-compute[71113]:     <controller type='ide' index='0'>
Jul 31 09:53:45 user nova-compute[71113]:       <alias name='ide'/>
Jul 31 09:53:45 user nova-compute[71113]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 31 09:53:45 user nova-compute[71113]:     </controller>
Jul 31 09:53:45 user nova-compute[71113]:     <interface type='ethernet'>
Jul 31 09:53:45 user nova-compute[71113]:       <mac address='fa:16:3e:64:ce:90'/>
Jul 31 09:53:45 user nova-compute[71113]:       <target dev='tapb57ab83c-c7'/>
Jul 31 09:53:45 user nova-compute[71113]:       <model type='virtio'/>
Jul 31 09:53:45 user nova-compute[71113]:       <mtu size='1442'/>
Jul 31 09:53:45 user nova-compute[71113]:       <alias name='net0'/>
Jul 31 09:53:45 user nova-compute[71113]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 31 09:53:45 user nova-compute[71113]:     </interface>
Jul 31 09:53:45 user nova-compute[71113]:     <serial type='pty'>
Jul 31 09:53:45 user nova-compute[71113]:       <source path='/dev/pts/6'/>
Jul 31 09:53:45 user nova-compute[71113]:       <log file='/opt/stack/data/nova/instances/af1f4e7c-b336-457a-94cc-3df3c3203370/console.log' append='off'/>
Jul 31 09:53:45 user nova-compute[71113]:       <target type='isa-serial' port='0'>
Jul 31 09:53:45 user nova-compute[71113]:         <model name='isa-serial'/>
Jul 31 09:53:45 user nova-compute[71113]:       </target>
Jul 31 09:53:45 user nova-compute[71113]:       <alias name='serial0'/>
Jul 31 09:53:45 user nova-compute[71113]:     </serial>
Jul 31 09:53:45 user nova-compute[71113]:     <console type='pty' tty='/dev/pts/6'>
Jul 31 09:53:45 user nova-compute[71113]:       <source path='/dev/pts/6'/>
Jul 31 09:53:45 user nova-compute[71113]:       <log file='/opt/stack/data/nova/instances/af1f4e7c-b336-457a-94cc-3df3c3203370/console.log' append='off'/>
Jul 31 09:53:45 user nova-compute[71113]:       <target type='serial' port='0'/>
Jul 31 09:53:45 user nova-compute[71113]:       <alias name='serial0'/>
Jul 31 09:53:45 user nova-compute[71113]:     </console>
Jul 31 09:53:45 user nova-compute[71113]:     <input type='mouse' bus='ps2'>
Jul 31 09:53:45 user nova-compute[71113]:       <alias name='input0'/>
Jul 31 09:53:45 user nova-compute[71113]:     </input>
Jul 31 09:53:45 user nova-compute[71113]:     <input type='keyboard' bus='ps2'>
Jul 31 09:53:45 user nova-compute[71113]:       <alias name='input1'/>
Jul 31 09:53:45 user nova-compute[71113]:     </input>
Jul 31 09:53:45 user nova-compute[71113]:     <graphics type='vnc' port='5900' autoport='yes' listen='0.0.0.0'>
Jul 31 09:53:45 user nova-compute[71113]:       <listen type='address' address='0.0.0.0'/>
Jul 31 09:53:45 user nova-compute[71113]:     </graphics>
Jul 31 09:53:45 user nova-compute[71113]:     <audio id='1' type='none'/>
Jul 31 09:53:45 user nova-compute[71113]:     <video>
Jul 31 09:53:45 user nova-compute[71113]:       <model type='virtio' heads='1' primary='yes'/>
Jul 31 09:53:45 user nova-compute[71113]:       <alias name='video0'/>
Jul 31 09:53:45 user nova-compute[71113]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 31 09:53:45 user nova-compute[71113]:     </video>
Jul 31 09:53:45 user nova-compute[71113]:     <memballoon model='virtio'>
Jul 31 09:53:45 user nova-compute[71113]:       <stats period='10'/>
Jul 31 09:53:45 user nova-compute[71113]:       <alias name='balloon0'/>
Jul 31 09:53:45 user nova-compute[71113]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 31 09:53:45 user nova-compute[71113]:     </memballoon>
Jul 31 09:53:45 user nova-compute[71113]:     <rng model='virtio'>
Jul 31 09:53:45 user nova-compute[71113]:       <backend model='random'>/dev/urandom</backend>
Jul 31 09:53:45 user nova-compute[71113]:       <alias name='rng0'/>
Jul 31 09:53:45 user nova-compute[71113]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 31 09:53:45 user nova-compute[71113]:     </rng>
Jul 31 09:53:45 user nova-compute[71113]:   </devices>
Jul 31 09:53:45 user nova-compute[71113]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 31 09:53:45 user nova-compute[71113]:     <label>libvirt-af1f4e7c-b336-457a-94cc-3df3c3203370</label>
Jul 31 09:53:45 user nova-compute[71113]:     <imagelabel>libvirt-af1f4e7c-b336-457a-94cc-3df3c3203370</imagelabel>
Jul 31 09:53:45 user nova-compute[71113]:   </seclabel>
Jul 31 09:53:45 user nova-compute[71113]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 31 09:53:45 user nova-compute[71113]:     <label>+64055:+108</label>
Jul 31 09:53:45 user nova-compute[71113]:     <imagelabel>+64055:+108</imagelabel>
Jul 31 09:53:45 user nova-compute[71113]:   </seclabel>
Jul 31 09:53:45 user nova-compute[71113]: </domain>
Jul 31 09:53:45 user nova-compute[71113]:  {{(pid=71113) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 31 09:53:45 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-3b9813fe-aecf-4976-bd93-f62f3569c0b9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Successfully detached device tap2fa349d3-4e from instance af1f4e7c-b336-457a-94cc-3df3c3203370 from the live domain config.
Jul 31 09:53:45 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-3b9813fe-aecf-4976-bd93-f62f3569c0b9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T09:51:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-601671640',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-601671640',id=17,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrt/0N3rqkgPN6SuyXfpoCTkV9Bk0pcEdYe3hmzwwFIugD3ohq+ljDgxWA2owuO7ncn48ukAgrCkpv3bs19B971Yw7oJwFLv7z/1GwjZIhoKmL+3YWqpkWzV2dkY74VfA==',key_name='tempest-keypair-341346334',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:51:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c8a3ec2098864e8797f77f70e1784acd',ramdisk_id='',reservation_id='r-sijnqnb0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-740569977',owner_user_name='tempest-TaggedAttachmentsTest-740569977-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:51:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21f1d14ad39e4cd0b19e8484f1635344',uuid=af1f4e7c-b336-457a-94cc-3df3c3203370,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2fa349d3-4e53-4101-b101-4032d9560dc2", "address": "fa:16:3e:47:64:c0", "network": {"id": "6c6d62a0-47a1-4c17-9ec9-110146a5043b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-803239299", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c8a3ec2098864e8797f77f70e1784acd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fa349d3-4e", "ovs_interfaceid": "2fa349d3-4e53-4101-b101-4032d9560dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 09:53:45 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-3b9813fe-aecf-4976-bd93-f62f3569c0b9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Converting VIF {"id": "2fa349d3-4e53-4101-b101-4032d9560dc2", "address": "fa:16:3e:47:64:c0", "network": {"id": "6c6d62a0-47a1-4c17-9ec9-110146a5043b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-803239299", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.67", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c8a3ec2098864e8797f77f70e1784acd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fa349d3-4e", "ovs_interfaceid": "2fa349d3-4e53-4101-b101-4032d9560dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:53:45 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-3b9813fe-aecf-4976-bd93-f62f3569c0b9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:64:c0,bridge_name='br-int',has_traffic_filtering=True,id=2fa349d3-4e53-4101-b101-4032d9560dc2,network=Network(6c6d62a0-47a1-4c17-9ec9-110146a5043b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fa349d3-4e') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:53:45 user nova-compute[71113]: DEBUG os_vif [None req-3b9813fe-aecf-4976-bd93-f62f3569c0b9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:64:c0,bridge_name='br-int',has_traffic_filtering=True,id=2fa349d3-4e53-4101-b101-4032d9560dc2,network=Network(6c6d62a0-47a1-4c17-9ec9-110146a5043b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fa349d3-4e') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 09:53:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2fa349d3-4e, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:53:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:53:46 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:46 user nova-compute[71113]: INFO os_vif [None req-3b9813fe-aecf-4976-bd93-f62f3569c0b9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:64:c0,bridge_name='br-int',has_traffic_filtering=True,id=2fa349d3-4e53-4101-b101-4032d9560dc2,network=Network(6c6d62a0-47a1-4c17-9ec9-110146a5043b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fa349d3-4e')
Jul 31 09:53:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-3b9813fe-aecf-4976-bd93-f62f3569c0b9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 09:53:46 user nova-compute[71113]:   <nova:package version="0.0.0"/>
Jul 31 09:53:46 user nova-compute[71113]:   <nova:name>tempest-device-tagging-server-601671640</nova:name>
Jul 31 09:53:46 user nova-compute[71113]:   <nova:creationTime>2023-07-31 09:53:46</nova:creationTime>
Jul 31 09:53:46 user nova-compute[71113]:   <nova:flavor name="m1.tiny">
Jul 31 09:53:46 user nova-compute[71113]:     <nova:memory>512</nova:memory>
Jul 31 09:53:46 user nova-compute[71113]:     <nova:disk>1</nova:disk>
Jul 31 09:53:46 user nova-compute[71113]:     <nova:swap>0</nova:swap>
Jul 31 09:53:46 user nova-compute[71113]:     <nova:ephemeral>0</nova:ephemeral>
Jul 31 09:53:46 user nova-compute[71113]:     <nova:vcpus>1</nova:vcpus>
Jul 31 09:53:46 user nova-compute[71113]:   </nova:flavor>
Jul 31 09:53:46 user nova-compute[71113]:   <nova:owner>
Jul 31 09:53:46 user nova-compute[71113]:     <nova:user uuid="21f1d14ad39e4cd0b19e8484f1635344">tempest-TaggedAttachmentsTest-740569977-project-member</nova:user>
Jul 31 09:53:46 user nova-compute[71113]:     <nova:project uuid="c8a3ec2098864e8797f77f70e1784acd">tempest-TaggedAttachmentsTest-740569977</nova:project>
Jul 31 09:53:46 user nova-compute[71113]:   </nova:owner>
Jul 31 09:53:46 user nova-compute[71113]:   <nova:root type="image" uuid="078646fe-b504-41ed-a147-61072e903e51"/>
Jul 31 09:53:46 user nova-compute[71113]:   <nova:ports>
Jul 31 09:53:46 user nova-compute[71113]:     <nova:port uuid="b57ab83c-c78e-424e-889b-b0156de15bfe">
Jul 31 09:53:46 user nova-compute[71113]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 31 09:53:46 user nova-compute[71113]:     </nova:port>
Jul 31 09:53:46 user nova-compute[71113]:   </nova:ports>
Jul 31 09:53:46 user nova-compute[71113]: </nova:instance>
Jul 31 09:53:46 user nova-compute[71113]:  {{(pid=71113) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Jul 31 09:53:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ab22e226-16b5-4bc8-8044-d839ebf4c4a5 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Lock "e133dba2-7426-493b-8282-ed18f3ca0a4a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.543s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:53:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-3b9813fe-aecf-4976-bd93-f62f3569c0b9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Acquiring lock "refresh_cache-af1f4e7c-b336-457a-94cc-3df3c3203370" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:53:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-3b9813fe-aecf-4976-bd93-f62f3569c0b9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Acquired lock "refresh_cache-af1f4e7c-b336-457a-94cc-3df3c3203370" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:53:46 user nova-compute[71113]: DEBUG nova.network.neutron [None req-3b9813fe-aecf-4976-bd93-f62f3569c0b9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-a33b26f4-1387-4088-a2ac-57543234e5ce tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Acquiring lock "6d92f7e3-6f70-4344-9f15-9815d51024b6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-a33b26f4-1387-4088-a2ac-57543234e5ce tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "6d92f7e3-6f70-4344-9f15-9815d51024b6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:53:47 user nova-compute[71113]: INFO nova.compute.manager [None req-a33b26f4-1387-4088-a2ac-57543234e5ce tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Detaching volume 4ea6b7be-5366-487b-934f-2123377c7c29
Jul 31 09:53:47 user nova-compute[71113]: INFO nova.virt.block_device [None req-a33b26f4-1387-4088-a2ac-57543234e5ce tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Attempting to driver detach volume 4ea6b7be-5366-487b-934f-2123377c7c29 from mountpoint /dev/vdb
Jul 31 09:53:47 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-a33b26f4-1387-4088-a2ac-57543234e5ce tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Attempting to detach device vdb from instance 6d92f7e3-6f70-4344-9f15-9815d51024b6 from the persistent domain config. {{(pid=71113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-a33b26f4-1387-4088-a2ac-57543234e5ce tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 09:53:47 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:53:47 user nova-compute[71113]:   <source dev="/dev/sde"/>
Jul 31 09:53:47 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 09:53:47 user nova-compute[71113]:   <serial>4ea6b7be-5366-487b-934f-2123377c7c29</serial>
Jul 31 09:53:47 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 09:53:47 user nova-compute[71113]: </disk>
Jul 31 09:53:47 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 09:53:47 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-a33b26f4-1387-4088-a2ac-57543234e5ce tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Successfully detached device vdb from instance 6d92f7e3-6f70-4344-9f15-9815d51024b6 from the persistent domain config.
Jul 31 09:53:47 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-a33b26f4-1387-4088-a2ac-57543234e5ce tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6d92f7e3-6f70-4344-9f15-9815d51024b6 from the live domain config. {{(pid=71113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-a33b26f4-1387-4088-a2ac-57543234e5ce tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 09:53:47 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:53:47 user nova-compute[71113]:   <source dev="/dev/sde"/>
Jul 31 09:53:47 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 09:53:47 user nova-compute[71113]:   <serial>4ea6b7be-5366-487b-934f-2123377c7c29</serial>
Jul 31 09:53:47 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 09:53:47 user nova-compute[71113]: </disk>
Jul 31 09:53:47 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 09:53:47 user nova-compute[71113]: INFO nova.network.neutron [None req-3b9813fe-aecf-4976-bd93-f62f3569c0b9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Port 2fa349d3-4e53-4101-b101-4032d9560dc2 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Jul 31 09:53:47 user nova-compute[71113]: DEBUG nova.network.neutron [None req-3b9813fe-aecf-4976-bd93-f62f3569c0b9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Updating instance_info_cache with network_info: [{"id": "b57ab83c-c78e-424e-889b-b0156de15bfe", "address": "fa:16:3e:64:ce:90", "network": {"id": "2eebe293-45a3-4f39-bfa2-404813801391", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1697211995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8a3ec2098864e8797f77f70e1784acd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb57ab83c-c7", "ovs_interfaceid": "b57ab83c-c78e-424e-889b-b0156de15bfe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-3b9813fe-aecf-4976-bd93-f62f3569c0b9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Releasing lock "refresh_cache-af1f4e7c-b336-457a-94cc-3df3c3203370" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-3b9813fe-aecf-4976-bd93-f62f3569c0b9 tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Lock "interface-af1f4e7c-b336-457a-94cc-3df3c3203370-2fa349d3-4e53-4101-b101-4032d9560dc2" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.699s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG nova.compute.manager [req-98caf960-2248-47f6-9c90-24aaefa92bf8 req-10c4f2a2-cb03-48f7-926f-91573174ce13 service nova] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Received event network-vif-unplugged-2fa349d3-4e53-4101-b101-4032d9560dc2 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-98caf960-2248-47f6-9c90-24aaefa92bf8 req-10c4f2a2-cb03-48f7-926f-91573174ce13 service nova] Acquiring lock "af1f4e7c-b336-457a-94cc-3df3c3203370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-98caf960-2248-47f6-9c90-24aaefa92bf8 req-10c4f2a2-cb03-48f7-926f-91573174ce13 service nova] Lock "af1f4e7c-b336-457a-94cc-3df3c3203370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-98caf960-2248-47f6-9c90-24aaefa92bf8 req-10c4f2a2-cb03-48f7-926f-91573174ce13 service nova] Lock "af1f4e7c-b336-457a-94cc-3df3c3203370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG nova.compute.manager [req-98caf960-2248-47f6-9c90-24aaefa92bf8 req-10c4f2a2-cb03-48f7-926f-91573174ce13 service nova] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] No waiting events found dispatching network-vif-unplugged-2fa349d3-4e53-4101-b101-4032d9560dc2 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:53:47 user nova-compute[71113]: WARNING nova.compute.manager [req-98caf960-2248-47f6-9c90-24aaefa92bf8 req-10c4f2a2-cb03-48f7-926f-91573174ce13 service nova] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Received unexpected event network-vif-unplugged-2fa349d3-4e53-4101-b101-4032d9560dc2 for instance with vm_state active and task_state None.
Jul 31 09:53:47 user nova-compute[71113]: DEBUG nova.compute.manager [req-98caf960-2248-47f6-9c90-24aaefa92bf8 req-10c4f2a2-cb03-48f7-926f-91573174ce13 service nova] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Received event network-vif-plugged-2fa349d3-4e53-4101-b101-4032d9560dc2 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-98caf960-2248-47f6-9c90-24aaefa92bf8 req-10c4f2a2-cb03-48f7-926f-91573174ce13 service nova] Acquiring lock "af1f4e7c-b336-457a-94cc-3df3c3203370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-98caf960-2248-47f6-9c90-24aaefa92bf8 req-10c4f2a2-cb03-48f7-926f-91573174ce13 service nova] Lock "af1f4e7c-b336-457a-94cc-3df3c3203370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-98caf960-2248-47f6-9c90-24aaefa92bf8 req-10c4f2a2-cb03-48f7-926f-91573174ce13 service nova] Lock "af1f4e7c-b336-457a-94cc-3df3c3203370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG nova.compute.manager [req-98caf960-2248-47f6-9c90-24aaefa92bf8 req-10c4f2a2-cb03-48f7-926f-91573174ce13 service nova] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] No waiting events found dispatching network-vif-plugged-2fa349d3-4e53-4101-b101-4032d9560dc2 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:53:47 user nova-compute[71113]: WARNING nova.compute.manager [req-98caf960-2248-47f6-9c90-24aaefa92bf8 req-10c4f2a2-cb03-48f7-926f-91573174ce13 service nova] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Received unexpected event network-vif-plugged-2fa349d3-4e53-4101-b101-4032d9560dc2 for instance with vm_state active and task_state None.
Jul 31 09:53:47 user nova-compute[71113]: DEBUG nova.compute.manager [req-98caf960-2248-47f6-9c90-24aaefa92bf8 req-10c4f2a2-cb03-48f7-926f-91573174ce13 service nova] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Received event network-vif-deleted-2fa349d3-4e53-4101-b101-4032d9560dc2 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Received event <DeviceRemovedEvent: 1690797227.6642692, 6d92f7e3-6f70-4344-9f15-9815d51024b6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71113) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-a33b26f4-1387-4088-a2ac-57543234e5ce tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6d92f7e3-6f70-4344-9f15-9815d51024b6 {{(pid=71113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 09:53:47 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-a33b26f4-1387-4088-a2ac-57543234e5ce tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Successfully detached device vdb from instance 6d92f7e3-6f70-4344-9f15-9815d51024b6 from the live domain config.
Jul 31 09:53:47 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a33b26f4-1387-4088-a2ac-57543234e5ce tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33b26f4-1387-4088-a2ac-57543234e5ce tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:4ea6b7be-5366-487b-934f-2123377c7c29'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RLGkIuei', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:53:47 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-a33b26f4-1387-4088-a2ac-57543234e5ce tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:53:47 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-a33b26f4-1387-4088-a2ac-57543234e5ce tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-a33b26f4-1387-4088-a2ac-57543234e5ce tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33b26f4-1387-4088-a2ac-57543234e5ce tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ea6b7be-5366-487b-934f-2123377c7c29', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[323d2606-0232-4814-a667-cc3bb74e20eb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ea6b7be-5366-487b-934f-2123377c7c29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd680c1-3254-4a5d-b3ea-87ef2a789eb6]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ea6b7be-5366-487b-934f-2123377c7c29 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33b26f4-1387-4088-a2ac-57543234e5ce tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:53:47 user nova-compute[71113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)
Jul 31 09:53:47 user nova-compute[71113]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ea6b7be-5366-487b-934f-2123377c7c29 (non-flash)
Jul 31 09:53:47 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33b26f4-1387-4088-a2ac-57543234e5ce tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:53:47 user nova-compute[71113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)
Jul 31 09:53:47 user nova-compute[71113]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ea6b7be-5366-487b-934f-2123377c7c29 (non-flash)
Jul 31 09:53:47 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33b26f4-1387-4088-a2ac-57543234e5ce tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f78f0652050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ea6b7be-5366-487b-934f-2123377c7c29'): ({'sde'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-a33b26f4-1387-4088-a2ac-57543234e5ce tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Removing single pathed devices sde {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a764b0ef-49af-480a-ac23-b89c560d3922]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[68025be1-0cea-47e5-ad3a-c71e6b90f72f]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-a33b26f4-1387-4088-a2ac-57543234e5ce tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Flushing IO for device /dev/sde {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[31402942-7d51-4d54-a52c-a6c18fe1130f]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-a33b26f4-1387-4088-a2ac-57543234e5ce tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.056s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e625e47-09d8-48de-a7fa-30b9a5f718d7]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-a33b26f4-1387-4088-a2ac-57543234e5ce tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-a33b26f4-1387-4088-a2ac-57543234e5ce tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] SCSI volumes sde have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33b26f4-1387-4088-a2ac-57543234e5ce tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ea6b7be-5366-487b-934f-2123377c7c29')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ea6b7be-5366-487b-934f-2123377c7c29 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ea6b7be-5366-487b-934f-2123377c7c29 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e2e623-c76b-4dc2-8464-68db02ac14c7]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33b26f4-1387-4088-a2ac-57543234e5ce tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ea6b7be-5366-487b-934f-2123377c7c29 -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ea6b7be-5366-487b-934f-2123377c7c29 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2278e6-07b7-43fc-bf1a-ea9dd4af8ff6]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:4ea6b7be-5366-487b-934f-2123377c7c29, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:4ea6b7be-5366-487b-934f-2123377c7c29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33b26f4-1387-4088-a2ac-57543234e5ce tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:4ea6b7be-5366-487b-934f-2123377c7c29, portal: 172.16.0.220,3260]
Jul 31 09:53:47 user nova-compute[71113]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:4ea6b7be-5366-487b-934f-2123377c7c29, portal: 172.16.0.220,3260] successful.
Jul 31 09:53:47 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ea6b7be-5366-487b-934f-2123377c7c29 -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ea6b7be-5366-487b-934f-2123377c7c29 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a6aeb3-412e-42d0-ba08-ca5988898691]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33b26f4-1387-4088-a2ac-57543234e5ce tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-a33b26f4-1387-4088-a2ac-57543234e5ce tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33b26f4-1387-4088-a2ac-57543234e5ce tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] <== disconnect_volume: return (290ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:53:47 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a33b26f4-1387-4088-a2ac-57543234e5ce tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 09:53:48 user nova-compute[71113]: DEBUG nova.objects.instance [None req-a33b26f4-1387-4088-a2ac-57543234e5ce tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lazy-loading 'flavor' on Instance uuid 6d92f7e3-6f70-4344-9f15-9815d51024b6 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:53:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-a33b26f4-1387-4088-a2ac-57543234e5ce tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "6d92f7e3-6f70-4344-9f15-9815d51024b6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.684s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:53:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquiring lock "92d25a03-98ce-4bde-a3cc-20313ae77d41" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:53:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "92d25a03-98ce-4bde-a3cc-20313ae77d41" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:53:55 user nova-compute[71113]: DEBUG nova.compute.manager [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Starting instance... {{(pid=71113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 09:53:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:53:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:53:56 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 09:53:56 user nova-compute[71113]: INFO nova.compute.claims [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Claim successful on node user
Jul 31 09:53:56 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:53:56 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:53:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.504s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:53:56 user nova-compute[71113]: DEBUG nova.compute.manager [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Start building networks asynchronously for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 09:53:56 user nova-compute[71113]: DEBUG nova.compute.manager [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Allocating IP information in the background. {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 09:53:56 user nova-compute[71113]: DEBUG nova.network.neutron [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] allocate_for_instance() {{(pid=71113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 09:53:56 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 09:53:56 user nova-compute[71113]: DEBUG nova.compute.manager [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Start building block device mappings for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 09:53:56 user nova-compute[71113]: DEBUG nova.policy [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f4f505d5eddc4df48ec267f6f69a01f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88bbf2636f6248fcbe644af4eab0c823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71113) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 09:53:56 user nova-compute[71113]: INFO nova.virt.block_device [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Booting with blank volume at /dev/vda
Jul 31 09:53:57 user nova-compute[71113]: DEBUG nova.network.neutron [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Successfully created port: e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 09:53:58 user nova-compute[71113]: DEBUG nova.network.neutron [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Successfully updated port: e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 09:53:58 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquiring lock "refresh_cache-92d25a03-98ce-4bde-a3cc-20313ae77d41" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:53:58 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquired lock "refresh_cache-92d25a03-98ce-4bde-a3cc-20313ae77d41" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:53:58 user nova-compute[71113]: DEBUG nova.network.neutron [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 09:53:58 user nova-compute[71113]: DEBUG nova.compute.manager [req-39300ab7-668f-41da-82ea-4cf82bbefa6c req-e31dc77a-94a2-4b21-beb2-789c2d9db972 service nova] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Received event network-changed-e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:53:58 user nova-compute[71113]: DEBUG nova.compute.manager [req-39300ab7-668f-41da-82ea-4cf82bbefa6c req-e31dc77a-94a2-4b21-beb2-789c2d9db972 service nova] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Refreshing instance network info cache due to event network-changed-e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:53:58 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-39300ab7-668f-41da-82ea-4cf82bbefa6c req-e31dc77a-94a2-4b21-beb2-789c2d9db972 service nova] Acquiring lock "refresh_cache-92d25a03-98ce-4bde-a3cc-20313ae77d41" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:53:58 user nova-compute[71113]: DEBUG nova.network.neutron [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 09:53:59 user nova-compute[71113]: DEBUG nova.network.neutron [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Updating instance_info_cache with network_info: [{"id": "e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d", "address": "fa:16:3e:2c:5b:c3", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape82fc7e2-25", "ovs_interfaceid": "e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:53:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Releasing lock "refresh_cache-92d25a03-98ce-4bde-a3cc-20313ae77d41" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:53:59 user nova-compute[71113]: DEBUG nova.compute.manager [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Instance network_info: |[{"id": "e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d", "address": "fa:16:3e:2c:5b:c3", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape82fc7e2-25", "ovs_interfaceid": "e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 09:53:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-39300ab7-668f-41da-82ea-4cf82bbefa6c req-e31dc77a-94a2-4b21-beb2-789c2d9db972 service nova] Acquired lock "refresh_cache-92d25a03-98ce-4bde-a3cc-20313ae77d41" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:53:59 user nova-compute[71113]: DEBUG nova.network.neutron [req-39300ab7-668f-41da-82ea-4cf82bbefa6c req-e31dc77a-94a2-4b21-beb2-789c2d9db972 service nova] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Refreshing network info cache for port e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:53:59 user nova-compute[71113]: DEBUG nova.compute.manager [req-775185b2-b0c8-4ff0-be09-24f08da23daf req-65a26524-29df-48af-b899-86bcc3a2c594 service nova] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Received event network-changed-da9f4dda-8c5c-4af8-9b15-7572a9e66f9f {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:53:59 user nova-compute[71113]: DEBUG nova.compute.manager [req-775185b2-b0c8-4ff0-be09-24f08da23daf req-65a26524-29df-48af-b899-86bcc3a2c594 service nova] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Refreshing instance network info cache due to event network-changed-da9f4dda-8c5c-4af8-9b15-7572a9e66f9f. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:53:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-775185b2-b0c8-4ff0-be09-24f08da23daf req-65a26524-29df-48af-b899-86bcc3a2c594 service nova] Acquiring lock "refresh_cache-225aca75-f3cc-4fc9-a3a3-52be185e9c42" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:53:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-775185b2-b0c8-4ff0-be09-24f08da23daf req-65a26524-29df-48af-b899-86bcc3a2c594 service nova] Acquired lock "refresh_cache-225aca75-f3cc-4fc9-a3a3-52be185e9c42" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:53:59 user nova-compute[71113]: DEBUG nova.network.neutron [req-775185b2-b0c8-4ff0-be09-24f08da23daf req-65a26524-29df-48af-b899-86bcc3a2c594 service nova] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Refreshing network info cache for port da9f4dda-8c5c-4af8-9b15-7572a9e66f9f {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:53:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:53:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9d152900-5ce5-4f90-b30d-d07e95c6dfaa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Acquiring lock "225aca75-f3cc-4fc9-a3a3-52be185e9c42" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:53:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9d152900-5ce5-4f90-b30d-d07e95c6dfaa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "225aca75-f3cc-4fc9-a3a3-52be185e9c42" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:53:59 user nova-compute[71113]: DEBUG nova.objects.instance [None req-9d152900-5ce5-4f90-b30d-d07e95c6dfaa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lazy-loading 'flavor' on Instance uuid 225aca75-f3cc-4fc9-a3a3-52be185e9c42 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:53:59 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-9d152900-5ce5-4f90-b30d-d07e95c6dfaa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Ignoring supplied device name: /dev/vdb
Jul 31 09:53:59 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690797224.6318338, e133dba2-7426-493b-8282-ed18f3ca0a4a => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:53:59 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] VM Stopped (Lifecycle Event)
Jul 31 09:53:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9d152900-5ce5-4f90-b30d-d07e95c6dfaa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "225aca75-f3cc-4fc9-a3a3-52be185e9c42" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:53:59 user nova-compute[71113]: DEBUG nova.compute.manager [None req-c07aa603-d780-4d3e-9625-e5119c441840 None None] [instance: e133dba2-7426-493b-8282-ed18f3ca0a4a] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:53:59 user nova-compute[71113]: DEBUG nova.network.neutron [req-39300ab7-668f-41da-82ea-4cf82bbefa6c req-e31dc77a-94a2-4b21-beb2-789c2d9db972 service nova] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Updated VIF entry in instance network info cache for port e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:53:59 user nova-compute[71113]: DEBUG nova.network.neutron [req-39300ab7-668f-41da-82ea-4cf82bbefa6c req-e31dc77a-94a2-4b21-beb2-789c2d9db972 service nova] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Updating instance_info_cache with network_info: [{"id": "e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d", "address": "fa:16:3e:2c:5b:c3", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape82fc7e2-25", "ovs_interfaceid": "e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:53:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-39300ab7-668f-41da-82ea-4cf82bbefa6c req-e31dc77a-94a2-4b21-beb2-789c2d9db972 service nova] Releasing lock "refresh_cache-92d25a03-98ce-4bde-a3cc-20313ae77d41" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:53:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9d152900-5ce5-4f90-b30d-d07e95c6dfaa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Acquiring lock "225aca75-f3cc-4fc9-a3a3-52be185e9c42" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:53:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9d152900-5ce5-4f90-b30d-d07e95c6dfaa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "225aca75-f3cc-4fc9-a3a3-52be185e9c42" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:53:59 user nova-compute[71113]: INFO nova.compute.manager [None req-9d152900-5ce5-4f90-b30d-d07e95c6dfaa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Attaching volume 8730cac4-517b-4b24-a539-6b9a473e33d1 to /dev/vdb
Jul 31 09:53:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Acquiring lock "eb68aada-46ba-4798-a16e-bb2cacfcd747" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:53:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:53:59 user nova-compute[71113]: DEBUG os_brick.utils [None req-9d152900-5ce5-4f90-b30d-d07e95c6dfaa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:53:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:59 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Starting instance... {{(pid=71113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 09:53:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:59 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7406474-d3c6-4041-826d-b9e26dbe580b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:59 user nova-compute[71113]: DEBUG nova.network.neutron [req-775185b2-b0c8-4ff0-be09-24f08da23daf req-65a26524-29df-48af-b899-86bcc3a2c594 service nova] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Updated VIF entry in instance network info cache for port da9f4dda-8c5c-4af8-9b15-7572a9e66f9f. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:53:59 user nova-compute[71113]: DEBUG nova.network.neutron [req-775185b2-b0c8-4ff0-be09-24f08da23daf req-65a26524-29df-48af-b899-86bcc3a2c594 service nova] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Updating instance_info_cache with network_info: [{"id": "da9f4dda-8c5c-4af8-9b15-7572a9e66f9f", "address": "fa:16:3e:72:f1:32", "network": {"id": "2ce9c333-b413-4073-af8c-2e583872df61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1283872978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b02dfb26bc2472baef63892ab5b2492", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda9f4dda-8c", "ovs_interfaceid": "da9f4dda-8c5c-4af8-9b15-7572a9e66f9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:53:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.028s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:59 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8e7d86-a395-4f14-886e-3c0ba37719ce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:53:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-775185b2-b0c8-4ff0-be09-24f08da23daf req-65a26524-29df-48af-b899-86bcc3a2c594 service nova] Releasing lock "refresh_cache-225aca75-f3cc-4fc9-a3a3-52be185e9c42" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:53:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:53:59 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff07fcf4-f6c0-47d4-991b-2993908599a9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:59 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e10ca7-c6ac-4343-bc2c-2eb02510ee3a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:53:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-9d152900-5ce5-4f90-b30d-d07e95c6dfaa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-9d152900-5ce5-4f90-b30d-d07e95c6dfaa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:54:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:54:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:54:00 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9d152900-5ce5-4f90-b30d-d07e95c6dfaa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 09:54:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:00 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 09:54:00 user nova-compute[71113]: INFO nova.compute.claims [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Claim successful on node user
Jul 31 09:54:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:54:00 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 09:54:00 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[47daf9d2-3bf4-4621-b5e7-9d0e1759aef4]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:00 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-9d152900-5ce5-4f90-b30d-d07e95c6dfaa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 09:54:00 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-9d152900-5ce5-4f90-b30d-d07e95c6dfaa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 09:54:00 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-9d152900-5ce5-4f90-b30d-d07e95c6dfaa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 09:54:00 user nova-compute[71113]: DEBUG os_brick.utils [None req-9d152900-5ce5-4f90-b30d-d07e95c6dfaa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] <== get_connector_properties: return (176ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:54:00 user nova-compute[71113]: DEBUG nova.virt.block_device [None req-9d152900-5ce5-4f90-b30d-d07e95c6dfaa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Updating existing volume attachment record: 0784b321-7ed2-41b7-861b-871321f3003e {{(pid=71113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 09:54:00 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:54:00 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:54:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.512s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:54:00 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Start building networks asynchronously for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 09:54:00 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Allocating IP information in the background. {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 09:54:00 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] allocate_for_instance() {{(pid=71113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 09:54:00 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 09:54:00 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Start building block device mappings for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 09:54:00 user nova-compute[71113]: INFO nova.virt.block_device [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Booting with volume b9fe201f-b1ba-4c0e-8426-14f6713d3d16 at /dev/vda
Jul 31 09:54:00 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:01 user nova-compute[71113]: DEBUG os_brick.utils [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:54:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:01 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[910e90b6-2ed1-42b8-96fa-20a6ee5c3162]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:01 user nova-compute[71113]: DEBUG nova.policy [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4b9e45d968444ffba99ecf4c845b101e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db8c3c401c94419b4f534a20d60388c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71113) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 09:54:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:01 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e74dec-7a1d-4f0c-a022-f37a2010174e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:01 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0dcb30-45fe-44cb-8de8-470aad8d675e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:01 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f23684d-b020-418b-9b16-96ee355b758f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:54:01 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 09:54:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:54:01 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 09:54:01 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61915c3-1ef6-43ef-afd9-e52c7c20465a]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:01 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 09:54:01 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 09:54:01 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 09:54:01 user nova-compute[71113]: DEBUG os_brick.utils [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:54:01 user nova-compute[71113]: DEBUG nova.virt.block_device [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Updating existing volume attachment record: f5d7a895-4c68-4e77-b0bf-ad0e781247cc {{(pid=71113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 09:54:01 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:54:01 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:02 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Successfully created port: 4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 09:54:02 user nova-compute[71113]: DEBUG os_brick.utils [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:54:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:02 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[56bac35f-5fd3-4762-94bc-9186729451d0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:02 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a57eb75-778a-4a55-8842-1b63053cccc5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:02 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d659f452-6d61-450f-b678-e33aab1946c4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:02 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6923027-ddaf-478b-98f7-da25026e610a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:54:02 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 09:54:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:54:02 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 09:54:02 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1341fc7a-3cca-4d35-8eba-33c18e5d839a]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:02 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 09:54:02 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 09:54:02 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 09:54:02 user nova-compute[71113]: DEBUG os_brick.utils [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:54:02 user nova-compute[71113]: DEBUG nova.virt.block_device [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Updating existing volume attachment record: 25c20a3f-02ba-47ea-bb31-242eb91ccbdf {{(pid=71113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 09:54:02 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Successfully created port: cb50bad1-1e1e-4138-8b0b-f7dc17d0d760 {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 09:54:02 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:54:03 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Successfully created port: 685563e0-3264-4974-9df4-c9187df31d0b {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 09:54:03 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:54:03 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:54:03 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:54:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:54:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:54:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:54:03 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 09:54:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d2948be-3ebb-4067-a0c8-e2ca884814ff/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:04 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Successfully created port: 113cfbd7-7a98-4be6-af79-76777a24650c {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 09:54:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d2948be-3ebb-4067-a0c8-e2ca884814ff/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d2948be-3ebb-4067-a0c8-e2ca884814ff/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d2948be-3ebb-4067-a0c8-e2ca884814ff/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:04 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 09:54:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4df9380-7882-48a6-ba64-bb17429e54ac/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4df9380-7882-48a6-ba64-bb17429e54ac/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4df9380-7882-48a6-ba64-bb17429e54ac/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:04 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Successfully created port: bcad9d15-2562-4660-93b0-91a32ac0c390 {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 09:54:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4df9380-7882-48a6-ba64-bb17429e54ac/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/225aca75-f3cc-4fc9-a3a3-52be185e9c42/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/225aca75-f3cc-4fc9-a3a3-52be185e9c42/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/225aca75-f3cc-4fc9-a3a3-52be185e9c42/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/225aca75-f3cc-4fc9-a3a3-52be185e9c42/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a4b47dd-b335-4c2f-9dee-5421357a0ee1/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a4b47dd-b335-4c2f-9dee-5421357a0ee1/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a4b47dd-b335-4c2f-9dee-5421357a0ee1/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a4b47dd-b335-4c2f-9dee-5421357a0ee1/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:05 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 09:54:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:05 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Successfully updated port: 4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 09:54:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af1f4e7c-b336-457a-94cc-3df3c3203370/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:06 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:06 user nova-compute[71113]: DEBUG nova.compute.manager [req-ddde0320-f43b-4ae3-b76d-b853dc4f65bb req-738cc418-877e-4d25-815c-169c1c7f813f service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received event network-changed-4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:54:06 user nova-compute[71113]: DEBUG nova.compute.manager [req-ddde0320-f43b-4ae3-b76d-b853dc4f65bb req-738cc418-877e-4d25-815c-169c1c7f813f service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Refreshing instance network info cache due to event network-changed-4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:54:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ddde0320-f43b-4ae3-b76d-b853dc4f65bb req-738cc418-877e-4d25-815c-169c1c7f813f service nova] Acquiring lock "refresh_cache-eb68aada-46ba-4798-a16e-bb2cacfcd747" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:54:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ddde0320-f43b-4ae3-b76d-b853dc4f65bb req-738cc418-877e-4d25-815c-169c1c7f813f service nova] Acquired lock "refresh_cache-eb68aada-46ba-4798-a16e-bb2cacfcd747" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:54:06 user nova-compute[71113]: DEBUG nova.network.neutron [req-ddde0320-f43b-4ae3-b76d-b853dc4f65bb req-738cc418-877e-4d25-815c-169c1c7f813f service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Refreshing network info cache for port 4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:54:06 user nova-compute[71113]: DEBUG nova.network.neutron [req-ddde0320-f43b-4ae3-b76d-b853dc4f65bb req-738cc418-877e-4d25-815c-169c1c7f813f service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 09:54:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af1f4e7c-b336-457a-94cc-3df3c3203370/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af1f4e7c-b336-457a-94cc-3df3c3203370/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af1f4e7c-b336-457a-94cc-3df3c3203370/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:06 user nova-compute[71113]: DEBUG nova.network.neutron [req-ddde0320-f43b-4ae3-b76d-b853dc4f65bb req-738cc418-877e-4d25-815c-169c1c7f813f service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:54:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ddde0320-f43b-4ae3-b76d-b853dc4f65bb req-738cc418-877e-4d25-815c-169c1c7f813f service nova] Releasing lock "refresh_cache-eb68aada-46ba-4798-a16e-bb2cacfcd747" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:54:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:06 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Successfully updated port: 6f734493-7794-4e1e-a68b-4ce6995dadef {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 09:54:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d92f7e3-6f70-4344-9f15-9815d51024b6/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d92f7e3-6f70-4344-9f15-9815d51024b6/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d92f7e3-6f70-4344-9f15-9815d51024b6/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:07 user nova-compute[71113]: DEBUG nova.objects.instance [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lazy-loading 'flavor' on Instance uuid 1112a49d-27bd-4fc8-bae6-ec1decbb47db {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:54:07 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d92f7e3-6f70-4344-9f15-9815d51024b6/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:07 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Acquiring lock "refresh_cache-1112a49d-27bd-4fc8-bae6-ec1decbb47db" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:54:07 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Acquired lock "refresh_cache-1112a49d-27bd-4fc8-bae6-ec1decbb47db" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:54:07 user nova-compute[71113]: DEBUG nova.network.neutron [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 09:54:07 user nova-compute[71113]: DEBUG nova.objects.instance [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lazy-loading 'info_cache' on Instance uuid 1112a49d-27bd-4fc8-bae6-ec1decbb47db {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:54:07 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:54:07 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:54:07 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=7512MB free_disk=25.339900970458984GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 09:54:07 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:54:07 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:54:07 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Successfully updated port: 8354cc56-3d78-4f7a-b2fa-ee95e704d67c {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 09:54:07 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 0ea0401b-26c2-4655-956b-1bc000debd53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:54:07 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 1112a49d-27bd-4fc8-bae6-ec1decbb47db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:54:07 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 9a4b47dd-b335-4c2f-9dee-5421357a0ee1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:54:07 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance f4df9380-7882-48a6-ba64-bb17429e54ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:54:07 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance efa311a0-fe2e-4c0f-af66-09c3eb38fbf1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:54:07 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 3157a7a6-b8a9-4e2d-a157-360bce4c625d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:54:07 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance af1f4e7c-b336-457a-94cc-3df3c3203370 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:54:07 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 6d92f7e3-6f70-4344-9f15-9815d51024b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:54:07 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 225aca75-f3cc-4fc9-a3a3-52be185e9c42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:54:07 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 8d2948be-3ebb-4067-a0c8-e2ca884814ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:54:07 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 92d25a03-98ce-4bde-a3cc-20313ae77d41 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:54:07 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance eb68aada-46ba-4798-a16e-bb2cacfcd747 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:54:07 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 09:54:07 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG nova.network.neutron [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Updating instance_info_cache with network_info: [{"id": "647f984e-a9e3-4e49-9877-75ad4826e467", "address": "fa:16:3e:72:e2:f2", "network": {"id": "26352e29-fc15-48ac-be14-8af7a0c80219", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866093358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bae93d4fff5e4990bd9fe78e71d6d2d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647f984e-a9", "ovs_interfaceid": "647f984e-a9e3-4e49-9877-75ad4826e467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG nova.compute.manager [req-78ca3ddb-536c-49c7-997c-a542093df704 req-ee044f82-2e34-431d-b6f6-04314fc345b1 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received event network-changed-6f734493-7794-4e1e-a68b-4ce6995dadef {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG nova.compute.manager [req-78ca3ddb-536c-49c7-997c-a542093df704 req-ee044f82-2e34-431d-b6f6-04314fc345b1 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Refreshing instance network info cache due to event network-changed-6f734493-7794-4e1e-a68b-4ce6995dadef. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-78ca3ddb-536c-49c7-997c-a542093df704 req-ee044f82-2e34-431d-b6f6-04314fc345b1 service nova] Acquiring lock "refresh_cache-eb68aada-46ba-4798-a16e-bb2cacfcd747" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-78ca3ddb-536c-49c7-997c-a542093df704 req-ee044f82-2e34-431d-b6f6-04314fc345b1 service nova] Acquired lock "refresh_cache-eb68aada-46ba-4798-a16e-bb2cacfcd747" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG nova.network.neutron [req-78ca3ddb-536c-49c7-997c-a542093df704 req-ee044f82-2e34-431d-b6f6-04314fc345b1 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Refreshing network info cache for port 6f734493-7794-4e1e-a68b-4ce6995dadef {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Releasing lock "refresh_cache-1112a49d-27bd-4fc8-bae6-ec1decbb47db" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:54:08 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Instance destroyed successfully.
Jul 31 09:54:08 user nova-compute[71113]: DEBUG nova.objects.instance [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lazy-loading 'resources' on Instance uuid 1112a49d-27bd-4fc8-bae6-ec1decbb47db {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:46:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-945276604',display_name='tempest-AttachVolumeTestJSON-server-945276604',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-945276604',id=4,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrh1mBzVZxlJvQ7fNDAygLsv+THMZUpGRA7FK4egW/8+4V1WnWdx5N/BO7+Js/uDb74ZnuQwIBHV28KCkKnxQdjKa1wMXR+/Fwf+zqW2yRjgeNcXtlxa12OdQcYhwsVfQ==',key_name='tempest-keypair-1526222779',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:46:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='bae93d4fff5e4990bd9fe78e71d6d2d2',ramdisk_id='',reservation_id='r-l6z5atk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1230374483',owner_user_name='tempest-AttachVolumeTestJSON-1230374483-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:52:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07e8e7f9b62d452a88a29f333177c9d2',uuid=1112a49d-27bd-4fc8-bae6-ec1decbb47db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "647f984e-a9e3-4e49-9877-75ad4826e467", "address": "fa:16:3e:72:e2:f2", "network": {"id": "26352e29-fc15-48ac-be14-8af7a0c80219", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866093358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bae93d4fff5e4990bd9fe78e71d6d2d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647f984e-a9", "ovs_interfaceid": "647f984e-a9e3-4e49-9877-75ad4826e467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Converting VIF {"id": "647f984e-a9e3-4e49-9877-75ad4826e467", "address": "fa:16:3e:72:e2:f2", "network": {"id": "26352e29-fc15-48ac-be14-8af7a0c80219", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866093358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bae93d4fff5e4990bd9fe78e71d6d2d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647f984e-a9", "ovs_interfaceid": "647f984e-a9e3-4e49-9877-75ad4826e467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:e2:f2,bridge_name='br-int',has_traffic_filtering=True,id=647f984e-a9e3-4e49-9877-75ad4826e467,network=Network(26352e29-fc15-48ac-be14-8af7a0c80219),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap647f984e-a9') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG os_vif [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:e2:f2,bridge_name='br-int',has_traffic_filtering=True,id=647f984e-a9e3-4e49-9877-75ad4826e467,network=Network(26352e29-fc15-48ac-be14-8af7a0c80219),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap647f984e-a9') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap647f984e-a9, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG nova.network.neutron [req-78ca3ddb-536c-49c7-997c-a542093df704 req-ee044f82-2e34-431d-b6f6-04314fc345b1 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:54:08 user nova-compute[71113]: INFO os_vif [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:e2:f2,bridge_name='br-int',has_traffic_filtering=True,id=647f984e-a9e3-4e49-9877-75ad4826e467,network=Network(26352e29-fc15-48ac-be14-8af7a0c80219),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap647f984e-a9')
Jul 31 09:54:08 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Start _get_guest_xml network_info=[{"id": "647f984e-a9e3-4e49-9877-75ad4826e467", "address": "fa:16:3e:72:e2:f2", "network": {"id": "26352e29-fc15-48ac-be14-8af7a0c80219", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866093358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bae93d4fff5e4990bd9fe78e71d6d2d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647f984e-a9", "ovs_interfaceid": "647f984e-a9e3-4e49-9877-75ad4826e467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'image_id': '078646fe-b504-41ed-a147-61072e903e51'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG nova.objects.instance [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lazy-loading 'numa_topology' on Instance uuid 1112a49d-27bd-4fc8-bae6-ec1decbb47db {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.565s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:54:08 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:54:08 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:54:08 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG nova.objects.instance [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1112a49d-27bd-4fc8-bae6-ec1decbb47db {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:46:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-945276604',display_name='tempest-AttachVolumeTestJSON-server-945276604',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-945276604',id=4,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrh1mBzVZxlJvQ7fNDAygLsv+THMZUpGRA7FK4egW/8+4V1WnWdx5N/BO7+Js/uDb74ZnuQwIBHV28KCkKnxQdjKa1wMXR+/Fwf+zqW2yRjgeNcXtlxa12OdQcYhwsVfQ==',key_name='tempest-keypair-1526222779',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:46:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='bae93d4fff5e4990bd9fe78e71d6d2d2',ramdisk_id='',reservation_id='r-l6z5atk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1230374483',owner_user_name='tempest-AttachVolumeTestJSON-1230374483-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:52:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07e8e7f9b62d452a88a29f333177c9d2',uuid=1112a49d-27bd-4fc8-bae6-ec1decbb47db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "647f984e-a9e3-4e49-9877-75ad4826e467", "address": "fa:16:3e:72:e2:f2", "network": {"id": "26352e29-fc15-48ac-be14-8af7a0c80219", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866093358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bae93d4fff5e4990bd9fe78e71d6d2d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647f984e-a9", "ovs_interfaceid": "647f984e-a9e3-4e49-9877-75ad4826e467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Converting VIF {"id": "647f984e-a9e3-4e49-9877-75ad4826e467", "address": "fa:16:3e:72:e2:f2", "network": {"id": "26352e29-fc15-48ac-be14-8af7a0c80219", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866093358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bae93d4fff5e4990bd9fe78e71d6d2d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647f984e-a9", "ovs_interfaceid": "647f984e-a9e3-4e49-9877-75ad4826e467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:e2:f2,bridge_name='br-int',has_traffic_filtering=True,id=647f984e-a9e3-4e49-9877-75ad4826e467,network=Network(26352e29-fc15-48ac-be14-8af7a0c80219),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap647f984e-a9') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG nova.objects.instance [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lazy-loading 'pci_devices' on Instance uuid 1112a49d-27bd-4fc8-bae6-ec1decbb47db {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] End _get_guest_xml xml=<domain type="kvm">
Jul 31 09:54:08 user nova-compute[71113]:   <uuid>1112a49d-27bd-4fc8-bae6-ec1decbb47db</uuid>
Jul 31 09:54:08 user nova-compute[71113]:   <name>instance-00000004</name>
Jul 31 09:54:08 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 09:54:08 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 09:54:08 user nova-compute[71113]:   <metadata>
Jul 31 09:54:08 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 09:54:08 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 09:54:08 user nova-compute[71113]:       <nova:name>tempest-AttachVolumeTestJSON-server-945276604</nova:name>
Jul 31 09:54:08 user nova-compute[71113]:       <nova:creationTime>2023-07-31 09:54:08</nova:creationTime>
Jul 31 09:54:08 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 09:54:08 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 09:54:08 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 09:54:08 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 09:54:08 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 09:54:08 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 09:54:08 user nova-compute[71113]:       </nova:flavor>
Jul 31 09:54:08 user nova-compute[71113]:       <nova:owner>
Jul 31 09:54:08 user nova-compute[71113]:         <nova:user uuid="07e8e7f9b62d452a88a29f333177c9d2">tempest-AttachVolumeTestJSON-1230374483-project-member</nova:user>
Jul 31 09:54:08 user nova-compute[71113]:         <nova:project uuid="bae93d4fff5e4990bd9fe78e71d6d2d2">tempest-AttachVolumeTestJSON-1230374483</nova:project>
Jul 31 09:54:08 user nova-compute[71113]:       </nova:owner>
Jul 31 09:54:08 user nova-compute[71113]:       <nova:root type="image" uuid="078646fe-b504-41ed-a147-61072e903e51"/>
Jul 31 09:54:08 user nova-compute[71113]:       <nova:ports>
Jul 31 09:54:08 user nova-compute[71113]:         <nova:port uuid="647f984e-a9e3-4e49-9877-75ad4826e467">
Jul 31 09:54:08 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 31 09:54:08 user nova-compute[71113]:         </nova:port>
Jul 31 09:54:08 user nova-compute[71113]:       </nova:ports>
Jul 31 09:54:08 user nova-compute[71113]:     </nova:instance>
Jul 31 09:54:08 user nova-compute[71113]:   </metadata>
Jul 31 09:54:08 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 09:54:08 user nova-compute[71113]:     <system>
Jul 31 09:54:08 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 09:54:08 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 09:54:08 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 09:54:08 user nova-compute[71113]:       <entry name="serial">1112a49d-27bd-4fc8-bae6-ec1decbb47db</entry>
Jul 31 09:54:08 user nova-compute[71113]:       <entry name="uuid">1112a49d-27bd-4fc8-bae6-ec1decbb47db</entry>
Jul 31 09:54:08 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 09:54:08 user nova-compute[71113]:     </system>
Jul 31 09:54:08 user nova-compute[71113]:   </sysinfo>
Jul 31 09:54:08 user nova-compute[71113]:   <os>
Jul 31 09:54:08 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 09:54:08 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 09:54:08 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 09:54:08 user nova-compute[71113]:   </os>
Jul 31 09:54:08 user nova-compute[71113]:   <features>
Jul 31 09:54:08 user nova-compute[71113]:     <acpi/>
Jul 31 09:54:08 user nova-compute[71113]:     <apic/>
Jul 31 09:54:08 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 09:54:08 user nova-compute[71113]:   </features>
Jul 31 09:54:08 user nova-compute[71113]:   <clock offset="utc">
Jul 31 09:54:08 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 09:54:08 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 09:54:08 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 09:54:08 user nova-compute[71113]:   </clock>
Jul 31 09:54:08 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 09:54:08 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 09:54:08 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 09:54:08 user nova-compute[71113]:   </cpu>
Jul 31 09:54:08 user nova-compute[71113]:   <devices>
Jul 31 09:54:08 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 09:54:08 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 09:54:08 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk"/>
Jul 31 09:54:08 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 09:54:08 user nova-compute[71113]:     </disk>
Jul 31 09:54:08 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 09:54:08 user nova-compute[71113]:       <mac address="fa:16:3e:72:e2:f2"/>
Jul 31 09:54:08 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:54:08 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 09:54:08 user nova-compute[71113]:       <target dev="tap647f984e-a9"/>
Jul 31 09:54:08 user nova-compute[71113]:     </interface>
Jul 31 09:54:08 user nova-compute[71113]:     <serial type="pty">
Jul 31 09:54:08 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/console.log" append="off"/>
Jul 31 09:54:08 user nova-compute[71113]:     </serial>
Jul 31 09:54:08 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 09:54:08 user nova-compute[71113]:     <video>
Jul 31 09:54:08 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:54:08 user nova-compute[71113]:     </video>
Jul 31 09:54:08 user nova-compute[71113]:     <rng model="virtio">
Jul 31 09:54:08 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 09:54:08 user nova-compute[71113]:     </rng>
Jul 31 09:54:08 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 09:54:08 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 09:54:08 user nova-compute[71113]:       <stats period="10"/>
Jul 31 09:54:08 user nova-compute[71113]:     </memballoon>
Jul 31 09:54:08 user nova-compute[71113]:   </devices>
Jul 31 09:54:08 user nova-compute[71113]: </domain>
Jul 31 09:54:08 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG nova.network.neutron [req-78ca3ddb-536c-49c7-997c-a542093df704 req-ee044f82-2e34-431d-b6f6-04314fc345b1 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-78ca3ddb-536c-49c7-997c-a542093df704 req-ee044f82-2e34-431d-b6f6-04314fc345b1 service nova] Releasing lock "refresh_cache-eb68aada-46ba-4798-a16e-bb2cacfcd747" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG nova.compute.manager [req-78ca3ddb-536c-49c7-997c-a542093df704 req-ee044f82-2e34-431d-b6f6-04314fc345b1 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received event network-changed-8354cc56-3d78-4f7a-b2fa-ee95e704d67c {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG nova.compute.manager [req-78ca3ddb-536c-49c7-997c-a542093df704 req-ee044f82-2e34-431d-b6f6-04314fc345b1 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Refreshing instance network info cache due to event network-changed-8354cc56-3d78-4f7a-b2fa-ee95e704d67c. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-78ca3ddb-536c-49c7-997c-a542093df704 req-ee044f82-2e34-431d-b6f6-04314fc345b1 service nova] Acquiring lock "refresh_cache-eb68aada-46ba-4798-a16e-bb2cacfcd747" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-78ca3ddb-536c-49c7-997c-a542093df704 req-ee044f82-2e34-431d-b6f6-04314fc345b1 service nova] Acquired lock "refresh_cache-eb68aada-46ba-4798-a16e-bb2cacfcd747" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG nova.network.neutron [req-78ca3ddb-536c-49c7-997c-a542093df704 req-ee044f82-2e34-431d-b6f6-04314fc345b1 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Refreshing network info cache for port 8354cc56-3d78-4f7a-b2fa-ee95e704d67c {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG nova.network.neutron [req-78ca3ddb-536c-49c7-997c-a542093df704 req-ee044f82-2e34-431d-b6f6-04314fc345b1 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Successfully updated port: cb50bad1-1e1e-4138-8b0b-f7dc17d0d760 {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG nova.objects.instance [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1112a49d-27bd-4fc8-bae6-ec1decbb47db {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG nova.network.neutron [req-78ca3ddb-536c-49c7-997c-a542093df704 req-ee044f82-2e34-431d-b6f6-04314fc345b1 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-78ca3ddb-536c-49c7-997c-a542093df704 req-ee044f82-2e34-431d-b6f6-04314fc345b1 service nova] Releasing lock "refresh_cache-eb68aada-46ba-4798-a16e-bb2cacfcd747" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.143s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk. size=1073741824 {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Cannot resize image /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk to a smaller size. {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG nova.objects.instance [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lazy-loading 'migration_context' on Instance uuid 1112a49d-27bd-4fc8-bae6-ec1decbb47db {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:46:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-945276604',display_name='tempest-AttachVolumeTestJSON-server-945276604',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-945276604',id=4,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrh1mBzVZxlJvQ7fNDAygLsv+THMZUpGRA7FK4egW/8+4V1WnWdx5N/BO7+Js/uDb74ZnuQwIBHV28KCkKnxQdjKa1wMXR+/Fwf+zqW2yRjgeNcXtlxa12OdQcYhwsVfQ==',key_name='tempest-keypair-1526222779',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:46:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='bae93d4fff5e4990bd9fe78e71d6d2d2',ramdisk_id='',reservation_id='r-l6z5atk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1230374483',owner_user_name='tempest-AttachVolumeTestJSON-1230374483-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:52:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07e8e7f9b62d452a88a29f333177c9d2',uuid=1112a49d-27bd-4fc8-bae6-ec1decbb47db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "647f984e-a9e3-4e49-9877-75ad4826e467", "address": "fa:16:3e:72:e2:f2", "network": {"id": "26352e29-fc15-48ac-be14-8af7a0c80219", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866093358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bae93d4fff5e4990bd9fe78e71d6d2d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647f984e-a9", "ovs_interfaceid": "647f984e-a9e3-4e49-9877-75ad4826e467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Converting VIF {"id": "647f984e-a9e3-4e49-9877-75ad4826e467", "address": "fa:16:3e:72:e2:f2", "network": {"id": "26352e29-fc15-48ac-be14-8af7a0c80219", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866093358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bae93d4fff5e4990bd9fe78e71d6d2d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647f984e-a9", "ovs_interfaceid": "647f984e-a9e3-4e49-9877-75ad4826e467", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:e2:f2,bridge_name='br-int',has_traffic_filtering=True,id=647f984e-a9e3-4e49-9877-75ad4826e467,network=Network(26352e29-fc15-48ac-be14-8af7a0c80219),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap647f984e-a9') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG os_vif [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:e2:f2,bridge_name='br-int',has_traffic_filtering=True,id=647f984e-a9e3-4e49-9877-75ad4826e467,network=Network(26352e29-fc15-48ac-be14-8af7a0c80219),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap647f984e-a9') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap647f984e-a9, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap647f984e-a9, col_values=(('external_ids', {'iface-id': '647f984e-a9e3-4e49-9877-75ad4826e467', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:e2:f2', 'vm-uuid': '1112a49d-27bd-4fc8-bae6-ec1decbb47db'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:54:08 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:08 user nova-compute[71113]: INFO os_vif [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:e2:f2,bridge_name='br-int',has_traffic_filtering=True,id=647f984e-a9e3-4e49-9877-75ad4826e467,network=Network(26352e29-fc15-48ac-be14-8af7a0c80219),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap647f984e-a9')
Jul 31 09:54:08 user nova-compute[71113]: INFO nova.virt.block_device [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Booting with volume b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef at /dev/vdb
Jul 31 09:54:09 user nova-compute[71113]: DEBUG os_brick.utils [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:54:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:09 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29bc804-4757-4cb4-857a-a8ce3be38975]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:09 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e953ad-bc54-47bf-ab7b-b529fb66a991]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:09 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5522cfa5-9f5f-40f0-a2fb-728c58239677]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:09 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f6964e-bfbe-4e6b-978d-dd1dbea09da4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:54:09 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 09:54:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:09 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:54:09 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:54:09 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:54:09 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 09:54:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:54:09 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 09:54:09 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2836ff-7ae4-4fd0-afe4-d4649043a5e2]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:09 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 09:54:09 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 09:54:09 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 09:54:09 user nova-compute[71113]: DEBUG os_brick.utils [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:54:09 user nova-compute[71113]: DEBUG nova.virt.block_device [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Updating existing volume attachment record: 82ea7304-2453-42c0-b8fe-93c1203d7ce4 {{(pid=71113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 09:54:09 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Successfully updated port: 685563e0-3264-4974-9df4-c9187df31d0b {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 09:54:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:09 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:54:09 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:54:09 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 09:54:09 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "refresh_cache-efa311a0-fe2e-4c0f-af66-09c3eb38fbf1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:54:09 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquired lock "refresh_cache-efa311a0-fe2e-4c0f-af66-09c3eb38fbf1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:54:09 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Forcefully refreshing network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG nova.compute.manager [req-0ee52199-2c12-45db-8be9-1a9dc745d19d req-aee419e7-9613-4912-b36b-121eda1b17de service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received event network-changed-cb50bad1-1e1e-4138-8b0b-f7dc17d0d760 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG nova.compute.manager [req-0ee52199-2c12-45db-8be9-1a9dc745d19d req-aee419e7-9613-4912-b36b-121eda1b17de service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Refreshing instance network info cache due to event network-changed-cb50bad1-1e1e-4138-8b0b-f7dc17d0d760. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-0ee52199-2c12-45db-8be9-1a9dc745d19d req-aee419e7-9613-4912-b36b-121eda1b17de service nova] Acquiring lock "refresh_cache-eb68aada-46ba-4798-a16e-bb2cacfcd747" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-0ee52199-2c12-45db-8be9-1a9dc745d19d req-aee419e7-9613-4912-b36b-121eda1b17de service nova] Acquired lock "refresh_cache-eb68aada-46ba-4798-a16e-bb2cacfcd747" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG nova.network.neutron [req-0ee52199-2c12-45db-8be9-1a9dc745d19d req-aee419e7-9613-4912-b36b-121eda1b17de service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Refreshing network info cache for port cb50bad1-1e1e-4138-8b0b-f7dc17d0d760 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d152900-5ce5-4f90-b30d-d07e95c6dfaa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d152900-5ce5-4f90-b30d-d07e95c6dfaa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QvpwdbAt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:54:10 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-9d152900-5ce5-4f90-b30d-d07e95c6dfaa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:54:10 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-9d152900-5ce5-4f90-b30d-d07e95c6dfaa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-9d152900-5ce5-4f90-b30d-d07e95c6dfaa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:54:10 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-9d152900-5ce5-4f90-b30d-d07e95c6dfaa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:54:10 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-9d152900-5ce5-4f90-b30d-d07e95c6dfaa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-9d152900-5ce5-4f90-b30d-d07e95c6dfaa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:54:10 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-9d152900-5ce5-4f90-b30d-d07e95c6dfaa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 09:54:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1 -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b290c249-4c1a-4c9a-95dd-068099b33527]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d152900-5ce5-4f90-b30d-d07e95c6dfaa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 09:54:10 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG nova.network.neutron [req-0ee52199-2c12-45db-8be9-1a9dc745d19d req-aee419e7-9613-4912-b36b-121eda1b17de service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1 -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Successfully updated port: 113cfbd7-7a98-4be6-af79-76777a24650c {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b6f342-6d5c-45a0-8263-9871a91fc32d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d152900-5ce5-4f90-b30d-d07e95c6dfaa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1] added
Jul 31 09:54:10 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[524b38d9-25ee-4337-849b-045911859f72]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d152900-5ce5-4f90-b30d-d07e95c6dfaa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[51145b6f-5eaa-413f-94c6-ba32b9532cfb]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d152900-5ce5-4f90-b30d-d07e95c6dfaa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QvpwdbAt {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QvpwdbAt" returned: 0 in 0.030s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9e93ad-e343-44f5-acf9-72502165f046]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d152900-5ce5-4f90-b30d-d07e95c6dfaa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QvpwdbAt'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f092b7c8-0979-4f12-8669-b5a96d8f6cb2]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d152900-5ce5-4f90-b30d-d07e95c6dfaa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa907f9-88be-4320-8b61-906f338e5d2d]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d152900-5ce5-4f90-b30d-d07e95c6dfaa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:54:10 user nova-compute[71113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)
Jul 31 09:54:10 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d152900-5ce5-4f90-b30d-d07e95c6dfaa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:54:10 user nova-compute[71113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)
Jul 31 09:54:10 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1 -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Updating instance_info_cache with network_info: [{"id": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "address": "fa:16:3e:16:bb:aa", "network": {"id": "4f2ea02a-9b26-4f2a-af23-39c060703ff3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-725518740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5bb5c0790e54702b881dc5e45641be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b5a493-47", "ovs_interfaceid": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Releasing lock "refresh_cache-efa311a0-fe2e-4c0f-af66-09c3eb38fbf1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Updated the network info_cache for instance {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG nova.compute.manager [req-02ffa574-0ddc-4108-9de3-a5391c0b3cc0 req-032d2f8b-abc1-43c6-870d-5ac8c762f3e9 service nova] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Received event network-vif-plugged-647f984e-a9e3-4e49-9877-75ad4826e467 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-02ffa574-0ddc-4108-9de3-a5391c0b3cc0 req-032d2f8b-abc1-43c6-870d-5ac8c762f3e9 service nova] Acquiring lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-02ffa574-0ddc-4108-9de3-a5391c0b3cc0 req-032d2f8b-abc1-43c6-870d-5ac8c762f3e9 service nova] Lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-02ffa574-0ddc-4108-9de3-a5391c0b3cc0 req-032d2f8b-abc1-43c6-870d-5ac8c762f3e9 service nova] Lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG nova.compute.manager [req-02ffa574-0ddc-4108-9de3-a5391c0b3cc0 req-032d2f8b-abc1-43c6-870d-5ac8c762f3e9 service nova] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] No waiting events found dispatching network-vif-plugged-647f984e-a9e3-4e49-9877-75ad4826e467 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:54:10 user nova-compute[71113]: WARNING nova.compute.manager [req-02ffa574-0ddc-4108-9de3-a5391c0b3cc0 req-032d2f8b-abc1-43c6-870d-5ac8c762f3e9 service nova] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Received unexpected event network-vif-plugged-647f984e-a9e3-4e49-9877-75ad4826e467 for instance with vm_state stopped and task_state powering-on.
Jul 31 09:54:10 user nova-compute[71113]: DEBUG nova.network.neutron [req-0ee52199-2c12-45db-8be9-1a9dc745d19d req-aee419e7-9613-4912-b36b-121eda1b17de service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-0ee52199-2c12-45db-8be9-1a9dc745d19d req-aee419e7-9613-4912-b36b-121eda1b17de service nova] Releasing lock "refresh_cache-eb68aada-46ba-4798-a16e-bb2cacfcd747" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG nova.compute.manager [req-0ee52199-2c12-45db-8be9-1a9dc745d19d req-aee419e7-9613-4912-b36b-121eda1b17de service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received event network-changed-685563e0-3264-4974-9df4-c9187df31d0b {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG nova.compute.manager [req-0ee52199-2c12-45db-8be9-1a9dc745d19d req-aee419e7-9613-4912-b36b-121eda1b17de service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Refreshing instance network info cache due to event network-changed-685563e0-3264-4974-9df4-c9187df31d0b. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-0ee52199-2c12-45db-8be9-1a9dc745d19d req-aee419e7-9613-4912-b36b-121eda1b17de service nova] Acquiring lock "refresh_cache-eb68aada-46ba-4798-a16e-bb2cacfcd747" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-0ee52199-2c12-45db-8be9-1a9dc745d19d req-aee419e7-9613-4912-b36b-121eda1b17de service nova] Acquired lock "refresh_cache-eb68aada-46ba-4798-a16e-bb2cacfcd747" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:54:10 user nova-compute[71113]: DEBUG nova.network.neutron [req-0ee52199-2c12-45db-8be9-1a9dc745d19d req-aee419e7-9613-4912-b36b-121eda1b17de service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Refreshing network info cache for port 685563e0-3264-4974-9df4-c9187df31d0b {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:54:11 user nova-compute[71113]: DEBUG nova.network.neutron [req-0ee52199-2c12-45db-8be9-1a9dc745d19d req-aee419e7-9613-4912-b36b-121eda1b17de service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 09:54:11 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:11 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:11 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Successfully updated port: bcad9d15-2562-4660-93b0-91a32ac0c390 {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 09:54:11 user nova-compute[71113]: DEBUG nova.network.neutron [req-0ee52199-2c12-45db-8be9-1a9dc745d19d req-aee419e7-9613-4912-b36b-121eda1b17de service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:54:11 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Acquiring lock "refresh_cache-eb68aada-46ba-4798-a16e-bb2cacfcd747" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:54:11 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-0ee52199-2c12-45db-8be9-1a9dc745d19d req-aee419e7-9613-4912-b36b-121eda1b17de service nova] Releasing lock "refresh_cache-eb68aada-46ba-4798-a16e-bb2cacfcd747" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:54:11 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Acquired lock "refresh_cache-eb68aada-46ba-4798-a16e-bb2cacfcd747" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:54:11 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 09:54:11 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 09:54:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1 -p 172.16.0.220:3260 --login" returned: 0 in 1.075s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:11 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6554e5a0-bca9-46d0-be78-6660a414c8d4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:11 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d152900-5ce5-4f90-b30d-d07e95c6dfaa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1, portal: 172.16.0.220,3260]
Jul 31 09:54:11 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1, portal: 172.16.0.220,3260] successful.
Jul 31 09:54:11 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:54:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:11 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ccd1a50-99be-409c-ba8b-ffcf3130d597]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:11 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d152900-5ce5-4f90-b30d-d07e95c6dfaa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:54:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:11 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[636eb055-8450-48b0-8665-58a840525116]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:11 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d152900-5ce5-4f90-b30d-d07e95c6dfaa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:54:11 user nova-compute[71113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)
Jul 31 09:54:11 user nova-compute[71113]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1 (non-flash)
Jul 31 09:54:11 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:54:11 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d152900-5ce5-4f90-b30d-d07e95c6dfaa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:54:11 user nova-compute[71113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)
Jul 31 09:54:11 user nova-compute[71113]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1 (non-flash)
Jul 31 09:54:11 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:54:11 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-9d152900-5ce5-4f90-b30d-d07e95c6dfaa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.371s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:54:11 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d152900-5ce5-4f90-b30d-d07e95c6dfaa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 09:54:11 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-9d152900-5ce5-4f90-b30d-d07e95c6dfaa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 09:54:11 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-9d152900-5ce5-4f90-b30d-d07e95c6dfaa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 09:54:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:11 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[daeba71e-819e-4df7-ab8c-d4c654f785d4]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:11 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-9d152900-5ce5-4f90-b30d-d07e95c6dfaa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: None {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 09:54:12 user nova-compute[71113]: DEBUG nova.compute.manager [req-be8ff0bc-7d82-4eae-9e4f-bd7183284749 req-e137e710-1008-4b54-8e53-f824d56a5018 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received event network-changed-113cfbd7-7a98-4be6-af79-76777a24650c {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:54:12 user nova-compute[71113]: DEBUG nova.compute.manager [req-be8ff0bc-7d82-4eae-9e4f-bd7183284749 req-e137e710-1008-4b54-8e53-f824d56a5018 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Refreshing instance network info cache due to event network-changed-113cfbd7-7a98-4be6-af79-76777a24650c. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:54:12 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-be8ff0bc-7d82-4eae-9e4f-bd7183284749 req-e137e710-1008-4b54-8e53-f824d56a5018 service nova] Acquiring lock "refresh_cache-eb68aada-46ba-4798-a16e-bb2cacfcd747" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:54:12 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797252.6371574, 1112a49d-27bd-4fc8-bae6-ec1decbb47db => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:54:12 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] VM Resumed (Lifecycle Event)
Jul 31 09:54:12 user nova-compute[71113]: DEBUG nova.compute.manager [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 09:54:12 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Instance rebooted successfully.
Jul 31 09:54:12 user nova-compute[71113]: DEBUG nova.compute.manager [None req-c375206a-ca48-4891-962f-ccee8580b7ad tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:54:12 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:54:12 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:54:12 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] During sync_power_state the instance has a pending task (powering-on). Skip.
Jul 31 09:54:12 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797252.6392758, 1112a49d-27bd-4fc8-bae6-ec1decbb47db => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:54:12 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] VM Started (Lifecycle Event)
Jul 31 09:54:12 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:54:12 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:54:12 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-9d152900-5ce5-4f90-b30d-d07e95c6dfaa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 09:54:12 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d152900-5ce5-4f90-b30d-d07e95c6dfaa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QvpwdbAt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 09:54:12 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-9d152900-5ce5-4f90-b30d-d07e95c6dfaa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.411s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:54:12 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d152900-5ce5-4f90-b30d-d07e95c6dfaa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] <== connect_volume: return (2412ms) {'type': 'block', 'scsi_wwn': '26662356233666266', 'path': '/dev/sdc'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:54:12 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d152900-5ce5-4f90-b30d-d07e95c6dfaa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662356233666266', 'path': '/dev/sdc'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 09:54:12 user nova-compute[71113]: DEBUG nova.objects.instance [None req-9d152900-5ce5-4f90-b30d-d07e95c6dfaa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lazy-loading 'flavor' on Instance uuid 225aca75-f3cc-4fc9-a3a3-52be185e9c42 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:54:12 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-9d152900-5ce5-4f90-b30d-d07e95c6dfaa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 09:54:12 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:54:12 user nova-compute[71113]:   <source dev="/dev/sdc"/>
Jul 31 09:54:12 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 09:54:12 user nova-compute[71113]:   <serial>8730cac4-517b-4b24-a539-6b9a473e33d1</serial>
Jul 31 09:54:12 user nova-compute[71113]: </disk>
Jul 31 09:54:12 user nova-compute[71113]:  {{(pid=71113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 09:54:12 user nova-compute[71113]: DEBUG nova.compute.manager [req-bb21e19d-42f0-4c1c-a9d5-265debba1594 req-99811023-2f04-49b3-bc5e-cb1af20cf63f service nova] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Received event network-vif-plugged-647f984e-a9e3-4e49-9877-75ad4826e467 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:54:12 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-bb21e19d-42f0-4c1c-a9d5-265debba1594 req-99811023-2f04-49b3-bc5e-cb1af20cf63f service nova] Acquiring lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:54:12 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-bb21e19d-42f0-4c1c-a9d5-265debba1594 req-99811023-2f04-49b3-bc5e-cb1af20cf63f service nova] Lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:54:12 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-bb21e19d-42f0-4c1c-a9d5-265debba1594 req-99811023-2f04-49b3-bc5e-cb1af20cf63f service nova] Lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:54:12 user nova-compute[71113]: DEBUG nova.compute.manager [req-bb21e19d-42f0-4c1c-a9d5-265debba1594 req-99811023-2f04-49b3-bc5e-cb1af20cf63f service nova] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] No waiting events found dispatching network-vif-plugged-647f984e-a9e3-4e49-9877-75ad4826e467 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:54:12 user nova-compute[71113]: WARNING nova.compute.manager [req-bb21e19d-42f0-4c1c-a9d5-265debba1594 req-99811023-2f04-49b3-bc5e-cb1af20cf63f service nova] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Received unexpected event network-vif-plugged-647f984e-a9e3-4e49-9877-75ad4826e467 for instance with vm_state active and task_state None.
Jul 31 09:54:13 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-9d152900-5ce5-4f90-b30d-d07e95c6dfaa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:54:13 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-9d152900-5ce5-4f90-b30d-d07e95c6dfaa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:54:13 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-9d152900-5ce5-4f90-b30d-d07e95c6dfaa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] No VIF found with MAC fa:16:3e:72:f1:32, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 09:54:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9d152900-5ce5-4f90-b30d-d07e95c6dfaa tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "225aca75-f3cc-4fc9-a3a3-52be185e9c42" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.629s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:54:13 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Updating instance_info_cache with network_info: [{"id": "4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e", "address": "fa:16:3e:71:d1:b6", "network": {"id": "f9b8375f-1e97-4274-8fef-ebe96b9dec13", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-937842323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dcc0c50-3d", "ovs_interfaceid": "4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6f734493-7794-4e1e-a68b-4ce6995dadef", "address": "fa:16:3e:77:21:46", "network": {"id": "93576160-6eb8-473f-ad25-fc3bb5e10825", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155060213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f734493-77", "ovs_interfaceid": "6f734493-7794-4e1e-a68b-4ce6995dadef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8354cc56-3d78-4f7a-b2fa-ee95e704d67c", "address": "fa:16:3e:51:5b:97", "network": {"id": "93576160-6eb8-473f-ad25-fc3bb5e10825", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155060213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8354cc56-3d", "ovs_interfaceid": "8354cc56-3d78-4f7a-b2fa-ee95e704d67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cb50bad1-1e1e-4138-8b0b-f7dc17d0d760", "address": "fa:16:3e:64:4b:9d", "network": {"id": "93576160-6eb8-473f-ad25-fc3bb5e10825", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155060213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb50bad1-1e", "ovs_interfaceid": "cb50bad1-1e1e-4138-8b0b-f7dc17d0d760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "685563e0-3264-4974-9df4-c9187df31d0b", "address": "fa:16:3e:b6:98:ef", "network": {"id": "93576160-6eb8-473f-ad25-fc3bb5e10825", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155060213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap685563e0-32", "ovs_interfaceid": "685563e0-3264-4974-9df4-c9187df31d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "113cfbd7-7a98-4be6-af79-76777a24650c", "address": "fa:16:3e:1a:85:42", "network": {"id": "b15c2d5a-d882-480a-9d49-9f6991094b80", "bridge": "br-int", "label": "tempest-device-tagging-net2-323585513", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap113cfbd7-7a", "ovs_interfaceid": "113cfbd7-7a98-4be6-af79-76777a24650c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bcad9d15-2562-4660-93b0-91a32ac0c390", "address": "fa:16:3e:0f:b0:dc", "network": {"id": "b15c2d5a-d882-480a-9d49-9f6991094b80", "bridge": "br-int", "label": "tempest-device-tagging-net2-323585513", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcad9d15-25", "ovs_interfaceid": "bcad9d15-2562-4660-93b0-91a32ac0c390", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:54:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Releasing lock "refresh_cache-eb68aada-46ba-4798-a16e-bb2cacfcd747" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:54:13 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Instance network_info: |[{"id": "4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e", "address": "fa:16:3e:71:d1:b6", "network": {"id": "f9b8375f-1e97-4274-8fef-ebe96b9dec13", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-937842323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dcc0c50-3d", "ovs_interfaceid": "4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6f734493-7794-4e1e-a68b-4ce6995dadef", "address": "fa:16:3e:77:21:46", "network": {"id": "93576160-6eb8-473f-ad25-fc3bb5e10825", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155060213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f734493-77", "ovs_interfaceid": "6f734493-7794-4e1e-a68b-4ce6995dadef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8354cc56-3d78-4f7a-b2fa-ee95e704d67c", "address": "fa:16:3e:51:5b:97", "network": {"id": "93576160-6eb8-473f-ad25-fc3bb5e10825", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155060213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8354cc56-3d", "ovs_interfaceid": "8354cc56-3d78-4f7a-b2fa-ee95e704d67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cb50bad1-1e1e-4138-8b0b-f7dc17d0d760", "address": "fa:16:3e:64:4b:9d", "network": {"id": "93576160-6eb8-473f-ad25-fc3bb5e10825", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155060213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb50bad1-1e", "ovs_interfaceid": "cb50bad1-1e1e-4138-8b0b-f7dc17d0d760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "685563e0-3264-4974-9df4-c9187df31d0b", "address": "fa:16:3e:b6:98:ef", "network": {"id": "93576160-6eb8-473f-ad25-fc3bb5e10825", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155060213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap685563e0-32", "ovs_interfaceid": "685563e0-3264-4974-9df4-c9187df31d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "113cfbd7-7a98-4be6-af79-76777a24650c", "address": "fa:16:3e:1a:85:42", "network": {"id": "b15c2d5a-d882-480a-9d49-9f6991094b80", "bridge": "br-int", "label": "tempest-device-tagging-net2-323585513", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap113cfbd7-7a", "ovs_interfaceid": "113cfbd7-7a98-4be6-af79-76777a24650c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bcad9d15-2562-4660-93b0-91a32ac0c390", "address": "fa:16:3e:0f:b0:dc", "network": {"id": "b15c2d5a-d882-480a-9d49-9f6991094b80", "bridge": "br-int", "label": "tempest-device-tagging-net2-323585513", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcad9d15-25", "ovs_interfaceid": "bcad9d15-2562-4660-93b0-91a32ac0c390", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 09:54:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-be8ff0bc-7d82-4eae-9e4f-bd7183284749 req-e137e710-1008-4b54-8e53-f824d56a5018 service nova] Acquired lock "refresh_cache-eb68aada-46ba-4798-a16e-bb2cacfcd747" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:54:13 user nova-compute[71113]: DEBUG nova.network.neutron [req-be8ff0bc-7d82-4eae-9e4f-bd7183284749 req-e137e710-1008-4b54-8e53-f824d56a5018 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Refreshing network info cache for port 113cfbd7-7a98-4be6-af79-76777a24650c {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:54:13 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:14 user nova-compute[71113]: DEBUG nova.network.neutron [req-be8ff0bc-7d82-4eae-9e4f-bd7183284749 req-e137e710-1008-4b54-8e53-f824d56a5018 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Updated VIF entry in instance network info cache for port 113cfbd7-7a98-4be6-af79-76777a24650c. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:54:14 user nova-compute[71113]: DEBUG nova.network.neutron [req-be8ff0bc-7d82-4eae-9e4f-bd7183284749 req-e137e710-1008-4b54-8e53-f824d56a5018 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Updating instance_info_cache with network_info: [{"id": "4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e", "address": "fa:16:3e:71:d1:b6", "network": {"id": "f9b8375f-1e97-4274-8fef-ebe96b9dec13", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-937842323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dcc0c50-3d", "ovs_interfaceid": "4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6f734493-7794-4e1e-a68b-4ce6995dadef", "address": "fa:16:3e:77:21:46", "network": {"id": "93576160-6eb8-473f-ad25-fc3bb5e10825", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155060213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f734493-77", "ovs_interfaceid": "6f734493-7794-4e1e-a68b-4ce6995dadef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8354cc56-3d78-4f7a-b2fa-ee95e704d67c", "address": "fa:16:3e:51:5b:97", "network": {"id": "93576160-6eb8-473f-ad25-fc3bb5e10825", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155060213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8354cc56-3d", "ovs_interfaceid": "8354cc56-3d78-4f7a-b2fa-ee95e704d67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cb50bad1-1e1e-4138-8b0b-f7dc17d0d760", "address": "fa:16:3e:64:4b:9d", "network": {"id": "93576160-6eb8-473f-ad25-fc3bb5e10825", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155060213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb50bad1-1e", "ovs_interfaceid": "cb50bad1-1e1e-4138-8b0b-f7dc17d0d760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "685563e0-3264-4974-9df4-c9187df31d0b", "address": "fa:16:3e:b6:98:ef", "network": {"id": "93576160-6eb8-473f-ad25-fc3bb5e10825", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155060213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap685563e0-32", "ovs_interfaceid": "685563e0-3264-4974-9df4-c9187df31d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "113cfbd7-7a98-4be6-af79-76777a24650c", "address": "fa:16:3e:1a:85:42", "network": {"id": "b15c2d5a-d882-480a-9d49-9f6991094b80", "bridge": "br-int", "label": "tempest-device-tagging-net2-323585513", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap113cfbd7-7a", "ovs_interfaceid": "113cfbd7-7a98-4be6-af79-76777a24650c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bcad9d15-2562-4660-93b0-91a32ac0c390", "address": "fa:16:3e:0f:b0:dc", "network": {"id": "b15c2d5a-d882-480a-9d49-9f6991094b80", "bridge": "br-int", "label": "tempest-device-tagging-net2-323585513", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcad9d15-25", "ovs_interfaceid": "bcad9d15-2562-4660-93b0-91a32ac0c390", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:54:14 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-be8ff0bc-7d82-4eae-9e4f-bd7183284749 req-e137e710-1008-4b54-8e53-f824d56a5018 service nova] Releasing lock "refresh_cache-eb68aada-46ba-4798-a16e-bb2cacfcd747" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:54:14 user nova-compute[71113]: DEBUG nova.compute.manager [req-be8ff0bc-7d82-4eae-9e4f-bd7183284749 req-e137e710-1008-4b54-8e53-f824d56a5018 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received event network-changed-bcad9d15-2562-4660-93b0-91a32ac0c390 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:54:14 user nova-compute[71113]: DEBUG nova.compute.manager [req-be8ff0bc-7d82-4eae-9e4f-bd7183284749 req-e137e710-1008-4b54-8e53-f824d56a5018 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Refreshing instance network info cache due to event network-changed-bcad9d15-2562-4660-93b0-91a32ac0c390. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:54:14 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-be8ff0bc-7d82-4eae-9e4f-bd7183284749 req-e137e710-1008-4b54-8e53-f824d56a5018 service nova] Acquiring lock "refresh_cache-eb68aada-46ba-4798-a16e-bb2cacfcd747" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:54:14 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-be8ff0bc-7d82-4eae-9e4f-bd7183284749 req-e137e710-1008-4b54-8e53-f824d56a5018 service nova] Acquired lock "refresh_cache-eb68aada-46ba-4798-a16e-bb2cacfcd747" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:54:14 user nova-compute[71113]: DEBUG nova.network.neutron [req-be8ff0bc-7d82-4eae-9e4f-bd7183284749 req-e137e710-1008-4b54-8e53-f824d56a5018 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Refreshing network info cache for port bcad9d15-2562-4660-93b0-91a32ac0c390 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:54:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:14 user nova-compute[71113]: DEBUG nova.network.neutron [req-be8ff0bc-7d82-4eae-9e4f-bd7183284749 req-e137e710-1008-4b54-8e53-f824d56a5018 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Updated VIF entry in instance network info cache for port bcad9d15-2562-4660-93b0-91a32ac0c390. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:54:14 user nova-compute[71113]: DEBUG nova.network.neutron [req-be8ff0bc-7d82-4eae-9e4f-bd7183284749 req-e137e710-1008-4b54-8e53-f824d56a5018 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Updating instance_info_cache with network_info: [{"id": "4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e", "address": "fa:16:3e:71:d1:b6", "network": {"id": "f9b8375f-1e97-4274-8fef-ebe96b9dec13", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-937842323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dcc0c50-3d", "ovs_interfaceid": "4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6f734493-7794-4e1e-a68b-4ce6995dadef", "address": "fa:16:3e:77:21:46", "network": {"id": "93576160-6eb8-473f-ad25-fc3bb5e10825", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155060213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f734493-77", "ovs_interfaceid": "6f734493-7794-4e1e-a68b-4ce6995dadef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8354cc56-3d78-4f7a-b2fa-ee95e704d67c", "address": "fa:16:3e:51:5b:97", "network": {"id": "93576160-6eb8-473f-ad25-fc3bb5e10825", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155060213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8354cc56-3d", "ovs_interfaceid": "8354cc56-3d78-4f7a-b2fa-ee95e704d67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cb50bad1-1e1e-4138-8b0b-f7dc17d0d760", "address": "fa:16:3e:64:4b:9d", "network": {"id": "93576160-6eb8-473f-ad25-fc3bb5e10825", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155060213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb50bad1-1e", "ovs_interfaceid": "cb50bad1-1e1e-4138-8b0b-f7dc17d0d760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "685563e0-3264-4974-9df4-c9187df31d0b", "address": "fa:16:3e:b6:98:ef", "network": {"id": "93576160-6eb8-473f-ad25-fc3bb5e10825", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155060213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap685563e0-32", "ovs_interfaceid": "685563e0-3264-4974-9df4-c9187df31d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "113cfbd7-7a98-4be6-af79-76777a24650c", "address": "fa:16:3e:1a:85:42", "network": {"id": "b15c2d5a-d882-480a-9d49-9f6991094b80", "bridge": "br-int", "label": "tempest-device-tagging-net2-323585513", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap113cfbd7-7a", "ovs_interfaceid": "113cfbd7-7a98-4be6-af79-76777a24650c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bcad9d15-2562-4660-93b0-91a32ac0c390", "address": "fa:16:3e:0f:b0:dc", "network": {"id": "b15c2d5a-d882-480a-9d49-9f6991094b80", "bridge": "br-int", "label": "tempest-device-tagging-net2-323585513", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcad9d15-25", "ovs_interfaceid": "bcad9d15-2562-4660-93b0-91a32ac0c390", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:54:14 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-be8ff0bc-7d82-4eae-9e4f-bd7183284749 req-e137e710-1008-4b54-8e53-f824d56a5018 service nova] Releasing lock "refresh_cache-eb68aada-46ba-4798-a16e-bb2cacfcd747" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:54:17 user nova-compute[71113]: INFO nova.virt.block_device [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Booting with volume 5a73437e-fd87-45af-a143-9480a736be71 at /dev/vdc
Jul 31 09:54:17 user nova-compute[71113]: DEBUG os_brick.utils [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:54:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:17 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f1a9da-1be1-4e29-a82a-a18ee0da660c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:17 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b6d857-7859-454e-ab5d-64c7b8fa9ced]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:17 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b946043d-4b81-4885-98dd-06efb2e97ad2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:17 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[320d8806-0fb0-436a-85a5-80ce683b1d1e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:54:17 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 09:54:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:54:17 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 09:54:17 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2247a41a-1c73-403f-842c-343ccca438f5]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:17 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 09:54:17 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 09:54:17 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 09:54:17 user nova-compute[71113]: DEBUG os_brick.utils [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:54:17 user nova-compute[71113]: DEBUG nova.virt.block_device [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Updating existing volume attachment record: 22688df3-8cdd-4234-ba66-4fcb0ec5f7ef {{(pid=71113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG nova.compute.manager [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Start spawning the instance on the hypervisor. {{(pid=71113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 09:54:18 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Creating image(s)
Jul 31 09:54:18 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Did not create local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Ensure instance console log exists: /opt/stack/data/nova/instances/92d25a03-98ce-4bde-a3cc-20313ae77d41/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Start _get_guest_xml network_info=[{"id": "e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d", "address": "fa:16:3e:2c:5b:c3", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape82fc7e2-25", "ovs_interfaceid": "e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '25c20a3f-02ba-47ea-bb31-242eb91ccbdf', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MFWCkIfi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '92d25a03-98ce-4bde-a3cc-20313ae77d41', 'attached_at': '', 'detached_at': '', 'volume_id': '1e143852-2ce0-4b78-9b3e-2e2efb1d1407', 'serial': '1e143852-2ce0-4b78-9b3e-2e2efb1d1407'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 09:54:18 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:54:18 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:54:18 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MFWCkIfi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:54:18 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:54:18 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:54:18 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:54:18 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:54:18 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 09:54:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[146ebfd5-c1c7-4d25-81ce-8937b3d36254]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 09:54:18 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd28de89-31ff-4a22-b105-ac5ddbe27474]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407] added
Jul 31 09:54:18 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4aa778-14d3-4046-aaee-51b6ae32bc64]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[644aa4d2-5a9f-4390-8c4b-016e54fc4d0f]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MFWCkIfi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MFWCkIfi" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e11ac73-3f04-436a-ba1d-849f0b0c5ae8]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MFWCkIfi'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[08be4c3d-b52e-4bdc-9f63-6d2d04bd5512]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b895b098-df05-48ac-ab24-82ffff0b47f6]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:54:18 user nova-compute[71113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)
Jul 31 09:54:18 user nova-compute[71113]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1 (non-flash)
Jul 31 09:54:18 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:54:18 user nova-compute[71113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)
Jul 31 09:54:18 user nova-compute[71113]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1 (non-flash)
Jul 31 09:54:18 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[71836514-8b8a-4be3-8fbe-409ef927e0ca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407, portal: 172.16.0.220,3260]
Jul 31 09:54:18 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407, portal: 172.16.0.220,3260] successful.
Jul 31 09:54:18 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14b7961-77eb-4eef-b44b-4ee90424959d]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24f52df-83ea-443a-b678-62fb63e06f1b]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:54:18 user nova-compute[71113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)
Jul 31 09:54:18 user nova-compute[71113]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1 (non-flash)
Jul 31 09:54:18 user nova-compute[71113]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:54:18 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:54:18 user nova-compute[71113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)
Jul 31 09:54:18 user nova-compute[71113]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1 (non-flash)
Jul 31 09:54:18 user nova-compute[71113]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:54:18 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] HCTL ('36', '-', '-', 0) found on session 25 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d52265-873b-42d8-8e8f-576dd0cdd60f]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MFWCkIfi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 09:54:18 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:19 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:54:19 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '23363366562323130', 'path': '/dev/sde'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:54:19 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363366562323130', 'path': '/dev/sde'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 09:54:19 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:53:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-931201663',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-931201663',id=21,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88bbf2636f6248fcbe644af4eab0c823',ramdisk_id='',reservation_id='r-x25o75li',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1194948978',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:53:57Z,user_data=None,user_id='f4f505d5eddc4df48ec267f6f69a01f9',uuid=92d25a03-98ce-4bde-a3cc-20313ae77d41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d", "address": "fa:16:3e:2c:5b:c3", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape82fc7e2-25", "ovs_interfaceid": "e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 09:54:19 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Converting VIF {"id": "e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d", "address": "fa:16:3e:2c:5b:c3", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape82fc7e2-25", "ovs_interfaceid": "e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:54:19 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:5b:c3,bridge_name='br-int',has_traffic_filtering=True,id=e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d,network=Network(6f88bfaa-d58d-4ac2-b43d-0689d50456ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape82fc7e2-25') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:54:19 user nova-compute[71113]: DEBUG nova.objects.instance [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lazy-loading 'pci_devices' on Instance uuid 92d25a03-98ce-4bde-a3cc-20313ae77d41 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:54:19 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] End _get_guest_xml xml=<domain type="kvm">
Jul 31 09:54:19 user nova-compute[71113]:   <uuid>92d25a03-98ce-4bde-a3cc-20313ae77d41</uuid>
Jul 31 09:54:19 user nova-compute[71113]:   <name>instance-00000015</name>
Jul 31 09:54:19 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 09:54:19 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 09:54:19 user nova-compute[71113]:   <metadata>
Jul 31 09:54:19 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 09:54:19 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 09:54:19 user nova-compute[71113]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-931201663</nova:name>
Jul 31 09:54:19 user nova-compute[71113]:       <nova:creationTime>2023-07-31 09:54:18</nova:creationTime>
Jul 31 09:54:19 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 09:54:19 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 09:54:19 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 09:54:19 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 09:54:19 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 09:54:19 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 09:54:19 user nova-compute[71113]:       </nova:flavor>
Jul 31 09:54:19 user nova-compute[71113]:       <nova:owner>
Jul 31 09:54:19 user nova-compute[71113]:         <nova:user uuid="f4f505d5eddc4df48ec267f6f69a01f9">tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member</nova:user>
Jul 31 09:54:19 user nova-compute[71113]:         <nova:project uuid="88bbf2636f6248fcbe644af4eab0c823">tempest-ServerBootFromVolumeStableRescueTest-1194948978</nova:project>
Jul 31 09:54:19 user nova-compute[71113]:       </nova:owner>
Jul 31 09:54:19 user nova-compute[71113]:       <nova:root type="image" uuid="078646fe-b504-41ed-a147-61072e903e51"/>
Jul 31 09:54:19 user nova-compute[71113]:       <nova:ports>
Jul 31 09:54:19 user nova-compute[71113]:         <nova:port uuid="e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d">
Jul 31 09:54:19 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 31 09:54:19 user nova-compute[71113]:         </nova:port>
Jul 31 09:54:19 user nova-compute[71113]:       </nova:ports>
Jul 31 09:54:19 user nova-compute[71113]:     </nova:instance>
Jul 31 09:54:19 user nova-compute[71113]:   </metadata>
Jul 31 09:54:19 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 09:54:19 user nova-compute[71113]:     <system>
Jul 31 09:54:19 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 09:54:19 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 09:54:19 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 09:54:19 user nova-compute[71113]:       <entry name="serial">92d25a03-98ce-4bde-a3cc-20313ae77d41</entry>
Jul 31 09:54:19 user nova-compute[71113]:       <entry name="uuid">92d25a03-98ce-4bde-a3cc-20313ae77d41</entry>
Jul 31 09:54:19 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 09:54:19 user nova-compute[71113]:     </system>
Jul 31 09:54:19 user nova-compute[71113]:   </sysinfo>
Jul 31 09:54:19 user nova-compute[71113]:   <os>
Jul 31 09:54:19 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 09:54:19 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 09:54:19 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 09:54:19 user nova-compute[71113]:   </os>
Jul 31 09:54:19 user nova-compute[71113]:   <features>
Jul 31 09:54:19 user nova-compute[71113]:     <acpi/>
Jul 31 09:54:19 user nova-compute[71113]:     <apic/>
Jul 31 09:54:19 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 09:54:19 user nova-compute[71113]:   </features>
Jul 31 09:54:19 user nova-compute[71113]:   <clock offset="utc">
Jul 31 09:54:19 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 09:54:19 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 09:54:19 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 09:54:19 user nova-compute[71113]:   </clock>
Jul 31 09:54:19 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 09:54:19 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 09:54:19 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 09:54:19 user nova-compute[71113]:   </cpu>
Jul 31 09:54:19 user nova-compute[71113]:   <devices>
Jul 31 09:54:19 user nova-compute[71113]:     <disk type="block" device="disk">
Jul 31 09:54:19 user nova-compute[71113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:54:19 user nova-compute[71113]:       <source dev="/dev/sde"/>
Jul 31 09:54:19 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 09:54:19 user nova-compute[71113]:       <serial>1e143852-2ce0-4b78-9b3e-2e2efb1d1407</serial>
Jul 31 09:54:19 user nova-compute[71113]:     </disk>
Jul 31 09:54:19 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 09:54:19 user nova-compute[71113]:       <mac address="fa:16:3e:2c:5b:c3"/>
Jul 31 09:54:19 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:54:19 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 09:54:19 user nova-compute[71113]:       <target dev="tape82fc7e2-25"/>
Jul 31 09:54:19 user nova-compute[71113]:     </interface>
Jul 31 09:54:19 user nova-compute[71113]:     <serial type="pty">
Jul 31 09:54:19 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/92d25a03-98ce-4bde-a3cc-20313ae77d41/console.log" append="off"/>
Jul 31 09:54:19 user nova-compute[71113]:     </serial>
Jul 31 09:54:19 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 09:54:19 user nova-compute[71113]:     <video>
Jul 31 09:54:19 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:54:19 user nova-compute[71113]:     </video>
Jul 31 09:54:19 user nova-compute[71113]:     <rng model="virtio">
Jul 31 09:54:19 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 09:54:19 user nova-compute[71113]:     </rng>
Jul 31 09:54:19 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 09:54:19 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 09:54:19 user nova-compute[71113]:       <stats period="10"/>
Jul 31 09:54:19 user nova-compute[71113]:     </memballoon>
Jul 31 09:54:19 user nova-compute[71113]:   </devices>
Jul 31 09:54:19 user nova-compute[71113]: </domain>
Jul 31 09:54:19 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 09:54:19 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:53:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-931201663',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-931201663',id=21,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88bbf2636f6248fcbe644af4eab0c823',ramdisk_id='',reservation_id='r-x25o75li',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1194948978',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:53:57Z,user_data=None,user_id='f4f505d5eddc4df48ec267f6f69a01f9',uuid=92d25a03-98ce-4bde-a3cc-20313ae77d41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d", "address": "fa:16:3e:2c:5b:c3", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape82fc7e2-25", "ovs_interfaceid": "e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 09:54:19 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Converting VIF {"id": "e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d", "address": "fa:16:3e:2c:5b:c3", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape82fc7e2-25", "ovs_interfaceid": "e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:54:19 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:5b:c3,bridge_name='br-int',has_traffic_filtering=True,id=e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d,network=Network(6f88bfaa-d58d-4ac2-b43d-0689d50456ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape82fc7e2-25') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:54:19 user nova-compute[71113]: DEBUG os_vif [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:5b:c3,bridge_name='br-int',has_traffic_filtering=True,id=e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d,network=Network(6f88bfaa-d58d-4ac2-b43d-0689d50456ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape82fc7e2-25') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 09:54:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:54:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 09:54:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape82fc7e2-25, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:54:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape82fc7e2-25, col_values=(('external_ids', {'iface-id': 'e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:5b:c3', 'vm-uuid': '92d25a03-98ce-4bde-a3cc-20313ae77d41'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:54:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:54:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:19 user nova-compute[71113]: INFO os_vif [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:5b:c3,bridge_name='br-int',has_traffic_filtering=True,id=e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d,network=Network(6f88bfaa-d58d-4ac2-b43d-0689d50456ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape82fc7e2-25')
Jul 31 09:54:19 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:54:19 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] No VIF found with MAC fa:16:3e:2c:5b:c3, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 09:54:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:21 user nova-compute[71113]: DEBUG nova.compute.manager [req-ea6e9ab3-d2a0-4e6d-b0fa-b963e15f18e9 req-2e32493f-b841-4ea1-85c9-794d5a4b4e1e service nova] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Received event network-vif-plugged-e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:54:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ea6e9ab3-d2a0-4e6d-b0fa-b963e15f18e9 req-2e32493f-b841-4ea1-85c9-794d5a4b4e1e service nova] Acquiring lock "92d25a03-98ce-4bde-a3cc-20313ae77d41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:54:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ea6e9ab3-d2a0-4e6d-b0fa-b963e15f18e9 req-2e32493f-b841-4ea1-85c9-794d5a4b4e1e service nova] Lock "92d25a03-98ce-4bde-a3cc-20313ae77d41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:54:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ea6e9ab3-d2a0-4e6d-b0fa-b963e15f18e9 req-2e32493f-b841-4ea1-85c9-794d5a4b4e1e service nova] Lock "92d25a03-98ce-4bde-a3cc-20313ae77d41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:54:21 user nova-compute[71113]: DEBUG nova.compute.manager [req-ea6e9ab3-d2a0-4e6d-b0fa-b963e15f18e9 req-2e32493f-b841-4ea1-85c9-794d5a4b4e1e service nova] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] No waiting events found dispatching network-vif-plugged-e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:54:21 user nova-compute[71113]: WARNING nova.compute.manager [req-ea6e9ab3-d2a0-4e6d-b0fa-b963e15f18e9 req-2e32493f-b841-4ea1-85c9-794d5a4b4e1e service nova] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Received unexpected event network-vif-plugged-e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d for instance with vm_state building and task_state spawning.
Jul 31 09:54:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:23 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797263.2569892, 92d25a03-98ce-4bde-a3cc-20313ae77d41 => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:54:23 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] VM Resumed (Lifecycle Event)
Jul 31 09:54:23 user nova-compute[71113]: DEBUG nova.compute.manager [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 09:54:23 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 09:54:23 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Instance spawned successfully.
Jul 31 09:54:23 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 09:54:23 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:54:23 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Found default for hw_cdrom_bus of ide {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:54:23 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Found default for hw_disk_bus of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:54:23 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Found default for hw_input_bus of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:54:23 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Found default for hw_pointer_model of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:54:23 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Found default for hw_video_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:54:23 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Found default for hw_vif_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:54:23 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:54:23 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:54:23 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797263.2581413, 92d25a03-98ce-4bde-a3cc-20313ae77d41 => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:54:23 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] VM Started (Lifecycle Event)
Jul 31 09:54:23 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:54:23 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:54:23 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:54:23 user nova-compute[71113]: DEBUG nova.compute.manager [req-c2bbf20d-f1d0-47d1-86a8-c73e76efd165 req-821ba1d2-fc69-4916-aa96-e09a6e0ae77d service nova] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Received event network-vif-plugged-e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:54:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-c2bbf20d-f1d0-47d1-86a8-c73e76efd165 req-821ba1d2-fc69-4916-aa96-e09a6e0ae77d service nova] Acquiring lock "92d25a03-98ce-4bde-a3cc-20313ae77d41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:54:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-c2bbf20d-f1d0-47d1-86a8-c73e76efd165 req-821ba1d2-fc69-4916-aa96-e09a6e0ae77d service nova] Lock "92d25a03-98ce-4bde-a3cc-20313ae77d41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:54:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-c2bbf20d-f1d0-47d1-86a8-c73e76efd165 req-821ba1d2-fc69-4916-aa96-e09a6e0ae77d service nova] Lock "92d25a03-98ce-4bde-a3cc-20313ae77d41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:54:23 user nova-compute[71113]: DEBUG nova.compute.manager [req-c2bbf20d-f1d0-47d1-86a8-c73e76efd165 req-821ba1d2-fc69-4916-aa96-e09a6e0ae77d service nova] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] No waiting events found dispatching network-vif-plugged-e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:54:23 user nova-compute[71113]: WARNING nova.compute.manager [req-c2bbf20d-f1d0-47d1-86a8-c73e76efd165 req-821ba1d2-fc69-4916-aa96-e09a6e0ae77d service nova] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Received unexpected event network-vif-plugged-e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d for instance with vm_state building and task_state spawning.
Jul 31 09:54:23 user nova-compute[71113]: INFO nova.compute.manager [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Took 5.35 seconds to spawn the instance on the hypervisor.
Jul 31 09:54:23 user nova-compute[71113]: DEBUG nova.compute.manager [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:54:23 user nova-compute[71113]: INFO nova.compute.manager [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Took 27.52 seconds to build instance.
Jul 31 09:54:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-bc929829-484e-4a6e-bbcd-0809222d8353 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "92d25a03-98ce-4bde-a3cc-20313ae77d41" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.637s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:54:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Start spawning the instance on the hypervisor. {{(pid=71113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 09:54:25 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Creating image(s)
Jul 31 09:54:25 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Did not create local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Ensure instance console log exists: /opt/stack/data/nova/instances/eb68aada-46ba-4798-a16e-bb2cacfcd747/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Start _get_guest_xml network_info=[{"id": "4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e", "address": "fa:16:3e:71:d1:b6", "network": {"id": "f9b8375f-1e97-4274-8fef-ebe96b9dec13", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-937842323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dcc0c50-3d", "ovs_interfaceid": "4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6f734493-7794-4e1e-a68b-4ce6995dadef", "address": "fa:16:3e:77:21:46", "network": {"id": "93576160-6eb8-473f-ad25-fc3bb5e10825", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155060213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f734493-77", "ovs_interfaceid": "6f734493-7794-4e1e-a68b-4ce6995dadef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8354cc56-3d78-4f7a-b2fa-ee95e704d67c", "address": "fa:16:3e:51:5b:97", "network": {"id": "93576160-6eb8-473f-ad25-fc3bb5e10825", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155060213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8354cc56-3d", "ovs_interfaceid": "8354cc56-3d78-4f7a-b2fa-ee95e704d67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cb50bad1-1e1e-4138-8b0b-f7dc17d0d760", "address": "fa:16:3e:64:4b:9d", "network": {"id": "93576160-6eb8-473f-ad25-fc3bb5e10825", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155060213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb50bad1-1e", "ovs_interfaceid": "cb50bad1-1e1e-4138-8b0b-f7dc17d0d760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "685563e0-3264-4974-9df4-c9187df31d0b", "address": "fa:16:3e:b6:98:ef", "network": {"id": "93576160-6eb8-473f-ad25-fc3bb5e10825", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155060213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap685563e0-32", "ovs_interfaceid": "685563e0-3264-4974-9df4-c9187df31d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "113cfbd7-7a98-4be6-af79-76777a24650c", "address": "fa:16:3e:1a:85:42", "network": {"id": "b15c2d5a-d882-480a-9d49-9f6991094b80", "bridge": "br-int", "label": "tempest-device-tagging-net2-323585513", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap113cfbd7-7a", "ovs_interfaceid": "113cfbd7-7a98-4be6-af79-76777a24650c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bcad9d15-2562-4660-93b0-91a32ac0c390", "address": "fa:16:3e:0f:b0:dc", "network": {"id": "b15c2d5a-d882-480a-9d49-9f6991094b80", "bridge": "br-int", "label": "tempest-device-tagging-net2-323585513", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcad9d15-25", "ovs_interfaceid": "bcad9d15-2562-4660-93b0-91a32ac0c390", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'f5d7a895-4c68-4e77-b0bf-ad0e781247cc', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SPTInQLJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'eb68aada-46ba-4798-a16e-bb2cacfcd747', 'attached_at': '', 'detached_at': '', 'volume_id': 'b9fe201f-b1ba-4c0e-8426-14f6713d3d16', 'serial': 'b9fe201f-b1ba-4c0e-8426-14f6713d3d16'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None}, {'attachment_id': '82ea7304-2453-42c0-b8fe-93c1203d7ce4', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hFaPdzXH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'eb68aada-46ba-4798-a16e-bb2cacfcd747', 'attached_at': '', 'detached_at': '', 'volume_id': 'b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef', 'serial': 'b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef'}, 'boot_index': 1, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None}, {'attachment_id': '22688df3-8cdd-4234-ba66-4fcb0ec5f7ef', 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rbozjDlO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'eb68aada-46ba-4798-a16e-bb2cacfcd747', 'attached_at': '', 'detached_at': '', 'volume_id': '5a73437e-fd87-45af-a143-9480a736be71', 'serial': '5a73437e-fd87-45af-a143-9480a736be71'}, 'boot_index': 2, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 09:54:25 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:54:25 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:54:25 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SPTInQLJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:54:25 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:54:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:54:25 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:54:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:54:25 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 09:54:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd8d7b9-a5f3-483c-8bfc-0f82261b3867]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 09:54:25 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[640bc305-165d-4fb5-8019-fd7c0f03b747]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16] added
Jul 31 09:54:25 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c959b2f-a158-4efa-903c-16ff94819571]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0298754f-1273-4ad1-aab5-c0831546a8a6]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SPTInQLJ {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SPTInQLJ" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d890021-a13b-4505-98e0-5a92f4bcbc28]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SPTInQLJ'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea243819-5287-4b05-bfa2-cbc7afb4619f]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4768d1d1-6302-425b-99fe-7e96e50b5c04]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:54:25 user nova-compute[71113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)
Jul 31 09:54:25 user nova-compute[71113]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1 (non-flash)
Jul 31 09:54:25 user nova-compute[71113]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:54:25 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:54:25 user nova-compute[71113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)
Jul 31 09:54:25 user nova-compute[71113]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1 (non-flash)
Jul 31 09:54:25 user nova-compute[71113]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:54:25 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ec5128-b0d5-403b-ab0c-a1d12a5bc707]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16, portal: 172.16.0.220,3260]
Jul 31 09:54:25 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16, portal: 172.16.0.220,3260] successful.
Jul 31 09:54:25 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e004d22f-318d-4400-ae7a-1d932ea97636]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5af3494-c6b5-4662-87d3-e1295bc12ce9]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:54:25 user nova-compute[71113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)
Jul 31 09:54:25 user nova-compute[71113]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1 (non-flash)
Jul 31 09:54:25 user nova-compute[71113]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:54:25 user nova-compute[71113]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 (non-flash)
Jul 31 09:54:25 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:54:25 user nova-compute[71113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)
Jul 31 09:54:25 user nova-compute[71113]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1 (non-flash)
Jul 31 09:54:25 user nova-compute[71113]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:54:25 user nova-compute[71113]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 (non-flash)
Jul 31 09:54:25 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] HCTL ('37', '-', '-', 0) found on session 26 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[809f6c91-9d44-4c94-8c9c-3945d895be89]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:25 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Searching for a device in session 26 and hctl ['37', '*', '*', 0] yield: None {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 09:54:26 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Searching for a device in session 26 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 09:54:26 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SPTInQLJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 09:54:26 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:54:26 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '26364346530313736', 'path': '/dev/sdf'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:54:26 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364346530313736', 'path': '/dev/sdf'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 09:54:26 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 09:54:26 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hFaPdzXH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:54:26 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:54:26 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:54:26 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:54:26 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:54:26 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:54:26 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:54:26 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 09:54:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:26 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c6a1a5-2a68-4465-99a5-0f579ebdc05b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:26 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 09:54:26 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:54:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:26 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7f8df0-cd60-4af6-979c-de25de0d0aab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:26 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef] added
Jul 31 09:54:26 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:54:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:26 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e189a6d-d5b3-480d-bd8a-2e2682ab382c]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:26 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:54:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:26 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca73c9f-d04b-4288-a231-7fa8a3703789]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:26 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:54:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hFaPdzXH {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hFaPdzXH" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:26 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a140aaae-e76d-4636-b198-42ce6fe8b491]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:26 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hFaPdzXH'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:54:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:26 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c09cb9-3156-43c0-9795-2892127525e5]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:26 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:54:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:26 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf026b1-7f94-4270-b055-50fd56a3a8c8]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:26 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:54:26 user nova-compute[71113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)
Jul 31 09:54:26 user nova-compute[71113]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1 (non-flash)
Jul 31 09:54:26 user nova-compute[71113]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:54:26 user nova-compute[71113]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 (non-flash)
Jul 31 09:54:26 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:54:26 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:54:26 user nova-compute[71113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)
Jul 31 09:54:26 user nova-compute[71113]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1 (non-flash)
Jul 31 09:54:26 user nova-compute[71113]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:54:26 user nova-compute[71113]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 (non-flash)
Jul 31 09:54:26 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:54:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:27 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:27 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbc4620-3131-414b-adb1-c3a0181af902]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:27 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef, portal: 172.16.0.220,3260]
Jul 31 09:54:27 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef, portal: 172.16.0.220,3260] successful.
Jul 31 09:54:27 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:54:27 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:27 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.053s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:27 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb542dcc-4809-4a9c-afdb-bda1fa37e331]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:27 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:54:27 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:27 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:27 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91bc978-be64-4d90-8f46-d6ebca69d8e2]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:27 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:54:27 user nova-compute[71113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)
Jul 31 09:54:27 user nova-compute[71113]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1 (non-flash)
Jul 31 09:54:27 user nova-compute[71113]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:54:27 user nova-compute[71113]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 (non-flash)
Jul 31 09:54:27 user nova-compute[71113]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef (non-flash)
Jul 31 09:54:27 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:54:27 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:54:27 user nova-compute[71113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)
Jul 31 09:54:27 user nova-compute[71113]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1 (non-flash)
Jul 31 09:54:27 user nova-compute[71113]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:54:27 user nova-compute[71113]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 (non-flash)
Jul 31 09:54:27 user nova-compute[71113]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef (non-flash)
Jul 31 09:54:27 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:54:27 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:54:27 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 09:54:27 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] HCTL ('38', '-', '-', 0) found on session 27 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 09:54:27 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 09:54:27 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:27 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:27 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72fb1d5-529a-473f-9830-08f47871724a]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:27 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Searching for a device in session 27 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 09:54:27 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hFaPdzXH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '26632663266346338', 'path': '/dev/sdg'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632663266346338', 'path': '/dev/sdg'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rbozjDlO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:54:28 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:54:28 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:54:28 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:54:28 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:54:28 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 09:54:28 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71 -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b64d7a8-bd69-408f-a1d7-366183b9b47e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 09:54:28 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71 -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9199e400-1155-4098-af26-0d1964698e9a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71] added
Jul 31 09:54:28 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a19809-a714-4c62-9d47-200176885d63]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[77270cc7-45f9-4a00-893c-987f88dc3eda]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rbozjDlO {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rbozjDlO" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[100f43da-c6fe-4842-84ef-eaa81ca37699]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rbozjDlO'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[28329899-918c-49a3-b137-cca8db508d25]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbe777b-bfad-43cf-b764-f89b142aafed]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:54:28 user nova-compute[71113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)
Jul 31 09:54:28 user nova-compute[71113]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1 (non-flash)
Jul 31 09:54:28 user nova-compute[71113]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:54:28 user nova-compute[71113]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 (non-flash)
Jul 31 09:54:28 user nova-compute[71113]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef (non-flash)
Jul 31 09:54:28 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:54:28 user nova-compute[71113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)
Jul 31 09:54:28 user nova-compute[71113]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1 (non-flash)
Jul 31 09:54:28 user nova-compute[71113]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:54:28 user nova-compute[71113]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 (non-flash)
Jul 31 09:54:28 user nova-compute[71113]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef (non-flash)
Jul 31 09:54:28 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71 -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a68114-f048-45a7-8c1e-a947bbb15976]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71, portal: 172.16.0.220,3260]
Jul 31 09:54:28 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71, portal: 172.16.0.220,3260] successful.
Jul 31 09:54:28 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[85bcd63d-abf9-4781-b16f-4173774a53dd]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f20c7b-60b0-4a0e-b8ff-6a13c6434dab]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:54:28 user nova-compute[71113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)
Jul 31 09:54:28 user nova-compute[71113]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1 (non-flash)
Jul 31 09:54:28 user nova-compute[71113]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:54:28 user nova-compute[71113]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 (non-flash)
Jul 31 09:54:28 user nova-compute[71113]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef (non-flash)
Jul 31 09:54:28 user nova-compute[71113]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71 (non-flash)
Jul 31 09:54:28 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:54:28 user nova-compute[71113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)
Jul 31 09:54:28 user nova-compute[71113]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1 (non-flash)
Jul 31 09:54:28 user nova-compute[71113]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:54:28 user nova-compute[71113]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 (non-flash)
Jul 31 09:54:28 user nova-compute[71113]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef (non-flash)
Jul 31 09:54:28 user nova-compute[71113]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71 (non-flash)
Jul 31 09:54:28 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] HCTL ('39', '-', '-', 0) found on session 28 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b67165-0da5-4071-95de-8d9dbd12939f]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Searching for a device in session 28 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 09:54:28 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rbozjDlO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23630663735333135', 'path': '/dev/sdh'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630663735333135', 'path': '/dev/sdh'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T09:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1432155715',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1432155715',id=22,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUpJgODgUF9u3PO8QOqpE//ep50IsMXQIzo1b11XqsIWrhDj9vxGwUiGlSPERfjYPo8m8x6f54Kdo20ukge6PicaA87ygzLS1taG9DCB2HH0QHqHEJz+oqlZn8EcXAIXA==',key_name='tempest-keypair-385475384',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4db8c3c401c94419b4f534a20d60388c',ramdisk_id='',reservation_id='r-bypbvdk2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-477255538',owner_user_name='tempest-TaggedBootDevicesTest-477255538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:54:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b9e45d968444ffba99ecf4c845b101e',uuid=eb68aada-46ba-4798-a16e-bb2cacfcd747,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e", "address": "fa:16:3e:71:d1:b6", "network": {"id": "f9b8375f-1e97-4274-8fef-ebe96b9dec13", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-937842323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dcc0c50-3d", "ovs_interfaceid": "4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Converting VIF {"id": "4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e", "address": "fa:16:3e:71:d1:b6", "network": {"id": "f9b8375f-1e97-4274-8fef-ebe96b9dec13", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-937842323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dcc0c50-3d", "ovs_interfaceid": "4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:d1:b6,bridge_name='br-int',has_traffic_filtering=True,id=4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e,network=Network(f9b8375f-1e97-4274-8fef-ebe96b9dec13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dcc0c50-3d') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T09:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1432155715',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1432155715',id=22,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUpJgODgUF9u3PO8QOqpE//ep50IsMXQIzo1b11XqsIWrhDj9vxGwUiGlSPERfjYPo8m8x6f54Kdo20ukge6PicaA87ygzLS1taG9DCB2HH0QHqHEJz+oqlZn8EcXAIXA==',key_name='tempest-keypair-385475384',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4db8c3c401c94419b4f534a20d60388c',ramdisk_id='',reservation_id='r-bypbvdk2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-477255538',owner_user_name='tempest-TaggedBootDevicesTest-477255538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:54:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b9e45d968444ffba99ecf4c845b101e',uuid=eb68aada-46ba-4798-a16e-bb2cacfcd747,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f734493-7794-4e1e-a68b-4ce6995dadef", "address": "fa:16:3e:77:21:46", "network": {"id": "93576160-6eb8-473f-ad25-fc3bb5e10825", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155060213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f734493-77", "ovs_interfaceid": "6f734493-7794-4e1e-a68b-4ce6995dadef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Converting VIF {"id": "6f734493-7794-4e1e-a68b-4ce6995dadef", "address": "fa:16:3e:77:21:46", "network": {"id": "93576160-6eb8-473f-ad25-fc3bb5e10825", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155060213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f734493-77", "ovs_interfaceid": "6f734493-7794-4e1e-a68b-4ce6995dadef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:21:46,bridge_name='br-int',has_traffic_filtering=True,id=6f734493-7794-4e1e-a68b-4ce6995dadef,network=Network(93576160-6eb8-473f-ad25-fc3bb5e10825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6f734493-77') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T09:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1432155715',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1432155715',id=22,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUpJgODgUF9u3PO8QOqpE//ep50IsMXQIzo1b11XqsIWrhDj9vxGwUiGlSPERfjYPo8m8x6f54Kdo20ukge6PicaA87ygzLS1taG9DCB2HH0QHqHEJz+oqlZn8EcXAIXA==',key_name='tempest-keypair-385475384',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4db8c3c401c94419b4f534a20d60388c',ramdisk_id='',reservation_id='r-bypbvdk2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-477255538',owner_user_name='tempest-TaggedBootDevicesTest-477255538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:54:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b9e45d968444ffba99ecf4c845b101e',uuid=eb68aada-46ba-4798-a16e-bb2cacfcd747,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8354cc56-3d78-4f7a-b2fa-ee95e704d67c", "address": "fa:16:3e:51:5b:97", "network": {"id": "93576160-6eb8-473f-ad25-fc3bb5e10825", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155060213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8354cc56-3d", "ovs_interfaceid": "8354cc56-3d78-4f7a-b2fa-ee95e704d67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Converting VIF {"id": "8354cc56-3d78-4f7a-b2fa-ee95e704d67c", "address": "fa:16:3e:51:5b:97", "network": {"id": "93576160-6eb8-473f-ad25-fc3bb5e10825", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155060213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8354cc56-3d", "ovs_interfaceid": "8354cc56-3d78-4f7a-b2fa-ee95e704d67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:5b:97,bridge_name='br-int',has_traffic_filtering=True,id=8354cc56-3d78-4f7a-b2fa-ee95e704d67c,network=Network(93576160-6eb8-473f-ad25-fc3bb5e10825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8354cc56-3d') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T09:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1432155715',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1432155715',id=22,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUpJgODgUF9u3PO8QOqpE//ep50IsMXQIzo1b11XqsIWrhDj9vxGwUiGlSPERfjYPo8m8x6f54Kdo20ukge6PicaA87ygzLS1taG9DCB2HH0QHqHEJz+oqlZn8EcXAIXA==',key_name='tempest-keypair-385475384',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4db8c3c401c94419b4f534a20d60388c',ramdisk_id='',reservation_id='r-bypbvdk2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-477255538',owner_user_name='tempest-TaggedBootDevicesTest-477255538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:54:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b9e45d968444ffba99ecf4c845b101e',uuid=eb68aada-46ba-4798-a16e-bb2cacfcd747,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb50bad1-1e1e-4138-8b0b-f7dc17d0d760", "address": "fa:16:3e:64:4b:9d", "network": {"id": "93576160-6eb8-473f-ad25-fc3bb5e10825", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155060213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb50bad1-1e", "ovs_interfaceid": "cb50bad1-1e1e-4138-8b0b-f7dc17d0d760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Converting VIF {"id": "cb50bad1-1e1e-4138-8b0b-f7dc17d0d760", "address": "fa:16:3e:64:4b:9d", "network": {"id": "93576160-6eb8-473f-ad25-fc3bb5e10825", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155060213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb50bad1-1e", "ovs_interfaceid": "cb50bad1-1e1e-4138-8b0b-f7dc17d0d760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:4b:9d,bridge_name='br-int',has_traffic_filtering=True,id=cb50bad1-1e1e-4138-8b0b-f7dc17d0d760,network=Network(93576160-6eb8-473f-ad25-fc3bb5e10825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb50bad1-1e') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T09:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1432155715',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1432155715',id=22,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUpJgODgUF9u3PO8QOqpE//ep50IsMXQIzo1b11XqsIWrhDj9vxGwUiGlSPERfjYPo8m8x6f54Kdo20ukge6PicaA87ygzLS1taG9DCB2HH0QHqHEJz+oqlZn8EcXAIXA==',key_name='tempest-keypair-385475384',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4db8c3c401c94419b4f534a20d60388c',ramdisk_id='',reservation_id='r-bypbvdk2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-477255538',owner_user_name='tempest-TaggedBootDevicesTest-477255538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:54:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b9e45d968444ffba99ecf4c845b101e',uuid=eb68aada-46ba-4798-a16e-bb2cacfcd747,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "685563e0-3264-4974-9df4-c9187df31d0b", "address": "fa:16:3e:b6:98:ef", "network": {"id": "93576160-6eb8-473f-ad25-fc3bb5e10825", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155060213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap685563e0-32", "ovs_interfaceid": "685563e0-3264-4974-9df4-c9187df31d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Converting VIF {"id": "685563e0-3264-4974-9df4-c9187df31d0b", "address": "fa:16:3e:b6:98:ef", "network": {"id": "93576160-6eb8-473f-ad25-fc3bb5e10825", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155060213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap685563e0-32", "ovs_interfaceid": "685563e0-3264-4974-9df4-c9187df31d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:98:ef,bridge_name='br-int',has_traffic_filtering=True,id=685563e0-3264-4974-9df4-c9187df31d0b,network=Network(93576160-6eb8-473f-ad25-fc3bb5e10825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap685563e0-32') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T09:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1432155715',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1432155715',id=22,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUpJgODgUF9u3PO8QOqpE//ep50IsMXQIzo1b11XqsIWrhDj9vxGwUiGlSPERfjYPo8m8x6f54Kdo20ukge6PicaA87ygzLS1taG9DCB2HH0QHqHEJz+oqlZn8EcXAIXA==',key_name='tempest-keypair-385475384',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4db8c3c401c94419b4f534a20d60388c',ramdisk_id='',reservation_id='r-bypbvdk2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-477255538',owner_user_name='tempest-TaggedBootDevicesTest-477255538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:54:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b9e45d968444ffba99ecf4c845b101e',uuid=eb68aada-46ba-4798-a16e-bb2cacfcd747,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "113cfbd7-7a98-4be6-af79-76777a24650c", "address": "fa:16:3e:1a:85:42", "network": {"id": "b15c2d5a-d882-480a-9d49-9f6991094b80", "bridge": "br-int", "label": "tempest-device-tagging-net2-323585513", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap113cfbd7-7a", "ovs_interfaceid": "113cfbd7-7a98-4be6-af79-76777a24650c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Converting VIF {"id": "113cfbd7-7a98-4be6-af79-76777a24650c", "address": "fa:16:3e:1a:85:42", "network": {"id": "b15c2d5a-d882-480a-9d49-9f6991094b80", "bridge": "br-int", "label": "tempest-device-tagging-net2-323585513", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap113cfbd7-7a", "ovs_interfaceid": "113cfbd7-7a98-4be6-af79-76777a24650c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:85:42,bridge_name='br-int',has_traffic_filtering=True,id=113cfbd7-7a98-4be6-af79-76777a24650c,network=Network(b15c2d5a-d882-480a-9d49-9f6991094b80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap113cfbd7-7a') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T09:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1432155715',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1432155715',id=22,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUpJgODgUF9u3PO8QOqpE//ep50IsMXQIzo1b11XqsIWrhDj9vxGwUiGlSPERfjYPo8m8x6f54Kdo20ukge6PicaA87ygzLS1taG9DCB2HH0QHqHEJz+oqlZn8EcXAIXA==',key_name='tempest-keypair-385475384',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4db8c3c401c94419b4f534a20d60388c',ramdisk_id='',reservation_id='r-bypbvdk2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-477255538',owner_user_name='tempest-TaggedBootDevicesTest-477255538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:54:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b9e45d968444ffba99ecf4c845b101e',uuid=eb68aada-46ba-4798-a16e-bb2cacfcd747,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bcad9d15-2562-4660-93b0-91a32ac0c390", "address": "fa:16:3e:0f:b0:dc", "network": {"id": "b15c2d5a-d882-480a-9d49-9f6991094b80", "bridge": "br-int", "label": "tempest-device-tagging-net2-323585513", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcad9d15-25", "ovs_interfaceid": "bcad9d15-2562-4660-93b0-91a32ac0c390", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Converting VIF {"id": "bcad9d15-2562-4660-93b0-91a32ac0c390", "address": "fa:16:3e:0f:b0:dc", "network": {"id": "b15c2d5a-d882-480a-9d49-9f6991094b80", "bridge": "br-int", "label": "tempest-device-tagging-net2-323585513", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcad9d15-25", "ovs_interfaceid": "bcad9d15-2562-4660-93b0-91a32ac0c390", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:b0:dc,bridge_name='br-int',has_traffic_filtering=True,id=bcad9d15-2562-4660-93b0-91a32ac0c390,network=Network(b15c2d5a-d882-480a-9d49-9f6991094b80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcad9d15-25') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG nova.objects.instance [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Lazy-loading 'pci_devices' on Instance uuid eb68aada-46ba-4798-a16e-bb2cacfcd747 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] End _get_guest_xml xml=<domain type="kvm">
Jul 31 09:54:29 user nova-compute[71113]:   <uuid>eb68aada-46ba-4798-a16e-bb2cacfcd747</uuid>
Jul 31 09:54:29 user nova-compute[71113]:   <name>instance-00000016</name>
Jul 31 09:54:29 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 09:54:29 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 09:54:29 user nova-compute[71113]:   <metadata>
Jul 31 09:54:29 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 09:54:29 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 09:54:29 user nova-compute[71113]:       <nova:name>tempest-device-tagging-server-1432155715</nova:name>
Jul 31 09:54:29 user nova-compute[71113]:       <nova:creationTime>2023-07-31 09:54:25</nova:creationTime>
Jul 31 09:54:29 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 09:54:29 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 09:54:29 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 09:54:29 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 09:54:29 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 09:54:29 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 09:54:29 user nova-compute[71113]:       </nova:flavor>
Jul 31 09:54:29 user nova-compute[71113]:       <nova:owner>
Jul 31 09:54:29 user nova-compute[71113]:         <nova:user uuid="4b9e45d968444ffba99ecf4c845b101e">tempest-TaggedBootDevicesTest-477255538-project-member</nova:user>
Jul 31 09:54:29 user nova-compute[71113]:         <nova:project uuid="4db8c3c401c94419b4f534a20d60388c">tempest-TaggedBootDevicesTest-477255538</nova:project>
Jul 31 09:54:29 user nova-compute[71113]:       </nova:owner>
Jul 31 09:54:29 user nova-compute[71113]:       <nova:root type="image" uuid="078646fe-b504-41ed-a147-61072e903e51"/>
Jul 31 09:54:29 user nova-compute[71113]:       <nova:ports>
Jul 31 09:54:29 user nova-compute[71113]:         <nova:port uuid="4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e">
Jul 31 09:54:29 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 31 09:54:29 user nova-compute[71113]:         </nova:port>
Jul 31 09:54:29 user nova-compute[71113]:         <nova:port uuid="6f734493-7794-4e1e-a68b-4ce6995dadef">
Jul 31 09:54:29 user nova-compute[71113]:           <nova:ip type="fixed" address="10.1.1.138" ipVersion="4"/>
Jul 31 09:54:29 user nova-compute[71113]:         </nova:port>
Jul 31 09:54:29 user nova-compute[71113]:         <nova:port uuid="8354cc56-3d78-4f7a-b2fa-ee95e704d67c">
Jul 31 09:54:29 user nova-compute[71113]:           <nova:ip type="fixed" address="10.1.1.7" ipVersion="4"/>
Jul 31 09:54:29 user nova-compute[71113]:         </nova:port>
Jul 31 09:54:29 user nova-compute[71113]:         <nova:port uuid="cb50bad1-1e1e-4138-8b0b-f7dc17d0d760">
Jul 31 09:54:29 user nova-compute[71113]:           <nova:ip type="fixed" address="10.1.1.127" ipVersion="4"/>
Jul 31 09:54:29 user nova-compute[71113]:         </nova:port>
Jul 31 09:54:29 user nova-compute[71113]:         <nova:port uuid="685563e0-3264-4974-9df4-c9187df31d0b">
Jul 31 09:54:29 user nova-compute[71113]:           <nova:ip type="fixed" address="10.1.1.117" ipVersion="4"/>
Jul 31 09:54:29 user nova-compute[71113]:         </nova:port>
Jul 31 09:54:29 user nova-compute[71113]:         <nova:port uuid="113cfbd7-7a98-4be6-af79-76777a24650c">
Jul 31 09:54:29 user nova-compute[71113]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Jul 31 09:54:29 user nova-compute[71113]:         </nova:port>
Jul 31 09:54:29 user nova-compute[71113]:         <nova:port uuid="bcad9d15-2562-4660-93b0-91a32ac0c390">
Jul 31 09:54:29 user nova-compute[71113]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Jul 31 09:54:29 user nova-compute[71113]:         </nova:port>
Jul 31 09:54:29 user nova-compute[71113]:       </nova:ports>
Jul 31 09:54:29 user nova-compute[71113]:     </nova:instance>
Jul 31 09:54:29 user nova-compute[71113]:   </metadata>
Jul 31 09:54:29 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 09:54:29 user nova-compute[71113]:     <system>
Jul 31 09:54:29 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 09:54:29 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 09:54:29 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 09:54:29 user nova-compute[71113]:       <entry name="serial">eb68aada-46ba-4798-a16e-bb2cacfcd747</entry>
Jul 31 09:54:29 user nova-compute[71113]:       <entry name="uuid">eb68aada-46ba-4798-a16e-bb2cacfcd747</entry>
Jul 31 09:54:29 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 09:54:29 user nova-compute[71113]:     </system>
Jul 31 09:54:29 user nova-compute[71113]:   </sysinfo>
Jul 31 09:54:29 user nova-compute[71113]:   <os>
Jul 31 09:54:29 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 09:54:29 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 09:54:29 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 09:54:29 user nova-compute[71113]:   </os>
Jul 31 09:54:29 user nova-compute[71113]:   <features>
Jul 31 09:54:29 user nova-compute[71113]:     <acpi/>
Jul 31 09:54:29 user nova-compute[71113]:     <apic/>
Jul 31 09:54:29 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 09:54:29 user nova-compute[71113]:   </features>
Jul 31 09:54:29 user nova-compute[71113]:   <clock offset="utc">
Jul 31 09:54:29 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 09:54:29 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 09:54:29 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 09:54:29 user nova-compute[71113]:   </clock>
Jul 31 09:54:29 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 09:54:29 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 09:54:29 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 09:54:29 user nova-compute[71113]:   </cpu>
Jul 31 09:54:29 user nova-compute[71113]:   <devices>
Jul 31 09:54:29 user nova-compute[71113]:     <disk type="file" device="cdrom">
Jul 31 09:54:29 user nova-compute[71113]:       <driver name="qemu" type="raw" cache="none"/>
Jul 31 09:54:29 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/eb68aada-46ba-4798-a16e-bb2cacfcd747/disk.config"/>
Jul 31 09:54:29 user nova-compute[71113]:       <target dev="hda" bus="ide"/>
Jul 31 09:54:29 user nova-compute[71113]:     </disk>
Jul 31 09:54:29 user nova-compute[71113]:     <disk type="block" device="disk">
Jul 31 09:54:29 user nova-compute[71113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:54:29 user nova-compute[71113]:       <source dev="/dev/sdf"/>
Jul 31 09:54:29 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 09:54:29 user nova-compute[71113]:       <serial>b9fe201f-b1ba-4c0e-8426-14f6713d3d16</serial>
Jul 31 09:54:29 user nova-compute[71113]:     </disk>
Jul 31 09:54:29 user nova-compute[71113]:     <disk type="block" device="disk">
Jul 31 09:54:29 user nova-compute[71113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:54:29 user nova-compute[71113]:       <source dev="/dev/sdg"/>
Jul 31 09:54:29 user nova-compute[71113]:       <target dev="vdb" bus="virtio"/>
Jul 31 09:54:29 user nova-compute[71113]:       <serial>b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef</serial>
Jul 31 09:54:29 user nova-compute[71113]:     </disk>
Jul 31 09:54:29 user nova-compute[71113]:     <disk type="block" device="disk">
Jul 31 09:54:29 user nova-compute[71113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:54:29 user nova-compute[71113]:       <source dev="/dev/sdh"/>
Jul 31 09:54:29 user nova-compute[71113]:       <target dev="vdc" bus="virtio"/>
Jul 31 09:54:29 user nova-compute[71113]:       <serial>5a73437e-fd87-45af-a143-9480a736be71</serial>
Jul 31 09:54:29 user nova-compute[71113]:     </disk>
Jul 31 09:54:29 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 09:54:29 user nova-compute[71113]:       <mac address="fa:16:3e:71:d1:b6"/>
Jul 31 09:54:29 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:54:29 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 09:54:29 user nova-compute[71113]:       <target dev="tap4dcc0c50-3d"/>
Jul 31 09:54:29 user nova-compute[71113]:     </interface>
Jul 31 09:54:29 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 09:54:29 user nova-compute[71113]:       <mac address="fa:16:3e:77:21:46"/>
Jul 31 09:54:29 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:54:29 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 09:54:29 user nova-compute[71113]:       <target dev="tap6f734493-77"/>
Jul 31 09:54:29 user nova-compute[71113]:     </interface>
Jul 31 09:54:29 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 09:54:29 user nova-compute[71113]:       <mac address="fa:16:3e:51:5b:97"/>
Jul 31 09:54:29 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:54:29 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 09:54:29 user nova-compute[71113]:       <target dev="tap8354cc56-3d"/>
Jul 31 09:54:29 user nova-compute[71113]:     </interface>
Jul 31 09:54:29 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 09:54:29 user nova-compute[71113]:       <mac address="fa:16:3e:64:4b:9d"/>
Jul 31 09:54:29 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:54:29 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 09:54:29 user nova-compute[71113]:       <target dev="tapcb50bad1-1e"/>
Jul 31 09:54:29 user nova-compute[71113]:     </interface>
Jul 31 09:54:29 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 09:54:29 user nova-compute[71113]:       <mac address="fa:16:3e:b6:98:ef"/>
Jul 31 09:54:29 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:54:29 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 09:54:29 user nova-compute[71113]:       <target dev="tap685563e0-32"/>
Jul 31 09:54:29 user nova-compute[71113]:     </interface>
Jul 31 09:54:29 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 09:54:29 user nova-compute[71113]:       <mac address="fa:16:3e:1a:85:42"/>
Jul 31 09:54:29 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:54:29 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 09:54:29 user nova-compute[71113]:       <target dev="tap113cfbd7-7a"/>
Jul 31 09:54:29 user nova-compute[71113]:     </interface>
Jul 31 09:54:29 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 09:54:29 user nova-compute[71113]:       <mac address="fa:16:3e:0f:b0:dc"/>
Jul 31 09:54:29 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:54:29 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 09:54:29 user nova-compute[71113]:       <target dev="tapbcad9d15-25"/>
Jul 31 09:54:29 user nova-compute[71113]:     </interface>
Jul 31 09:54:29 user nova-compute[71113]:     <serial type="pty">
Jul 31 09:54:29 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/eb68aada-46ba-4798-a16e-bb2cacfcd747/console.log" append="off"/>
Jul 31 09:54:29 user nova-compute[71113]:     </serial>
Jul 31 09:54:29 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 09:54:29 user nova-compute[71113]:     <video>
Jul 31 09:54:29 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:54:29 user nova-compute[71113]:     </video>
Jul 31 09:54:29 user nova-compute[71113]:     <rng model="virtio">
Jul 31 09:54:29 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 09:54:29 user nova-compute[71113]:     </rng>
Jul 31 09:54:29 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 09:54:29 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 09:54:29 user nova-compute[71113]:       <stats period="10"/>
Jul 31 09:54:29 user nova-compute[71113]:     </memballoon>
Jul 31 09:54:29 user nova-compute[71113]:   </devices>
Jul 31 09:54:29 user nova-compute[71113]: </domain>
Jul 31 09:54:29 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T09:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1432155715',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1432155715',id=22,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUpJgODgUF9u3PO8QOqpE//ep50IsMXQIzo1b11XqsIWrhDj9vxGwUiGlSPERfjYPo8m8x6f54Kdo20ukge6PicaA87ygzLS1taG9DCB2HH0QHqHEJz+oqlZn8EcXAIXA==',key_name='tempest-keypair-385475384',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4db8c3c401c94419b4f534a20d60388c',ramdisk_id='',reservation_id='r-bypbvdk2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-477255538',owner_user_name='tempest-TaggedBootDevicesTest-477255538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:54:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b9e45d968444ffba99ecf4c845b101e',uuid=eb68aada-46ba-4798-a16e-bb2cacfcd747,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e", "address": "fa:16:3e:71:d1:b6", "network": {"id": "f9b8375f-1e97-4274-8fef-ebe96b9dec13", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-937842323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dcc0c50-3d", "ovs_interfaceid": "4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Converting VIF {"id": "4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e", "address": "fa:16:3e:71:d1:b6", "network": {"id": "f9b8375f-1e97-4274-8fef-ebe96b9dec13", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-937842323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dcc0c50-3d", "ovs_interfaceid": "4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:d1:b6,bridge_name='br-int',has_traffic_filtering=True,id=4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e,network=Network(f9b8375f-1e97-4274-8fef-ebe96b9dec13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dcc0c50-3d') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG os_vif [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:d1:b6,bridge_name='br-int',has_traffic_filtering=True,id=4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e,network=Network(f9b8375f-1e97-4274-8fef-ebe96b9dec13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dcc0c50-3d') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4dcc0c50-3d, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4dcc0c50-3d, col_values=(('external_ids', {'iface-id': '4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:d1:b6', 'vm-uuid': 'eb68aada-46ba-4798-a16e-bb2cacfcd747'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:29 user nova-compute[71113]: INFO os_vif [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:d1:b6,bridge_name='br-int',has_traffic_filtering=True,id=4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e,network=Network(f9b8375f-1e97-4274-8fef-ebe96b9dec13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dcc0c50-3d')
Jul 31 09:54:29 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T09:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1432155715',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1432155715',id=22,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUpJgODgUF9u3PO8QOqpE//ep50IsMXQIzo1b11XqsIWrhDj9vxGwUiGlSPERfjYPo8m8x6f54Kdo20ukge6PicaA87ygzLS1taG9DCB2HH0QHqHEJz+oqlZn8EcXAIXA==',key_name='tempest-keypair-385475384',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4db8c3c401c94419b4f534a20d60388c',ramdisk_id='',reservation_id='r-bypbvdk2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-477255538',owner_user_name='tempest-TaggedBootDevicesTest-477255538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:54:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b9e45d968444ffba99ecf4c845b101e',uuid=eb68aada-46ba-4798-a16e-bb2cacfcd747,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f734493-7794-4e1e-a68b-4ce6995dadef", "address": "fa:16:3e:77:21:46", "network": {"id": "93576160-6eb8-473f-ad25-fc3bb5e10825", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155060213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f734493-77", "ovs_interfaceid": "6f734493-7794-4e1e-a68b-4ce6995dadef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Converting VIF {"id": "6f734493-7794-4e1e-a68b-4ce6995dadef", "address": "fa:16:3e:77:21:46", "network": {"id": "93576160-6eb8-473f-ad25-fc3bb5e10825", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155060213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f734493-77", "ovs_interfaceid": "6f734493-7794-4e1e-a68b-4ce6995dadef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:21:46,bridge_name='br-int',has_traffic_filtering=True,id=6f734493-7794-4e1e-a68b-4ce6995dadef,network=Network(93576160-6eb8-473f-ad25-fc3bb5e10825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6f734493-77') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG os_vif [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:21:46,bridge_name='br-int',has_traffic_filtering=True,id=6f734493-7794-4e1e-a68b-4ce6995dadef,network=Network(93576160-6eb8-473f-ad25-fc3bb5e10825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6f734493-77') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f734493-77, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6f734493-77, col_values=(('external_ids', {'iface-id': '6f734493-7794-4e1e-a68b-4ce6995dadef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:21:46', 'vm-uuid': 'eb68aada-46ba-4798-a16e-bb2cacfcd747'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:29 user nova-compute[71113]: INFO os_vif [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:21:46,bridge_name='br-int',has_traffic_filtering=True,id=6f734493-7794-4e1e-a68b-4ce6995dadef,network=Network(93576160-6eb8-473f-ad25-fc3bb5e10825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6f734493-77')
Jul 31 09:54:29 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T09:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1432155715',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1432155715',id=22,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUpJgODgUF9u3PO8QOqpE//ep50IsMXQIzo1b11XqsIWrhDj9vxGwUiGlSPERfjYPo8m8x6f54Kdo20ukge6PicaA87ygzLS1taG9DCB2HH0QHqHEJz+oqlZn8EcXAIXA==',key_name='tempest-keypair-385475384',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4db8c3c401c94419b4f534a20d60388c',ramdisk_id='',reservation_id='r-bypbvdk2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-477255538',owner_user_name='tempest-TaggedBootDevicesTest-477255538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:54:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b9e45d968444ffba99ecf4c845b101e',uuid=eb68aada-46ba-4798-a16e-bb2cacfcd747,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8354cc56-3d78-4f7a-b2fa-ee95e704d67c", "address": "fa:16:3e:51:5b:97", "network": {"id": "93576160-6eb8-473f-ad25-fc3bb5e10825", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155060213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8354cc56-3d", "ovs_interfaceid": "8354cc56-3d78-4f7a-b2fa-ee95e704d67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Converting VIF {"id": "8354cc56-3d78-4f7a-b2fa-ee95e704d67c", "address": "fa:16:3e:51:5b:97", "network": {"id": "93576160-6eb8-473f-ad25-fc3bb5e10825", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155060213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8354cc56-3d", "ovs_interfaceid": "8354cc56-3d78-4f7a-b2fa-ee95e704d67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:5b:97,bridge_name='br-int',has_traffic_filtering=True,id=8354cc56-3d78-4f7a-b2fa-ee95e704d67c,network=Network(93576160-6eb8-473f-ad25-fc3bb5e10825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8354cc56-3d') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG os_vif [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:5b:97,bridge_name='br-int',has_traffic_filtering=True,id=8354cc56-3d78-4f7a-b2fa-ee95e704d67c,network=Network(93576160-6eb8-473f-ad25-fc3bb5e10825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8354cc56-3d') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8354cc56-3d, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8354cc56-3d, col_values=(('external_ids', {'iface-id': '8354cc56-3d78-4f7a-b2fa-ee95e704d67c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:5b:97', 'vm-uuid': 'eb68aada-46ba-4798-a16e-bb2cacfcd747'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:29 user nova-compute[71113]: INFO os_vif [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:5b:97,bridge_name='br-int',has_traffic_filtering=True,id=8354cc56-3d78-4f7a-b2fa-ee95e704d67c,network=Network(93576160-6eb8-473f-ad25-fc3bb5e10825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8354cc56-3d')
Jul 31 09:54:29 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T09:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1432155715',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1432155715',id=22,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUpJgODgUF9u3PO8QOqpE//ep50IsMXQIzo1b11XqsIWrhDj9vxGwUiGlSPERfjYPo8m8x6f54Kdo20ukge6PicaA87ygzLS1taG9DCB2HH0QHqHEJz+oqlZn8EcXAIXA==',key_name='tempest-keypair-385475384',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4db8c3c401c94419b4f534a20d60388c',ramdisk_id='',reservation_id='r-bypbvdk2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-477255538',owner_user_name='tempest-TaggedBootDevicesTest-477255538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:54:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b9e45d968444ffba99ecf4c845b101e',uuid=eb68aada-46ba-4798-a16e-bb2cacfcd747,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb50bad1-1e1e-4138-8b0b-f7dc17d0d760", "address": "fa:16:3e:64:4b:9d", "network": {"id": "93576160-6eb8-473f-ad25-fc3bb5e10825", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155060213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb50bad1-1e", "ovs_interfaceid": "cb50bad1-1e1e-4138-8b0b-f7dc17d0d760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Converting VIF {"id": "cb50bad1-1e1e-4138-8b0b-f7dc17d0d760", "address": "fa:16:3e:64:4b:9d", "network": {"id": "93576160-6eb8-473f-ad25-fc3bb5e10825", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155060213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb50bad1-1e", "ovs_interfaceid": "cb50bad1-1e1e-4138-8b0b-f7dc17d0d760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:4b:9d,bridge_name='br-int',has_traffic_filtering=True,id=cb50bad1-1e1e-4138-8b0b-f7dc17d0d760,network=Network(93576160-6eb8-473f-ad25-fc3bb5e10825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb50bad1-1e') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG os_vif [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:4b:9d,bridge_name='br-int',has_traffic_filtering=True,id=cb50bad1-1e1e-4138-8b0b-f7dc17d0d760,network=Network(93576160-6eb8-473f-ad25-fc3bb5e10825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb50bad1-1e') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb50bad1-1e, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcb50bad1-1e, col_values=(('external_ids', {'iface-id': 'cb50bad1-1e1e-4138-8b0b-f7dc17d0d760', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:4b:9d', 'vm-uuid': 'eb68aada-46ba-4798-a16e-bb2cacfcd747'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:29 user nova-compute[71113]: INFO os_vif [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:4b:9d,bridge_name='br-int',has_traffic_filtering=True,id=cb50bad1-1e1e-4138-8b0b-f7dc17d0d760,network=Network(93576160-6eb8-473f-ad25-fc3bb5e10825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb50bad1-1e')
Jul 31 09:54:29 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T09:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1432155715',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1432155715',id=22,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUpJgODgUF9u3PO8QOqpE//ep50IsMXQIzo1b11XqsIWrhDj9vxGwUiGlSPERfjYPo8m8x6f54Kdo20ukge6PicaA87ygzLS1taG9DCB2HH0QHqHEJz+oqlZn8EcXAIXA==',key_name='tempest-keypair-385475384',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4db8c3c401c94419b4f534a20d60388c',ramdisk_id='',reservation_id='r-bypbvdk2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-477255538',owner_user_name='tempest-TaggedBootDevicesTest-477255538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:54:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b9e45d968444ffba99ecf4c845b101e',uuid=eb68aada-46ba-4798-a16e-bb2cacfcd747,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "685563e0-3264-4974-9df4-c9187df31d0b", "address": "fa:16:3e:b6:98:ef", "network": {"id": "93576160-6eb8-473f-ad25-fc3bb5e10825", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155060213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap685563e0-32", "ovs_interfaceid": "685563e0-3264-4974-9df4-c9187df31d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Converting VIF {"id": "685563e0-3264-4974-9df4-c9187df31d0b", "address": "fa:16:3e:b6:98:ef", "network": {"id": "93576160-6eb8-473f-ad25-fc3bb5e10825", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155060213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap685563e0-32", "ovs_interfaceid": "685563e0-3264-4974-9df4-c9187df31d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:98:ef,bridge_name='br-int',has_traffic_filtering=True,id=685563e0-3264-4974-9df4-c9187df31d0b,network=Network(93576160-6eb8-473f-ad25-fc3bb5e10825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap685563e0-32') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG os_vif [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:98:ef,bridge_name='br-int',has_traffic_filtering=True,id=685563e0-3264-4974-9df4-c9187df31d0b,network=Network(93576160-6eb8-473f-ad25-fc3bb5e10825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap685563e0-32') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap685563e0-32, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap685563e0-32, col_values=(('external_ids', {'iface-id': '685563e0-3264-4974-9df4-c9187df31d0b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:98:ef', 'vm-uuid': 'eb68aada-46ba-4798-a16e-bb2cacfcd747'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:29 user nova-compute[71113]: INFO os_vif [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:98:ef,bridge_name='br-int',has_traffic_filtering=True,id=685563e0-3264-4974-9df4-c9187df31d0b,network=Network(93576160-6eb8-473f-ad25-fc3bb5e10825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap685563e0-32')
Jul 31 09:54:29 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T09:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1432155715',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1432155715',id=22,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUpJgODgUF9u3PO8QOqpE//ep50IsMXQIzo1b11XqsIWrhDj9vxGwUiGlSPERfjYPo8m8x6f54Kdo20ukge6PicaA87ygzLS1taG9DCB2HH0QHqHEJz+oqlZn8EcXAIXA==',key_name='tempest-keypair-385475384',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4db8c3c401c94419b4f534a20d60388c',ramdisk_id='',reservation_id='r-bypbvdk2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-477255538',owner_user_name='tempest-TaggedBootDevicesTest-477255538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:54:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b9e45d968444ffba99ecf4c845b101e',uuid=eb68aada-46ba-4798-a16e-bb2cacfcd747,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "113cfbd7-7a98-4be6-af79-76777a24650c", "address": "fa:16:3e:1a:85:42", "network": {"id": "b15c2d5a-d882-480a-9d49-9f6991094b80", "bridge": "br-int", "label": "tempest-device-tagging-net2-323585513", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap113cfbd7-7a", "ovs_interfaceid": "113cfbd7-7a98-4be6-af79-76777a24650c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Converting VIF {"id": "113cfbd7-7a98-4be6-af79-76777a24650c", "address": "fa:16:3e:1a:85:42", "network": {"id": "b15c2d5a-d882-480a-9d49-9f6991094b80", "bridge": "br-int", "label": "tempest-device-tagging-net2-323585513", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap113cfbd7-7a", "ovs_interfaceid": "113cfbd7-7a98-4be6-af79-76777a24650c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:85:42,bridge_name='br-int',has_traffic_filtering=True,id=113cfbd7-7a98-4be6-af79-76777a24650c,network=Network(b15c2d5a-d882-480a-9d49-9f6991094b80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap113cfbd7-7a') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG os_vif [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:85:42,bridge_name='br-int',has_traffic_filtering=True,id=113cfbd7-7a98-4be6-af79-76777a24650c,network=Network(b15c2d5a-d882-480a-9d49-9f6991094b80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap113cfbd7-7a') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap113cfbd7-7a, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap113cfbd7-7a, col_values=(('external_ids', {'iface-id': '113cfbd7-7a98-4be6-af79-76777a24650c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:85:42', 'vm-uuid': 'eb68aada-46ba-4798-a16e-bb2cacfcd747'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:29 user nova-compute[71113]: INFO os_vif [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:85:42,bridge_name='br-int',has_traffic_filtering=True,id=113cfbd7-7a98-4be6-af79-76777a24650c,network=Network(b15c2d5a-d882-480a-9d49-9f6991094b80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap113cfbd7-7a')
Jul 31 09:54:29 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T09:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1432155715',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1432155715',id=22,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUpJgODgUF9u3PO8QOqpE//ep50IsMXQIzo1b11XqsIWrhDj9vxGwUiGlSPERfjYPo8m8x6f54Kdo20ukge6PicaA87ygzLS1taG9DCB2HH0QHqHEJz+oqlZn8EcXAIXA==',key_name='tempest-keypair-385475384',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4db8c3c401c94419b4f534a20d60388c',ramdisk_id='',reservation_id='r-bypbvdk2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-477255538',owner_user_name='tempest-TaggedBootDevicesTest-477255538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:54:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b9e45d968444ffba99ecf4c845b101e',uuid=eb68aada-46ba-4798-a16e-bb2cacfcd747,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bcad9d15-2562-4660-93b0-91a32ac0c390", "address": "fa:16:3e:0f:b0:dc", "network": {"id": "b15c2d5a-d882-480a-9d49-9f6991094b80", "bridge": "br-int", "label": "tempest-device-tagging-net2-323585513", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcad9d15-25", "ovs_interfaceid": "bcad9d15-2562-4660-93b0-91a32ac0c390", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Converting VIF {"id": "bcad9d15-2562-4660-93b0-91a32ac0c390", "address": "fa:16:3e:0f:b0:dc", "network": {"id": "b15c2d5a-d882-480a-9d49-9f6991094b80", "bridge": "br-int", "label": "tempest-device-tagging-net2-323585513", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcad9d15-25", "ovs_interfaceid": "bcad9d15-2562-4660-93b0-91a32ac0c390", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:b0:dc,bridge_name='br-int',has_traffic_filtering=True,id=bcad9d15-2562-4660-93b0-91a32ac0c390,network=Network(b15c2d5a-d882-480a-9d49-9f6991094b80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcad9d15-25') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG os_vif [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:b0:dc,bridge_name='br-int',has_traffic_filtering=True,id=bcad9d15-2562-4660-93b0-91a32ac0c390,network=Network(b15c2d5a-d882-480a-9d49-9f6991094b80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcad9d15-25') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbcad9d15-25, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbcad9d15-25, col_values=(('external_ids', {'iface-id': 'bcad9d15-2562-4660-93b0-91a32ac0c390', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:b0:dc', 'vm-uuid': 'eb68aada-46ba-4798-a16e-bb2cacfcd747'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:29 user nova-compute[71113]: INFO os_vif [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:b0:dc,bridge_name='br-int',has_traffic_filtering=True,id=bcad9d15-2562-4660-93b0-91a32ac0c390,network=Network(b15c2d5a-d882-480a-9d49-9f6991094b80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcad9d15-25')
Jul 31 09:54:29 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] No BDM found with device name hda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] No VIF found with MAC fa:16:3e:71:d1:b6, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 09:54:29 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] No VIF found with MAC fa:16:3e:b6:98:ef, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 09:54:30 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Using config drive
Jul 31 09:54:30 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Creating config drive at /opt/stack/data/nova/instances/eb68aada-46ba-4798-a16e-bb2cacfcd747/disk.config
Jul 31 09:54:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/eb68aada-46ba-4798-a16e-bb2cacfcd747/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpguw3s19q {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/eb68aada-46ba-4798-a16e-bb2cacfcd747/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpguw3s19q" returned: 0 in 0.058s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:31 user nova-compute[71113]: DEBUG nova.compute.manager [req-0bd05499-64d9-44a7-b45b-5cb7cf7adcdd req-d2be8712-f604-4d9d-9f81-233c9189c065 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received event network-vif-plugged-4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:54:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-0bd05499-64d9-44a7-b45b-5cb7cf7adcdd req-d2be8712-f604-4d9d-9f81-233c9189c065 service nova] Acquiring lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:54:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-0bd05499-64d9-44a7-b45b-5cb7cf7adcdd req-d2be8712-f604-4d9d-9f81-233c9189c065 service nova] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:54:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-0bd05499-64d9-44a7-b45b-5cb7cf7adcdd req-d2be8712-f604-4d9d-9f81-233c9189c065 service nova] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:54:32 user nova-compute[71113]: DEBUG nova.compute.manager [req-0bd05499-64d9-44a7-b45b-5cb7cf7adcdd req-d2be8712-f604-4d9d-9f81-233c9189c065 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] No waiting events found dispatching network-vif-plugged-4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:54:32 user nova-compute[71113]: WARNING nova.compute.manager [req-0bd05499-64d9-44a7-b45b-5cb7cf7adcdd req-d2be8712-f604-4d9d-9f81-233c9189c065 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received unexpected event network-vif-plugged-4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e for instance with vm_state building and task_state spawning.
Jul 31 09:54:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:32 user nova-compute[71113]: DEBUG nova.compute.manager [req-604d1bc4-820f-4c35-a28b-d0715a27589a req-c138ee9f-79a5-4460-adcf-f5a96435bd42 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received event network-vif-plugged-6f734493-7794-4e1e-a68b-4ce6995dadef {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:54:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-604d1bc4-820f-4c35-a28b-d0715a27589a req-c138ee9f-79a5-4460-adcf-f5a96435bd42 service nova] Acquiring lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:54:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-604d1bc4-820f-4c35-a28b-d0715a27589a req-c138ee9f-79a5-4460-adcf-f5a96435bd42 service nova] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:54:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-604d1bc4-820f-4c35-a28b-d0715a27589a req-c138ee9f-79a5-4460-adcf-f5a96435bd42 service nova] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:54:32 user nova-compute[71113]: DEBUG nova.compute.manager [req-604d1bc4-820f-4c35-a28b-d0715a27589a req-c138ee9f-79a5-4460-adcf-f5a96435bd42 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] No waiting events found dispatching network-vif-plugged-6f734493-7794-4e1e-a68b-4ce6995dadef {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:54:32 user nova-compute[71113]: WARNING nova.compute.manager [req-604d1bc4-820f-4c35-a28b-d0715a27589a req-c138ee9f-79a5-4460-adcf-f5a96435bd42 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received unexpected event network-vif-plugged-6f734493-7794-4e1e-a68b-4ce6995dadef for instance with vm_state building and task_state spawning.
Jul 31 09:54:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:32 user nova-compute[71113]: DEBUG nova.compute.manager [req-a9a03be5-ee65-48d5-9e7a-74e1183fea0e req-e727cfbb-641d-4515-972c-ade332621418 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received event network-vif-plugged-cb50bad1-1e1e-4138-8b0b-f7dc17d0d760 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:54:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-a9a03be5-ee65-48d5-9e7a-74e1183fea0e req-e727cfbb-641d-4515-972c-ade332621418 service nova] Acquiring lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:54:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-a9a03be5-ee65-48d5-9e7a-74e1183fea0e req-e727cfbb-641d-4515-972c-ade332621418 service nova] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:54:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-a9a03be5-ee65-48d5-9e7a-74e1183fea0e req-e727cfbb-641d-4515-972c-ade332621418 service nova] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:54:32 user nova-compute[71113]: DEBUG nova.compute.manager [req-a9a03be5-ee65-48d5-9e7a-74e1183fea0e req-e727cfbb-641d-4515-972c-ade332621418 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] No waiting events found dispatching network-vif-plugged-cb50bad1-1e1e-4138-8b0b-f7dc17d0d760 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:54:32 user nova-compute[71113]: WARNING nova.compute.manager [req-a9a03be5-ee65-48d5-9e7a-74e1183fea0e req-e727cfbb-641d-4515-972c-ade332621418 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received unexpected event network-vif-plugged-cb50bad1-1e1e-4138-8b0b-f7dc17d0d760 for instance with vm_state building and task_state spawning.
Jul 31 09:54:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:33 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:33 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:33 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:33 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:33 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:33 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:33 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:33 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:33 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:33 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:33 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:33 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:33 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:33 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:33 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:33 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:33 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG nova.compute.manager [req-3827d614-7b1c-493c-a59c-7822ed501e82 req-5bd99c91-1e5a-4b3d-8e52-9222d4952f75 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received event network-vif-plugged-4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3827d614-7b1c-493c-a59c-7822ed501e82 req-5bd99c91-1e5a-4b3d-8e52-9222d4952f75 service nova] Acquiring lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3827d614-7b1c-493c-a59c-7822ed501e82 req-5bd99c91-1e5a-4b3d-8e52-9222d4952f75 service nova] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3827d614-7b1c-493c-a59c-7822ed501e82 req-5bd99c91-1e5a-4b3d-8e52-9222d4952f75 service nova] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG nova.compute.manager [req-3827d614-7b1c-493c-a59c-7822ed501e82 req-5bd99c91-1e5a-4b3d-8e52-9222d4952f75 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] No waiting events found dispatching network-vif-plugged-4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:54:34 user nova-compute[71113]: WARNING nova.compute.manager [req-3827d614-7b1c-493c-a59c-7822ed501e82 req-5bd99c91-1e5a-4b3d-8e52-9222d4952f75 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received unexpected event network-vif-plugged-4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e for instance with vm_state building and task_state spawning.
Jul 31 09:54:34 user nova-compute[71113]: DEBUG nova.compute.manager [req-3827d614-7b1c-493c-a59c-7822ed501e82 req-5bd99c91-1e5a-4b3d-8e52-9222d4952f75 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received event network-vif-plugged-113cfbd7-7a98-4be6-af79-76777a24650c {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3827d614-7b1c-493c-a59c-7822ed501e82 req-5bd99c91-1e5a-4b3d-8e52-9222d4952f75 service nova] Acquiring lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3827d614-7b1c-493c-a59c-7822ed501e82 req-5bd99c91-1e5a-4b3d-8e52-9222d4952f75 service nova] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3827d614-7b1c-493c-a59c-7822ed501e82 req-5bd99c91-1e5a-4b3d-8e52-9222d4952f75 service nova] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG nova.compute.manager [req-3827d614-7b1c-493c-a59c-7822ed501e82 req-5bd99c91-1e5a-4b3d-8e52-9222d4952f75 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] No waiting events found dispatching network-vif-plugged-113cfbd7-7a98-4be6-af79-76777a24650c {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:54:34 user nova-compute[71113]: WARNING nova.compute.manager [req-3827d614-7b1c-493c-a59c-7822ed501e82 req-5bd99c91-1e5a-4b3d-8e52-9222d4952f75 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received unexpected event network-vif-plugged-113cfbd7-7a98-4be6-af79-76777a24650c for instance with vm_state building and task_state spawning.
Jul 31 09:54:34 user nova-compute[71113]: DEBUG nova.compute.manager [req-3827d614-7b1c-493c-a59c-7822ed501e82 req-5bd99c91-1e5a-4b3d-8e52-9222d4952f75 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received event network-vif-plugged-113cfbd7-7a98-4be6-af79-76777a24650c {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3827d614-7b1c-493c-a59c-7822ed501e82 req-5bd99c91-1e5a-4b3d-8e52-9222d4952f75 service nova] Acquiring lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3827d614-7b1c-493c-a59c-7822ed501e82 req-5bd99c91-1e5a-4b3d-8e52-9222d4952f75 service nova] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3827d614-7b1c-493c-a59c-7822ed501e82 req-5bd99c91-1e5a-4b3d-8e52-9222d4952f75 service nova] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG nova.compute.manager [req-3827d614-7b1c-493c-a59c-7822ed501e82 req-5bd99c91-1e5a-4b3d-8e52-9222d4952f75 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] No waiting events found dispatching network-vif-plugged-113cfbd7-7a98-4be6-af79-76777a24650c {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:54:34 user nova-compute[71113]: WARNING nova.compute.manager [req-3827d614-7b1c-493c-a59c-7822ed501e82 req-5bd99c91-1e5a-4b3d-8e52-9222d4952f75 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received unexpected event network-vif-plugged-113cfbd7-7a98-4be6-af79-76777a24650c for instance with vm_state building and task_state spawning.
Jul 31 09:54:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-25aceec6-ce9d-4ab6-8b6f-96c8b4b3b830 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Acquiring lock "225aca75-f3cc-4fc9-a3a3-52be185e9c42" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-25aceec6-ce9d-4ab6-8b6f-96c8b4b3b830 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "225aca75-f3cc-4fc9-a3a3-52be185e9c42" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:54:34 user nova-compute[71113]: INFO nova.compute.manager [None req-25aceec6-ce9d-4ab6-8b6f-96c8b4b3b830 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Detaching volume 8730cac4-517b-4b24-a539-6b9a473e33d1
Jul 31 09:54:34 user nova-compute[71113]: DEBUG nova.compute.manager [req-8422689b-3520-41d6-a57d-22dcb13aa0ba req-2864bb06-f7ca-4dcb-8f2a-c20ba3687af0 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received event network-vif-plugged-6f734493-7794-4e1e-a68b-4ce6995dadef {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8422689b-3520-41d6-a57d-22dcb13aa0ba req-2864bb06-f7ca-4dcb-8f2a-c20ba3687af0 service nova] Acquiring lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8422689b-3520-41d6-a57d-22dcb13aa0ba req-2864bb06-f7ca-4dcb-8f2a-c20ba3687af0 service nova] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8422689b-3520-41d6-a57d-22dcb13aa0ba req-2864bb06-f7ca-4dcb-8f2a-c20ba3687af0 service nova] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG nova.compute.manager [req-8422689b-3520-41d6-a57d-22dcb13aa0ba req-2864bb06-f7ca-4dcb-8f2a-c20ba3687af0 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] No waiting events found dispatching network-vif-plugged-6f734493-7794-4e1e-a68b-4ce6995dadef {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:54:34 user nova-compute[71113]: WARNING nova.compute.manager [req-8422689b-3520-41d6-a57d-22dcb13aa0ba req-2864bb06-f7ca-4dcb-8f2a-c20ba3687af0 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received unexpected event network-vif-plugged-6f734493-7794-4e1e-a68b-4ce6995dadef for instance with vm_state building and task_state spawning.
Jul 31 09:54:34 user nova-compute[71113]: DEBUG nova.compute.manager [req-8422689b-3520-41d6-a57d-22dcb13aa0ba req-2864bb06-f7ca-4dcb-8f2a-c20ba3687af0 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received event network-vif-plugged-8354cc56-3d78-4f7a-b2fa-ee95e704d67c {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8422689b-3520-41d6-a57d-22dcb13aa0ba req-2864bb06-f7ca-4dcb-8f2a-c20ba3687af0 service nova] Acquiring lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8422689b-3520-41d6-a57d-22dcb13aa0ba req-2864bb06-f7ca-4dcb-8f2a-c20ba3687af0 service nova] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8422689b-3520-41d6-a57d-22dcb13aa0ba req-2864bb06-f7ca-4dcb-8f2a-c20ba3687af0 service nova] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG nova.compute.manager [req-8422689b-3520-41d6-a57d-22dcb13aa0ba req-2864bb06-f7ca-4dcb-8f2a-c20ba3687af0 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] No waiting events found dispatching network-vif-plugged-8354cc56-3d78-4f7a-b2fa-ee95e704d67c {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:54:34 user nova-compute[71113]: WARNING nova.compute.manager [req-8422689b-3520-41d6-a57d-22dcb13aa0ba req-2864bb06-f7ca-4dcb-8f2a-c20ba3687af0 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received unexpected event network-vif-plugged-8354cc56-3d78-4f7a-b2fa-ee95e704d67c for instance with vm_state building and task_state spawning.
Jul 31 09:54:34 user nova-compute[71113]: DEBUG nova.compute.manager [req-8422689b-3520-41d6-a57d-22dcb13aa0ba req-2864bb06-f7ca-4dcb-8f2a-c20ba3687af0 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received event network-vif-plugged-8354cc56-3d78-4f7a-b2fa-ee95e704d67c {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8422689b-3520-41d6-a57d-22dcb13aa0ba req-2864bb06-f7ca-4dcb-8f2a-c20ba3687af0 service nova] Acquiring lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8422689b-3520-41d6-a57d-22dcb13aa0ba req-2864bb06-f7ca-4dcb-8f2a-c20ba3687af0 service nova] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8422689b-3520-41d6-a57d-22dcb13aa0ba req-2864bb06-f7ca-4dcb-8f2a-c20ba3687af0 service nova] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG nova.compute.manager [req-8422689b-3520-41d6-a57d-22dcb13aa0ba req-2864bb06-f7ca-4dcb-8f2a-c20ba3687af0 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] No waiting events found dispatching network-vif-plugged-8354cc56-3d78-4f7a-b2fa-ee95e704d67c {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:54:34 user nova-compute[71113]: WARNING nova.compute.manager [req-8422689b-3520-41d6-a57d-22dcb13aa0ba req-2864bb06-f7ca-4dcb-8f2a-c20ba3687af0 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received unexpected event network-vif-plugged-8354cc56-3d78-4f7a-b2fa-ee95e704d67c for instance with vm_state building and task_state spawning.
Jul 31 09:54:34 user nova-compute[71113]: DEBUG nova.compute.manager [req-8422689b-3520-41d6-a57d-22dcb13aa0ba req-2864bb06-f7ca-4dcb-8f2a-c20ba3687af0 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received event network-vif-plugged-685563e0-3264-4974-9df4-c9187df31d0b {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8422689b-3520-41d6-a57d-22dcb13aa0ba req-2864bb06-f7ca-4dcb-8f2a-c20ba3687af0 service nova] Acquiring lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8422689b-3520-41d6-a57d-22dcb13aa0ba req-2864bb06-f7ca-4dcb-8f2a-c20ba3687af0 service nova] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8422689b-3520-41d6-a57d-22dcb13aa0ba req-2864bb06-f7ca-4dcb-8f2a-c20ba3687af0 service nova] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG nova.compute.manager [req-8422689b-3520-41d6-a57d-22dcb13aa0ba req-2864bb06-f7ca-4dcb-8f2a-c20ba3687af0 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] No waiting events found dispatching network-vif-plugged-685563e0-3264-4974-9df4-c9187df31d0b {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:54:34 user nova-compute[71113]: WARNING nova.compute.manager [req-8422689b-3520-41d6-a57d-22dcb13aa0ba req-2864bb06-f7ca-4dcb-8f2a-c20ba3687af0 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received unexpected event network-vif-plugged-685563e0-3264-4974-9df4-c9187df31d0b for instance with vm_state building and task_state spawning.
Jul 31 09:54:34 user nova-compute[71113]: DEBUG nova.compute.manager [req-8422689b-3520-41d6-a57d-22dcb13aa0ba req-2864bb06-f7ca-4dcb-8f2a-c20ba3687af0 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received event network-vif-plugged-685563e0-3264-4974-9df4-c9187df31d0b {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8422689b-3520-41d6-a57d-22dcb13aa0ba req-2864bb06-f7ca-4dcb-8f2a-c20ba3687af0 service nova] Acquiring lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8422689b-3520-41d6-a57d-22dcb13aa0ba req-2864bb06-f7ca-4dcb-8f2a-c20ba3687af0 service nova] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8422689b-3520-41d6-a57d-22dcb13aa0ba req-2864bb06-f7ca-4dcb-8f2a-c20ba3687af0 service nova] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG nova.compute.manager [req-8422689b-3520-41d6-a57d-22dcb13aa0ba req-2864bb06-f7ca-4dcb-8f2a-c20ba3687af0 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] No waiting events found dispatching network-vif-plugged-685563e0-3264-4974-9df4-c9187df31d0b {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:54:34 user nova-compute[71113]: WARNING nova.compute.manager [req-8422689b-3520-41d6-a57d-22dcb13aa0ba req-2864bb06-f7ca-4dcb-8f2a-c20ba3687af0 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received unexpected event network-vif-plugged-685563e0-3264-4974-9df4-c9187df31d0b for instance with vm_state building and task_state spawning.
Jul 31 09:54:34 user nova-compute[71113]: INFO nova.virt.block_device [None req-25aceec6-ce9d-4ab6-8b6f-96c8b4b3b830 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Attempting to driver detach volume 8730cac4-517b-4b24-a539-6b9a473e33d1 from mountpoint /dev/vdb
Jul 31 09:54:34 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-25aceec6-ce9d-4ab6-8b6f-96c8b4b3b830 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Attempting to detach device vdb from instance 225aca75-f3cc-4fc9-a3a3-52be185e9c42 from the persistent domain config. {{(pid=71113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-25aceec6-ce9d-4ab6-8b6f-96c8b4b3b830 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 09:54:34 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:54:34 user nova-compute[71113]:   <source dev="/dev/sdc"/>
Jul 31 09:54:34 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 09:54:34 user nova-compute[71113]:   <serial>8730cac4-517b-4b24-a539-6b9a473e33d1</serial>
Jul 31 09:54:34 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 09:54:34 user nova-compute[71113]: </disk>
Jul 31 09:54:34 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 09:54:34 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-25aceec6-ce9d-4ab6-8b6f-96c8b4b3b830 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Successfully detached device vdb from instance 225aca75-f3cc-4fc9-a3a3-52be185e9c42 from the persistent domain config.
Jul 31 09:54:34 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-25aceec6-ce9d-4ab6-8b6f-96c8b4b3b830 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 225aca75-f3cc-4fc9-a3a3-52be185e9c42 from the live domain config. {{(pid=71113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-25aceec6-ce9d-4ab6-8b6f-96c8b4b3b830 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 09:54:34 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:54:34 user nova-compute[71113]:   <source dev="/dev/sdc"/>
Jul 31 09:54:34 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 09:54:34 user nova-compute[71113]:   <serial>8730cac4-517b-4b24-a539-6b9a473e33d1</serial>
Jul 31 09:54:34 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 09:54:34 user nova-compute[71113]: </disk>
Jul 31 09:54:34 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b47e00c5-d5b8-402f-a31c-5fabc5affc22 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Acquiring lock "225aca75-f3cc-4fc9-a3a3-52be185e9c42" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Received event <DeviceRemovedEvent: 1690797274.8987577, 225aca75-f3cc-4fc9-a3a3-52be185e9c42 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71113) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-25aceec6-ce9d-4ab6-8b6f-96c8b4b3b830 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 225aca75-f3cc-4fc9-a3a3-52be185e9c42 {{(pid=71113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 09:54:34 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-25aceec6-ce9d-4ab6-8b6f-96c8b4b3b830 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Successfully detached device vdb from instance 225aca75-f3cc-4fc9-a3a3-52be185e9c42 from the live domain config.
Jul 31 09:54:34 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25aceec6-ce9d-4ab6-8b6f-96c8b4b3b830 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-25aceec6-ce9d-4ab6-8b6f-96c8b4b3b830 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QvpwdbAt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:54:34 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-25aceec6-ce9d-4ab6-8b6f-96c8b4b3b830 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:54:34 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-25aceec6-ce9d-4ab6-8b6f-96c8b4b3b830 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-25aceec6-ce9d-4ab6-8b6f-96c8b4b3b830 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-25aceec6-ce9d-4ab6-8b6f-96c8b4b3b830 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[65cade92-09dc-4b04-9eb7-3db42ba8cd6f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG nova.compute.manager [req-9ca1aaec-6b2d-4a5a-a4e3-b4571194af52 req-6c1f6d6e-dc6d-4f5f-83d6-cec28f778d7c service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received event network-vif-plugged-cb50bad1-1e1e-4138-8b0b-f7dc17d0d760 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9ca1aaec-6b2d-4a5a-a4e3-b4571194af52 req-6c1f6d6e-dc6d-4f5f-83d6-cec28f778d7c service nova] Acquiring lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9ca1aaec-6b2d-4a5a-a4e3-b4571194af52 req-6c1f6d6e-dc6d-4f5f-83d6-cec28f778d7c service nova] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9ca1aaec-6b2d-4a5a-a4e3-b4571194af52 req-6c1f6d6e-dc6d-4f5f-83d6-cec28f778d7c service nova] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG nova.compute.manager [req-9ca1aaec-6b2d-4a5a-a4e3-b4571194af52 req-6c1f6d6e-dc6d-4f5f-83d6-cec28f778d7c service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] No waiting events found dispatching network-vif-plugged-cb50bad1-1e1e-4138-8b0b-f7dc17d0d760 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:54:34 user nova-compute[71113]: WARNING nova.compute.manager [req-9ca1aaec-6b2d-4a5a-a4e3-b4571194af52 req-6c1f6d6e-dc6d-4f5f-83d6-cec28f778d7c service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received unexpected event network-vif-plugged-cb50bad1-1e1e-4138-8b0b-f7dc17d0d760 for instance with vm_state building and task_state spawning.
Jul 31 09:54:34 user nova-compute[71113]: DEBUG nova.compute.manager [req-9ca1aaec-6b2d-4a5a-a4e3-b4571194af52 req-6c1f6d6e-dc6d-4f5f-83d6-cec28f778d7c service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received event network-vif-plugged-bcad9d15-2562-4660-93b0-91a32ac0c390 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9ca1aaec-6b2d-4a5a-a4e3-b4571194af52 req-6c1f6d6e-dc6d-4f5f-83d6-cec28f778d7c service nova] Acquiring lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9ca1aaec-6b2d-4a5a-a4e3-b4571194af52 req-6c1f6d6e-dc6d-4f5f-83d6-cec28f778d7c service nova] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9ca1aaec-6b2d-4a5a-a4e3-b4571194af52 req-6c1f6d6e-dc6d-4f5f-83d6-cec28f778d7c service nova] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG nova.compute.manager [req-9ca1aaec-6b2d-4a5a-a4e3-b4571194af52 req-6c1f6d6e-dc6d-4f5f-83d6-cec28f778d7c service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] No waiting events found dispatching network-vif-plugged-bcad9d15-2562-4660-93b0-91a32ac0c390 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:54:34 user nova-compute[71113]: WARNING nova.compute.manager [req-9ca1aaec-6b2d-4a5a-a4e3-b4571194af52 req-6c1f6d6e-dc6d-4f5f-83d6-cec28f778d7c service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received unexpected event network-vif-plugged-bcad9d15-2562-4660-93b0-91a32ac0c390 for instance with vm_state building and task_state spawning.
Jul 31 09:54:34 user nova-compute[71113]: DEBUG nova.compute.manager [req-9ca1aaec-6b2d-4a5a-a4e3-b4571194af52 req-6c1f6d6e-dc6d-4f5f-83d6-cec28f778d7c service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received event network-vif-plugged-bcad9d15-2562-4660-93b0-91a32ac0c390 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9ca1aaec-6b2d-4a5a-a4e3-b4571194af52 req-6c1f6d6e-dc6d-4f5f-83d6-cec28f778d7c service nova] Acquiring lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9ca1aaec-6b2d-4a5a-a4e3-b4571194af52 req-6c1f6d6e-dc6d-4f5f-83d6-cec28f778d7c service nova] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9ca1aaec-6b2d-4a5a-a4e3-b4571194af52 req-6c1f6d6e-dc6d-4f5f-83d6-cec28f778d7c service nova] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG nova.compute.manager [req-9ca1aaec-6b2d-4a5a-a4e3-b4571194af52 req-6c1f6d6e-dc6d-4f5f-83d6-cec28f778d7c service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] No waiting events found dispatching network-vif-plugged-bcad9d15-2562-4660-93b0-91a32ac0c390 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:54:34 user nova-compute[71113]: WARNING nova.compute.manager [req-9ca1aaec-6b2d-4a5a-a4e3-b4571194af52 req-6c1f6d6e-dc6d-4f5f-83d6-cec28f778d7c service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received unexpected event network-vif-plugged-bcad9d15-2562-4660-93b0-91a32ac0c390 for instance with vm_state building and task_state spawning.
Jul 31 09:54:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aca7a88-cc52-4de8-a913-ab09f9368fa9]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-25aceec6-ce9d-4ab6-8b6f-96c8b4b3b830 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:54:34 user nova-compute[71113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)
Jul 31 09:54:34 user nova-compute[71113]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1 (non-flash)
Jul 31 09:54:34 user nova-compute[71113]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:54:34 user nova-compute[71113]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 (non-flash)
Jul 31 09:54:34 user nova-compute[71113]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef (non-flash)
Jul 31 09:54:34 user nova-compute[71113]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71 (non-flash)
Jul 31 09:54:34 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-25aceec6-ce9d-4ab6-8b6f-96c8b4b3b830 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:54:34 user nova-compute[71113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)
Jul 31 09:54:34 user nova-compute[71113]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1 (non-flash)
Jul 31 09:54:34 user nova-compute[71113]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:54:34 user nova-compute[71113]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 (non-flash)
Jul 31 09:54:34 user nova-compute[71113]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef (non-flash)
Jul 31 09:54:34 user nova-compute[71113]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71 (non-flash)
Jul 31 09:54:34 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-25aceec6-ce9d-4ab6-8b6f-96c8b4b3b830 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79082c6680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1'): ({'sdc'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-25aceec6-ce9d-4ab6-8b6f-96c8b4b3b830 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Removing single pathed devices sdc {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 09:54:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[766ab375-6a0d-4080-a592-56b31e22dfdd]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[565be4a9-c304-49cf-b6bb-d96e52bc571e]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:35 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-25aceec6-ce9d-4ab6-8b6f-96c8b4b3b830 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Flushing IO for device /dev/sdc {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 09:54:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[780e28f5-9e19-4eb1-8b25-88e0a8e67757]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:35 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-25aceec6-ce9d-4ab6-8b6f-96c8b4b3b830 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 09:54:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b73130a-529f-4860-9207-8eb80365888f]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:35 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-25aceec6-ce9d-4ab6-8b6f-96c8b4b3b830 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 09:54:35 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-25aceec6-ce9d-4ab6-8b6f-96c8b4b3b830 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] SCSI volumes sdc have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 09:54:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-25aceec6-ce9d-4ab6-8b6f-96c8b4b3b830 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 09:54:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.045s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9514ca0c-48dd-4711-a507-fe6c147675ed]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-25aceec6-ce9d-4ab6-8b6f-96c8b4b3b830 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:54:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1 -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f24af2-251f-4bd6-bfd8-753addd3b04d]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-25aceec6-ce9d-4ab6-8b6f-96c8b4b3b830 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1, portal: 172.16.0.220,3260]
Jul 31 09:54:35 user nova-compute[71113]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1, portal: 172.16.0.220,3260] successful.
Jul 31 09:54:35 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:54:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1 -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26b3ed8-befc-4991-bdd7-35654e4c7da0]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-25aceec6-ce9d-4ab6-8b6f-96c8b4b3b830 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:54:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-25aceec6-ce9d-4ab6-8b6f-96c8b4b3b830 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:54:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-25aceec6-ce9d-4ab6-8b6f-96c8b4b3b830 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] <== disconnect_volume: return (361ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:54:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25aceec6-ce9d-4ab6-8b6f-96c8b4b3b830 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 09:54:35 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797275.8742826, eb68aada-46ba-4798-a16e-bb2cacfcd747 => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:54:35 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] VM Resumed (Lifecycle Event)
Jul 31 09:54:35 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 09:54:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 09:54:35 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Instance spawned successfully.
Jul 31 09:54:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 09:54:35 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:54:35 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:54:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Found default for hw_cdrom_bus of ide {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:54:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Found default for hw_disk_bus of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:54:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Found default for hw_input_bus of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:54:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Found default for hw_pointer_model of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:54:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Found default for hw_video_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:54:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Found default for hw_vif_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:54:35 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:54:35 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797275.8812528, eb68aada-46ba-4798-a16e-bb2cacfcd747 => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:54:35 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] VM Started (Lifecycle Event)
Jul 31 09:54:35 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:54:35 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:54:35 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:54:36 user nova-compute[71113]: INFO nova.compute.manager [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Took 10.62 seconds to spawn the instance on the hypervisor.
Jul 31 09:54:36 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:54:36 user nova-compute[71113]: DEBUG nova.objects.instance [None req-25aceec6-ce9d-4ab6-8b6f-96c8b4b3b830 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lazy-loading 'flavor' on Instance uuid 225aca75-f3cc-4fc9-a3a3-52be185e9c42 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:54:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-25aceec6-ce9d-4ab6-8b6f-96c8b4b3b830 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "225aca75-f3cc-4fc9-a3a3-52be185e9c42" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.723s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:54:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b47e00c5-d5b8-402f-a31c-5fabc5affc22 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "225aca75-f3cc-4fc9-a3a3-52be185e9c42" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.581s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:54:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b47e00c5-d5b8-402f-a31c-5fabc5affc22 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Acquiring lock "225aca75-f3cc-4fc9-a3a3-52be185e9c42-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:54:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b47e00c5-d5b8-402f-a31c-5fabc5affc22 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "225aca75-f3cc-4fc9-a3a3-52be185e9c42-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:54:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b47e00c5-d5b8-402f-a31c-5fabc5affc22 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "225aca75-f3cc-4fc9-a3a3-52be185e9c42-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:54:36 user nova-compute[71113]: INFO nova.compute.manager [None req-b47e00c5-d5b8-402f-a31c-5fabc5affc22 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Terminating instance
Jul 31 09:54:36 user nova-compute[71113]: DEBUG nova.compute.manager [None req-b47e00c5-d5b8-402f-a31c-5fabc5affc22 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Start destroying the instance on the hypervisor. {{(pid=71113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 09:54:36 user nova-compute[71113]: INFO nova.compute.manager [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Took 36.17 seconds to build instance.
Jul 31 09:54:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0972bbbb-4ce6-46aa-a4f8-4077b254e3c9 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 36.264s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:54:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8d6d4fa3-3dcc-410e-a217-5048bfeb223b tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Acquiring lock "af1f4e7c-b336-457a-94cc-3df3c3203370" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:54:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8d6d4fa3-3dcc-410e-a217-5048bfeb223b tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Lock "af1f4e7c-b336-457a-94cc-3df3c3203370" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:54:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8d6d4fa3-3dcc-410e-a217-5048bfeb223b tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Acquiring lock "af1f4e7c-b336-457a-94cc-3df3c3203370-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:54:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8d6d4fa3-3dcc-410e-a217-5048bfeb223b tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Lock "af1f4e7c-b336-457a-94cc-3df3c3203370-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:54:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8d6d4fa3-3dcc-410e-a217-5048bfeb223b tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Lock "af1f4e7c-b336-457a-94cc-3df3c3203370-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:54:36 user nova-compute[71113]: INFO nova.compute.manager [None req-8d6d4fa3-3dcc-410e-a217-5048bfeb223b tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Terminating instance
Jul 31 09:54:36 user nova-compute[71113]: DEBUG nova.compute.manager [None req-8d6d4fa3-3dcc-410e-a217-5048bfeb223b tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Start destroying the instance on the hypervisor. {{(pid=71113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 09:54:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:36 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Instance destroyed successfully.
Jul 31 09:54:36 user nova-compute[71113]: DEBUG nova.objects.instance [None req-b47e00c5-d5b8-402f-a31c-5fabc5affc22 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lazy-loading 'resources' on Instance uuid 225aca75-f3cc-4fc9-a3a3-52be185e9c42 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:54:36 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-b47e00c5-d5b8-402f-a31c-5fabc5affc22 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:52:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-728911026',display_name='tempest-VolumesSnapshotTestJSON-instance-728911026',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-728911026',id=20,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDBH6DBXrEhSmt5MEU1VmCkITtMm02hcrsipt07/2h6S10jMtjkytv2bzqvT6WgzV9hSptbNwV4eD+5izpdPIxsjelUlnn3BKXW71unBBXEyDT8sRNeE9jvrWyvL84XBQ==',key_name='tempest-keypair-114753483',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:52:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b02dfb26bc2472baef63892ab5b2492',ramdisk_id='',reservation_id='r-fwtg3k92',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1215488088',owner_user_name='tempest-VolumesSnapshotTestJSON-1215488088-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:52:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e57ba3fd2d7a4d21a7653020def3f884',uuid=225aca75-f3cc-4fc9-a3a3-52be185e9c42,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da9f4dda-8c5c-4af8-9b15-7572a9e66f9f", "address": "fa:16:3e:72:f1:32", "network": {"id": "2ce9c333-b413-4073-af8c-2e583872df61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1283872978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b02dfb26bc2472baef63892ab5b2492", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda9f4dda-8c", "ovs_interfaceid": "da9f4dda-8c5c-4af8-9b15-7572a9e66f9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 09:54:36 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-b47e00c5-d5b8-402f-a31c-5fabc5affc22 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Converting VIF {"id": "da9f4dda-8c5c-4af8-9b15-7572a9e66f9f", "address": "fa:16:3e:72:f1:32", "network": {"id": "2ce9c333-b413-4073-af8c-2e583872df61", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1283872978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b02dfb26bc2472baef63892ab5b2492", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda9f4dda-8c", "ovs_interfaceid": "da9f4dda-8c5c-4af8-9b15-7572a9e66f9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:54:36 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-b47e00c5-d5b8-402f-a31c-5fabc5affc22 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:f1:32,bridge_name='br-int',has_traffic_filtering=True,id=da9f4dda-8c5c-4af8-9b15-7572a9e66f9f,network=Network(2ce9c333-b413-4073-af8c-2e583872df61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda9f4dda-8c') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:54:36 user nova-compute[71113]: DEBUG os_vif [None req-b47e00c5-d5b8-402f-a31c-5fabc5affc22 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:f1:32,bridge_name='br-int',has_traffic_filtering=True,id=da9f4dda-8c5c-4af8-9b15-7572a9e66f9f,network=Network(2ce9c333-b413-4073-af8c-2e583872df61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda9f4dda-8c') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 09:54:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda9f4dda-8c, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:54:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:54:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:36 user nova-compute[71113]: INFO os_vif [None req-b47e00c5-d5b8-402f-a31c-5fabc5affc22 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:f1:32,bridge_name='br-int',has_traffic_filtering=True,id=da9f4dda-8c5c-4af8-9b15-7572a9e66f9f,network=Network(2ce9c333-b413-4073-af8c-2e583872df61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda9f4dda-8c')
Jul 31 09:54:36 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b47e00c5-d5b8-402f-a31c-5fabc5affc22 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 09:54:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47e00c5-d5b8-402f-a31c-5fabc5affc22 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QvpwdbAt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:54:36 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-b47e00c5-d5b8-402f-a31c-5fabc5affc22 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:54:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-b47e00c5-d5b8-402f-a31c-5fabc5affc22 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:54:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-b47e00c5-d5b8-402f-a31c-5fabc5affc22 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:54:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47e00c5-d5b8-402f-a31c-5fabc5affc22 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8730cac4-517b-4b24-a539-6b9a473e33d1', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 09:54:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:36 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[be75f971-cf3b-443f-9b9f-e50806e59ba7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:36 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e02f124-8a36-461a-989f-1ba57f33bab0]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47e00c5-d5b8-402f-a31c-5fabc5affc22 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:54:36 user nova-compute[71113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)
Jul 31 09:54:36 user nova-compute[71113]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:54:36 user nova-compute[71113]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 (non-flash)
Jul 31 09:54:36 user nova-compute[71113]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef (non-flash)
Jul 31 09:54:36 user nova-compute[71113]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71 (non-flash)
Jul 31 09:54:36 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:54:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47e00c5-d5b8-402f-a31c-5fabc5affc22 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:54:36 user nova-compute[71113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)
Jul 31 09:54:36 user nova-compute[71113]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:54:36 user nova-compute[71113]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 (non-flash)
Jul 31 09:54:36 user nova-compute[71113]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef (non-flash)
Jul 31 09:54:36 user nova-compute[71113]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71 (non-flash)
Jul 31 09:54:36 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:54:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47e00c5-d5b8-402f-a31c-5fabc5affc22 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79082c7760>, {}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 09:54:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47e00c5-d5b8-402f-a31c-5fabc5affc22 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Disconnecting from: [] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 09:54:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-b47e00c5-d5b8-402f-a31c-5fabc5affc22 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.070s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:54:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47e00c5-d5b8-402f-a31c-5fabc5affc22 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] <== disconnect_volume: return (71ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:54:37 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b47e00c5-d5b8-402f-a31c-5fabc5affc22 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 09:54:37 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-b47e00c5-d5b8-402f-a31c-5fabc5affc22 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Deleting instance files /opt/stack/data/nova/instances/225aca75-f3cc-4fc9-a3a3-52be185e9c42_del
Jul 31 09:54:37 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-b47e00c5-d5b8-402f-a31c-5fabc5affc22 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Deletion of /opt/stack/data/nova/instances/225aca75-f3cc-4fc9-a3a3-52be185e9c42_del complete
Jul 31 09:54:37 user nova-compute[71113]: DEBUG nova.compute.manager [req-1394d39d-45d2-48a4-a4b8-2d3015f89e84 req-b69a6ba8-6785-45ed-b6ba-56f624ed06ff service nova] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Received event network-vif-unplugged-da9f4dda-8c5c-4af8-9b15-7572a9e66f9f {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:54:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1394d39d-45d2-48a4-a4b8-2d3015f89e84 req-b69a6ba8-6785-45ed-b6ba-56f624ed06ff service nova] Acquiring lock "225aca75-f3cc-4fc9-a3a3-52be185e9c42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:54:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1394d39d-45d2-48a4-a4b8-2d3015f89e84 req-b69a6ba8-6785-45ed-b6ba-56f624ed06ff service nova] Lock "225aca75-f3cc-4fc9-a3a3-52be185e9c42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:54:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1394d39d-45d2-48a4-a4b8-2d3015f89e84 req-b69a6ba8-6785-45ed-b6ba-56f624ed06ff service nova] Lock "225aca75-f3cc-4fc9-a3a3-52be185e9c42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:54:37 user nova-compute[71113]: DEBUG nova.compute.manager [req-1394d39d-45d2-48a4-a4b8-2d3015f89e84 req-b69a6ba8-6785-45ed-b6ba-56f624ed06ff service nova] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] No waiting events found dispatching network-vif-unplugged-da9f4dda-8c5c-4af8-9b15-7572a9e66f9f {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:54:37 user nova-compute[71113]: DEBUG nova.compute.manager [req-1394d39d-45d2-48a4-a4b8-2d3015f89e84 req-b69a6ba8-6785-45ed-b6ba-56f624ed06ff service nova] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Received event network-vif-unplugged-da9f4dda-8c5c-4af8-9b15-7572a9e66f9f for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 09:54:37 user nova-compute[71113]: DEBUG nova.compute.manager [req-1394d39d-45d2-48a4-a4b8-2d3015f89e84 req-b69a6ba8-6785-45ed-b6ba-56f624ed06ff service nova] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Received event network-vif-plugged-da9f4dda-8c5c-4af8-9b15-7572a9e66f9f {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:54:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1394d39d-45d2-48a4-a4b8-2d3015f89e84 req-b69a6ba8-6785-45ed-b6ba-56f624ed06ff service nova] Acquiring lock "225aca75-f3cc-4fc9-a3a3-52be185e9c42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:54:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1394d39d-45d2-48a4-a4b8-2d3015f89e84 req-b69a6ba8-6785-45ed-b6ba-56f624ed06ff service nova] Lock "225aca75-f3cc-4fc9-a3a3-52be185e9c42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:54:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1394d39d-45d2-48a4-a4b8-2d3015f89e84 req-b69a6ba8-6785-45ed-b6ba-56f624ed06ff service nova] Lock "225aca75-f3cc-4fc9-a3a3-52be185e9c42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:54:37 user nova-compute[71113]: DEBUG nova.compute.manager [req-1394d39d-45d2-48a4-a4b8-2d3015f89e84 req-b69a6ba8-6785-45ed-b6ba-56f624ed06ff service nova] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] No waiting events found dispatching network-vif-plugged-da9f4dda-8c5c-4af8-9b15-7572a9e66f9f {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:54:37 user nova-compute[71113]: WARNING nova.compute.manager [req-1394d39d-45d2-48a4-a4b8-2d3015f89e84 req-b69a6ba8-6785-45ed-b6ba-56f624ed06ff service nova] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Received unexpected event network-vif-plugged-da9f4dda-8c5c-4af8-9b15-7572a9e66f9f for instance with vm_state active and task_state deleting.
Jul 31 09:54:37 user nova-compute[71113]: INFO nova.compute.manager [None req-b47e00c5-d5b8-402f-a31c-5fabc5affc22 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Took 1.02 seconds to destroy the instance on the hypervisor.
Jul 31 09:54:37 user nova-compute[71113]: DEBUG oslo.service.loopingcall [None req-b47e00c5-d5b8-402f-a31c-5fabc5affc22 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71113) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 09:54:37 user nova-compute[71113]: DEBUG nova.compute.manager [-] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Deallocating network for instance {{(pid=71113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 09:54:37 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] deallocate_for_instance() {{(pid=71113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 09:54:37 user nova-compute[71113]: DEBUG nova.compute.manager [req-f100a2d8-c2f7-4535-b83a-a34480b9a176 req-eb0e7d91-abdf-4be2-9fea-9e63341b0c27 service nova] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Received event network-vif-unplugged-b57ab83c-c78e-424e-889b-b0156de15bfe {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:54:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f100a2d8-c2f7-4535-b83a-a34480b9a176 req-eb0e7d91-abdf-4be2-9fea-9e63341b0c27 service nova] Acquiring lock "af1f4e7c-b336-457a-94cc-3df3c3203370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:54:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f100a2d8-c2f7-4535-b83a-a34480b9a176 req-eb0e7d91-abdf-4be2-9fea-9e63341b0c27 service nova] Lock "af1f4e7c-b336-457a-94cc-3df3c3203370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:54:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f100a2d8-c2f7-4535-b83a-a34480b9a176 req-eb0e7d91-abdf-4be2-9fea-9e63341b0c27 service nova] Lock "af1f4e7c-b336-457a-94cc-3df3c3203370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:54:37 user nova-compute[71113]: DEBUG nova.compute.manager [req-f100a2d8-c2f7-4535-b83a-a34480b9a176 req-eb0e7d91-abdf-4be2-9fea-9e63341b0c27 service nova] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] No waiting events found dispatching network-vif-unplugged-b57ab83c-c78e-424e-889b-b0156de15bfe {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:54:37 user nova-compute[71113]: DEBUG nova.compute.manager [req-f100a2d8-c2f7-4535-b83a-a34480b9a176 req-eb0e7d91-abdf-4be2-9fea-9e63341b0c27 service nova] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Received event network-vif-unplugged-b57ab83c-c78e-424e-889b-b0156de15bfe for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 09:54:37 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Instance destroyed successfully.
Jul 31 09:54:37 user nova-compute[71113]: DEBUG nova.objects.instance [None req-8d6d4fa3-3dcc-410e-a217-5048bfeb223b tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Lazy-loading 'resources' on Instance uuid af1f4e7c-b336-457a-94cc-3df3c3203370 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:54:37 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-8d6d4fa3-3dcc-410e-a217-5048bfeb223b tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T09:51:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-601671640',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-601671640',id=17,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrt/0N3rqkgPN6SuyXfpoCTkV9Bk0pcEdYe3hmzwwFIugD3ohq+ljDgxWA2owuO7ncn48ukAgrCkpv3bs19B971Yw7oJwFLv7z/1GwjZIhoKmL+3YWqpkWzV2dkY74VfA==',key_name='tempest-keypair-341346334',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:51:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c8a3ec2098864e8797f77f70e1784acd',ramdisk_id='',reservation_id='r-sijnqnb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-740569977',owner_user_name='tempest-TaggedAttachmentsTest-740569977-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:51:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21f1d14ad39e4cd0b19e8484f1635344',uuid=af1f4e7c-b336-457a-94cc-3df3c3203370,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b57ab83c-c78e-424e-889b-b0156de15bfe", "address": "fa:16:3e:64:ce:90", "network": {"id": "2eebe293-45a3-4f39-bfa2-404813801391", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1697211995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8a3ec2098864e8797f77f70e1784acd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb57ab83c-c7", "ovs_interfaceid": "b57ab83c-c78e-424e-889b-b0156de15bfe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 09:54:37 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-8d6d4fa3-3dcc-410e-a217-5048bfeb223b tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Converting VIF {"id": "b57ab83c-c78e-424e-889b-b0156de15bfe", "address": "fa:16:3e:64:ce:90", "network": {"id": "2eebe293-45a3-4f39-bfa2-404813801391", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1697211995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8a3ec2098864e8797f77f70e1784acd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb57ab83c-c7", "ovs_interfaceid": "b57ab83c-c78e-424e-889b-b0156de15bfe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:54:37 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-8d6d4fa3-3dcc-410e-a217-5048bfeb223b tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:ce:90,bridge_name='br-int',has_traffic_filtering=True,id=b57ab83c-c78e-424e-889b-b0156de15bfe,network=Network(2eebe293-45a3-4f39-bfa2-404813801391),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb57ab83c-c7') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:54:37 user nova-compute[71113]: DEBUG os_vif [None req-8d6d4fa3-3dcc-410e-a217-5048bfeb223b tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:ce:90,bridge_name='br-int',has_traffic_filtering=True,id=b57ab83c-c78e-424e-889b-b0156de15bfe,network=Network(2eebe293-45a3-4f39-bfa2-404813801391),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb57ab83c-c7') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 09:54:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb57ab83c-c7, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:54:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:54:37 user nova-compute[71113]: INFO os_vif [None req-8d6d4fa3-3dcc-410e-a217-5048bfeb223b tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:ce:90,bridge_name='br-int',has_traffic_filtering=True,id=b57ab83c-c78e-424e-889b-b0156de15bfe,network=Network(2eebe293-45a3-4f39-bfa2-404813801391),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb57ab83c-c7')
Jul 31 09:54:37 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-8d6d4fa3-3dcc-410e-a217-5048bfeb223b tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Deleting instance files /opt/stack/data/nova/instances/af1f4e7c-b336-457a-94cc-3df3c3203370_del
Jul 31 09:54:37 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-8d6d4fa3-3dcc-410e-a217-5048bfeb223b tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Deletion of /opt/stack/data/nova/instances/af1f4e7c-b336-457a-94cc-3df3c3203370_del complete
Jul 31 09:54:37 user nova-compute[71113]: INFO nova.compute.manager [None req-8d6d4fa3-3dcc-410e-a217-5048bfeb223b tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Took 1.06 seconds to destroy the instance on the hypervisor.
Jul 31 09:54:37 user nova-compute[71113]: DEBUG oslo.service.loopingcall [None req-8d6d4fa3-3dcc-410e-a217-5048bfeb223b tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71113) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 09:54:37 user nova-compute[71113]: DEBUG nova.compute.manager [-] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Deallocating network for instance {{(pid=71113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 09:54:37 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] deallocate_for_instance() {{(pid=71113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 09:54:38 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:54:38 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Took 1.18 seconds to deallocate network for instance.
Jul 31 09:54:38 user nova-compute[71113]: WARNING nova.volume.cinder [None req-b47e00c5-d5b8-402f-a31c-5fabc5affc22 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Attachment 0784b321-7ed2-41b7-861b-871321f3003e does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 0784b321-7ed2-41b7-861b-871321f3003e. (HTTP 404) (Request-ID: req-d063fe6b-941a-445a-9e52-c84d3dc41cef)
Jul 31 09:54:38 user nova-compute[71113]: INFO nova.compute.manager [None req-b47e00c5-d5b8-402f-a31c-5fabc5affc22 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Took 0.03 seconds to detach 1 volumes for instance.
Jul 31 09:54:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b47e00c5-d5b8-402f-a31c-5fabc5affc22 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:54:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b47e00c5-d5b8-402f-a31c-5fabc5affc22 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:54:38 user nova-compute[71113]: DEBUG nova.compute.manager [req-ad2e76b4-7fbf-41b2-92a4-4dccb4844bb8 req-c119406e-03a3-4ef8-a390-cfd3ddf81f28 service nova] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Received event network-changed-72cf4ec9-ac91-4f38-a4f5-9859bb5138bf {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:54:38 user nova-compute[71113]: DEBUG nova.compute.manager [req-ad2e76b4-7fbf-41b2-92a4-4dccb4844bb8 req-c119406e-03a3-4ef8-a390-cfd3ddf81f28 service nova] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Refreshing instance network info cache due to event network-changed-72cf4ec9-ac91-4f38-a4f5-9859bb5138bf. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:54:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ad2e76b4-7fbf-41b2-92a4-4dccb4844bb8 req-c119406e-03a3-4ef8-a390-cfd3ddf81f28 service nova] Acquiring lock "refresh_cache-6d92f7e3-6f70-4344-9f15-9815d51024b6" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:54:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ad2e76b4-7fbf-41b2-92a4-4dccb4844bb8 req-c119406e-03a3-4ef8-a390-cfd3ddf81f28 service nova] Acquired lock "refresh_cache-6d92f7e3-6f70-4344-9f15-9815d51024b6" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:54:38 user nova-compute[71113]: DEBUG nova.network.neutron [req-ad2e76b4-7fbf-41b2-92a4-4dccb4844bb8 req-c119406e-03a3-4ef8-a390-cfd3ddf81f28 service nova] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Refreshing network info cache for port 72cf4ec9-ac91-4f38-a4f5-9859bb5138bf {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:54:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ac440a50-8acc-4be6-a06a-14cfdf14c8ea tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Acquiring lock "6d92f7e3-6f70-4344-9f15-9815d51024b6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:54:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ac440a50-8acc-4be6-a06a-14cfdf14c8ea tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "6d92f7e3-6f70-4344-9f15-9815d51024b6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:54:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ac440a50-8acc-4be6-a06a-14cfdf14c8ea tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Acquiring lock "6d92f7e3-6f70-4344-9f15-9815d51024b6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:54:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ac440a50-8acc-4be6-a06a-14cfdf14c8ea tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "6d92f7e3-6f70-4344-9f15-9815d51024b6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:54:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ac440a50-8acc-4be6-a06a-14cfdf14c8ea tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "6d92f7e3-6f70-4344-9f15-9815d51024b6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:54:38 user nova-compute[71113]: INFO nova.compute.manager [None req-ac440a50-8acc-4be6-a06a-14cfdf14c8ea tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Terminating instance
Jul 31 09:54:38 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-b47e00c5-d5b8-402f-a31c-5fabc5affc22 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:54:38 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ac440a50-8acc-4be6-a06a-14cfdf14c8ea tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Start destroying the instance on the hypervisor. {{(pid=71113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 09:54:38 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-b47e00c5-d5b8-402f-a31c-5fabc5affc22 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:54:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b47e00c5-d5b8-402f-a31c-5fabc5affc22 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.498s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:54:38 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:38 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-b47e00c5-d5b8-402f-a31c-5fabc5affc22 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Deleted allocations for instance 225aca75-f3cc-4fc9-a3a3-52be185e9c42
Jul 31 09:54:38 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b47e00c5-d5b8-402f-a31c-5fabc5affc22 tempest-VolumesSnapshotTestJSON-1215488088 tempest-VolumesSnapshotTestJSON-1215488088-project-member] Lock "225aca75-f3cc-4fc9-a3a3-52be185e9c42" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.008s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:54:39 user nova-compute[71113]: DEBUG nova.compute.manager [req-e52f5c0d-3560-4cc2-955b-7d0c51326f97 req-297eed76-0b1f-4529-9cf4-99a7ce808976 service nova] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Received event network-vif-unplugged-72cf4ec9-ac91-4f38-a4f5-9859bb5138bf {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:54:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e52f5c0d-3560-4cc2-955b-7d0c51326f97 req-297eed76-0b1f-4529-9cf4-99a7ce808976 service nova] Acquiring lock "6d92f7e3-6f70-4344-9f15-9815d51024b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:54:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e52f5c0d-3560-4cc2-955b-7d0c51326f97 req-297eed76-0b1f-4529-9cf4-99a7ce808976 service nova] Lock "6d92f7e3-6f70-4344-9f15-9815d51024b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:54:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e52f5c0d-3560-4cc2-955b-7d0c51326f97 req-297eed76-0b1f-4529-9cf4-99a7ce808976 service nova] Lock "6d92f7e3-6f70-4344-9f15-9815d51024b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:54:39 user nova-compute[71113]: DEBUG nova.compute.manager [req-e52f5c0d-3560-4cc2-955b-7d0c51326f97 req-297eed76-0b1f-4529-9cf4-99a7ce808976 service nova] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] No waiting events found dispatching network-vif-unplugged-72cf4ec9-ac91-4f38-a4f5-9859bb5138bf {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:54:39 user nova-compute[71113]: DEBUG nova.compute.manager [req-e52f5c0d-3560-4cc2-955b-7d0c51326f97 req-297eed76-0b1f-4529-9cf4-99a7ce808976 service nova] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Received event network-vif-unplugged-72cf4ec9-ac91-4f38-a4f5-9859bb5138bf for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 09:54:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:39 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:54:39 user nova-compute[71113]: DEBUG nova.compute.manager [req-7b748d74-6fa5-4446-bdb0-7feee1aa6032 req-569dd558-b3a4-49f2-a520-d6704980f6c9 service nova] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Received event network-vif-plugged-b57ab83c-c78e-424e-889b-b0156de15bfe {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:54:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7b748d74-6fa5-4446-bdb0-7feee1aa6032 req-569dd558-b3a4-49f2-a520-d6704980f6c9 service nova] Acquiring lock "af1f4e7c-b336-457a-94cc-3df3c3203370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:54:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7b748d74-6fa5-4446-bdb0-7feee1aa6032 req-569dd558-b3a4-49f2-a520-d6704980f6c9 service nova] Lock "af1f4e7c-b336-457a-94cc-3df3c3203370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:54:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7b748d74-6fa5-4446-bdb0-7feee1aa6032 req-569dd558-b3a4-49f2-a520-d6704980f6c9 service nova] Lock "af1f4e7c-b336-457a-94cc-3df3c3203370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:54:39 user nova-compute[71113]: DEBUG nova.compute.manager [req-7b748d74-6fa5-4446-bdb0-7feee1aa6032 req-569dd558-b3a4-49f2-a520-d6704980f6c9 service nova] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] No waiting events found dispatching network-vif-plugged-b57ab83c-c78e-424e-889b-b0156de15bfe {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:54:39 user nova-compute[71113]: WARNING nova.compute.manager [req-7b748d74-6fa5-4446-bdb0-7feee1aa6032 req-569dd558-b3a4-49f2-a520-d6704980f6c9 service nova] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Received unexpected event network-vif-plugged-b57ab83c-c78e-424e-889b-b0156de15bfe for instance with vm_state active and task_state deleting.
Jul 31 09:54:39 user nova-compute[71113]: DEBUG nova.compute.manager [req-7b748d74-6fa5-4446-bdb0-7feee1aa6032 req-569dd558-b3a4-49f2-a520-d6704980f6c9 service nova] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Received event network-vif-deleted-da9f4dda-8c5c-4af8-9b15-7572a9e66f9f {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:54:39 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Took 1.61 seconds to deallocate network for instance.
Jul 31 09:54:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8d6d4fa3-3dcc-410e-a217-5048bfeb223b tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:54:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8d6d4fa3-3dcc-410e-a217-5048bfeb223b tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:54:39 user nova-compute[71113]: DEBUG nova.network.neutron [req-ad2e76b4-7fbf-41b2-92a4-4dccb4844bb8 req-c119406e-03a3-4ef8-a390-cfd3ddf81f28 service nova] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Updated VIF entry in instance network info cache for port 72cf4ec9-ac91-4f38-a4f5-9859bb5138bf. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:54:39 user nova-compute[71113]: DEBUG nova.network.neutron [req-ad2e76b4-7fbf-41b2-92a4-4dccb4844bb8 req-c119406e-03a3-4ef8-a390-cfd3ddf81f28 service nova] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Updating instance_info_cache with network_info: [{"id": "72cf4ec9-ac91-4f38-a4f5-9859bb5138bf", "address": "fa:16:3e:07:7b:f4", "network": {"id": "8c75ddf2-700c-4f01-b8cf-af57bdab7d37", "bridge": "br-int", "label": "tempest-TestStampPattern-1367141606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60e95a8fd2446d5bd5308f10caa6930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72cf4ec9-ac", "ovs_interfaceid": "72cf4ec9-ac91-4f38-a4f5-9859bb5138bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:54:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ad2e76b4-7fbf-41b2-92a4-4dccb4844bb8 req-c119406e-03a3-4ef8-a390-cfd3ddf81f28 service nova] Releasing lock "refresh_cache-6d92f7e3-6f70-4344-9f15-9815d51024b6" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:54:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:39 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Instance destroyed successfully.
Jul 31 09:54:39 user nova-compute[71113]: DEBUG nova.objects.instance [None req-ac440a50-8acc-4be6-a06a-14cfdf14c8ea tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lazy-loading 'resources' on Instance uuid 6d92f7e3-6f70-4344-9f15-9815d51024b6 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:54:39 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-ac440a50-8acc-4be6-a06a-14cfdf14c8ea tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:51:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1747166891',display_name='tempest-TestStampPattern-server-1747166891',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1747166891',id=18,image_ref='bb8cda9d-fc71-4cd9-84f5-a118a86c8336',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrIg8Re0SPL90KGI/7mfKXKiutrisvPKJSJwI2GyIKoRN6YbCL8gOrKsaFBkaHBzRjOk6oMjoGJtW64C2f48/NDQKl52ZNucPGtAtvZuIzC2XttPHjvBX5TLIsYhRNoTA==',key_name='tempest-TestStampPattern-211360877',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:51:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f60e95a8fd2446d5bd5308f10caa6930',ramdisk_id='',reservation_id='r-dhcn2cxh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='9a4b47dd-b335-4c2f-9dee-5421357a0ee1',image_min_disk='1',image_min_ram='0',image_owner_id='f60e95a8fd2446d5bd5308f10caa6930',image_owner_project_name='tempest-TestStampPattern-12160385',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-12160385-project-member',image_user_id='a414c37ab0384024821d33e393b711af',owner_project_name='tempest-TestStampPattern-12160385',owner_user_name='tempest-TestStampPattern-12160385-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:51:48Z,user_data=None,user_id='a414c37ab0384024821d33e393b711af',uuid=6d92f7e3-6f70-4344-9f15-9815d51024b6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72cf4ec9-ac91-4f38-a4f5-9859bb5138bf", "address": "fa:16:3e:07:7b:f4", "network": {"id": "8c75ddf2-700c-4f01-b8cf-af57bdab7d37", "bridge": "br-int", "label": "tempest-TestStampPattern-1367141606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60e95a8fd2446d5bd5308f10caa6930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72cf4ec9-ac", "ovs_interfaceid": "72cf4ec9-ac91-4f38-a4f5-9859bb5138bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 09:54:39 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-ac440a50-8acc-4be6-a06a-14cfdf14c8ea tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Converting VIF {"id": "72cf4ec9-ac91-4f38-a4f5-9859bb5138bf", "address": "fa:16:3e:07:7b:f4", "network": {"id": "8c75ddf2-700c-4f01-b8cf-af57bdab7d37", "bridge": "br-int", "label": "tempest-TestStampPattern-1367141606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60e95a8fd2446d5bd5308f10caa6930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72cf4ec9-ac", "ovs_interfaceid": "72cf4ec9-ac91-4f38-a4f5-9859bb5138bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:54:39 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-ac440a50-8acc-4be6-a06a-14cfdf14c8ea tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:7b:f4,bridge_name='br-int',has_traffic_filtering=True,id=72cf4ec9-ac91-4f38-a4f5-9859bb5138bf,network=Network(8c75ddf2-700c-4f01-b8cf-af57bdab7d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72cf4ec9-ac') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:54:39 user nova-compute[71113]: DEBUG os_vif [None req-ac440a50-8acc-4be6-a06a-14cfdf14c8ea tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:7b:f4,bridge_name='br-int',has_traffic_filtering=True,id=72cf4ec9-ac91-4f38-a4f5-9859bb5138bf,network=Network(8c75ddf2-700c-4f01-b8cf-af57bdab7d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72cf4ec9-ac') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 09:54:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap72cf4ec9-ac, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:54:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:54:39 user nova-compute[71113]: INFO os_vif [None req-ac440a50-8acc-4be6-a06a-14cfdf14c8ea tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:7b:f4,bridge_name='br-int',has_traffic_filtering=True,id=72cf4ec9-ac91-4f38-a4f5-9859bb5138bf,network=Network(8c75ddf2-700c-4f01-b8cf-af57bdab7d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72cf4ec9-ac')
Jul 31 09:54:39 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-ac440a50-8acc-4be6-a06a-14cfdf14c8ea tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Deleting instance files /opt/stack/data/nova/instances/6d92f7e3-6f70-4344-9f15-9815d51024b6_del
Jul 31 09:54:39 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-ac440a50-8acc-4be6-a06a-14cfdf14c8ea tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Deletion of /opt/stack/data/nova/instances/6d92f7e3-6f70-4344-9f15-9815d51024b6_del complete
Jul 31 09:54:39 user nova-compute[71113]: INFO nova.compute.manager [None req-ac440a50-8acc-4be6-a06a-14cfdf14c8ea tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Took 0.95 seconds to destroy the instance on the hypervisor.
Jul 31 09:54:39 user nova-compute[71113]: DEBUG oslo.service.loopingcall [None req-ac440a50-8acc-4be6-a06a-14cfdf14c8ea tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71113) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 09:54:39 user nova-compute[71113]: DEBUG nova.compute.manager [-] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Deallocating network for instance {{(pid=71113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 09:54:39 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] deallocate_for_instance() {{(pid=71113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 09:54:39 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-8d6d4fa3-3dcc-410e-a217-5048bfeb223b tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:54:39 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-8d6d4fa3-3dcc-410e-a217-5048bfeb223b tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:54:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8d6d4fa3-3dcc-410e-a217-5048bfeb223b tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.483s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:54:39 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-8d6d4fa3-3dcc-410e-a217-5048bfeb223b tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Deleted allocations for instance af1f4e7c-b336-457a-94cc-3df3c3203370
Jul 31 09:54:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8d6d4fa3-3dcc-410e-a217-5048bfeb223b tempest-TaggedAttachmentsTest-740569977 tempest-TaggedAttachmentsTest-740569977-project-member] Lock "af1f4e7c-b336-457a-94cc-3df3c3203370" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.367s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:54:40 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:54:40 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Took 0.54 seconds to deallocate network for instance.
Jul 31 09:54:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ac440a50-8acc-4be6-a06a-14cfdf14c8ea tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:54:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ac440a50-8acc-4be6-a06a-14cfdf14c8ea tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:54:40 user nova-compute[71113]: DEBUG nova.compute.manager [req-dbe69134-f3c2-431f-bc99-5518be5701a4 req-3825f153-85d7-4973-8eb9-0c62ea64342f service nova] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Received event network-vif-deleted-b57ab83c-c78e-424e-889b-b0156de15bfe {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:54:40 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-ac440a50-8acc-4be6-a06a-14cfdf14c8ea tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:54:40 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-ac440a50-8acc-4be6-a06a-14cfdf14c8ea tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:54:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ac440a50-8acc-4be6-a06a-14cfdf14c8ea tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.424s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:54:40 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-ac440a50-8acc-4be6-a06a-14cfdf14c8ea tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Deleted allocations for instance 6d92f7e3-6f70-4344-9f15-9815d51024b6
Jul 31 09:54:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ac440a50-8acc-4be6-a06a-14cfdf14c8ea tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "6d92f7e3-6f70-4344-9f15-9815d51024b6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.142s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:54:41 user nova-compute[71113]: DEBUG nova.compute.manager [req-447dcd29-ab53-4ea8-b819-9cb9b4f9685a req-da865f30-897f-4626-b342-0c4c56b0d373 service nova] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Received event network-vif-plugged-72cf4ec9-ac91-4f38-a4f5-9859bb5138bf {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:54:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-447dcd29-ab53-4ea8-b819-9cb9b4f9685a req-da865f30-897f-4626-b342-0c4c56b0d373 service nova] Acquiring lock "6d92f7e3-6f70-4344-9f15-9815d51024b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:54:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-447dcd29-ab53-4ea8-b819-9cb9b4f9685a req-da865f30-897f-4626-b342-0c4c56b0d373 service nova] Lock "6d92f7e3-6f70-4344-9f15-9815d51024b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:54:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-447dcd29-ab53-4ea8-b819-9cb9b4f9685a req-da865f30-897f-4626-b342-0c4c56b0d373 service nova] Lock "6d92f7e3-6f70-4344-9f15-9815d51024b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:54:41 user nova-compute[71113]: DEBUG nova.compute.manager [req-447dcd29-ab53-4ea8-b819-9cb9b4f9685a req-da865f30-897f-4626-b342-0c4c56b0d373 service nova] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] No waiting events found dispatching network-vif-plugged-72cf4ec9-ac91-4f38-a4f5-9859bb5138bf {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:54:41 user nova-compute[71113]: WARNING nova.compute.manager [req-447dcd29-ab53-4ea8-b819-9cb9b4f9685a req-da865f30-897f-4626-b342-0c4c56b0d373 service nova] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Received unexpected event network-vif-plugged-72cf4ec9-ac91-4f38-a4f5-9859bb5138bf for instance with vm_state deleted and task_state None.
Jul 31 09:54:41 user nova-compute[71113]: DEBUG nova.compute.manager [req-0eb9a3be-f4ca-4e55-bab1-e936248ddca7 req-f145434a-0b54-43fe-b580-9b9f717be773 service nova] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Received event network-vif-deleted-72cf4ec9-ac91-4f38-a4f5-9859bb5138bf {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:54:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:54:51 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690797276.828043, 225aca75-f3cc-4fc9-a3a3-52be185e9c42 => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:54:51 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] VM Stopped (Lifecycle Event)
Jul 31 09:54:51 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0473d693-e2f4-4e0e-94d0-e26e197ec551 None None] [instance: 225aca75-f3cc-4fc9-a3a3-52be185e9c42] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:54:52 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690797277.3792977, af1f4e7c-b336-457a-94cc-3df3c3203370 => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:54:52 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] VM Stopped (Lifecycle Event)
Jul 31 09:54:52 user nova-compute[71113]: DEBUG nova.compute.manager [None req-46d143b5-d56a-4000-a9ae-7c283dc678f0 None None] [instance: af1f4e7c-b336-457a-94cc-3df3c3203370] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:54:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:54 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690797279.596218, 6d92f7e3-6f70-4344-9f15-9815d51024b6 => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:54:54 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] VM Stopped (Lifecycle Event)
Jul 31 09:54:54 user nova-compute[71113]: DEBUG nova.compute.manager [None req-f65fa1c0-bcb8-4da6-a2bf-bf30a1e95f70 None None] [instance: 6d92f7e3-6f70-4344-9f15-9815d51024b6] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:54:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-848f2f26-3d37-4b0a-9ff6-c63c5731560e tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Acquiring lock "8d2948be-3ebb-4067-a0c8-e2ca884814ff" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:54:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-848f2f26-3d37-4b0a-9ff6-c63c5731560e tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "8d2948be-3ebb-4067-a0c8-e2ca884814ff" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:54:59 user nova-compute[71113]: INFO nova.compute.manager [None req-848f2f26-3d37-4b0a-9ff6-c63c5731560e tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Detaching volume a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e
Jul 31 09:54:59 user nova-compute[71113]: INFO nova.virt.block_device [None req-848f2f26-3d37-4b0a-9ff6-c63c5731560e tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Attempting to driver detach volume a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e from mountpoint /dev/vdc
Jul 31 09:54:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-848f2f26-3d37-4b0a-9ff6-c63c5731560e tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Attempting to detach device vdc from instance 8d2948be-3ebb-4067-a0c8-e2ca884814ff from the persistent domain config. {{(pid=71113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 09:54:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-848f2f26-3d37-4b0a-9ff6-c63c5731560e tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 09:54:59 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:54:59 user nova-compute[71113]:   <source dev="/dev/sdb"/>
Jul 31 09:54:59 user nova-compute[71113]:   <target dev="vdc" bus="virtio"/>
Jul 31 09:54:59 user nova-compute[71113]:   <serial>a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e</serial>
Jul 31 09:54:59 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 31 09:54:59 user nova-compute[71113]: </disk>
Jul 31 09:54:59 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 09:54:59 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-848f2f26-3d37-4b0a-9ff6-c63c5731560e tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Successfully detached device vdc from instance 8d2948be-3ebb-4067-a0c8-e2ca884814ff from the persistent domain config.
Jul 31 09:54:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-848f2f26-3d37-4b0a-9ff6-c63c5731560e tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 8d2948be-3ebb-4067-a0c8-e2ca884814ff from the live domain config. {{(pid=71113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 09:54:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-848f2f26-3d37-4b0a-9ff6-c63c5731560e tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 09:54:59 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:54:59 user nova-compute[71113]:   <source dev="/dev/sdb"/>
Jul 31 09:54:59 user nova-compute[71113]:   <target dev="vdc" bus="virtio"/>
Jul 31 09:54:59 user nova-compute[71113]:   <serial>a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e</serial>
Jul 31 09:54:59 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 31 09:54:59 user nova-compute[71113]: </disk>
Jul 31 09:54:59 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 09:54:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Received event <DeviceRemovedEvent: 1690797299.6210334, 8d2948be-3ebb-4067-a0c8-e2ca884814ff => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71113) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 09:54:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-848f2f26-3d37-4b0a-9ff6-c63c5731560e tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 8d2948be-3ebb-4067-a0c8-e2ca884814ff {{(pid=71113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 09:54:59 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-848f2f26-3d37-4b0a-9ff6-c63c5731560e tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Successfully detached device vdc from instance 8d2948be-3ebb-4067-a0c8-e2ca884814ff from the live domain config.
Jul 31 09:54:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-848f2f26-3d37-4b0a-9ff6-c63c5731560e tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 09:54:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-848f2f26-3d37-4b0a-9ff6-c63c5731560e tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vXLMNWVl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:54:59 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-848f2f26-3d37-4b0a-9ff6-c63c5731560e tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:54:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-848f2f26-3d37-4b0a-9ff6-c63c5731560e tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:54:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-848f2f26-3d37-4b0a-9ff6-c63c5731560e tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:54:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-848f2f26-3d37-4b0a-9ff6-c63c5731560e tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 09:54:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:54:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:59 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db6dbfb-49c1-463a-a6f3-e52792f8549a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.139s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:59 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[96194d97-35c3-4d07-acea-095f687d9d64]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-848f2f26-3d37-4b0a-9ff6-c63c5731560e tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:54:59 user nova-compute[71113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)
Jul 31 09:54:59 user nova-compute[71113]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:54:59 user nova-compute[71113]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 (non-flash)
Jul 31 09:54:59 user nova-compute[71113]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef (non-flash)
Jul 31 09:54:59 user nova-compute[71113]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71 (non-flash)
Jul 31 09:54:59 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:54:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-848f2f26-3d37-4b0a-9ff6-c63c5731560e tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:54:59 user nova-compute[71113]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e (non-flash)
Jul 31 09:54:59 user nova-compute[71113]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:54:59 user nova-compute[71113]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 (non-flash)
Jul 31 09:54:59 user nova-compute[71113]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef (non-flash)
Jul 31 09:54:59 user nova-compute[71113]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71 (non-flash)
Jul 31 09:54:59 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:54:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-848f2f26-3d37-4b0a-9ff6-c63c5731560e tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7908390940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e'): ({'sdb'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 09:54:59 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-848f2f26-3d37-4b0a-9ff6-c63c5731560e tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Removing single pathed devices sdb {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 09:54:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:59 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9559f09-0c23-49db-90ba-4e86a6241b2e]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:59 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[34fcc17f-0386-4a4d-a6f0-c6747da8e85c]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:59 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-848f2f26-3d37-4b0a-9ff6-c63c5731560e tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Flushing IO for device /dev/sdb {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 09:54:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:59 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[18593bf1-5543-4a01-b605-788e903b7d25]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:59 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-848f2f26-3d37-4b0a-9ff6-c63c5731560e tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 09:54:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:59 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebaa1836-6cc2-4d5f-a5ce-e912a6cee8e6]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:59 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-848f2f26-3d37-4b0a-9ff6-c63c5731560e tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 09:54:59 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-848f2f26-3d37-4b0a-9ff6-c63c5731560e tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] SCSI volumes sdb have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 09:54:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-848f2f26-3d37-4b0a-9ff6-c63c5731560e tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 09:54:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:54:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:54:59 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[12733551-59a0-40d3-94d9-7d0485b6cc23]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:54:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-848f2f26-3d37-4b0a-9ff6-c63c5731560e tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:54:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:00 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e165b3a-dd93-4bce-bd0b-c57d9bfc7981]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:00 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-848f2f26-3d37-4b0a-9ff6-c63c5731560e tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e, portal: 172.16.0.220,3260]
Jul 31 09:55:00 user nova-compute[71113]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e, portal: 172.16.0.220,3260] successful.
Jul 31 09:55:00 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:55:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a27f7538-c1c4-4b3d-a08a-6b6b4ec5332e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:00 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee82bc5-30af-4a1b-9d27-7b21b2b9fdac]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:00 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-848f2f26-3d37-4b0a-9ff6-c63c5731560e tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:55:00 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-848f2f26-3d37-4b0a-9ff6-c63c5731560e tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.427s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:55:00 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-848f2f26-3d37-4b0a-9ff6-c63c5731560e tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] <== disconnect_volume: return (428ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:55:00 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-848f2f26-3d37-4b0a-9ff6-c63c5731560e tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 09:55:00 user nova-compute[71113]: DEBUG nova.objects.instance [None req-848f2f26-3d37-4b0a-9ff6-c63c5731560e tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lazy-loading 'flavor' on Instance uuid 8d2948be-3ebb-4067-a0c8-e2ca884814ff {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:55:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-848f2f26-3d37-4b0a-9ff6-c63c5731560e tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "8d2948be-3ebb-4067-a0c8-e2ca884814ff" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.857s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:55:02 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:55:03 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:55:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:55:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:55:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:55:03 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 09:55:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d2948be-3ebb-4067-a0c8-e2ca884814ff/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d2948be-3ebb-4067-a0c8-e2ca884814ff/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d2948be-3ebb-4067-a0c8-e2ca884814ff/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d2948be-3ebb-4067-a0c8-e2ca884814ff/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:04 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 09:55:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4df9380-7882-48a6-ba64-bb17429e54ac/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4df9380-7882-48a6-ba64-bb17429e54ac/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4df9380-7882-48a6-ba64-bb17429e54ac/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4df9380-7882-48a6-ba64-bb17429e54ac/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a4b47dd-b335-4c2f-9dee-5421357a0ee1/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a4b47dd-b335-4c2f-9dee-5421357a0ee1/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a4b47dd-b335-4c2f-9dee-5421357a0ee1/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a4b47dd-b335-4c2f-9dee-5421357a0ee1/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:05 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 09:55:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:05 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 09:55:05 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 09:55:05 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 09:55:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:06 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:55:06 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:55:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=7600MB free_disk=25.391555786132812GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 09:55:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:55:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:55:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 0ea0401b-26c2-4655-956b-1bc000debd53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:55:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 1112a49d-27bd-4fc8-bae6-ec1decbb47db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:55:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 9a4b47dd-b335-4c2f-9dee-5421357a0ee1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:55:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance f4df9380-7882-48a6-ba64-bb17429e54ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:55:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance efa311a0-fe2e-4c0f-af66-09c3eb38fbf1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:55:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 3157a7a6-b8a9-4e2d-a157-360bce4c625d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:55:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 8d2948be-3ebb-4067-a0c8-e2ca884814ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:55:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 92d25a03-98ce-4bde-a3cc-20313ae77d41 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:55:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance eb68aada-46ba-4798-a16e-bb2cacfcd747 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:55:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 09:55:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 09:55:06 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:55:06 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:55:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 09:55:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.412s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:55:07 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:55:07 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:55:07 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:55:07 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:55:07 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:55:07 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 09:55:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:09 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:55:10 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:55:10 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 09:55:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "refresh_cache-1112a49d-27bd-4fc8-bae6-ec1decbb47db" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:55:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquired lock "refresh_cache-1112a49d-27bd-4fc8-bae6-ec1decbb47db" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:55:10 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Forcefully refreshing network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 09:55:11 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-08ca7b48-e567-4997-95f0-731c6252932b tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Acquiring lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:55:11 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-08ca7b48-e567-4997-95f0-731c6252932b tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:55:11 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-08ca7b48-e567-4997-95f0-731c6252932b tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Acquiring lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:55:11 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-08ca7b48-e567-4997-95f0-731c6252932b tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:55:11 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-08ca7b48-e567-4997-95f0-731c6252932b tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:55:11 user nova-compute[71113]: INFO nova.compute.manager [None req-08ca7b48-e567-4997-95f0-731c6252932b tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Terminating instance
Jul 31 09:55:11 user nova-compute[71113]: DEBUG nova.compute.manager [None req-08ca7b48-e567-4997-95f0-731c6252932b tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Start destroying the instance on the hypervisor. {{(pid=71113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 09:55:11 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:11 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:11 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:11 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:11 user nova-compute[71113]: DEBUG nova.compute.manager [req-09a70771-3ecf-4c3b-a2be-e29fb586e6da req-efff1ee2-af90-457e-8bd8-020a7a41db2b service nova] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Received event network-vif-unplugged-39b5a493-47bd-4599-9a9f-bb80c93fb332 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:55:11 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-09a70771-3ecf-4c3b-a2be-e29fb586e6da req-efff1ee2-af90-457e-8bd8-020a7a41db2b service nova] Acquiring lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:55:11 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-09a70771-3ecf-4c3b-a2be-e29fb586e6da req-efff1ee2-af90-457e-8bd8-020a7a41db2b service nova] Lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:55:11 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-09a70771-3ecf-4c3b-a2be-e29fb586e6da req-efff1ee2-af90-457e-8bd8-020a7a41db2b service nova] Lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:55:11 user nova-compute[71113]: DEBUG nova.compute.manager [req-09a70771-3ecf-4c3b-a2be-e29fb586e6da req-efff1ee2-af90-457e-8bd8-020a7a41db2b service nova] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] No waiting events found dispatching network-vif-unplugged-39b5a493-47bd-4599-9a9f-bb80c93fb332 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:55:11 user nova-compute[71113]: DEBUG nova.compute.manager [req-09a70771-3ecf-4c3b-a2be-e29fb586e6da req-efff1ee2-af90-457e-8bd8-020a7a41db2b service nova] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Received event network-vif-unplugged-39b5a493-47bd-4599-9a9f-bb80c93fb332 for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 09:55:11 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Updating instance_info_cache with network_info: [{"id": "647f984e-a9e3-4e49-9877-75ad4826e467", "address": "fa:16:3e:72:e2:f2", "network": {"id": "26352e29-fc15-48ac-be14-8af7a0c80219", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866093358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bae93d4fff5e4990bd9fe78e71d6d2d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647f984e-a9", "ovs_interfaceid": "647f984e-a9e3-4e49-9877-75ad4826e467", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:55:11 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Releasing lock "refresh_cache-1112a49d-27bd-4fc8-bae6-ec1decbb47db" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:55:11 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Updated the network info_cache for instance {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 09:55:11 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Instance destroyed successfully.
Jul 31 09:55:11 user nova-compute[71113]: DEBUG nova.objects.instance [None req-08ca7b48-e567-4997-95f0-731c6252932b tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lazy-loading 'resources' on Instance uuid efa311a0-fe2e-4c0f-af66-09c3eb38fbf1 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:55:11 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-08ca7b48-e567-4997-95f0-731c6252932b tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:46:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1025510923',display_name='tempest-ServerActionsTestOtherB-server-1025510923',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1025510923',id=3,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJo+xi4tu0GGLLf+2/4AMwJN8W9HV5KOFul5csHl5tHCHdJymtchsdGYmiKLfCyzN953/rO7ubVJnctaNhLzLpYKjY5Z2Nn1cEvYAzU5x1ZT5edLumoNfJjhx0wRkZgiEQ==',key_name='tempest-keypair-947034726',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:52:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a5bb5c0790e54702b881dc5e45641be8',ramdisk_id='',reservation_id='r-o5vysyfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1778056817',owner_user_name='tempest-ServerActionsTestOtherB-1778056817-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:52:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b5f449e8b1948cf914daef537aea164',uuid=efa311a0-fe2e-4c0f-af66-09c3eb38fbf1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "address": "fa:16:3e:16:bb:aa", "network": {"id": "4f2ea02a-9b26-4f2a-af23-39c060703ff3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-725518740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5bb5c0790e54702b881dc5e45641be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b5a493-47", "ovs_interfaceid": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 09:55:11 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-08ca7b48-e567-4997-95f0-731c6252932b tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Converting VIF {"id": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "address": "fa:16:3e:16:bb:aa", "network": {"id": "4f2ea02a-9b26-4f2a-af23-39c060703ff3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-725518740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5bb5c0790e54702b881dc5e45641be8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b5a493-47", "ovs_interfaceid": "39b5a493-47bd-4599-9a9f-bb80c93fb332", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:55:11 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-08ca7b48-e567-4997-95f0-731c6252932b tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:bb:aa,bridge_name='br-int',has_traffic_filtering=True,id=39b5a493-47bd-4599-9a9f-bb80c93fb332,network=Network(4f2ea02a-9b26-4f2a-af23-39c060703ff3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39b5a493-47') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:55:11 user nova-compute[71113]: DEBUG os_vif [None req-08ca7b48-e567-4997-95f0-731c6252932b tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:bb:aa,bridge_name='br-int',has_traffic_filtering=True,id=39b5a493-47bd-4599-9a9f-bb80c93fb332,network=Network(4f2ea02a-9b26-4f2a-af23-39c060703ff3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39b5a493-47') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 09:55:11 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:11 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap39b5a493-47, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:55:11 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:11 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:55:11 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:11 user nova-compute[71113]: INFO os_vif [None req-08ca7b48-e567-4997-95f0-731c6252932b tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:bb:aa,bridge_name='br-int',has_traffic_filtering=True,id=39b5a493-47bd-4599-9a9f-bb80c93fb332,network=Network(4f2ea02a-9b26-4f2a-af23-39c060703ff3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39b5a493-47')
Jul 31 09:55:11 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08ca7b48-e567-4997-95f0-731c6252932b tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 09:55:11 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ca7b48-e567-4997-95f0-731c6252932b tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FGERQMJC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:55:11 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-08ca7b48-e567-4997-95f0-731c6252932b tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:55:11 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-08ca7b48-e567-4997-95f0-731c6252932b tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:55:11 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-08ca7b48-e567-4997-95f0-731c6252932b tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:55:11 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ca7b48-e567-4997-95f0-731c6252932b tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 09:55:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:11 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da0935b-a528-4d7c-9b4f-23d4cb186ed4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:11 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c68f5b4-70d6-4927-ad6b-fb3b67216ed7]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:11 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ca7b48-e567-4997-95f0-731c6252932b tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:55:11 user nova-compute[71113]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:55:11 user nova-compute[71113]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 (non-flash)
Jul 31 09:55:11 user nova-compute[71113]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef (non-flash)
Jul 31 09:55:11 user nova-compute[71113]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71 (non-flash)
Jul 31 09:55:11 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:55:11 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ca7b48-e567-4997-95f0-731c6252932b tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c (non-flash)
Jul 31 09:55:11 user nova-compute[71113]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:55:11 user nova-compute[71113]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 (non-flash)
Jul 31 09:55:11 user nova-compute[71113]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef (non-flash)
Jul 31 09:55:11 user nova-compute[71113]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71 (non-flash)
Jul 31 09:55:11 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:55:11 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ca7b48-e567-4997-95f0-731c6252932b tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f78f05acc10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c'): ({'sdd'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 09:55:11 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-08ca7b48-e567-4997-95f0-731c6252932b tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Removing single pathed devices sdd {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 09:55:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:11 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[cebfe0cc-4df3-42df-8a90-f119528b486a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:11 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e55198f-dc85-41ec-ae70-52b36d0d6c5f]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:11 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-08ca7b48-e567-4997-95f0-731c6252932b tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Flushing IO for device /dev/sdd {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 09:55:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:11 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4cff37-77da-4a63-8d7c-4afb3dba60de]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:11 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-08ca7b48-e567-4997-95f0-731c6252932b tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 09:55:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:12 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:12 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c73abd7-03d7-4794-a51d-693992f81d0a]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:12 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-08ca7b48-e567-4997-95f0-731c6252932b tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 09:55:12 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-08ca7b48-e567-4997-95f0-731c6252932b tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] SCSI volumes sdd have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 09:55:12 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ca7b48-e567-4997-95f0-731c6252932b tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 09:55:12 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:12 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:12 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f3083f-01da-4168-b988-f32d63f8d43b]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:12 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ca7b48-e567-4997-95f0-731c6252932b tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:55:12 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:12 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:12 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4444ea8-7b93-4659-986d-86ffb74287ff]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:12 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ca7b48-e567-4997-95f0-731c6252932b tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c, portal: 172.16.0.220,3260]
Jul 31 09:55:12 user nova-compute[71113]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c, portal: 172.16.0.220,3260] successful.
Jul 31 09:55:12 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:55:12 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:12 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc7c0a40-0540-43ec-8a1d-7dd80d222f2c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:12 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42d6500-dd35-4a47-a5ec-7776b09c8411]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:12 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ca7b48-e567-4997-95f0-731c6252932b tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:55:12 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-08ca7b48-e567-4997-95f0-731c6252932b tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:55:12 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-08ca7b48-e567-4997-95f0-731c6252932b tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] <== disconnect_volume: return (307ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:55:12 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08ca7b48-e567-4997-95f0-731c6252932b tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 09:55:12 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-08ca7b48-e567-4997-95f0-731c6252932b tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Deleting instance files /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1_del
Jul 31 09:55:12 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-08ca7b48-e567-4997-95f0-731c6252932b tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Deletion of /opt/stack/data/nova/instances/efa311a0-fe2e-4c0f-af66-09c3eb38fbf1_del complete
Jul 31 09:55:12 user nova-compute[71113]: INFO nova.compute.manager [None req-08ca7b48-e567-4997-95f0-731c6252932b tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Took 1.20 seconds to destroy the instance on the hypervisor.
Jul 31 09:55:12 user nova-compute[71113]: DEBUG oslo.service.loopingcall [None req-08ca7b48-e567-4997-95f0-731c6252932b tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71113) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 09:55:12 user nova-compute[71113]: DEBUG nova.compute.manager [-] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Deallocating network for instance {{(pid=71113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 09:55:12 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] deallocate_for_instance() {{(pid=71113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 09:55:13 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:13 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:55:13 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Took 0.85 seconds to deallocate network for instance.
Jul 31 09:55:13 user nova-compute[71113]: DEBUG nova.compute.manager [req-3bba5077-ee8d-44b1-a70e-09e4efed3d36 req-297484c6-4c75-4ddb-bda6-0010adab4614 service nova] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Received event network-vif-deleted-39b5a493-47bd-4599-9a9f-bb80c93fb332 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:55:13 user nova-compute[71113]: DEBUG nova.compute.manager [req-4d971aa0-6ce5-49e6-bb38-c1dc75e3991a req-9b93c849-a610-463b-a174-12231e543826 service nova] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Received event network-vif-plugged-39b5a493-47bd-4599-9a9f-bb80c93fb332 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:55:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-4d971aa0-6ce5-49e6-bb38-c1dc75e3991a req-9b93c849-a610-463b-a174-12231e543826 service nova] Acquiring lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:55:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-4d971aa0-6ce5-49e6-bb38-c1dc75e3991a req-9b93c849-a610-463b-a174-12231e543826 service nova] Lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:55:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-4d971aa0-6ce5-49e6-bb38-c1dc75e3991a req-9b93c849-a610-463b-a174-12231e543826 service nova] Lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:55:13 user nova-compute[71113]: DEBUG nova.compute.manager [req-4d971aa0-6ce5-49e6-bb38-c1dc75e3991a req-9b93c849-a610-463b-a174-12231e543826 service nova] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] No waiting events found dispatching network-vif-plugged-39b5a493-47bd-4599-9a9f-bb80c93fb332 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:55:13 user nova-compute[71113]: WARNING nova.compute.manager [req-4d971aa0-6ce5-49e6-bb38-c1dc75e3991a req-9b93c849-a610-463b-a174-12231e543826 service nova] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Received unexpected event network-vif-plugged-39b5a493-47bd-4599-9a9f-bb80c93fb332 for instance with vm_state active and task_state deleting.
Jul 31 09:55:13 user nova-compute[71113]: INFO nova.compute.manager [None req-08ca7b48-e567-4997-95f0-731c6252932b tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Took 0.73 seconds to detach 1 volumes for instance.
Jul 31 09:55:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-08ca7b48-e567-4997-95f0-731c6252932b tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:55:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-08ca7b48-e567-4997-95f0-731c6252932b tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:55:14 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-08ca7b48-e567-4997-95f0-731c6252932b tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:55:14 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-08ca7b48-e567-4997-95f0-731c6252932b tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:55:14 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-08ca7b48-e567-4997-95f0-731c6252932b tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.307s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:55:14 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-08ca7b48-e567-4997-95f0-731c6252932b tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Deleted allocations for instance efa311a0-fe2e-4c0f-af66-09c3eb38fbf1
Jul 31 09:55:14 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-08ca7b48-e567-4997-95f0-731c6252932b tempest-ServerActionsTestOtherB-1778056817 tempest-ServerActionsTestOtherB-1778056817-project-member] Lock "efa311a0-fe2e-4c0f-af66-09c3eb38fbf1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.268s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:55:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Acquiring lock "a950d710-4596-4355-ac31-568c7728335a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:55:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "a950d710-4596-4355-ac31-568c7728335a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:55:16 user nova-compute[71113]: DEBUG nova.compute.manager [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Starting instance... {{(pid=71113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 09:55:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:55:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:55:16 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 09:55:16 user nova-compute[71113]: INFO nova.compute.claims [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Claim successful on node user
Jul 31 09:55:17 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:55:17 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:55:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.357s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:55:17 user nova-compute[71113]: DEBUG nova.compute.manager [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Start building networks asynchronously for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 09:55:17 user nova-compute[71113]: DEBUG nova.compute.manager [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Allocating IP information in the background. {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 09:55:17 user nova-compute[71113]: DEBUG nova.network.neutron [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] allocate_for_instance() {{(pid=71113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 09:55:17 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 09:55:17 user nova-compute[71113]: DEBUG nova.compute.manager [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Start building block device mappings for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 09:55:17 user nova-compute[71113]: INFO nova.virt.block_device [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Booting with volume 78ea4913-8d79-4c9a-9324-c2d9f86c6d38 at /dev/vda
Jul 31 09:55:17 user nova-compute[71113]: DEBUG nova.policy [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7029dd8d775d4c14bb349b72b1171d5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a5479fd014325b8790a80b2405d1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71113) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 09:55:17 user nova-compute[71113]: DEBUG os_brick.utils [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:55:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:17 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e7afa4-d1ea-43b5-ad66-4bb9118cfc46]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:17 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[435a8b5b-a67d-4c56-9dc0-e4e195103251]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:17 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6532a406-f46f-49ff-9882-4fcf0bd042d5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:17 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab653d8-c4f3-4bed-87a8-dc18a7c984c3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:55:17 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 09:55:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:55:17 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 09:55:17 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5893128a-3b6c-4356-b4d2-b0f79b065efb]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:17 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 09:55:17 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 09:55:17 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 09:55:17 user nova-compute[71113]: DEBUG os_brick.utils [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:55:17 user nova-compute[71113]: DEBUG nova.virt.block_device [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Updating existing volume attachment record: e2c12d18-6a17-475a-afec-1631a1da4d3f {{(pid=71113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 09:55:18 user nova-compute[71113]: DEBUG nova.network.neutron [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Successfully created port: 469843c1-3548-4bae-90bb-7fd1f5ac0052 {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 09:55:18 user nova-compute[71113]: DEBUG nova.network.neutron [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Successfully updated port: 469843c1-3548-4bae-90bb-7fd1f5ac0052 {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 09:55:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Acquiring lock "refresh_cache-a950d710-4596-4355-ac31-568c7728335a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:55:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Acquired lock "refresh_cache-a950d710-4596-4355-ac31-568c7728335a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:55:18 user nova-compute[71113]: DEBUG nova.network.neutron [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 09:55:18 user nova-compute[71113]: DEBUG nova.compute.manager [req-017259fa-25be-4901-a4e1-31fcc1a6398b req-8ebb0e08-f3f2-48ea-be48-81fc7374fe1b service nova] [instance: a950d710-4596-4355-ac31-568c7728335a] Received event network-changed-469843c1-3548-4bae-90bb-7fd1f5ac0052 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:55:18 user nova-compute[71113]: DEBUG nova.compute.manager [req-017259fa-25be-4901-a4e1-31fcc1a6398b req-8ebb0e08-f3f2-48ea-be48-81fc7374fe1b service nova] [instance: a950d710-4596-4355-ac31-568c7728335a] Refreshing instance network info cache due to event network-changed-469843c1-3548-4bae-90bb-7fd1f5ac0052. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:55:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-017259fa-25be-4901-a4e1-31fcc1a6398b req-8ebb0e08-f3f2-48ea-be48-81fc7374fe1b service nova] Acquiring lock "refresh_cache-a950d710-4596-4355-ac31-568c7728335a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:55:18 user nova-compute[71113]: DEBUG nova.network.neutron [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 09:55:19 user nova-compute[71113]: DEBUG nova.network.neutron [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Updating instance_info_cache with network_info: [{"id": "469843c1-3548-4bae-90bb-7fd1f5ac0052", "address": "fa:16:3e:08:cb:ac", "network": {"id": "cc84435f-b983-425d-bad0-36039e592e25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1662840158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f7a5479fd014325b8790a80b2405d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469843c1-35", "ovs_interfaceid": "469843c1-3548-4bae-90bb-7fd1f5ac0052", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:55:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Releasing lock "refresh_cache-a950d710-4596-4355-ac31-568c7728335a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:55:19 user nova-compute[71113]: DEBUG nova.compute.manager [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Instance network_info: |[{"id": "469843c1-3548-4bae-90bb-7fd1f5ac0052", "address": "fa:16:3e:08:cb:ac", "network": {"id": "cc84435f-b983-425d-bad0-36039e592e25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1662840158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f7a5479fd014325b8790a80b2405d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469843c1-35", "ovs_interfaceid": "469843c1-3548-4bae-90bb-7fd1f5ac0052", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 09:55:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-017259fa-25be-4901-a4e1-31fcc1a6398b req-8ebb0e08-f3f2-48ea-be48-81fc7374fe1b service nova] Acquired lock "refresh_cache-a950d710-4596-4355-ac31-568c7728335a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:55:19 user nova-compute[71113]: DEBUG nova.network.neutron [req-017259fa-25be-4901-a4e1-31fcc1a6398b req-8ebb0e08-f3f2-48ea-be48-81fc7374fe1b service nova] [instance: a950d710-4596-4355-ac31-568c7728335a] Refreshing network info cache for port 469843c1-3548-4bae-90bb-7fd1f5ac0052 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:55:19 user nova-compute[71113]: DEBUG nova.network.neutron [req-017259fa-25be-4901-a4e1-31fcc1a6398b req-8ebb0e08-f3f2-48ea-be48-81fc7374fe1b service nova] [instance: a950d710-4596-4355-ac31-568c7728335a] Updated VIF entry in instance network info cache for port 469843c1-3548-4bae-90bb-7fd1f5ac0052. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:55:19 user nova-compute[71113]: DEBUG nova.network.neutron [req-017259fa-25be-4901-a4e1-31fcc1a6398b req-8ebb0e08-f3f2-48ea-be48-81fc7374fe1b service nova] [instance: a950d710-4596-4355-ac31-568c7728335a] Updating instance_info_cache with network_info: [{"id": "469843c1-3548-4bae-90bb-7fd1f5ac0052", "address": "fa:16:3e:08:cb:ac", "network": {"id": "cc84435f-b983-425d-bad0-36039e592e25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1662840158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f7a5479fd014325b8790a80b2405d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469843c1-35", "ovs_interfaceid": "469843c1-3548-4bae-90bb-7fd1f5ac0052", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:55:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-017259fa-25be-4901-a4e1-31fcc1a6398b req-8ebb0e08-f3f2-48ea-be48-81fc7374fe1b service nova] Releasing lock "refresh_cache-a950d710-4596-4355-ac31-568c7728335a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:55:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG nova.compute.manager [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Start spawning the instance on the hypervisor. {{(pid=71113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 09:55:25 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Creating image(s)
Jul 31 09:55:25 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Did not create local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Ensure instance console log exists: /opt/stack/data/nova/instances/a950d710-4596-4355-ac31-568c7728335a/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Start _get_guest_xml network_info=[{"id": "469843c1-3548-4bae-90bb-7fd1f5ac0052", "address": "fa:16:3e:08:cb:ac", "network": {"id": "cc84435f-b983-425d-bad0-36039e592e25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1662840158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f7a5479fd014325b8790a80b2405d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469843c1-35", "ovs_interfaceid": "469843c1-3548-4bae-90bb-7fd1f5ac0052", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'e2c12d18-6a17-475a-afec-1631a1da4d3f', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vwYotCOs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a950d710-4596-4355-ac31-568c7728335a', 'attached_at': '', 'detached_at': '', 'volume_id': '78ea4913-8d79-4c9a-9324-c2d9f86c6d38', 'serial': '78ea4913-8d79-4c9a-9324-c2d9f86c6d38'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 09:55:25 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:55:25 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:55:25 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vwYotCOs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:55:25 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:55:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:55:25 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:55:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:55:25 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 09:55:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f1625b-a94f-4b1d-b497-87e5eb060ea9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 09:55:25 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8242887-3aea-4e40-bb1d-22c044bef564]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38] added
Jul 31 09:55:25 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf7f143-f52f-4a22-9f71-9664ebd2a31d]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb67c03-8ae4-4d9e-82da-b81e814bd966]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vwYotCOs {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vwYotCOs" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a349c5-9c19-411f-8dab-62a263d60799]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vwYotCOs'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba1fa07-55a0-4199-838f-102e9bb3ac84]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc6d799-aa8e-4de9-9885-1d981c637418]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:55:25 user nova-compute[71113]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 (non-flash)
Jul 31 09:55:25 user nova-compute[71113]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef (non-flash)
Jul 31 09:55:25 user nova-compute[71113]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71 (non-flash)
Jul 31 09:55:25 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:55:25 user nova-compute[71113]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 (non-flash)
Jul 31 09:55:25 user nova-compute[71113]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef (non-flash)
Jul 31 09:55:25 user nova-compute[71113]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71 (non-flash)
Jul 31 09:55:25 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e69b704-8185-4712-8ff5-85c0f939a2dd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38, portal: 172.16.0.220,3260]
Jul 31 09:55:25 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38, portal: 172.16.0.220,3260] successful.
Jul 31 09:55:25 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef51fab-4658-4aa3-91e8-f648a4f841f9]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ae6cba-6471-401b-abd4-3b8c82dfbdd5]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:55:25 user nova-compute[71113]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 (non-flash)
Jul 31 09:55:25 user nova-compute[71113]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef (non-flash)
Jul 31 09:55:25 user nova-compute[71113]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71 (non-flash)
Jul 31 09:55:25 user nova-compute[71113]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)
Jul 31 09:55:25 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:55:25 user nova-compute[71113]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 (non-flash)
Jul 31 09:55:25 user nova-compute[71113]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef (non-flash)
Jul 31 09:55:25 user nova-compute[71113]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71 (non-flash)
Jul 31 09:55:25 user nova-compute[71113]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)
Jul 31 09:55:25 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad20e8f-10e4-4400-8ec4-b78a3824ab46]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:25 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: None {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 09:55:26 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 09:55:26 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vwYotCOs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 09:55:26 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:55:26 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23063656365616236', 'path': '/dev/sdb'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:55:26 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063656365616236', 'path': '/dev/sdb'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 09:55:26 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:55:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-834893459',display_name='tempest-ServerActionsTestOtherA-server-834893459',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-834893459',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5EE1xUvLRoodLjDMpmYpiUOpJ4L9wfbpJsZ+HUVFxXJGKbpzcG8jQIKPQ0cQElq3F/Fhyr7R6+c9C8jzz21FzCpd/o9T+iI7W2nanWOzhB0iUhT1vp4Ko8/FdZGlABXg==',key_name='tempest-keypair-58057469',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f7a5479fd014325b8790a80b2405d1d',ramdisk_id='',reservation_id='r-l0unkf5n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2065923437',owner_user_name='tempest-ServerActionsTestOtherA-2065923437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:55:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7029dd8d775d4c14bb349b72b1171d5f',uuid=a950d710-4596-4355-ac31-568c7728335a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "469843c1-3548-4bae-90bb-7fd1f5ac0052", "address": "fa:16:3e:08:cb:ac", "network": {"id": "cc84435f-b983-425d-bad0-36039e592e25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1662840158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f7a5479fd014325b8790a80b2405d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469843c1-35", "ovs_interfaceid": "469843c1-3548-4bae-90bb-7fd1f5ac0052", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 09:55:26 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Converting VIF {"id": "469843c1-3548-4bae-90bb-7fd1f5ac0052", "address": "fa:16:3e:08:cb:ac", "network": {"id": "cc84435f-b983-425d-bad0-36039e592e25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1662840158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f7a5479fd014325b8790a80b2405d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469843c1-35", "ovs_interfaceid": "469843c1-3548-4bae-90bb-7fd1f5ac0052", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:55:26 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:cb:ac,bridge_name='br-int',has_traffic_filtering=True,id=469843c1-3548-4bae-90bb-7fd1f5ac0052,network=Network(cc84435f-b983-425d-bad0-36039e592e25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469843c1-35') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:55:26 user nova-compute[71113]: DEBUG nova.objects.instance [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lazy-loading 'pci_devices' on Instance uuid a950d710-4596-4355-ac31-568c7728335a {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:55:26 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] End _get_guest_xml xml=<domain type="kvm">
Jul 31 09:55:26 user nova-compute[71113]:   <uuid>a950d710-4596-4355-ac31-568c7728335a</uuid>
Jul 31 09:55:26 user nova-compute[71113]:   <name>instance-00000017</name>
Jul 31 09:55:26 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 09:55:26 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 09:55:26 user nova-compute[71113]:   <metadata>
Jul 31 09:55:26 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 09:55:26 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 09:55:26 user nova-compute[71113]:       <nova:name>tempest-ServerActionsTestOtherA-server-834893459</nova:name>
Jul 31 09:55:26 user nova-compute[71113]:       <nova:creationTime>2023-07-31 09:55:25</nova:creationTime>
Jul 31 09:55:26 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 09:55:26 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 09:55:26 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 09:55:26 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 09:55:26 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 09:55:26 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 09:55:26 user nova-compute[71113]:       </nova:flavor>
Jul 31 09:55:26 user nova-compute[71113]:       <nova:owner>
Jul 31 09:55:26 user nova-compute[71113]:         <nova:user uuid="7029dd8d775d4c14bb349b72b1171d5f">tempest-ServerActionsTestOtherA-2065923437-project-member</nova:user>
Jul 31 09:55:26 user nova-compute[71113]:         <nova:project uuid="9f7a5479fd014325b8790a80b2405d1d">tempest-ServerActionsTestOtherA-2065923437</nova:project>
Jul 31 09:55:26 user nova-compute[71113]:       </nova:owner>
Jul 31 09:55:26 user nova-compute[71113]:       <nova:ports>
Jul 31 09:55:26 user nova-compute[71113]:         <nova:port uuid="469843c1-3548-4bae-90bb-7fd1f5ac0052">
Jul 31 09:55:26 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 31 09:55:26 user nova-compute[71113]:         </nova:port>
Jul 31 09:55:26 user nova-compute[71113]:       </nova:ports>
Jul 31 09:55:26 user nova-compute[71113]:     </nova:instance>
Jul 31 09:55:26 user nova-compute[71113]:   </metadata>
Jul 31 09:55:26 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 09:55:26 user nova-compute[71113]:     <system>
Jul 31 09:55:26 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 09:55:26 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 09:55:26 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 09:55:26 user nova-compute[71113]:       <entry name="serial">a950d710-4596-4355-ac31-568c7728335a</entry>
Jul 31 09:55:26 user nova-compute[71113]:       <entry name="uuid">a950d710-4596-4355-ac31-568c7728335a</entry>
Jul 31 09:55:26 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 09:55:26 user nova-compute[71113]:     </system>
Jul 31 09:55:26 user nova-compute[71113]:   </sysinfo>
Jul 31 09:55:26 user nova-compute[71113]:   <os>
Jul 31 09:55:26 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 09:55:26 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 09:55:26 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 09:55:26 user nova-compute[71113]:   </os>
Jul 31 09:55:26 user nova-compute[71113]:   <features>
Jul 31 09:55:26 user nova-compute[71113]:     <acpi/>
Jul 31 09:55:26 user nova-compute[71113]:     <apic/>
Jul 31 09:55:26 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 09:55:26 user nova-compute[71113]:   </features>
Jul 31 09:55:26 user nova-compute[71113]:   <clock offset="utc">
Jul 31 09:55:26 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 09:55:26 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 09:55:26 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 09:55:26 user nova-compute[71113]:   </clock>
Jul 31 09:55:26 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 09:55:26 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 09:55:26 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 09:55:26 user nova-compute[71113]:   </cpu>
Jul 31 09:55:26 user nova-compute[71113]:   <devices>
Jul 31 09:55:26 user nova-compute[71113]:     <disk type="block" device="disk">
Jul 31 09:55:26 user nova-compute[71113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:55:26 user nova-compute[71113]:       <source dev="/dev/sdb"/>
Jul 31 09:55:26 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 09:55:26 user nova-compute[71113]:       <serial>78ea4913-8d79-4c9a-9324-c2d9f86c6d38</serial>
Jul 31 09:55:26 user nova-compute[71113]:     </disk>
Jul 31 09:55:26 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 09:55:26 user nova-compute[71113]:       <mac address="fa:16:3e:08:cb:ac"/>
Jul 31 09:55:26 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:55:26 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 09:55:26 user nova-compute[71113]:       <target dev="tap469843c1-35"/>
Jul 31 09:55:26 user nova-compute[71113]:     </interface>
Jul 31 09:55:26 user nova-compute[71113]:     <serial type="pty">
Jul 31 09:55:26 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/a950d710-4596-4355-ac31-568c7728335a/console.log" append="off"/>
Jul 31 09:55:26 user nova-compute[71113]:     </serial>
Jul 31 09:55:26 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 09:55:26 user nova-compute[71113]:     <video>
Jul 31 09:55:26 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:55:26 user nova-compute[71113]:     </video>
Jul 31 09:55:26 user nova-compute[71113]:     <rng model="virtio">
Jul 31 09:55:26 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 09:55:26 user nova-compute[71113]:     </rng>
Jul 31 09:55:26 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 09:55:26 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 09:55:26 user nova-compute[71113]:       <stats period="10"/>
Jul 31 09:55:26 user nova-compute[71113]:     </memballoon>
Jul 31 09:55:26 user nova-compute[71113]:   </devices>
Jul 31 09:55:26 user nova-compute[71113]: </domain>
Jul 31 09:55:26 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 09:55:26 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:55:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-834893459',display_name='tempest-ServerActionsTestOtherA-server-834893459',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-834893459',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5EE1xUvLRoodLjDMpmYpiUOpJ4L9wfbpJsZ+HUVFxXJGKbpzcG8jQIKPQ0cQElq3F/Fhyr7R6+c9C8jzz21FzCpd/o9T+iI7W2nanWOzhB0iUhT1vp4Ko8/FdZGlABXg==',key_name='tempest-keypair-58057469',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f7a5479fd014325b8790a80b2405d1d',ramdisk_id='',reservation_id='r-l0unkf5n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2065923437',owner_user_name='tempest-ServerActionsTestOtherA-2065923437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:55:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7029dd8d775d4c14bb349b72b1171d5f',uuid=a950d710-4596-4355-ac31-568c7728335a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "469843c1-3548-4bae-90bb-7fd1f5ac0052", "address": "fa:16:3e:08:cb:ac", "network": {"id": "cc84435f-b983-425d-bad0-36039e592e25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1662840158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f7a5479fd014325b8790a80b2405d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469843c1-35", "ovs_interfaceid": "469843c1-3548-4bae-90bb-7fd1f5ac0052", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 09:55:26 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Converting VIF {"id": "469843c1-3548-4bae-90bb-7fd1f5ac0052", "address": "fa:16:3e:08:cb:ac", "network": {"id": "cc84435f-b983-425d-bad0-36039e592e25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1662840158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f7a5479fd014325b8790a80b2405d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469843c1-35", "ovs_interfaceid": "469843c1-3548-4bae-90bb-7fd1f5ac0052", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:55:26 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:cb:ac,bridge_name='br-int',has_traffic_filtering=True,id=469843c1-3548-4bae-90bb-7fd1f5ac0052,network=Network(cc84435f-b983-425d-bad0-36039e592e25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469843c1-35') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:55:26 user nova-compute[71113]: DEBUG os_vif [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:cb:ac,bridge_name='br-int',has_traffic_filtering=True,id=469843c1-3548-4bae-90bb-7fd1f5ac0052,network=Network(cc84435f-b983-425d-bad0-36039e592e25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469843c1-35') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 09:55:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:55:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 09:55:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap469843c1-35, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:55:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap469843c1-35, col_values=(('external_ids', {'iface-id': '469843c1-3548-4bae-90bb-7fd1f5ac0052', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:cb:ac', 'vm-uuid': 'a950d710-4596-4355-ac31-568c7728335a'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:55:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:55:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:26 user nova-compute[71113]: INFO os_vif [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:cb:ac,bridge_name='br-int',has_traffic_filtering=True,id=469843c1-3548-4bae-90bb-7fd1f5ac0052,network=Network(cc84435f-b983-425d-bad0-36039e592e25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469843c1-35')
Jul 31 09:55:26 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:55:26 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] No VIF found with MAC fa:16:3e:08:cb:ac, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 09:55:26 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690797311.7980435, efa311a0-fe2e-4c0f-af66-09c3eb38fbf1 => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:55:26 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] VM Stopped (Lifecycle Event)
Jul 31 09:55:26 user nova-compute[71113]: DEBUG nova.compute.manager [None req-1f5e9216-4fed-47fc-a7f7-dc8da24f9418 None None] [instance: efa311a0-fe2e-4c0f-af66-09c3eb38fbf1] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:55:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:28 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:28 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:28 user nova-compute[71113]: DEBUG nova.compute.manager [req-c84cd786-f249-4290-8edc-d1d563f63ced req-8f3b699c-d20a-4d95-b315-3ab8331da18b service nova] [instance: a950d710-4596-4355-ac31-568c7728335a] Received event network-vif-plugged-469843c1-3548-4bae-90bb-7fd1f5ac0052 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:55:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-c84cd786-f249-4290-8edc-d1d563f63ced req-8f3b699c-d20a-4d95-b315-3ab8331da18b service nova] Acquiring lock "a950d710-4596-4355-ac31-568c7728335a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:55:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-c84cd786-f249-4290-8edc-d1d563f63ced req-8f3b699c-d20a-4d95-b315-3ab8331da18b service nova] Lock "a950d710-4596-4355-ac31-568c7728335a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:55:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-c84cd786-f249-4290-8edc-d1d563f63ced req-8f3b699c-d20a-4d95-b315-3ab8331da18b service nova] Lock "a950d710-4596-4355-ac31-568c7728335a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:55:28 user nova-compute[71113]: DEBUG nova.compute.manager [req-c84cd786-f249-4290-8edc-d1d563f63ced req-8f3b699c-d20a-4d95-b315-3ab8331da18b service nova] [instance: a950d710-4596-4355-ac31-568c7728335a] No waiting events found dispatching network-vif-plugged-469843c1-3548-4bae-90bb-7fd1f5ac0052 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:55:28 user nova-compute[71113]: WARNING nova.compute.manager [req-c84cd786-f249-4290-8edc-d1d563f63ced req-8f3b699c-d20a-4d95-b315-3ab8331da18b service nova] [instance: a950d710-4596-4355-ac31-568c7728335a] Received unexpected event network-vif-plugged-469843c1-3548-4bae-90bb-7fd1f5ac0052 for instance with vm_state building and task_state spawning.
Jul 31 09:55:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:30 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797330.166615, a950d710-4596-4355-ac31-568c7728335a => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:55:30 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: a950d710-4596-4355-ac31-568c7728335a] VM Resumed (Lifecycle Event)
Jul 31 09:55:30 user nova-compute[71113]: DEBUG nova.compute.manager [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 09:55:30 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 09:55:30 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: a950d710-4596-4355-ac31-568c7728335a] Instance spawned successfully.
Jul 31 09:55:30 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 09:55:30 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: a950d710-4596-4355-ac31-568c7728335a] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:55:30 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: a950d710-4596-4355-ac31-568c7728335a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:55:30 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Found default for hw_cdrom_bus of ide {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:55:30 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Found default for hw_disk_bus of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:55:30 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Found default for hw_input_bus of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:55:30 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Found default for hw_pointer_model of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:55:30 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Found default for hw_video_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:55:30 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Found default for hw_vif_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:55:30 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: a950d710-4596-4355-ac31-568c7728335a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:55:30 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797330.1696553, a950d710-4596-4355-ac31-568c7728335a => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:55:30 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: a950d710-4596-4355-ac31-568c7728335a] VM Started (Lifecycle Event)
Jul 31 09:55:30 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: a950d710-4596-4355-ac31-568c7728335a] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:55:30 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: a950d710-4596-4355-ac31-568c7728335a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:55:30 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: a950d710-4596-4355-ac31-568c7728335a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:55:30 user nova-compute[71113]: DEBUG nova.compute.manager [req-c8a45175-1e99-4ae2-bc4f-1175b6f9c405 req-9494f163-c9a1-4218-8875-7d377e192546 service nova] [instance: a950d710-4596-4355-ac31-568c7728335a] Received event network-vif-plugged-469843c1-3548-4bae-90bb-7fd1f5ac0052 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:55:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-c8a45175-1e99-4ae2-bc4f-1175b6f9c405 req-9494f163-c9a1-4218-8875-7d377e192546 service nova] Acquiring lock "a950d710-4596-4355-ac31-568c7728335a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:55:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-c8a45175-1e99-4ae2-bc4f-1175b6f9c405 req-9494f163-c9a1-4218-8875-7d377e192546 service nova] Lock "a950d710-4596-4355-ac31-568c7728335a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:55:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-c8a45175-1e99-4ae2-bc4f-1175b6f9c405 req-9494f163-c9a1-4218-8875-7d377e192546 service nova] Lock "a950d710-4596-4355-ac31-568c7728335a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:55:30 user nova-compute[71113]: DEBUG nova.compute.manager [req-c8a45175-1e99-4ae2-bc4f-1175b6f9c405 req-9494f163-c9a1-4218-8875-7d377e192546 service nova] [instance: a950d710-4596-4355-ac31-568c7728335a] No waiting events found dispatching network-vif-plugged-469843c1-3548-4bae-90bb-7fd1f5ac0052 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:55:30 user nova-compute[71113]: WARNING nova.compute.manager [req-c8a45175-1e99-4ae2-bc4f-1175b6f9c405 req-9494f163-c9a1-4218-8875-7d377e192546 service nova] [instance: a950d710-4596-4355-ac31-568c7728335a] Received unexpected event network-vif-plugged-469843c1-3548-4bae-90bb-7fd1f5ac0052 for instance with vm_state building and task_state spawning.
Jul 31 09:55:30 user nova-compute[71113]: INFO nova.compute.manager [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Took 5.16 seconds to spawn the instance on the hypervisor.
Jul 31 09:55:30 user nova-compute[71113]: DEBUG nova.compute.manager [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:55:30 user nova-compute[71113]: INFO nova.compute.manager [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Took 13.47 seconds to build instance.
Jul 31 09:55:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-71aed59b-5a89-4407-8861-f9660bc978b9 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "a950d710-4596-4355-ac31-568c7728335a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.561s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:55:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:40 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:43 user nova-compute[71113]: DEBUG nova.compute.manager [req-493f19de-9edb-4bc7-8378-e5f8fad05b34 req-9c7e24a4-3745-44a5-92a4-8c2d5e4358ce service nova] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Received event network-changed-e95375b7-8c89-4353-9ba9-0469792056dd {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:55:43 user nova-compute[71113]: DEBUG nova.compute.manager [req-493f19de-9edb-4bc7-8378-e5f8fad05b34 req-9c7e24a4-3745-44a5-92a4-8c2d5e4358ce service nova] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Refreshing instance network info cache due to event network-changed-e95375b7-8c89-4353-9ba9-0469792056dd. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:55:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-493f19de-9edb-4bc7-8378-e5f8fad05b34 req-9c7e24a4-3745-44a5-92a4-8c2d5e4358ce service nova] Acquiring lock "refresh_cache-9a4b47dd-b335-4c2f-9dee-5421357a0ee1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:55:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-493f19de-9edb-4bc7-8378-e5f8fad05b34 req-9c7e24a4-3745-44a5-92a4-8c2d5e4358ce service nova] Acquired lock "refresh_cache-9a4b47dd-b335-4c2f-9dee-5421357a0ee1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:55:43 user nova-compute[71113]: DEBUG nova.network.neutron [req-493f19de-9edb-4bc7-8378-e5f8fad05b34 req-9c7e24a4-3745-44a5-92a4-8c2d5e4358ce service nova] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Refreshing network info cache for port e95375b7-8c89-4353-9ba9-0469792056dd {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:55:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f007b4f8-9385-48c2-b00c-6851c09ee8b8 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Acquiring lock "9a4b47dd-b335-4c2f-9dee-5421357a0ee1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:55:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f007b4f8-9385-48c2-b00c-6851c09ee8b8 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "9a4b47dd-b335-4c2f-9dee-5421357a0ee1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:55:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f007b4f8-9385-48c2-b00c-6851c09ee8b8 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Acquiring lock "9a4b47dd-b335-4c2f-9dee-5421357a0ee1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:55:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f007b4f8-9385-48c2-b00c-6851c09ee8b8 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "9a4b47dd-b335-4c2f-9dee-5421357a0ee1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:55:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f007b4f8-9385-48c2-b00c-6851c09ee8b8 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "9a4b47dd-b335-4c2f-9dee-5421357a0ee1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:55:43 user nova-compute[71113]: INFO nova.compute.manager [None req-f007b4f8-9385-48c2-b00c-6851c09ee8b8 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Terminating instance
Jul 31 09:55:43 user nova-compute[71113]: DEBUG nova.compute.manager [None req-f007b4f8-9385-48c2-b00c-6851c09ee8b8 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Start destroying the instance on the hypervisor. {{(pid=71113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 09:55:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:44 user nova-compute[71113]: DEBUG nova.compute.manager [req-98746f03-a04d-46fb-a02b-a907655caaee req-e6eb19a4-6d32-4f27-b2dc-2a8ebf843ed5 service nova] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Received event network-vif-unplugged-e95375b7-8c89-4353-9ba9-0469792056dd {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:55:44 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-98746f03-a04d-46fb-a02b-a907655caaee req-e6eb19a4-6d32-4f27-b2dc-2a8ebf843ed5 service nova] Acquiring lock "9a4b47dd-b335-4c2f-9dee-5421357a0ee1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:55:44 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-98746f03-a04d-46fb-a02b-a907655caaee req-e6eb19a4-6d32-4f27-b2dc-2a8ebf843ed5 service nova] Lock "9a4b47dd-b335-4c2f-9dee-5421357a0ee1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:55:44 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-98746f03-a04d-46fb-a02b-a907655caaee req-e6eb19a4-6d32-4f27-b2dc-2a8ebf843ed5 service nova] Lock "9a4b47dd-b335-4c2f-9dee-5421357a0ee1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:55:44 user nova-compute[71113]: DEBUG nova.compute.manager [req-98746f03-a04d-46fb-a02b-a907655caaee req-e6eb19a4-6d32-4f27-b2dc-2a8ebf843ed5 service nova] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] No waiting events found dispatching network-vif-unplugged-e95375b7-8c89-4353-9ba9-0469792056dd {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:55:44 user nova-compute[71113]: DEBUG nova.compute.manager [req-98746f03-a04d-46fb-a02b-a907655caaee req-e6eb19a4-6d32-4f27-b2dc-2a8ebf843ed5 service nova] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Received event network-vif-unplugged-e95375b7-8c89-4353-9ba9-0469792056dd for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 09:55:44 user nova-compute[71113]: DEBUG nova.network.neutron [req-493f19de-9edb-4bc7-8378-e5f8fad05b34 req-9c7e24a4-3745-44a5-92a4-8c2d5e4358ce service nova] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Updated VIF entry in instance network info cache for port e95375b7-8c89-4353-9ba9-0469792056dd. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:55:44 user nova-compute[71113]: DEBUG nova.network.neutron [req-493f19de-9edb-4bc7-8378-e5f8fad05b34 req-9c7e24a4-3745-44a5-92a4-8c2d5e4358ce service nova] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Updating instance_info_cache with network_info: [{"id": "e95375b7-8c89-4353-9ba9-0469792056dd", "address": "fa:16:3e:16:25:0d", "network": {"id": "8c75ddf2-700c-4f01-b8cf-af57bdab7d37", "bridge": "br-int", "label": "tempest-TestStampPattern-1367141606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60e95a8fd2446d5bd5308f10caa6930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape95375b7-8c", "ovs_interfaceid": "e95375b7-8c89-4353-9ba9-0469792056dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:55:44 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-493f19de-9edb-4bc7-8378-e5f8fad05b34 req-9c7e24a4-3745-44a5-92a4-8c2d5e4358ce service nova] Releasing lock "refresh_cache-9a4b47dd-b335-4c2f-9dee-5421357a0ee1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:55:44 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Instance destroyed successfully.
Jul 31 09:55:44 user nova-compute[71113]: DEBUG nova.objects.instance [None req-f007b4f8-9385-48c2-b00c-6851c09ee8b8 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lazy-loading 'resources' on Instance uuid 9a4b47dd-b335-4c2f-9dee-5421357a0ee1 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:55:44 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-f007b4f8-9385-48c2-b00c-6851c09ee8b8 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:48:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1259370919',display_name='tempest-TestStampPattern-server-1259370919',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1259370919',id=11,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrIg8Re0SPL90KGI/7mfKXKiutrisvPKJSJwI2GyIKoRN6YbCL8gOrKsaFBkaHBzRjOk6oMjoGJtW64C2f48/NDQKl52ZNucPGtAtvZuIzC2XttPHjvBX5TLIsYhRNoTA==',key_name='tempest-TestStampPattern-211360877',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:48:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f60e95a8fd2446d5bd5308f10caa6930',ramdisk_id='',reservation_id='r-mosn1a30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-12160385',owner_user_name='tempest-TestStampPattern-12160385-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:51:38Z,user_data=None,user_id='a414c37ab0384024821d33e393b711af',uuid=9a4b47dd-b335-4c2f-9dee-5421357a0ee1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e95375b7-8c89-4353-9ba9-0469792056dd", "address": "fa:16:3e:16:25:0d", "network": {"id": "8c75ddf2-700c-4f01-b8cf-af57bdab7d37", "bridge": "br-int", "label": "tempest-TestStampPattern-1367141606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60e95a8fd2446d5bd5308f10caa6930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape95375b7-8c", "ovs_interfaceid": "e95375b7-8c89-4353-9ba9-0469792056dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 09:55:44 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-f007b4f8-9385-48c2-b00c-6851c09ee8b8 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Converting VIF {"id": "e95375b7-8c89-4353-9ba9-0469792056dd", "address": "fa:16:3e:16:25:0d", "network": {"id": "8c75ddf2-700c-4f01-b8cf-af57bdab7d37", "bridge": "br-int", "label": "tempest-TestStampPattern-1367141606-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f60e95a8fd2446d5bd5308f10caa6930", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape95375b7-8c", "ovs_interfaceid": "e95375b7-8c89-4353-9ba9-0469792056dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:55:44 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-f007b4f8-9385-48c2-b00c-6851c09ee8b8 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:25:0d,bridge_name='br-int',has_traffic_filtering=True,id=e95375b7-8c89-4353-9ba9-0469792056dd,network=Network(8c75ddf2-700c-4f01-b8cf-af57bdab7d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape95375b7-8c') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:55:44 user nova-compute[71113]: DEBUG os_vif [None req-f007b4f8-9385-48c2-b00c-6851c09ee8b8 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:25:0d,bridge_name='br-int',has_traffic_filtering=True,id=e95375b7-8c89-4353-9ba9-0469792056dd,network=Network(8c75ddf2-700c-4f01-b8cf-af57bdab7d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape95375b7-8c') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 09:55:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape95375b7-8c, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:55:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:44 user nova-compute[71113]: INFO os_vif [None req-f007b4f8-9385-48c2-b00c-6851c09ee8b8 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:25:0d,bridge_name='br-int',has_traffic_filtering=True,id=e95375b7-8c89-4353-9ba9-0469792056dd,network=Network(8c75ddf2-700c-4f01-b8cf-af57bdab7d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape95375b7-8c')
Jul 31 09:55:44 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-f007b4f8-9385-48c2-b00c-6851c09ee8b8 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Deleting instance files /opt/stack/data/nova/instances/9a4b47dd-b335-4c2f-9dee-5421357a0ee1_del
Jul 31 09:55:44 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-f007b4f8-9385-48c2-b00c-6851c09ee8b8 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Deletion of /opt/stack/data/nova/instances/9a4b47dd-b335-4c2f-9dee-5421357a0ee1_del complete
Jul 31 09:55:44 user nova-compute[71113]: INFO nova.compute.manager [None req-f007b4f8-9385-48c2-b00c-6851c09ee8b8 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Took 1.01 seconds to destroy the instance on the hypervisor.
Jul 31 09:55:44 user nova-compute[71113]: DEBUG oslo.service.loopingcall [None req-f007b4f8-9385-48c2-b00c-6851c09ee8b8 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71113) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 09:55:44 user nova-compute[71113]: DEBUG nova.compute.manager [-] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Deallocating network for instance {{(pid=71113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 09:55:44 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] deallocate_for_instance() {{(pid=71113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 09:55:45 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:55:45 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Took 0.70 seconds to deallocate network for instance.
Jul 31 09:55:45 user nova-compute[71113]: DEBUG nova.compute.manager [req-558562fb-0e96-4ba9-8cce-969c35feb85a req-610da8bb-2cd1-4ab6-8d13-d916e828be7e service nova] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Received event network-vif-deleted-e95375b7-8c89-4353-9ba9-0469792056dd {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:55:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f007b4f8-9385-48c2-b00c-6851c09ee8b8 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:55:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f007b4f8-9385-48c2-b00c-6851c09ee8b8 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:55:45 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-f007b4f8-9385-48c2-b00c-6851c09ee8b8 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:55:45 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-f007b4f8-9385-48c2-b00c-6851c09ee8b8 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:55:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f007b4f8-9385-48c2-b00c-6851c09ee8b8 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.493s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:55:45 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-f007b4f8-9385-48c2-b00c-6851c09ee8b8 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Deleted allocations for instance 9a4b47dd-b335-4c2f-9dee-5421357a0ee1
Jul 31 09:55:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f007b4f8-9385-48c2-b00c-6851c09ee8b8 tempest-TestStampPattern-12160385 tempest-TestStampPattern-12160385-project-member] Lock "9a4b47dd-b335-4c2f-9dee-5421357a0ee1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.468s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:55:46 user nova-compute[71113]: DEBUG nova.compute.manager [req-8160a46f-ea36-4c06-947d-ead3f8632c6f req-83d38b96-21c0-4f09-874b-86627751da9c service nova] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Received event network-vif-plugged-e95375b7-8c89-4353-9ba9-0469792056dd {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:55:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8160a46f-ea36-4c06-947d-ead3f8632c6f req-83d38b96-21c0-4f09-874b-86627751da9c service nova] Acquiring lock "9a4b47dd-b335-4c2f-9dee-5421357a0ee1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:55:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8160a46f-ea36-4c06-947d-ead3f8632c6f req-83d38b96-21c0-4f09-874b-86627751da9c service nova] Lock "9a4b47dd-b335-4c2f-9dee-5421357a0ee1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:55:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8160a46f-ea36-4c06-947d-ead3f8632c6f req-83d38b96-21c0-4f09-874b-86627751da9c service nova] Lock "9a4b47dd-b335-4c2f-9dee-5421357a0ee1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:55:46 user nova-compute[71113]: DEBUG nova.compute.manager [req-8160a46f-ea36-4c06-947d-ead3f8632c6f req-83d38b96-21c0-4f09-874b-86627751da9c service nova] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] No waiting events found dispatching network-vif-plugged-e95375b7-8c89-4353-9ba9-0469792056dd {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:55:46 user nova-compute[71113]: WARNING nova.compute.manager [req-8160a46f-ea36-4c06-947d-ead3f8632c6f req-83d38b96-21c0-4f09-874b-86627751da9c service nova] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Received unexpected event network-vif-plugged-e95375b7-8c89-4353-9ba9-0469792056dd for instance with vm_state deleted and task_state None.
Jul 31 09:55:47 user nova-compute[71113]: INFO nova.compute.manager [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Rescuing
Jul 31 09:55:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquiring lock "refresh_cache-92d25a03-98ce-4bde-a3cc-20313ae77d41" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:55:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquired lock "refresh_cache-92d25a03-98ce-4bde-a3cc-20313ae77d41" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:55:47 user nova-compute[71113]: DEBUG nova.network.neutron [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 09:55:48 user nova-compute[71113]: DEBUG nova.network.neutron [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Updating instance_info_cache with network_info: [{"id": "e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d", "address": "fa:16:3e:2c:5b:c3", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape82fc7e2-25", "ovs_interfaceid": "e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:55:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Releasing lock "refresh_cache-92d25a03-98ce-4bde-a3cc-20313ae77d41" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:55:48 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:48 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:48 user nova-compute[71113]: DEBUG nova.compute.manager [req-eeeeed10-8737-4324-aa8b-31add0f8bf4a req-0bda9bc4-e937-4273-add3-2c2547dcb7ed service nova] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Received event network-vif-unplugged-e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:55:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-eeeeed10-8737-4324-aa8b-31add0f8bf4a req-0bda9bc4-e937-4273-add3-2c2547dcb7ed service nova] Acquiring lock "92d25a03-98ce-4bde-a3cc-20313ae77d41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:55:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-eeeeed10-8737-4324-aa8b-31add0f8bf4a req-0bda9bc4-e937-4273-add3-2c2547dcb7ed service nova] Lock "92d25a03-98ce-4bde-a3cc-20313ae77d41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:55:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-eeeeed10-8737-4324-aa8b-31add0f8bf4a req-0bda9bc4-e937-4273-add3-2c2547dcb7ed service nova] Lock "92d25a03-98ce-4bde-a3cc-20313ae77d41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:55:48 user nova-compute[71113]: DEBUG nova.compute.manager [req-eeeeed10-8737-4324-aa8b-31add0f8bf4a req-0bda9bc4-e937-4273-add3-2c2547dcb7ed service nova] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] No waiting events found dispatching network-vif-unplugged-e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:55:48 user nova-compute[71113]: WARNING nova.compute.manager [req-eeeeed10-8737-4324-aa8b-31add0f8bf4a req-0bda9bc4-e937-4273-add3-2c2547dcb7ed service nova] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Received unexpected event network-vif-unplugged-e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d for instance with vm_state active and task_state rescuing.
Jul 31 09:55:48 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:48 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:48 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:48 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:48 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Instance destroyed successfully.
Jul 31 09:55:48 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:48 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Attempting a stable device rescue
Jul 31 09:55:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71113) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 31 09:55:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Instance directory exists: not creating {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 31 09:55:48 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Creating image(s)
Jul 31 09:55:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquiring lock "/opt/stack/data/nova/instances/92d25a03-98ce-4bde-a3cc-20313ae77d41/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:55:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "/opt/stack/data/nova/instances/92d25a03-98ce-4bde-a3cc-20313ae77d41/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:55:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "/opt/stack/data/nova/instances/92d25a03-98ce-4bde-a3cc-20313ae77d41/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:55:48 user nova-compute[71113]: DEBUG nova.objects.instance [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lazy-loading 'trusted_certs' on Instance uuid 92d25a03-98ce-4bde-a3cc-20313ae77d41 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:55:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquiring lock "5f53e13821f83924a2a8d8cb5717e8abc2c2989c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:55:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "5f53e13821f83924a2a8d8cb5717e8abc2c2989c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:55:48 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5f53e13821f83924a2a8d8cb5717e8abc2c2989c.part --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:50 user nova-compute[71113]: DEBUG nova.compute.manager [req-6a0af875-a519-45ee-8b83-4b07a3087dd7 req-986b0447-b203-4e54-b1cb-eebdd2c8d516 service nova] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Received event network-vif-plugged-e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:55:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-6a0af875-a519-45ee-8b83-4b07a3087dd7 req-986b0447-b203-4e54-b1cb-eebdd2c8d516 service nova] Acquiring lock "92d25a03-98ce-4bde-a3cc-20313ae77d41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:55:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-6a0af875-a519-45ee-8b83-4b07a3087dd7 req-986b0447-b203-4e54-b1cb-eebdd2c8d516 service nova] Lock "92d25a03-98ce-4bde-a3cc-20313ae77d41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:55:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-6a0af875-a519-45ee-8b83-4b07a3087dd7 req-986b0447-b203-4e54-b1cb-eebdd2c8d516 service nova] Lock "92d25a03-98ce-4bde-a3cc-20313ae77d41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:55:50 user nova-compute[71113]: DEBUG nova.compute.manager [req-6a0af875-a519-45ee-8b83-4b07a3087dd7 req-986b0447-b203-4e54-b1cb-eebdd2c8d516 service nova] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] No waiting events found dispatching network-vif-plugged-e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:55:50 user nova-compute[71113]: WARNING nova.compute.manager [req-6a0af875-a519-45ee-8b83-4b07a3087dd7 req-986b0447-b203-4e54-b1cb-eebdd2c8d516 service nova] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Received unexpected event network-vif-plugged-e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d for instance with vm_state active and task_state rescuing.
Jul 31 09:55:50 user nova-compute[71113]: DEBUG nova.compute.manager [req-6a0af875-a519-45ee-8b83-4b07a3087dd7 req-986b0447-b203-4e54-b1cb-eebdd2c8d516 service nova] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Received event network-vif-plugged-e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:55:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-6a0af875-a519-45ee-8b83-4b07a3087dd7 req-986b0447-b203-4e54-b1cb-eebdd2c8d516 service nova] Acquiring lock "92d25a03-98ce-4bde-a3cc-20313ae77d41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:55:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-6a0af875-a519-45ee-8b83-4b07a3087dd7 req-986b0447-b203-4e54-b1cb-eebdd2c8d516 service nova] Lock "92d25a03-98ce-4bde-a3cc-20313ae77d41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:55:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-6a0af875-a519-45ee-8b83-4b07a3087dd7 req-986b0447-b203-4e54-b1cb-eebdd2c8d516 service nova] Lock "92d25a03-98ce-4bde-a3cc-20313ae77d41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:55:50 user nova-compute[71113]: DEBUG nova.compute.manager [req-6a0af875-a519-45ee-8b83-4b07a3087dd7 req-986b0447-b203-4e54-b1cb-eebdd2c8d516 service nova] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] No waiting events found dispatching network-vif-plugged-e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:55:50 user nova-compute[71113]: WARNING nova.compute.manager [req-6a0af875-a519-45ee-8b83-4b07a3087dd7 req-986b0447-b203-4e54-b1cb-eebdd2c8d516 service nova] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Received unexpected event network-vif-plugged-e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d for instance with vm_state active and task_state rescuing.
Jul 31 09:55:50 user nova-compute[71113]: DEBUG nova.compute.manager [req-6a0af875-a519-45ee-8b83-4b07a3087dd7 req-986b0447-b203-4e54-b1cb-eebdd2c8d516 service nova] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Received event network-vif-plugged-e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:55:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-6a0af875-a519-45ee-8b83-4b07a3087dd7 req-986b0447-b203-4e54-b1cb-eebdd2c8d516 service nova] Acquiring lock "92d25a03-98ce-4bde-a3cc-20313ae77d41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:55:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-6a0af875-a519-45ee-8b83-4b07a3087dd7 req-986b0447-b203-4e54-b1cb-eebdd2c8d516 service nova] Lock "92d25a03-98ce-4bde-a3cc-20313ae77d41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:55:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-6a0af875-a519-45ee-8b83-4b07a3087dd7 req-986b0447-b203-4e54-b1cb-eebdd2c8d516 service nova] Lock "92d25a03-98ce-4bde-a3cc-20313ae77d41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:55:50 user nova-compute[71113]: DEBUG nova.compute.manager [req-6a0af875-a519-45ee-8b83-4b07a3087dd7 req-986b0447-b203-4e54-b1cb-eebdd2c8d516 service nova] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] No waiting events found dispatching network-vif-plugged-e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:55:50 user nova-compute[71113]: WARNING nova.compute.manager [req-6a0af875-a519-45ee-8b83-4b07a3087dd7 req-986b0447-b203-4e54-b1cb-eebdd2c8d516 service nova] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Received unexpected event network-vif-plugged-e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d for instance with vm_state active and task_state rescuing.
Jul 31 09:55:50 user nova-compute[71113]: DEBUG nova.compute.manager [req-6a0af875-a519-45ee-8b83-4b07a3087dd7 req-986b0447-b203-4e54-b1cb-eebdd2c8d516 service nova] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Received event network-vif-unplugged-e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:55:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-6a0af875-a519-45ee-8b83-4b07a3087dd7 req-986b0447-b203-4e54-b1cb-eebdd2c8d516 service nova] Acquiring lock "92d25a03-98ce-4bde-a3cc-20313ae77d41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:55:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-6a0af875-a519-45ee-8b83-4b07a3087dd7 req-986b0447-b203-4e54-b1cb-eebdd2c8d516 service nova] Lock "92d25a03-98ce-4bde-a3cc-20313ae77d41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:55:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-6a0af875-a519-45ee-8b83-4b07a3087dd7 req-986b0447-b203-4e54-b1cb-eebdd2c8d516 service nova] Lock "92d25a03-98ce-4bde-a3cc-20313ae77d41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:55:50 user nova-compute[71113]: DEBUG nova.compute.manager [req-6a0af875-a519-45ee-8b83-4b07a3087dd7 req-986b0447-b203-4e54-b1cb-eebdd2c8d516 service nova] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] No waiting events found dispatching network-vif-unplugged-e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:55:50 user nova-compute[71113]: WARNING nova.compute.manager [req-6a0af875-a519-45ee-8b83-4b07a3087dd7 req-986b0447-b203-4e54-b1cb-eebdd2c8d516 service nova] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Received unexpected event network-vif-unplugged-e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d for instance with vm_state active and task_state rescuing.
Jul 31 09:55:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b20543db-6e03-4030-b80a-de2366c4816b tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Acquiring lock "8d2948be-3ebb-4067-a0c8-e2ca884814ff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:55:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b20543db-6e03-4030-b80a-de2366c4816b tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "8d2948be-3ebb-4067-a0c8-e2ca884814ff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:55:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b20543db-6e03-4030-b80a-de2366c4816b tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Acquiring lock "8d2948be-3ebb-4067-a0c8-e2ca884814ff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:55:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b20543db-6e03-4030-b80a-de2366c4816b tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "8d2948be-3ebb-4067-a0c8-e2ca884814ff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:55:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b20543db-6e03-4030-b80a-de2366c4816b tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "8d2948be-3ebb-4067-a0c8-e2ca884814ff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:55:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:55:50 user nova-compute[71113]: INFO nova.compute.manager [None req-b20543db-6e03-4030-b80a-de2366c4816b tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Terminating instance
Jul 31 09:55:50 user nova-compute[71113]: DEBUG nova.compute.manager [None req-b20543db-6e03-4030-b80a-de2366c4816b tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Start destroying the instance on the hypervisor. {{(pid=71113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 09:55:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5f53e13821f83924a2a8d8cb5717e8abc2c2989c.part --force-share --output=json" returned: 0 in 0.217s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:50 user nova-compute[71113]: DEBUG nova.virt.images [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] eacff5c2-f99c-4356-a415-9a6cb7318cc4 was qcow2, converting to raw {{(pid=71113) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 31 09:55:50 user nova-compute[71113]: DEBUG nova.privsep.utils [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71113) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 09:55:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5f53e13821f83924a2a8d8cb5717e8abc2c2989c.part /opt/stack/data/nova/instances/_base/5f53e13821f83924a2a8d8cb5717e8abc2c2989c.converted {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG nova.compute.manager [req-5c2676b2-2fa8-4d98-8293-4507a8b5a9a4 req-d4b01575-34d3-4bb4-b51a-6e85e4f4e51b service nova] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Received event network-vif-unplugged-f3560f1f-45f9-4ab3-b7a9-338b0483a656 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-5c2676b2-2fa8-4d98-8293-4507a8b5a9a4 req-d4b01575-34d3-4bb4-b51a-6e85e4f4e51b service nova] Acquiring lock "8d2948be-3ebb-4067-a0c8-e2ca884814ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-5c2676b2-2fa8-4d98-8293-4507a8b5a9a4 req-d4b01575-34d3-4bb4-b51a-6e85e4f4e51b service nova] Lock "8d2948be-3ebb-4067-a0c8-e2ca884814ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-5c2676b2-2fa8-4d98-8293-4507a8b5a9a4 req-d4b01575-34d3-4bb4-b51a-6e85e4f4e51b service nova] Lock "8d2948be-3ebb-4067-a0c8-e2ca884814ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG nova.compute.manager [req-5c2676b2-2fa8-4d98-8293-4507a8b5a9a4 req-d4b01575-34d3-4bb4-b51a-6e85e4f4e51b service nova] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] No waiting events found dispatching network-vif-unplugged-f3560f1f-45f9-4ab3-b7a9-338b0483a656 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG nova.compute.manager [req-5c2676b2-2fa8-4d98-8293-4507a8b5a9a4 req-d4b01575-34d3-4bb4-b51a-6e85e4f4e51b service nova] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Received event network-vif-unplugged-f3560f1f-45f9-4ab3-b7a9-338b0483a656 for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5f53e13821f83924a2a8d8cb5717e8abc2c2989c.part /opt/stack/data/nova/instances/_base/5f53e13821f83924a2a8d8cb5717e8abc2c2989c.converted" returned: 0 in 0.562s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5f53e13821f83924a2a8d8cb5717e8abc2c2989c.converted --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5f53e13821f83924a2a8d8cb5717e8abc2c2989c.converted --force-share --output=json" returned: 0 in 0.146s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "5f53e13821f83924a2a8d8cb5717e8abc2c2989c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.616s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquiring lock "5f53e13821f83924a2a8d8cb5717e8abc2c2989c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "5f53e13821f83924a2a8d8cb5717e8abc2c2989c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5f53e13821f83924a2a8d8cb5717e8abc2c2989c --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:51 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Instance destroyed successfully.
Jul 31 09:55:51 user nova-compute[71113]: DEBUG nova.objects.instance [None req-b20543db-6e03-4030-b80a-de2366c4816b tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lazy-loading 'resources' on Instance uuid 8d2948be-3ebb-4067-a0c8-e2ca884814ff {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-b20543db-6e03-4030-b80a-de2366c4816b tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T09:49:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-185195530',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-185195530',id=12,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPiftDuIkWFAIfzl0BTVm1LhY7q40iWz84gStK4DPV8cFJDmAmFDRgF+Fymadhnr5qIGHF7r0Tfo5uKpEAywooFh/gX7i9sx0LkpEaQXIt1KTEtZ1669nicWOlZ3zvT41w==',key_name='tempest-keypair-404775333',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:53:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4461b48e5470471d8fe1b61fb8af9c8d',ramdisk_id='',reservation_id='r-v0gpv3qp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-960167684',owner_user_name='tempest-AttachVolumeShelveTestJSON-960167684-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:53:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5199c7da0634b6e8111782122adcf70',uuid=8d2948be-3ebb-4067-a0c8-e2ca884814ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3560f1f-45f9-4ab3-b7a9-338b0483a656", "address": "fa:16:3e:91:a4:b3", "network": {"id": "e498d93a-703d-4d19-9adf-61469f37d4da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1320431580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4461b48e5470471d8fe1b61fb8af9c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3560f1f-45", "ovs_interfaceid": "f3560f1f-45f9-4ab3-b7a9-338b0483a656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-b20543db-6e03-4030-b80a-de2366c4816b tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Converting VIF {"id": "f3560f1f-45f9-4ab3-b7a9-338b0483a656", "address": "fa:16:3e:91:a4:b3", "network": {"id": "e498d93a-703d-4d19-9adf-61469f37d4da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1320431580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4461b48e5470471d8fe1b61fb8af9c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3560f1f-45", "ovs_interfaceid": "f3560f1f-45f9-4ab3-b7a9-338b0483a656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-b20543db-6e03-4030-b80a-de2366c4816b tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:a4:b3,bridge_name='br-int',has_traffic_filtering=True,id=f3560f1f-45f9-4ab3-b7a9-338b0483a656,network=Network(e498d93a-703d-4d19-9adf-61469f37d4da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3560f1f-45') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG os_vif [None req-b20543db-6e03-4030-b80a-de2366c4816b tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:a4:b3,bridge_name='br-int',has_traffic_filtering=True,id=f3560f1f-45f9-4ab3-b7a9-338b0483a656,network=Network(e498d93a-703d-4d19-9adf-61469f37d4da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3560f1f-45') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf3560f1f-45, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:51 user nova-compute[71113]: INFO os_vif [None req-b20543db-6e03-4030-b80a-de2366c4816b tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:a4:b3,bridge_name='br-int',has_traffic_filtering=True,id=f3560f1f-45f9-4ab3-b7a9-338b0483a656,network=Network(e498d93a-703d-4d19-9adf-61469f37d4da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3560f1f-45')
Jul 31 09:55:51 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-b20543db-6e03-4030-b80a-de2366c4816b tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Deleting instance files /opt/stack/data/nova/instances/8d2948be-3ebb-4067-a0c8-e2ca884814ff_del
Jul 31 09:55:51 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-b20543db-6e03-4030-b80a-de2366c4816b tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Deletion of /opt/stack/data/nova/instances/8d2948be-3ebb-4067-a0c8-e2ca884814ff_del complete
Jul 31 09:55:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5f53e13821f83924a2a8d8cb5717e8abc2c2989c --force-share --output=json" returned: 0 in 0.171s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5f53e13821f83924a2a8d8cb5717e8abc2c2989c,backing_fmt=raw /opt/stack/data/nova/instances/92d25a03-98ce-4bde-a3cc-20313ae77d41/disk.rescue {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5f53e13821f83924a2a8d8cb5717e8abc2c2989c,backing_fmt=raw /opt/stack/data/nova/instances/92d25a03-98ce-4bde-a3cc-20313ae77d41/disk.rescue" returned: 0 in 0.059s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "5f53e13821f83924a2a8d8cb5717e8abc2c2989c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG nova.objects.instance [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lazy-loading 'migration_context' on Instance uuid 92d25a03-98ce-4bde-a3cc-20313ae77d41 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Created local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Start _get_guest_xml network_info=[{"id": "e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d", "address": "fa:16:3e:2c:5b:c3", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "vif_mac": "fa:16:3e:2c:5b:c3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape82fc7e2-25", "ovs_interfaceid": "e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'eacff5c2-f99c-4356-a415-9a6cb7318cc4', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '25c20a3f-02ba-47ea-bb31-242eb91ccbdf', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MFWCkIfi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '92d25a03-98ce-4bde-a3cc-20313ae77d41', 'attached_at': '', 'detached_at': '', 'volume_id': '1e143852-2ce0-4b78-9b3e-2e2efb1d1407', 'serial': '1e143852-2ce0-4b78-9b3e-2e2efb1d1407'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG nova.objects.instance [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lazy-loading 'resources' on Instance uuid 92d25a03-98ce-4bde-a3cc-20313ae77d41 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG nova.objects.instance [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lazy-loading 'numa_topology' on Instance uuid 92d25a03-98ce-4bde-a3cc-20313ae77d41 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:55:51 user nova-compute[71113]: INFO nova.compute.manager [None req-b20543db-6e03-4030-b80a-de2366c4816b tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Took 1.14 seconds to destroy the instance on the hypervisor.
Jul 31 09:55:51 user nova-compute[71113]: DEBUG oslo.service.loopingcall [None req-b20543db-6e03-4030-b80a-de2366c4816b tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71113) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG nova.compute.manager [-] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Deallocating network for instance {{(pid=71113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] deallocate_for_instance() {{(pid=71113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 09:55:51 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:55:51 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:55:51 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG nova.objects.instance [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lazy-loading 'vcpu_model' on Instance uuid 92d25a03-98ce-4bde-a3cc-20313ae77d41 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MFWCkIfi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:55:51 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:55:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:55:51 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:55:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:55:51 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 09:55:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4398c6-60dd-4e2c-a72a-4dc6cdde1df3]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = MFWCkIfi\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 31 09:55:51 user nova-compute[71113]: node.name = iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407
Jul 31 09:55:51 user nova-compute[71113]: node.tpgt = -1
Jul 31 09:55:51 user nova-compute[71113]: node.startup = automatic
Jul 31 09:55:51 user nova-compute[71113]: node.leading_login = No
Jul 31 09:55:51 user nova-compute[71113]: iface.iscsi_ifacename = default
Jul 31 09:55:51 user nova-compute[71113]: iface.net_ifacename = <empty>
Jul 31 09:55:51 user nova-compute[71113]: iface.ipaddress = <empty>
Jul 31 09:55:51 user nova-compute[71113]: iface.prefix_len = 0
Jul 31 09:55:51 user nova-compute[71113]: iface.hwaddress = <empty>
Jul 31 09:55:51 user nova-compute[71113]: iface.transport_name = tcp
Jul 31 09:55:51 user nova-compute[71113]: iface.initiatorname = <empty>
Jul 31 09:55:51 user nova-compute[71113]: iface.state = <empty>
Jul 31 09:55:51 user nova-compute[71113]: iface.vlan_id = 0
Jul 31 09:55:51 user nova-compute[71113]: iface.vlan_priority = 0
Jul 31 09:55:51 user nova-compute[71113]: iface.vlan_state = <empty>
Jul 31 09:55:51 user nova-compute[71113]: iface.iface_num = 0
Jul 31 09:55:51 user nova-compute[71113]: iface.mtu = 0
Jul 31 09:55:51 user nova-compute[71113]: iface.port = 0
Jul 31 09:55:51 user nova-compute[71113]: iface.bootproto = <empty>
Jul 31 09:55:51 user nova-compute[71113]: iface.subnet_mask = <empty>
Jul 31 09:55:51 user nova-compute[71113]: iface.gateway = <empty>
Jul 31 09:55:51 user nova-compute[71113]: iface.dhcp_alt_client_id_state = <empty>
Jul 31 09:55:51 user nova-compute[71113]: iface.dhcp_alt_client_id = <empty>
Jul 31 09:55:51 user nova-compute[71113]: iface.dhcp_dns = <empty>
Jul 31 09:55:51 user nova-compute[71113]: iface.dhcp_learn_iqn = <empty>
Jul 31 09:55:51 user nova-compute[71113]: iface.dhcp_req_vendor_id_state = <empty>
Jul 31 09:55:51 user nova-compute[71113]: iface.dhcp_vendor_id_state = <empty>
Jul 31 09:55:51 user nova-compute[71113]: iface.dhcp_vendor_id = <empty>
Jul 31 09:55:51 user nova-compute[71113]: iface.dhcp_slp_da = <empty>
Jul 31 09:55:51 user nova-compute[71113]: iface.fragmentation = <empty>
Jul 31 09:55:51 user nova-compute[71113]: iface.gratuitous_arp = <empty>
Jul 31 09:55:51 user nova-compute[71113]: iface.incoming_forwarding = <empty>
Jul 31 09:55:51 user nova-compute[71113]: iface.tos_state = <empty>
Jul 31 09:55:51 user nova-compute[71113]: iface.tos = 0
Jul 31 09:55:51 user nova-compute[71113]: iface.ttl = 0
Jul 31 09:55:51 user nova-compute[71113]: iface.delayed_ack = <empty>
Jul 31 09:55:51 user nova-compute[71113]: iface.tcp_nagle = <empty>
Jul 31 09:55:51 user nova-compute[71113]: iface.tcp_wsf_state = <empty>
Jul 31 09:55:51 user nova-compute[71113]: iface.tcp_wsf = 0
Jul 31 09:55:51 user nova-compute[71113]: iface.tcp_timer_scale = 0
Jul 31 09:55:51 user nova-compute[71113]: iface.tcp_timestamp = <empty>
Jul 31 09:55:51 user nova-compute[71113]: iface.redirect = <empty>
Jul 31 09:55:51 user nova-compute[71113]: iface.def_task_mgmt_timeout = 0
Jul 31 09:55:51 user nova-compute[71113]: iface.header_digest = <empty>
Jul 31 09:55:51 user nova-compute[71113]: iface.data_digest = <empty>
Jul 31 09:55:51 user nova-compute[71113]: iface.immediate_data = <empty>
Jul 31 09:55:51 user nova-compute[71113]: iface.initial_r2t = <empty>
Jul 31 09:55:51 user nova-compute[71113]: iface.data_seq_inorder = <empty>
Jul 31 09:55:51 user nova-compute[71113]: iface.data_pdu_inorder = <empty>
Jul 31 09:55:51 user nova-compute[71113]: iface.erl = 0
Jul 31 09:55:51 user nova-compute[71113]: iface.max_receive_data_len = 0
Jul 31 09:55:51 user nova-compute[71113]: iface.first_burst_len = 0
Jul 31 09:55:51 user nova-compute[71113]: iface.max_outstanding_r2t = 0
Jul 31 09:55:51 user nova-compute[71113]: iface.max_burst_len = 0
Jul 31 09:55:51 user nova-compute[71113]: iface.chap_auth = <empty>
Jul 31 09:55:51 user nova-compute[71113]: iface.bidi_chap = <empty>
Jul 31 09:55:51 user nova-compute[71113]: iface.strict_login_compliance = <empty>
Jul 31 09:55:51 user nova-compute[71113]: iface.discovery_auth = <empty>
Jul 31 09:55:51 user nova-compute[71113]: iface.discovery_logout = <empty>
Jul 31 09:55:51 user nova-compute[71113]: node.discovery_address = <empty>
Jul 31 09:55:51 user nova-compute[71113]: node.discovery_port = 0
Jul 31 09:55:51 user nova-compute[71113]: node.discovery_type = static
Jul 31 09:55:51 user nova-compute[71113]: node.session.initial_cmdsn = 0
Jul 31 09:55:51 user nova-compute[71113]: node.session.initial_login_retry_max = 8
Jul 31 09:55:51 user nova-compute[71113]: node.session.xmit_thread_priority = -20
Jul 31 09:55:51 user nova-compute[71113]: node.session.cmds_max = 128
Jul 31 09:55:51 user nova-compute[71113]: node.session.queue_depth = 32
Jul 31 09:55:51 user nova-compute[71113]: node.session.nr_sessions = 1
Jul 31 09:55:51 user nova-compute[71113]: node.session.auth.authmethod = CHAP
Jul 31 09:55:51 user nova-compute[71113]: node.session.auth.username = MFWCkIfi
Jul 31 09:55:51 user nova-compute[71113]: node.session.auth.password = ***
Jul 31 09:55:51 user nova-compute[71113]: node.session.auth.username_in = <empty>
Jul 31 09:55:51 user nova-compute[71113]: node.session.auth.password_in = <empty>
Jul 31 09:55:51 user nova-compute[71113]: node.session.auth.chap_algs = MD5
Jul 31 09:55:51 user nova-compute[71113]: node.session.timeo.replacement_timeout = 120
Jul 31 09:55:51 user nova-compute[71113]: node.session.err_timeo.abort_timeout = 15
Jul 31 09:55:51 user nova-compute[71113]: node.session.err_timeo.lu_reset_timeout = 30
Jul 31 09:55:51 user nova-compute[71113]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 31 09:55:51 user nova-compute[71113]: node.session.err_timeo.host_reset_timeout = 60
Jul 31 09:55:51 user nova-compute[71113]: node.session.iscsi.FastAbort = Yes
Jul 31 09:55:51 user nova-compute[71113]: node.session.iscsi.InitialR2T = No
Jul 31 09:55:51 user nova-compute[71113]: node.session.iscsi.ImmediateData = Yes
Jul 31 09:55:51 user nova-compute[71113]: node.session.iscsi.FirstBurstLength = 262144
Jul 31 09:55:51 user nova-compute[71113]: node.session.iscsi.MaxBurstLength = 16776192
Jul 31 09:55:51 user nova-compute[71113]: node.session.iscsi.DefaultTime2Retain = 0
Jul 31 09:55:51 user nova-compute[71113]: node.session.iscsi.DefaultTime2Wait = 2
Jul 31 09:55:51 user nova-compute[71113]: node.session.iscsi.MaxConnections = 1
Jul 31 09:55:51 user nova-compute[71113]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 31 09:55:51 user nova-compute[71113]: node.session.iscsi.ERL = 0
Jul 31 09:55:51 user nova-compute[71113]: node.session.scan = manual
Jul 31 09:55:51 user nova-compute[71113]: node.session.reopen_max = 0
Jul 31 09:55:51 user nova-compute[71113]: node.conn[0].address = 172.16.0.220
Jul 31 09:55:51 user nova-compute[71113]: node.conn[0].port = 3260
Jul 31 09:55:51 user nova-compute[71113]: node.conn[0].startup = manual
Jul 31 09:55:51 user nova-compute[71113]: node.conn[0].tcp.window_size = 524288
Jul 31 09:55:51 user nova-compute[71113]: node.conn[0].tcp.type_of_service = 0
Jul 31 09:55:51 user nova-compute[71113]: node.conn[0].timeo.logout_timeout = 15
Jul 31 09:55:51 user nova-compute[71113]: node.conn[0].timeo.login_timeout = 15
Jul 31 09:55:51 user nova-compute[71113]: node.conn[0].timeo.auth_timeout = 45
Jul 31 09:55:51 user nova-compute[71113]: node.conn[0].timeo.noop_out_interval = 5
Jul 31 09:55:51 user nova-compute[71113]: node.conn[0].timeo.noop_out_timeout = 5
Jul 31 09:55:51 user nova-compute[71113]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 31 09:55:51 user nova-compute[71113]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 31 09:55:51 user nova-compute[71113]: node.conn[0].iscsi.HeaderDigest = None
Jul 31 09:55:51 user nova-compute[71113]: node.conn[0].iscsi.DataDigest = None
Jul 31 09:55:51 user nova-compute[71113]: node.conn[0].iscsi.IFMarker = No
Jul 31 09:55:51 user nova-compute[71113]: node.conn[0].iscsi.OFMarker = No
Jul 31 09:55:51 user nova-compute[71113]: # END RECORD
Jul 31 09:55:51 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9ddac0-11cf-4614-944b-d294bc347a2b]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:55:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:52 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8344a2ee-07f9-464c-b9e0-9e57eb3a87bd]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:52 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:55:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MFWCkIfi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MFWCkIfi" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:52 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43a4c9c-64bb-4f41-9e8e-dbb4e5bac844]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:52 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MFWCkIfi'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:55:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:52 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86e3b78-cf7a-47de-9e98-e45bb657fd54]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:52 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:55:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:52 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4856030b-1d14-4105-a55a-c0b93611e2c6]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:52 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:55:52 user nova-compute[71113]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 (non-flash)
Jul 31 09:55:52 user nova-compute[71113]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef (non-flash)
Jul 31 09:55:52 user nova-compute[71113]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71 (non-flash)
Jul 31 09:55:52 user nova-compute[71113]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)
Jul 31 09:55:52 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:55:52 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:55:52 user nova-compute[71113]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 (non-flash)
Jul 31 09:55:52 user nova-compute[71113]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef (non-flash)
Jul 31 09:55:52 user nova-compute[71113]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71 (non-flash)
Jul 31 09:55:52 user nova-compute[71113]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)
Jul 31 09:55:52 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:55:52 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.167s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:55:52 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 09:55:52 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] HCTL ('36', '0', '0', 0) found on session 25 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 09:55:52 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 09:55:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:52 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1fc4d7-1ef6-4ab1-8522-ae77d0752d0b]: (4, ('0 0 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:52 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Searching for a device in session 25 and hctl ('36', '0', '0', 0) yield: sde {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 09:55:52 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MFWCkIfi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 09:55:52 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.193s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:55:52 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] <== connect_volume: return (194ms) {'type': 'block', 'scsi_wwn': '23363366562323130', 'path': '/dev/sde'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:55:52 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363366562323130', 'path': '/dev/sde'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 09:55:52 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:53:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-931201663',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-931201663',id=21,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:54:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88bbf2636f6248fcbe644af4eab0c823',ramdisk_id='',reservation_id='r-x25o75li',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1194948978',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:54:23Z,user_data=None,user_id='f4f505d5eddc4df48ec267f6f69a01f9',uuid=92d25a03-98ce-4bde-a3cc-20313ae77d41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d", "address": "fa:16:3e:2c:5b:c3", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "vif_mac": "fa:16:3e:2c:5b:c3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape82fc7e2-25", "ovs_interfaceid": "e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 09:55:52 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Converting VIF {"id": "e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d", "address": "fa:16:3e:2c:5b:c3", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "vif_mac": "fa:16:3e:2c:5b:c3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape82fc7e2-25", "ovs_interfaceid": "e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:55:52 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:5b:c3,bridge_name='br-int',has_traffic_filtering=True,id=e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d,network=Network(6f88bfaa-d58d-4ac2-b43d-0689d50456ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape82fc7e2-25') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:55:52 user nova-compute[71113]: DEBUG nova.objects.instance [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lazy-loading 'pci_devices' on Instance uuid 92d25a03-98ce-4bde-a3cc-20313ae77d41 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:55:52 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] End _get_guest_xml xml=<domain type="kvm">
Jul 31 09:55:52 user nova-compute[71113]:   <uuid>92d25a03-98ce-4bde-a3cc-20313ae77d41</uuid>
Jul 31 09:55:52 user nova-compute[71113]:   <name>instance-00000015</name>
Jul 31 09:55:52 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 09:55:52 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 09:55:52 user nova-compute[71113]:   <metadata>
Jul 31 09:55:52 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 09:55:52 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 09:55:52 user nova-compute[71113]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-931201663</nova:name>
Jul 31 09:55:52 user nova-compute[71113]:       <nova:creationTime>2023-07-31 09:55:51</nova:creationTime>
Jul 31 09:55:52 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 09:55:52 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 09:55:52 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 09:55:52 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 09:55:52 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 09:55:52 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 09:55:52 user nova-compute[71113]:       </nova:flavor>
Jul 31 09:55:52 user nova-compute[71113]:       <nova:owner>
Jul 31 09:55:52 user nova-compute[71113]:         <nova:user uuid="f4f505d5eddc4df48ec267f6f69a01f9">tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member</nova:user>
Jul 31 09:55:52 user nova-compute[71113]:         <nova:project uuid="88bbf2636f6248fcbe644af4eab0c823">tempest-ServerBootFromVolumeStableRescueTest-1194948978</nova:project>
Jul 31 09:55:52 user nova-compute[71113]:       </nova:owner>
Jul 31 09:55:52 user nova-compute[71113]:       <nova:root type="image" uuid="078646fe-b504-41ed-a147-61072e903e51"/>
Jul 31 09:55:52 user nova-compute[71113]:       <nova:ports>
Jul 31 09:55:52 user nova-compute[71113]:         <nova:port uuid="e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d">
Jul 31 09:55:52 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 31 09:55:52 user nova-compute[71113]:         </nova:port>
Jul 31 09:55:52 user nova-compute[71113]:       </nova:ports>
Jul 31 09:55:52 user nova-compute[71113]:     </nova:instance>
Jul 31 09:55:52 user nova-compute[71113]:   </metadata>
Jul 31 09:55:52 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 09:55:52 user nova-compute[71113]:     <system>
Jul 31 09:55:52 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 09:55:52 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 09:55:52 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 09:55:52 user nova-compute[71113]:       <entry name="serial">92d25a03-98ce-4bde-a3cc-20313ae77d41</entry>
Jul 31 09:55:52 user nova-compute[71113]:       <entry name="uuid">92d25a03-98ce-4bde-a3cc-20313ae77d41</entry>
Jul 31 09:55:52 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 09:55:52 user nova-compute[71113]:     </system>
Jul 31 09:55:52 user nova-compute[71113]:   </sysinfo>
Jul 31 09:55:52 user nova-compute[71113]:   <os>
Jul 31 09:55:52 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 09:55:52 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 09:55:52 user nova-compute[71113]:   </os>
Jul 31 09:55:52 user nova-compute[71113]:   <features>
Jul 31 09:55:52 user nova-compute[71113]:     <acpi/>
Jul 31 09:55:52 user nova-compute[71113]:     <apic/>
Jul 31 09:55:52 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 09:55:52 user nova-compute[71113]:   </features>
Jul 31 09:55:52 user nova-compute[71113]:   <clock offset="utc">
Jul 31 09:55:52 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 09:55:52 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 09:55:52 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 09:55:52 user nova-compute[71113]:   </clock>
Jul 31 09:55:52 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 09:55:52 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 09:55:52 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 09:55:52 user nova-compute[71113]:   </cpu>
Jul 31 09:55:52 user nova-compute[71113]:   <devices>
Jul 31 09:55:52 user nova-compute[71113]:     <disk type="block" device="disk">
Jul 31 09:55:52 user nova-compute[71113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:55:52 user nova-compute[71113]:       <source dev="/dev/sde"/>
Jul 31 09:55:52 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 09:55:52 user nova-compute[71113]:       <serial>1e143852-2ce0-4b78-9b3e-2e2efb1d1407</serial>
Jul 31 09:55:52 user nova-compute[71113]:     </disk>
Jul 31 09:55:52 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 09:55:52 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 09:55:52 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/92d25a03-98ce-4bde-a3cc-20313ae77d41/disk.rescue"/>
Jul 31 09:55:52 user nova-compute[71113]:       <target dev="vdb" bus="virtio"/>
Jul 31 09:55:52 user nova-compute[71113]:       <boot order="1"/>
Jul 31 09:55:52 user nova-compute[71113]:     </disk>
Jul 31 09:55:52 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 09:55:52 user nova-compute[71113]:       <mac address="fa:16:3e:2c:5b:c3"/>
Jul 31 09:55:52 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:55:52 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 09:55:52 user nova-compute[71113]:       <target dev="tape82fc7e2-25"/>
Jul 31 09:55:52 user nova-compute[71113]:     </interface>
Jul 31 09:55:52 user nova-compute[71113]:     <serial type="pty">
Jul 31 09:55:52 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/92d25a03-98ce-4bde-a3cc-20313ae77d41/console.log" append="off"/>
Jul 31 09:55:52 user nova-compute[71113]:     </serial>
Jul 31 09:55:52 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 09:55:52 user nova-compute[71113]:     <video>
Jul 31 09:55:52 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:55:52 user nova-compute[71113]:     </video>
Jul 31 09:55:52 user nova-compute[71113]:     <rng model="virtio">
Jul 31 09:55:52 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 09:55:52 user nova-compute[71113]:     </rng>
Jul 31 09:55:52 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 09:55:52 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 09:55:52 user nova-compute[71113]:       <stats period="10"/>
Jul 31 09:55:52 user nova-compute[71113]:     </memballoon>
Jul 31 09:55:52 user nova-compute[71113]:   </devices>
Jul 31 09:55:52 user nova-compute[71113]: </domain>
Jul 31 09:55:52 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 09:55:52 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Instance destroyed successfully.
Jul 31 09:55:52 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:55:52 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:55:52 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] No VIF found with MAC fa:16:3e:2c:5b:c3, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 09:55:53 user nova-compute[71113]: DEBUG nova.compute.manager [req-6b562eed-4234-4fc5-bc55-ddbffc6890d7 req-93543564-dc2b-4303-9e17-436d2cae433e service nova] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Received event network-vif-plugged-e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:55:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-6b562eed-4234-4fc5-bc55-ddbffc6890d7 req-93543564-dc2b-4303-9e17-436d2cae433e service nova] Acquiring lock "92d25a03-98ce-4bde-a3cc-20313ae77d41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:55:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-6b562eed-4234-4fc5-bc55-ddbffc6890d7 req-93543564-dc2b-4303-9e17-436d2cae433e service nova] Lock "92d25a03-98ce-4bde-a3cc-20313ae77d41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:55:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-6b562eed-4234-4fc5-bc55-ddbffc6890d7 req-93543564-dc2b-4303-9e17-436d2cae433e service nova] Lock "92d25a03-98ce-4bde-a3cc-20313ae77d41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:55:53 user nova-compute[71113]: DEBUG nova.compute.manager [req-6b562eed-4234-4fc5-bc55-ddbffc6890d7 req-93543564-dc2b-4303-9e17-436d2cae433e service nova] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] No waiting events found dispatching network-vif-plugged-e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:55:53 user nova-compute[71113]: WARNING nova.compute.manager [req-6b562eed-4234-4fc5-bc55-ddbffc6890d7 req-93543564-dc2b-4303-9e17-436d2cae433e service nova] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Received unexpected event network-vif-plugged-e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d for instance with vm_state active and task_state rescuing.
Jul 31 09:55:53 user nova-compute[71113]: DEBUG nova.compute.manager [req-c697da20-ea10-430f-8593-a8f4258bedef req-f1f49f3d-45af-4aa4-8357-eda8e96fbb5e service nova] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Received event network-vif-plugged-f3560f1f-45f9-4ab3-b7a9-338b0483a656 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:55:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-c697da20-ea10-430f-8593-a8f4258bedef req-f1f49f3d-45af-4aa4-8357-eda8e96fbb5e service nova] Acquiring lock "8d2948be-3ebb-4067-a0c8-e2ca884814ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:55:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-c697da20-ea10-430f-8593-a8f4258bedef req-f1f49f3d-45af-4aa4-8357-eda8e96fbb5e service nova] Lock "8d2948be-3ebb-4067-a0c8-e2ca884814ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:55:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-c697da20-ea10-430f-8593-a8f4258bedef req-f1f49f3d-45af-4aa4-8357-eda8e96fbb5e service nova] Lock "8d2948be-3ebb-4067-a0c8-e2ca884814ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:55:53 user nova-compute[71113]: DEBUG nova.compute.manager [req-c697da20-ea10-430f-8593-a8f4258bedef req-f1f49f3d-45af-4aa4-8357-eda8e96fbb5e service nova] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] No waiting events found dispatching network-vif-plugged-f3560f1f-45f9-4ab3-b7a9-338b0483a656 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:55:53 user nova-compute[71113]: WARNING nova.compute.manager [req-c697da20-ea10-430f-8593-a8f4258bedef req-f1f49f3d-45af-4aa4-8357-eda8e96fbb5e service nova] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Received unexpected event network-vif-plugged-f3560f1f-45f9-4ab3-b7a9-338b0483a656 for instance with vm_state active and task_state deleting.
Jul 31 09:55:53 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:53 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:53 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:54 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:55:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:54 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Took 2.20 seconds to deallocate network for instance.
Jul 31 09:55:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b20543db-6e03-4030-b80a-de2366c4816b tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:55:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b20543db-6e03-4030-b80a-de2366c4816b tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:55:54 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-b20543db-6e03-4030-b80a-de2366c4816b tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:55:54 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-b20543db-6e03-4030-b80a-de2366c4816b tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:55:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b20543db-6e03-4030-b80a-de2366c4816b tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.487s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:55:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:54 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-b20543db-6e03-4030-b80a-de2366c4816b tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Deleted allocations for instance 8d2948be-3ebb-4067-a0c8-e2ca884814ff
Jul 31 09:55:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b20543db-6e03-4030-b80a-de2366c4816b tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "8d2948be-3ebb-4067-a0c8-e2ca884814ff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.210s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:55:55 user nova-compute[71113]: DEBUG nova.compute.manager [req-05b8e2c7-f343-4905-ad91-a1d6bf0e9bd4 req-b915a868-1393-4da0-a4e5-0a92ca8377fb service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received event network-changed-4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:55:55 user nova-compute[71113]: DEBUG nova.compute.manager [req-05b8e2c7-f343-4905-ad91-a1d6bf0e9bd4 req-b915a868-1393-4da0-a4e5-0a92ca8377fb service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Refreshing instance network info cache due to event network-changed-4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:55:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-05b8e2c7-f343-4905-ad91-a1d6bf0e9bd4 req-b915a868-1393-4da0-a4e5-0a92ca8377fb service nova] Acquiring lock "refresh_cache-eb68aada-46ba-4798-a16e-bb2cacfcd747" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:55:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-05b8e2c7-f343-4905-ad91-a1d6bf0e9bd4 req-b915a868-1393-4da0-a4e5-0a92ca8377fb service nova] Acquired lock "refresh_cache-eb68aada-46ba-4798-a16e-bb2cacfcd747" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:55:55 user nova-compute[71113]: DEBUG nova.network.neutron [req-05b8e2c7-f343-4905-ad91-a1d6bf0e9bd4 req-b915a868-1393-4da0-a4e5-0a92ca8377fb service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Refreshing network info cache for port 4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:55:55 user nova-compute[71113]: DEBUG nova.network.neutron [req-05b8e2c7-f343-4905-ad91-a1d6bf0e9bd4 req-b915a868-1393-4da0-a4e5-0a92ca8377fb service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Updated VIF entry in instance network info cache for port 4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:55:55 user nova-compute[71113]: DEBUG nova.network.neutron [req-05b8e2c7-f343-4905-ad91-a1d6bf0e9bd4 req-b915a868-1393-4da0-a4e5-0a92ca8377fb service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Updating instance_info_cache with network_info: [{"id": "4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e", "address": "fa:16:3e:71:d1:b6", "network": {"id": "f9b8375f-1e97-4274-8fef-ebe96b9dec13", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-937842323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dcc0c50-3d", "ovs_interfaceid": "4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6f734493-7794-4e1e-a68b-4ce6995dadef", "address": "fa:16:3e:77:21:46", "network": {"id": "93576160-6eb8-473f-ad25-fc3bb5e10825", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155060213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f734493-77", "ovs_interfaceid": "6f734493-7794-4e1e-a68b-4ce6995dadef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8354cc56-3d78-4f7a-b2fa-ee95e704d67c", "address": "fa:16:3e:51:5b:97", "network": {"id": "93576160-6eb8-473f-ad25-fc3bb5e10825", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155060213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8354cc56-3d", "ovs_interfaceid": "8354cc56-3d78-4f7a-b2fa-ee95e704d67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cb50bad1-1e1e-4138-8b0b-f7dc17d0d760", "address": "fa:16:3e:64:4b:9d", "network": {"id": "93576160-6eb8-473f-ad25-fc3bb5e10825", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155060213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb50bad1-1e", "ovs_interfaceid": "cb50bad1-1e1e-4138-8b0b-f7dc17d0d760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "685563e0-3264-4974-9df4-c9187df31d0b", "address": "fa:16:3e:b6:98:ef", "network": {"id": "93576160-6eb8-473f-ad25-fc3bb5e10825", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155060213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap685563e0-32", "ovs_interfaceid": "685563e0-3264-4974-9df4-c9187df31d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "113cfbd7-7a98-4be6-af79-76777a24650c", "address": "fa:16:3e:1a:85:42", "network": {"id": "b15c2d5a-d882-480a-9d49-9f6991094b80", "bridge": "br-int", "label": "tempest-device-tagging-net2-323585513", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap113cfbd7-7a", "ovs_interfaceid": "113cfbd7-7a98-4be6-af79-76777a24650c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bcad9d15-2562-4660-93b0-91a32ac0c390", "address": "fa:16:3e:0f:b0:dc", "network": {"id": "b15c2d5a-d882-480a-9d49-9f6991094b80", "bridge": "br-int", "label": "tempest-device-tagging-net2-323585513", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcad9d15-25", "ovs_interfaceid": "bcad9d15-2562-4660-93b0-91a32ac0c390", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:55:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-05b8e2c7-f343-4905-ad91-a1d6bf0e9bd4 req-b915a868-1393-4da0-a4e5-0a92ca8377fb service nova] Releasing lock "refresh_cache-eb68aada-46ba-4798-a16e-bb2cacfcd747" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:55:55 user nova-compute[71113]: DEBUG nova.compute.manager [req-05b8e2c7-f343-4905-ad91-a1d6bf0e9bd4 req-b915a868-1393-4da0-a4e5-0a92ca8377fb service nova] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Received event network-vif-deleted-f3560f1f-45f9-4ab3-b7a9-338b0483a656 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:55:55 user nova-compute[71113]: DEBUG nova.compute.manager [req-05b8e2c7-f343-4905-ad91-a1d6bf0e9bd4 req-b915a868-1393-4da0-a4e5-0a92ca8377fb service nova] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Received event network-vif-plugged-e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:55:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-05b8e2c7-f343-4905-ad91-a1d6bf0e9bd4 req-b915a868-1393-4da0-a4e5-0a92ca8377fb service nova] Acquiring lock "92d25a03-98ce-4bde-a3cc-20313ae77d41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:55:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-05b8e2c7-f343-4905-ad91-a1d6bf0e9bd4 req-b915a868-1393-4da0-a4e5-0a92ca8377fb service nova] Lock "92d25a03-98ce-4bde-a3cc-20313ae77d41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:55:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-05b8e2c7-f343-4905-ad91-a1d6bf0e9bd4 req-b915a868-1393-4da0-a4e5-0a92ca8377fb service nova] Lock "92d25a03-98ce-4bde-a3cc-20313ae77d41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:55:55 user nova-compute[71113]: DEBUG nova.compute.manager [req-05b8e2c7-f343-4905-ad91-a1d6bf0e9bd4 req-b915a868-1393-4da0-a4e5-0a92ca8377fb service nova] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] No waiting events found dispatching network-vif-plugged-e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:55:55 user nova-compute[71113]: WARNING nova.compute.manager [req-05b8e2c7-f343-4905-ad91-a1d6bf0e9bd4 req-b915a868-1393-4da0-a4e5-0a92ca8377fb service nova] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Received unexpected event network-vif-plugged-e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d for instance with vm_state active and task_state rescuing.
Jul 31 09:55:55 user nova-compute[71113]: DEBUG nova.compute.manager [req-05b8e2c7-f343-4905-ad91-a1d6bf0e9bd4 req-b915a868-1393-4da0-a4e5-0a92ca8377fb service nova] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Received event network-vif-plugged-e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:55:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-05b8e2c7-f343-4905-ad91-a1d6bf0e9bd4 req-b915a868-1393-4da0-a4e5-0a92ca8377fb service nova] Acquiring lock "92d25a03-98ce-4bde-a3cc-20313ae77d41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:55:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-05b8e2c7-f343-4905-ad91-a1d6bf0e9bd4 req-b915a868-1393-4da0-a4e5-0a92ca8377fb service nova] Lock "92d25a03-98ce-4bde-a3cc-20313ae77d41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:55:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-05b8e2c7-f343-4905-ad91-a1d6bf0e9bd4 req-b915a868-1393-4da0-a4e5-0a92ca8377fb service nova] Lock "92d25a03-98ce-4bde-a3cc-20313ae77d41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:55:55 user nova-compute[71113]: DEBUG nova.compute.manager [req-05b8e2c7-f343-4905-ad91-a1d6bf0e9bd4 req-b915a868-1393-4da0-a4e5-0a92ca8377fb service nova] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] No waiting events found dispatching network-vif-plugged-e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:55:55 user nova-compute[71113]: WARNING nova.compute.manager [req-05b8e2c7-f343-4905-ad91-a1d6bf0e9bd4 req-b915a868-1393-4da0-a4e5-0a92ca8377fb service nova] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Received unexpected event network-vif-plugged-e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d for instance with vm_state active and task_state rescuing.
Jul 31 09:55:56 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Removed pending event for 92d25a03-98ce-4bde-a3cc-20313ae77d41 due to event {{(pid=71113) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 31 09:55:56 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797356.3306532, 92d25a03-98ce-4bde-a3cc-20313ae77d41 => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:55:56 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] VM Resumed (Lifecycle Event)
Jul 31 09:55:56 user nova-compute[71113]: DEBUG nova.compute.manager [None req-f1287192-fce1-469b-ae7d-f1c2775535c6 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:55:56 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:55:56 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:55:56 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 31 09:55:56 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797356.331933, 92d25a03-98ce-4bde-a3cc-20313ae77d41 => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:55:56 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] VM Started (Lifecycle Event)
Jul 31 09:55:56 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:55:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Acquiring lock "eb68aada-46ba-4798-a16e-bb2cacfcd747" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:55:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:55:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Acquiring lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:55:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:55:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:55:56 user nova-compute[71113]: INFO nova.compute.manager [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Terminating instance
Jul 31 09:55:56 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:55:56 user nova-compute[71113]: DEBUG nova.compute.manager [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Start destroying the instance on the hypervisor. {{(pid=71113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 09:55:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:57 user nova-compute[71113]: DEBUG nova.compute.manager [req-5bd4c31c-97db-4f83-a473-9ce57aabdb88 req-66cc4077-3881-4ca0-88c1-c4bae5debbe4 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received event network-vif-unplugged-6f734493-7794-4e1e-a68b-4ce6995dadef {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:55:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-5bd4c31c-97db-4f83-a473-9ce57aabdb88 req-66cc4077-3881-4ca0-88c1-c4bae5debbe4 service nova] Acquiring lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:55:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-5bd4c31c-97db-4f83-a473-9ce57aabdb88 req-66cc4077-3881-4ca0-88c1-c4bae5debbe4 service nova] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:55:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-5bd4c31c-97db-4f83-a473-9ce57aabdb88 req-66cc4077-3881-4ca0-88c1-c4bae5debbe4 service nova] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:55:57 user nova-compute[71113]: DEBUG nova.compute.manager [req-5bd4c31c-97db-4f83-a473-9ce57aabdb88 req-66cc4077-3881-4ca0-88c1-c4bae5debbe4 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] No waiting events found dispatching network-vif-unplugged-6f734493-7794-4e1e-a68b-4ce6995dadef {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:55:57 user nova-compute[71113]: DEBUG nova.compute.manager [req-5bd4c31c-97db-4f83-a473-9ce57aabdb88 req-66cc4077-3881-4ca0-88c1-c4bae5debbe4 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received event network-vif-unplugged-6f734493-7794-4e1e-a68b-4ce6995dadef for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 09:55:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:57 user nova-compute[71113]: DEBUG nova.compute.manager [req-91690085-11d6-4269-8e66-cab97a52fbfb req-2126f577-c1a1-4ad6-96d8-101e3d69fa5f service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received event network-vif-unplugged-cb50bad1-1e1e-4138-8b0b-f7dc17d0d760 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:55:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-91690085-11d6-4269-8e66-cab97a52fbfb req-2126f577-c1a1-4ad6-96d8-101e3d69fa5f service nova] Acquiring lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:55:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-91690085-11d6-4269-8e66-cab97a52fbfb req-2126f577-c1a1-4ad6-96d8-101e3d69fa5f service nova] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:55:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-91690085-11d6-4269-8e66-cab97a52fbfb req-2126f577-c1a1-4ad6-96d8-101e3d69fa5f service nova] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:55:57 user nova-compute[71113]: DEBUG nova.compute.manager [req-91690085-11d6-4269-8e66-cab97a52fbfb req-2126f577-c1a1-4ad6-96d8-101e3d69fa5f service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] No waiting events found dispatching network-vif-unplugged-cb50bad1-1e1e-4138-8b0b-f7dc17d0d760 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:55:57 user nova-compute[71113]: DEBUG nova.compute.manager [req-91690085-11d6-4269-8e66-cab97a52fbfb req-2126f577-c1a1-4ad6-96d8-101e3d69fa5f service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received event network-vif-unplugged-cb50bad1-1e1e-4138-8b0b-f7dc17d0d760 for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 09:55:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:57 user nova-compute[71113]: DEBUG nova.compute.manager [req-74217dc8-1958-4bca-82a9-5351751d7123 req-fc5ba695-e24f-41e0-8315-582b71f82e1d service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received event network-vif-unplugged-4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:55:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-74217dc8-1958-4bca-82a9-5351751d7123 req-fc5ba695-e24f-41e0-8315-582b71f82e1d service nova] Acquiring lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:55:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-74217dc8-1958-4bca-82a9-5351751d7123 req-fc5ba695-e24f-41e0-8315-582b71f82e1d service nova] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:55:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-74217dc8-1958-4bca-82a9-5351751d7123 req-fc5ba695-e24f-41e0-8315-582b71f82e1d service nova] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:55:57 user nova-compute[71113]: DEBUG nova.compute.manager [req-74217dc8-1958-4bca-82a9-5351751d7123 req-fc5ba695-e24f-41e0-8315-582b71f82e1d service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] No waiting events found dispatching network-vif-unplugged-4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:55:57 user nova-compute[71113]: DEBUG nova.compute.manager [req-74217dc8-1958-4bca-82a9-5351751d7123 req-fc5ba695-e24f-41e0-8315-582b71f82e1d service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received event network-vif-unplugged-4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 09:55:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:58 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Instance destroyed successfully.
Jul 31 09:55:58 user nova-compute[71113]: DEBUG nova.objects.instance [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Lazy-loading 'resources' on Instance uuid eb68aada-46ba-4798-a16e-bb2cacfcd747 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T09:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1432155715',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1432155715',id=22,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUpJgODgUF9u3PO8QOqpE//ep50IsMXQIzo1b11XqsIWrhDj9vxGwUiGlSPERfjYPo8m8x6f54Kdo20ukge6PicaA87ygzLS1taG9DCB2HH0QHqHEJz+oqlZn8EcXAIXA==',key_name='tempest-keypair-385475384',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:54:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4db8c3c401c94419b4f534a20d60388c',ramdisk_id='',reservation_id='r-bypbvdk2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-477255538',owner_user_name='tempest-TaggedBootDevicesTest-477255538-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:54:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b9e45d968444ffba99ecf4c845b101e',uuid=eb68aada-46ba-4798-a16e-bb2cacfcd747,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e", "address": "fa:16:3e:71:d1:b6", "network": {"id": "f9b8375f-1e97-4274-8fef-ebe96b9dec13", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-937842323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dcc0c50-3d", "ovs_interfaceid": "4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Converting VIF {"id": "4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e", "address": "fa:16:3e:71:d1:b6", "network": {"id": "f9b8375f-1e97-4274-8fef-ebe96b9dec13", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-937842323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dcc0c50-3d", "ovs_interfaceid": "4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:71:d1:b6,bridge_name='br-int',has_traffic_filtering=True,id=4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e,network=Network(f9b8375f-1e97-4274-8fef-ebe96b9dec13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dcc0c50-3d') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG os_vif [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:d1:b6,bridge_name='br-int',has_traffic_filtering=True,id=4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e,network=Network(f9b8375f-1e97-4274-8fef-ebe96b9dec13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dcc0c50-3d') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4dcc0c50-3d, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:58 user nova-compute[71113]: INFO os_vif [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:d1:b6,bridge_name='br-int',has_traffic_filtering=True,id=4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e,network=Network(f9b8375f-1e97-4274-8fef-ebe96b9dec13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dcc0c50-3d')
Jul 31 09:55:58 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T09:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1432155715',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1432155715',id=22,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUpJgODgUF9u3PO8QOqpE//ep50IsMXQIzo1b11XqsIWrhDj9vxGwUiGlSPERfjYPo8m8x6f54Kdo20ukge6PicaA87ygzLS1taG9DCB2HH0QHqHEJz+oqlZn8EcXAIXA==',key_name='tempest-keypair-385475384',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:54:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4db8c3c401c94419b4f534a20d60388c',ramdisk_id='',reservation_id='r-bypbvdk2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-477255538',owner_user_name='tempest-TaggedBootDevicesTest-477255538-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:54:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b9e45d968444ffba99ecf4c845b101e',uuid=eb68aada-46ba-4798-a16e-bb2cacfcd747,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f734493-7794-4e1e-a68b-4ce6995dadef", "address": "fa:16:3e:77:21:46", "network": {"id": "93576160-6eb8-473f-ad25-fc3bb5e10825", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155060213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f734493-77", "ovs_interfaceid": "6f734493-7794-4e1e-a68b-4ce6995dadef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Converting VIF {"id": "6f734493-7794-4e1e-a68b-4ce6995dadef", "address": "fa:16:3e:77:21:46", "network": {"id": "93576160-6eb8-473f-ad25-fc3bb5e10825", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155060213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f734493-77", "ovs_interfaceid": "6f734493-7794-4e1e-a68b-4ce6995dadef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:21:46,bridge_name='br-int',has_traffic_filtering=True,id=6f734493-7794-4e1e-a68b-4ce6995dadef,network=Network(93576160-6eb8-473f-ad25-fc3bb5e10825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6f734493-77') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG os_vif [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:21:46,bridge_name='br-int',has_traffic_filtering=True,id=6f734493-7794-4e1e-a68b-4ce6995dadef,network=Network(93576160-6eb8-473f-ad25-fc3bb5e10825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6f734493-77') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f734493-77, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-31ba4e49-5b40-43a9-9904-6b2fe7153ba8 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Acquiring lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-31ba4e49-5b40-43a9-9904-6b2fe7153ba8 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-31ba4e49-5b40-43a9-9904-6b2fe7153ba8 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Acquiring lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-31ba4e49-5b40-43a9-9904-6b2fe7153ba8 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-31ba4e49-5b40-43a9-9904-6b2fe7153ba8 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:55:58 user nova-compute[71113]: INFO nova.compute.manager [None req-31ba4e49-5b40-43a9-9904-6b2fe7153ba8 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Terminating instance
Jul 31 09:55:58 user nova-compute[71113]: DEBUG nova.compute.manager [None req-31ba4e49-5b40-43a9-9904-6b2fe7153ba8 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Start destroying the instance on the hypervisor. {{(pid=71113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:58 user nova-compute[71113]: INFO os_vif [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:21:46,bridge_name='br-int',has_traffic_filtering=True,id=6f734493-7794-4e1e-a68b-4ce6995dadef,network=Network(93576160-6eb8-473f-ad25-fc3bb5e10825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6f734493-77')
Jul 31 09:55:58 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T09:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1432155715',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1432155715',id=22,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUpJgODgUF9u3PO8QOqpE//ep50IsMXQIzo1b11XqsIWrhDj9vxGwUiGlSPERfjYPo8m8x6f54Kdo20ukge6PicaA87ygzLS1taG9DCB2HH0QHqHEJz+oqlZn8EcXAIXA==',key_name='tempest-keypair-385475384',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:54:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4db8c3c401c94419b4f534a20d60388c',ramdisk_id='',reservation_id='r-bypbvdk2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-477255538',owner_user_name='tempest-TaggedBootDevicesTest-477255538-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:54:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b9e45d968444ffba99ecf4c845b101e',uuid=eb68aada-46ba-4798-a16e-bb2cacfcd747,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8354cc56-3d78-4f7a-b2fa-ee95e704d67c", "address": "fa:16:3e:51:5b:97", "network": {"id": "93576160-6eb8-473f-ad25-fc3bb5e10825", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155060213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8354cc56-3d", "ovs_interfaceid": "8354cc56-3d78-4f7a-b2fa-ee95e704d67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Converting VIF {"id": "8354cc56-3d78-4f7a-b2fa-ee95e704d67c", "address": "fa:16:3e:51:5b:97", "network": {"id": "93576160-6eb8-473f-ad25-fc3bb5e10825", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155060213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8354cc56-3d", "ovs_interfaceid": "8354cc56-3d78-4f7a-b2fa-ee95e704d67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:5b:97,bridge_name='br-int',has_traffic_filtering=True,id=8354cc56-3d78-4f7a-b2fa-ee95e704d67c,network=Network(93576160-6eb8-473f-ad25-fc3bb5e10825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8354cc56-3d') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG os_vif [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:5b:97,bridge_name='br-int',has_traffic_filtering=True,id=8354cc56-3d78-4f7a-b2fa-ee95e704d67c,network=Network(93576160-6eb8-473f-ad25-fc3bb5e10825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8354cc56-3d') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8354cc56-3d, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:58 user nova-compute[71113]: INFO os_vif [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:5b:97,bridge_name='br-int',has_traffic_filtering=True,id=8354cc56-3d78-4f7a-b2fa-ee95e704d67c,network=Network(93576160-6eb8-473f-ad25-fc3bb5e10825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8354cc56-3d')
Jul 31 09:55:58 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T09:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1432155715',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1432155715',id=22,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUpJgODgUF9u3PO8QOqpE//ep50IsMXQIzo1b11XqsIWrhDj9vxGwUiGlSPERfjYPo8m8x6f54Kdo20ukge6PicaA87ygzLS1taG9DCB2HH0QHqHEJz+oqlZn8EcXAIXA==',key_name='tempest-keypair-385475384',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:54:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4db8c3c401c94419b4f534a20d60388c',ramdisk_id='',reservation_id='r-bypbvdk2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-477255538',owner_user_name='tempest-TaggedBootDevicesTest-477255538-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:54:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b9e45d968444ffba99ecf4c845b101e',uuid=eb68aada-46ba-4798-a16e-bb2cacfcd747,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb50bad1-1e1e-4138-8b0b-f7dc17d0d760", "address": "fa:16:3e:64:4b:9d", "network": {"id": "93576160-6eb8-473f-ad25-fc3bb5e10825", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155060213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb50bad1-1e", "ovs_interfaceid": "cb50bad1-1e1e-4138-8b0b-f7dc17d0d760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Converting VIF {"id": "cb50bad1-1e1e-4138-8b0b-f7dc17d0d760", "address": "fa:16:3e:64:4b:9d", "network": {"id": "93576160-6eb8-473f-ad25-fc3bb5e10825", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155060213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb50bad1-1e", "ovs_interfaceid": "cb50bad1-1e1e-4138-8b0b-f7dc17d0d760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:4b:9d,bridge_name='br-int',has_traffic_filtering=True,id=cb50bad1-1e1e-4138-8b0b-f7dc17d0d760,network=Network(93576160-6eb8-473f-ad25-fc3bb5e10825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb50bad1-1e') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG os_vif [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:4b:9d,bridge_name='br-int',has_traffic_filtering=True,id=cb50bad1-1e1e-4138-8b0b-f7dc17d0d760,network=Network(93576160-6eb8-473f-ad25-fc3bb5e10825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb50bad1-1e') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb50bad1-1e, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:58 user nova-compute[71113]: INFO os_vif [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:4b:9d,bridge_name='br-int',has_traffic_filtering=True,id=cb50bad1-1e1e-4138-8b0b-f7dc17d0d760,network=Network(93576160-6eb8-473f-ad25-fc3bb5e10825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb50bad1-1e')
Jul 31 09:55:58 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T09:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1432155715',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1432155715',id=22,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUpJgODgUF9u3PO8QOqpE//ep50IsMXQIzo1b11XqsIWrhDj9vxGwUiGlSPERfjYPo8m8x6f54Kdo20ukge6PicaA87ygzLS1taG9DCB2HH0QHqHEJz+oqlZn8EcXAIXA==',key_name='tempest-keypair-385475384',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:54:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4db8c3c401c94419b4f534a20d60388c',ramdisk_id='',reservation_id='r-bypbvdk2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-477255538',owner_user_name='tempest-TaggedBootDevicesTest-477255538-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:54:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b9e45d968444ffba99ecf4c845b101e',uuid=eb68aada-46ba-4798-a16e-bb2cacfcd747,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "685563e0-3264-4974-9df4-c9187df31d0b", "address": "fa:16:3e:b6:98:ef", "network": {"id": "93576160-6eb8-473f-ad25-fc3bb5e10825", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155060213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap685563e0-32", "ovs_interfaceid": "685563e0-3264-4974-9df4-c9187df31d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Converting VIF {"id": "685563e0-3264-4974-9df4-c9187df31d0b", "address": "fa:16:3e:b6:98:ef", "network": {"id": "93576160-6eb8-473f-ad25-fc3bb5e10825", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155060213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap685563e0-32", "ovs_interfaceid": "685563e0-3264-4974-9df4-c9187df31d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:98:ef,bridge_name='br-int',has_traffic_filtering=True,id=685563e0-3264-4974-9df4-c9187df31d0b,network=Network(93576160-6eb8-473f-ad25-fc3bb5e10825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap685563e0-32') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG os_vif [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:98:ef,bridge_name='br-int',has_traffic_filtering=True,id=685563e0-3264-4974-9df4-c9187df31d0b,network=Network(93576160-6eb8-473f-ad25-fc3bb5e10825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap685563e0-32') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap685563e0-32, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:58 user nova-compute[71113]: INFO os_vif [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:98:ef,bridge_name='br-int',has_traffic_filtering=True,id=685563e0-3264-4974-9df4-c9187df31d0b,network=Network(93576160-6eb8-473f-ad25-fc3bb5e10825),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap685563e0-32')
Jul 31 09:55:58 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T09:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1432155715',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1432155715',id=22,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUpJgODgUF9u3PO8QOqpE//ep50IsMXQIzo1b11XqsIWrhDj9vxGwUiGlSPERfjYPo8m8x6f54Kdo20ukge6PicaA87ygzLS1taG9DCB2HH0QHqHEJz+oqlZn8EcXAIXA==',key_name='tempest-keypair-385475384',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:54:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4db8c3c401c94419b4f534a20d60388c',ramdisk_id='',reservation_id='r-bypbvdk2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-477255538',owner_user_name='tempest-TaggedBootDevicesTest-477255538-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:54:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b9e45d968444ffba99ecf4c845b101e',uuid=eb68aada-46ba-4798-a16e-bb2cacfcd747,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "113cfbd7-7a98-4be6-af79-76777a24650c", "address": "fa:16:3e:1a:85:42", "network": {"id": "b15c2d5a-d882-480a-9d49-9f6991094b80", "bridge": "br-int", "label": "tempest-device-tagging-net2-323585513", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap113cfbd7-7a", "ovs_interfaceid": "113cfbd7-7a98-4be6-af79-76777a24650c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Converting VIF {"id": "113cfbd7-7a98-4be6-af79-76777a24650c", "address": "fa:16:3e:1a:85:42", "network": {"id": "b15c2d5a-d882-480a-9d49-9f6991094b80", "bridge": "br-int", "label": "tempest-device-tagging-net2-323585513", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap113cfbd7-7a", "ovs_interfaceid": "113cfbd7-7a98-4be6-af79-76777a24650c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:85:42,bridge_name='br-int',has_traffic_filtering=True,id=113cfbd7-7a98-4be6-af79-76777a24650c,network=Network(b15c2d5a-d882-480a-9d49-9f6991094b80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap113cfbd7-7a') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG os_vif [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:85:42,bridge_name='br-int',has_traffic_filtering=True,id=113cfbd7-7a98-4be6-af79-76777a24650c,network=Network(b15c2d5a-d882-480a-9d49-9f6991094b80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap113cfbd7-7a') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap113cfbd7-7a, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:58 user nova-compute[71113]: INFO os_vif [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:85:42,bridge_name='br-int',has_traffic_filtering=True,id=113cfbd7-7a98-4be6-af79-76777a24650c,network=Network(b15c2d5a-d882-480a-9d49-9f6991094b80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap113cfbd7-7a')
Jul 31 09:55:58 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T09:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1432155715',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1432155715',id=22,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUpJgODgUF9u3PO8QOqpE//ep50IsMXQIzo1b11XqsIWrhDj9vxGwUiGlSPERfjYPo8m8x6f54Kdo20ukge6PicaA87ygzLS1taG9DCB2HH0QHqHEJz+oqlZn8EcXAIXA==',key_name='tempest-keypair-385475384',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:54:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4db8c3c401c94419b4f534a20d60388c',ramdisk_id='',reservation_id='r-bypbvdk2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-477255538',owner_user_name='tempest-TaggedBootDevicesTest-477255538-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:54:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b9e45d968444ffba99ecf4c845b101e',uuid=eb68aada-46ba-4798-a16e-bb2cacfcd747,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bcad9d15-2562-4660-93b0-91a32ac0c390", "address": "fa:16:3e:0f:b0:dc", "network": {"id": "b15c2d5a-d882-480a-9d49-9f6991094b80", "bridge": "br-int", "label": "tempest-device-tagging-net2-323585513", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcad9d15-25", "ovs_interfaceid": "bcad9d15-2562-4660-93b0-91a32ac0c390", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Converting VIF {"id": "bcad9d15-2562-4660-93b0-91a32ac0c390", "address": "fa:16:3e:0f:b0:dc", "network": {"id": "b15c2d5a-d882-480a-9d49-9f6991094b80", "bridge": "br-int", "label": "tempest-device-tagging-net2-323585513", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcad9d15-25", "ovs_interfaceid": "bcad9d15-2562-4660-93b0-91a32ac0c390", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:b0:dc,bridge_name='br-int',has_traffic_filtering=True,id=bcad9d15-2562-4660-93b0-91a32ac0c390,network=Network(b15c2d5a-d882-480a-9d49-9f6991094b80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcad9d15-25') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG os_vif [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:b0:dc,bridge_name='br-int',has_traffic_filtering=True,id=bcad9d15-2562-4660-93b0-91a32ac0c390,network=Network(b15c2d5a-d882-480a-9d49-9f6991094b80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcad9d15-25') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbcad9d15-25, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:55:58 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:58 user nova-compute[71113]: INFO os_vif [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:b0:dc,bridge_name='br-int',has_traffic_filtering=True,id=bcad9d15-2562-4660-93b0-91a32ac0c390,network=Network(b15c2d5a-d882-480a-9d49-9f6991094b80),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcad9d15-25')
Jul 31 09:55:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rbozjDlO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:55:59 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:55:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49d0886-3d82-4f10-afe3-4a64d21fe355]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d6880c-d1ba-46a8-bd36-bc776d881402]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:55:59 user nova-compute[71113]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 (non-flash)
Jul 31 09:55:59 user nova-compute[71113]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef (non-flash)
Jul 31 09:55:59 user nova-compute[71113]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71 (non-flash)
Jul 31 09:55:59 user nova-compute[71113]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)
Jul 31 09:55:59 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:55:59 user nova-compute[71113]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 (non-flash)
Jul 31 09:55:59 user nova-compute[71113]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef (non-flash)
Jul 31 09:55:59 user nova-compute[71113]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71 (non-flash)
Jul 31 09:55:59 user nova-compute[71113]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)
Jul 31 09:55:59 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79082c7eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71'): ({'sdh'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Removing single pathed devices sdh {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c13eec-fd06-4503-ad5c-a6fcefcea3d9]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fd7967-32e4-40e0-806e-e9bc71e50fb2]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Flushing IO for device /dev/sdh {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bdc592e-ada5-4dd4-8d78-42f39122500c]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.044s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[41df64df-df21-4ec3-a9c9-3813c4276426]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] SCSI volumes sdh have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.042s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c55969-981e-47fd-bf3a-cb243abfbaa9]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71 -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG nova.compute.manager [req-7e482b3a-8928-44c0-80d9-02bb3ae77e9c req-9b6645df-3ffb-4082-93d8-bae368404dad service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received event network-vif-plugged-6f734493-7794-4e1e-a68b-4ce6995dadef {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7e482b3a-8928-44c0-80d9-02bb3ae77e9c req-9b6645df-3ffb-4082-93d8-bae368404dad service nova] Acquiring lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7e482b3a-8928-44c0-80d9-02bb3ae77e9c req-9b6645df-3ffb-4082-93d8-bae368404dad service nova] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7e482b3a-8928-44c0-80d9-02bb3ae77e9c req-9b6645df-3ffb-4082-93d8-bae368404dad service nova] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG nova.compute.manager [req-7e482b3a-8928-44c0-80d9-02bb3ae77e9c req-9b6645df-3ffb-4082-93d8-bae368404dad service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] No waiting events found dispatching network-vif-plugged-6f734493-7794-4e1e-a68b-4ce6995dadef {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:55:59 user nova-compute[71113]: WARNING nova.compute.manager [req-7e482b3a-8928-44c0-80d9-02bb3ae77e9c req-9b6645df-3ffb-4082-93d8-bae368404dad service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received unexpected event network-vif-plugged-6f734493-7794-4e1e-a68b-4ce6995dadef for instance with vm_state active and task_state deleting.
Jul 31 09:55:59 user nova-compute[71113]: DEBUG nova.compute.manager [req-7e482b3a-8928-44c0-80d9-02bb3ae77e9c req-9b6645df-3ffb-4082-93d8-bae368404dad service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received event network-vif-unplugged-8354cc56-3d78-4f7a-b2fa-ee95e704d67c {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7e482b3a-8928-44c0-80d9-02bb3ae77e9c req-9b6645df-3ffb-4082-93d8-bae368404dad service nova] Acquiring lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7e482b3a-8928-44c0-80d9-02bb3ae77e9c req-9b6645df-3ffb-4082-93d8-bae368404dad service nova] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7e482b3a-8928-44c0-80d9-02bb3ae77e9c req-9b6645df-3ffb-4082-93d8-bae368404dad service nova] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG nova.compute.manager [req-7e482b3a-8928-44c0-80d9-02bb3ae77e9c req-9b6645df-3ffb-4082-93d8-bae368404dad service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] No waiting events found dispatching network-vif-unplugged-8354cc56-3d78-4f7a-b2fa-ee95e704d67c {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG nova.compute.manager [req-7e482b3a-8928-44c0-80d9-02bb3ae77e9c req-9b6645df-3ffb-4082-93d8-bae368404dad service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received event network-vif-unplugged-8354cc56-3d78-4f7a-b2fa-ee95e704d67c for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG nova.compute.manager [req-7e482b3a-8928-44c0-80d9-02bb3ae77e9c req-9b6645df-3ffb-4082-93d8-bae368404dad service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received event network-vif-plugged-8354cc56-3d78-4f7a-b2fa-ee95e704d67c {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7e482b3a-8928-44c0-80d9-02bb3ae77e9c req-9b6645df-3ffb-4082-93d8-bae368404dad service nova] Acquiring lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7e482b3a-8928-44c0-80d9-02bb3ae77e9c req-9b6645df-3ffb-4082-93d8-bae368404dad service nova] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7e482b3a-8928-44c0-80d9-02bb3ae77e9c req-9b6645df-3ffb-4082-93d8-bae368404dad service nova] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG nova.compute.manager [req-7e482b3a-8928-44c0-80d9-02bb3ae77e9c req-9b6645df-3ffb-4082-93d8-bae368404dad service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] No waiting events found dispatching network-vif-plugged-8354cc56-3d78-4f7a-b2fa-ee95e704d67c {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:55:59 user nova-compute[71113]: WARNING nova.compute.manager [req-7e482b3a-8928-44c0-80d9-02bb3ae77e9c req-9b6645df-3ffb-4082-93d8-bae368404dad service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received unexpected event network-vif-plugged-8354cc56-3d78-4f7a-b2fa-ee95e704d67c for instance with vm_state active and task_state deleting.
Jul 31 09:55:59 user nova-compute[71113]: DEBUG nova.compute.manager [req-7e482b3a-8928-44c0-80d9-02bb3ae77e9c req-9b6645df-3ffb-4082-93d8-bae368404dad service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received event network-vif-unplugged-685563e0-3264-4974-9df4-c9187df31d0b {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7e482b3a-8928-44c0-80d9-02bb3ae77e9c req-9b6645df-3ffb-4082-93d8-bae368404dad service nova] Acquiring lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7e482b3a-8928-44c0-80d9-02bb3ae77e9c req-9b6645df-3ffb-4082-93d8-bae368404dad service nova] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7e482b3a-8928-44c0-80d9-02bb3ae77e9c req-9b6645df-3ffb-4082-93d8-bae368404dad service nova] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG nova.compute.manager [req-7e482b3a-8928-44c0-80d9-02bb3ae77e9c req-9b6645df-3ffb-4082-93d8-bae368404dad service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] No waiting events found dispatching network-vif-unplugged-685563e0-3264-4974-9df4-c9187df31d0b {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG nova.compute.manager [req-7e482b3a-8928-44c0-80d9-02bb3ae77e9c req-9b6645df-3ffb-4082-93d8-bae368404dad service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received event network-vif-unplugged-685563e0-3264-4974-9df4-c9187df31d0b for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG nova.compute.manager [req-9514632a-ac71-4296-9516-9f5da3bfbdb6 req-6aba4cfa-71d3-4017-b658-e3ad5f7e8576 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received event network-vif-plugged-cb50bad1-1e1e-4138-8b0b-f7dc17d0d760 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9514632a-ac71-4296-9516-9f5da3bfbdb6 req-6aba4cfa-71d3-4017-b658-e3ad5f7e8576 service nova] Acquiring lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9514632a-ac71-4296-9516-9f5da3bfbdb6 req-6aba4cfa-71d3-4017-b658-e3ad5f7e8576 service nova] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9514632a-ac71-4296-9516-9f5da3bfbdb6 req-6aba4cfa-71d3-4017-b658-e3ad5f7e8576 service nova] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG nova.compute.manager [req-9514632a-ac71-4296-9516-9f5da3bfbdb6 req-6aba4cfa-71d3-4017-b658-e3ad5f7e8576 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] No waiting events found dispatching network-vif-plugged-cb50bad1-1e1e-4138-8b0b-f7dc17d0d760 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:55:59 user nova-compute[71113]: WARNING nova.compute.manager [req-9514632a-ac71-4296-9516-9f5da3bfbdb6 req-6aba4cfa-71d3-4017-b658-e3ad5f7e8576 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received unexpected event network-vif-plugged-cb50bad1-1e1e-4138-8b0b-f7dc17d0d760 for instance with vm_state active and task_state deleting.
Jul 31 09:55:59 user nova-compute[71113]: DEBUG nova.compute.manager [req-9514632a-ac71-4296-9516-9f5da3bfbdb6 req-6aba4cfa-71d3-4017-b658-e3ad5f7e8576 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received event network-vif-unplugged-bcad9d15-2562-4660-93b0-91a32ac0c390 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9514632a-ac71-4296-9516-9f5da3bfbdb6 req-6aba4cfa-71d3-4017-b658-e3ad5f7e8576 service nova] Acquiring lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9514632a-ac71-4296-9516-9f5da3bfbdb6 req-6aba4cfa-71d3-4017-b658-e3ad5f7e8576 service nova] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9514632a-ac71-4296-9516-9f5da3bfbdb6 req-6aba4cfa-71d3-4017-b658-e3ad5f7e8576 service nova] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG nova.compute.manager [req-9514632a-ac71-4296-9516-9f5da3bfbdb6 req-6aba4cfa-71d3-4017-b658-e3ad5f7e8576 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] No waiting events found dispatching network-vif-unplugged-bcad9d15-2562-4660-93b0-91a32ac0c390 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG nova.compute.manager [req-9514632a-ac71-4296-9516-9f5da3bfbdb6 req-6aba4cfa-71d3-4017-b658-e3ad5f7e8576 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received event network-vif-unplugged-bcad9d15-2562-4660-93b0-91a32ac0c390 for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG nova.compute.manager [req-9514632a-ac71-4296-9516-9f5da3bfbdb6 req-6aba4cfa-71d3-4017-b658-e3ad5f7e8576 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received event network-vif-plugged-bcad9d15-2562-4660-93b0-91a32ac0c390 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9514632a-ac71-4296-9516-9f5da3bfbdb6 req-6aba4cfa-71d3-4017-b658-e3ad5f7e8576 service nova] Acquiring lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9514632a-ac71-4296-9516-9f5da3bfbdb6 req-6aba4cfa-71d3-4017-b658-e3ad5f7e8576 service nova] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9514632a-ac71-4296-9516-9f5da3bfbdb6 req-6aba4cfa-71d3-4017-b658-e3ad5f7e8576 service nova] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG nova.compute.manager [req-9514632a-ac71-4296-9516-9f5da3bfbdb6 req-6aba4cfa-71d3-4017-b658-e3ad5f7e8576 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] No waiting events found dispatching network-vif-plugged-bcad9d15-2562-4660-93b0-91a32ac0c390 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:55:59 user nova-compute[71113]: WARNING nova.compute.manager [req-9514632a-ac71-4296-9516-9f5da3bfbdb6 req-6aba4cfa-71d3-4017-b658-e3ad5f7e8576 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received unexpected event network-vif-plugged-bcad9d15-2562-4660-93b0-91a32ac0c390 for instance with vm_state active and task_state deleting.
Jul 31 09:55:59 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Instance destroyed successfully.
Jul 31 09:55:59 user nova-compute[71113]: DEBUG nova.objects.instance [None req-31ba4e49-5b40-43a9-9904-6b2fe7153ba8 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lazy-loading 'resources' on Instance uuid 1112a49d-27bd-4fc8-bae6-ec1decbb47db {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-31ba4e49-5b40-43a9-9904-6b2fe7153ba8 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:46:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-945276604',display_name='tempest-AttachVolumeTestJSON-server-945276604',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-945276604',id=4,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrh1mBzVZxlJvQ7fNDAygLsv+THMZUpGRA7FK4egW/8+4V1WnWdx5N/BO7+Js/uDb74ZnuQwIBHV28KCkKnxQdjKa1wMXR+/Fwf+zqW2yRjgeNcXtlxa12OdQcYhwsVfQ==',key_name='tempest-keypair-1526222779',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:46:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bae93d4fff5e4990bd9fe78e71d6d2d2',ramdisk_id='',reservation_id='r-l6z5atk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1230374483',owner_user_name='tempest-AttachVolumeTestJSON-1230374483-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:54:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07e8e7f9b62d452a88a29f333177c9d2',uuid=1112a49d-27bd-4fc8-bae6-ec1decbb47db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "647f984e-a9e3-4e49-9877-75ad4826e467", "address": "fa:16:3e:72:e2:f2", "network": {"id": "26352e29-fc15-48ac-be14-8af7a0c80219", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866093358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bae93d4fff5e4990bd9fe78e71d6d2d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647f984e-a9", "ovs_interfaceid": "647f984e-a9e3-4e49-9877-75ad4826e467", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-31ba4e49-5b40-43a9-9904-6b2fe7153ba8 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Converting VIF {"id": "647f984e-a9e3-4e49-9877-75ad4826e467", "address": "fa:16:3e:72:e2:f2", "network": {"id": "26352e29-fc15-48ac-be14-8af7a0c80219", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866093358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bae93d4fff5e4990bd9fe78e71d6d2d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647f984e-a9", "ovs_interfaceid": "647f984e-a9e3-4e49-9877-75ad4826e467", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-31ba4e49-5b40-43a9-9904-6b2fe7153ba8 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:e2:f2,bridge_name='br-int',has_traffic_filtering=True,id=647f984e-a9e3-4e49-9877-75ad4826e467,network=Network(26352e29-fc15-48ac-be14-8af7a0c80219),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap647f984e-a9') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG os_vif [None req-31ba4e49-5b40-43a9-9904-6b2fe7153ba8 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:e2:f2,bridge_name='br-int',has_traffic_filtering=True,id=647f984e-a9e3-4e49-9877-75ad4826e467,network=Network(26352e29-fc15-48ac-be14-8af7a0c80219),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap647f984e-a9') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap647f984e-a9, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:55:59 user nova-compute[71113]: INFO os_vif [None req-31ba4e49-5b40-43a9-9904-6b2fe7153ba8 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:e2:f2,bridge_name='br-int',has_traffic_filtering=True,id=647f984e-a9e3-4e49-9877-75ad4826e467,network=Network(26352e29-fc15-48ac-be14-8af7a0c80219),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap647f984e-a9')
Jul 31 09:55:59 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-31ba4e49-5b40-43a9-9904-6b2fe7153ba8 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Deleting instance files /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db_del
Jul 31 09:55:59 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-31ba4e49-5b40-43a9-9904-6b2fe7153ba8 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Deletion of /opt/stack/data/nova/instances/1112a49d-27bd-4fc8-bae6-ec1decbb47db_del complete
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[430eea2f-c2f7-4ce9-80fa-49bd28023c55]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71, portal: 172.16.0.220,3260]
Jul 31 09:55:59 user nova-compute[71113]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71, portal: 172.16.0.220,3260] successful.
Jul 31 09:55:59 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71 -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690797344.37221, 9a4b47dd-b335-4c2f-9dee-5421357a0ee1 => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:55:59 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] VM Stopped (Lifecycle Event)
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a73437e-fd87-45af-a143-9480a736be71 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG nova.compute.manager [req-f8a55865-34b5-4a46-a3d5-9c8ee267b43c req-39e38921-6bc0-46c6-a079-6f02f8417005 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received event network-vif-plugged-4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f8a55865-34b5-4a46-a3d5-9c8ee267b43c req-39e38921-6bc0-46c6-a079-6f02f8417005 service nova] Acquiring lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f8a55865-34b5-4a46-a3d5-9c8ee267b43c req-39e38921-6bc0-46c6-a079-6f02f8417005 service nova] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f8a55865-34b5-4a46-a3d5-9c8ee267b43c req-39e38921-6bc0-46c6-a079-6f02f8417005 service nova] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG nova.compute.manager [req-f8a55865-34b5-4a46-a3d5-9c8ee267b43c req-39e38921-6bc0-46c6-a079-6f02f8417005 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] No waiting events found dispatching network-vif-plugged-4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:55:59 user nova-compute[71113]: WARNING nova.compute.manager [req-f8a55865-34b5-4a46-a3d5-9c8ee267b43c req-39e38921-6bc0-46c6-a079-6f02f8417005 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received unexpected event network-vif-plugged-4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e for instance with vm_state active and task_state deleting.
Jul 31 09:55:59 user nova-compute[71113]: DEBUG nova.compute.manager [req-f8a55865-34b5-4a46-a3d5-9c8ee267b43c req-39e38921-6bc0-46c6-a079-6f02f8417005 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received event network-vif-unplugged-113cfbd7-7a98-4be6-af79-76777a24650c {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f8a55865-34b5-4a46-a3d5-9c8ee267b43c req-39e38921-6bc0-46c6-a079-6f02f8417005 service nova] Acquiring lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f8a55865-34b5-4a46-a3d5-9c8ee267b43c req-39e38921-6bc0-46c6-a079-6f02f8417005 service nova] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f8a55865-34b5-4a46-a3d5-9c8ee267b43c req-39e38921-6bc0-46c6-a079-6f02f8417005 service nova] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG nova.compute.manager [req-f8a55865-34b5-4a46-a3d5-9c8ee267b43c req-39e38921-6bc0-46c6-a079-6f02f8417005 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] No waiting events found dispatching network-vif-unplugged-113cfbd7-7a98-4be6-af79-76777a24650c {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG nova.compute.manager [req-f8a55865-34b5-4a46-a3d5-9c8ee267b43c req-39e38921-6bc0-46c6-a079-6f02f8417005 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received event network-vif-unplugged-113cfbd7-7a98-4be6-af79-76777a24650c for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG nova.compute.manager [req-f8a55865-34b5-4a46-a3d5-9c8ee267b43c req-39e38921-6bc0-46c6-a079-6f02f8417005 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received event network-vif-plugged-113cfbd7-7a98-4be6-af79-76777a24650c {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f8a55865-34b5-4a46-a3d5-9c8ee267b43c req-39e38921-6bc0-46c6-a079-6f02f8417005 service nova] Acquiring lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f8a55865-34b5-4a46-a3d5-9c8ee267b43c req-39e38921-6bc0-46c6-a079-6f02f8417005 service nova] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f8a55865-34b5-4a46-a3d5-9c8ee267b43c req-39e38921-6bc0-46c6-a079-6f02f8417005 service nova] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG nova.compute.manager [req-f8a55865-34b5-4a46-a3d5-9c8ee267b43c req-39e38921-6bc0-46c6-a079-6f02f8417005 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] No waiting events found dispatching network-vif-plugged-113cfbd7-7a98-4be6-af79-76777a24650c {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:55:59 user nova-compute[71113]: WARNING nova.compute.manager [req-f8a55865-34b5-4a46-a3d5-9c8ee267b43c req-39e38921-6bc0-46c6-a079-6f02f8417005 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received unexpected event network-vif-plugged-113cfbd7-7a98-4be6-af79-76777a24650c for instance with vm_state active and task_state deleting.
Jul 31 09:55:59 user nova-compute[71113]: DEBUG nova.compute.manager [req-f8a55865-34b5-4a46-a3d5-9c8ee267b43c req-39e38921-6bc0-46c6-a079-6f02f8417005 service nova] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Received event network-vif-unplugged-647f984e-a9e3-4e49-9877-75ad4826e467 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f8a55865-34b5-4a46-a3d5-9c8ee267b43c req-39e38921-6bc0-46c6-a079-6f02f8417005 service nova] Acquiring lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f8a55865-34b5-4a46-a3d5-9c8ee267b43c req-39e38921-6bc0-46c6-a079-6f02f8417005 service nova] Lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f8a55865-34b5-4a46-a3d5-9c8ee267b43c req-39e38921-6bc0-46c6-a079-6f02f8417005 service nova] Lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG nova.compute.manager [req-f8a55865-34b5-4a46-a3d5-9c8ee267b43c req-39e38921-6bc0-46c6-a079-6f02f8417005 service nova] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] No waiting events found dispatching network-vif-unplugged-647f984e-a9e3-4e49-9877-75ad4826e467 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG nova.compute.manager [req-f8a55865-34b5-4a46-a3d5-9c8ee267b43c req-39e38921-6bc0-46c6-a079-6f02f8417005 service nova] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Received event network-vif-unplugged-647f984e-a9e3-4e49-9877-75ad4826e467 for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG nova.compute.manager [req-f8a55865-34b5-4a46-a3d5-9c8ee267b43c req-39e38921-6bc0-46c6-a079-6f02f8417005 service nova] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Received event network-vif-plugged-647f984e-a9e3-4e49-9877-75ad4826e467 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f8a55865-34b5-4a46-a3d5-9c8ee267b43c req-39e38921-6bc0-46c6-a079-6f02f8417005 service nova] Acquiring lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f8a55865-34b5-4a46-a3d5-9c8ee267b43c req-39e38921-6bc0-46c6-a079-6f02f8417005 service nova] Lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f8a55865-34b5-4a46-a3d5-9c8ee267b43c req-39e38921-6bc0-46c6-a079-6f02f8417005 service nova] Lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG nova.compute.manager [req-f8a55865-34b5-4a46-a3d5-9c8ee267b43c req-39e38921-6bc0-46c6-a079-6f02f8417005 service nova] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] No waiting events found dispatching network-vif-plugged-647f984e-a9e3-4e49-9877-75ad4826e467 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:55:59 user nova-compute[71113]: WARNING nova.compute.manager [req-f8a55865-34b5-4a46-a3d5-9c8ee267b43c req-39e38921-6bc0-46c6-a079-6f02f8417005 service nova] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Received unexpected event network-vif-plugged-647f984e-a9e3-4e49-9877-75ad4826e467 for instance with vm_state active and task_state deleting.
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8086d1f-a5a4-4e02-b103-1cd94072c83d]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG nova.compute.manager [None req-b42257d7-a223-42ff-b1a8-ba2eeb651262 None None] [instance: 9a4b47dd-b335-4c2f-9dee-5421357a0ee1] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.416s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] <== disconnect_volume: return (421ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hFaPdzXH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:55:59 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:55:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:59 user nova-compute[71113]: INFO nova.compute.manager [None req-31ba4e49-5b40-43a9-9904-6b2fe7153ba8 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Took 0.98 seconds to destroy the instance on the hypervisor.
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo.service.loopingcall [None req-31ba4e49-5b40-43a9-9904-6b2fe7153ba8 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71113) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG nova.compute.manager [-] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Deallocating network for instance {{(pid=71113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] deallocate_for_instance() {{(pid=71113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ed5d0a-7000-42fb-ba1a-51e7316bc554]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[de30635a-5e61-4392-9573-9045c87aa4ae]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:55:59 user nova-compute[71113]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 (non-flash)
Jul 31 09:55:59 user nova-compute[71113]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef (non-flash)
Jul 31 09:55:59 user nova-compute[71113]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)
Jul 31 09:55:59 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:55:59 user nova-compute[71113]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 (non-flash)
Jul 31 09:55:59 user nova-compute[71113]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef (non-flash)
Jul 31 09:55:59 user nova-compute[71113]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)
Jul 31 09:55:59 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79083ac4c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef'): ({'sdg'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Removing single pathed devices sdg {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d523a9-4797-45cf-b9a8-1feda040caf7]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb96c1d-2dc1-457d-b0e3-ab3f431612a7]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Flushing IO for device /dev/sdg {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc8f594-4cc7-4476-9501-4361b618a30f]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.034s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e223146d-d92c-4c2d-8551-dff7ac3e7b99]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] SCSI volumes sdg have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb66ab2-d1d0-4e6d-8916-ac567904dd31]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[11af13cc-d157-4f7b-8484-de2cc488c9da]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef, portal: 172.16.0.220,3260]
Jul 31 09:55:59 user nova-compute[71113]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef, portal: 172.16.0.220,3260] successful.
Jul 31 09:55:59 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b024fcb4-69e7-4ad9-bcb6-0de7ec62a9ef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f557de-a9ce-4920-a4f3-5f45b4700c16]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] <== disconnect_volume: return (305ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SPTInQLJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:55:59 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:55:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6de0dfc-45df-46a7-a218-2bdd694b0b0e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66640b1-4d16-4f8c-811c-9b6ceeaf57de]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:55:59 user nova-compute[71113]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 (non-flash)
Jul 31 09:55:59 user nova-compute[71113]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)
Jul 31 09:55:59 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:55:59 user nova-compute[71113]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 (non-flash)
Jul 31 09:55:59 user nova-compute[71113]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)
Jul 31 09:55:59 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f78f06515a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16'): ({'sdf'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Removing single pathed devices sdf {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27a3db1-2456-48d0-9f7c-84445bfb53ae]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[488e5dc0-ae8f-4545-b8b6-6914a7496235]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Flushing IO for device /dev/sdf {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99ca710-ddf4-42da-8c72-5a4877b5a4ce]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.034s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ab081a-9ea2-4d4f-ba8c-bf5d8e348528]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] SCSI volumes sdf have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd159e65-5e97-477e-8857-0081462e54e7]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:55:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:56:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:56:00 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[023097fd-da67-493d-bff5-056e6c25293e]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:56:00 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16, portal: 172.16.0.220,3260]
Jul 31 09:56:00 user nova-compute[71113]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16, portal: 172.16.0.220,3260] successful.
Jul 31 09:56:00 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:56:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:56:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9fe201f-b1ba-4c0e-8426-14f6713d3d16 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:56:00 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[19baf338-5dd2-431b-9dc2-c5de79118060]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:56:00 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:56:00 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:56:00 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] <== disconnect_volume: return (284ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:56:00 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 09:56:00 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Deleting instance files /opt/stack/data/nova/instances/eb68aada-46ba-4798-a16e-bb2cacfcd747_del
Jul 31 09:56:00 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Deletion of /opt/stack/data/nova/instances/eb68aada-46ba-4798-a16e-bb2cacfcd747_del complete
Jul 31 09:56:00 user nova-compute[71113]: INFO nova.compute.manager [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Took 3.66 seconds to destroy the instance on the hypervisor.
Jul 31 09:56:00 user nova-compute[71113]: DEBUG oslo.service.loopingcall [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71113) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 09:56:00 user nova-compute[71113]: DEBUG nova.compute.manager [-] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Deallocating network for instance {{(pid=71113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 09:56:00 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] deallocate_for_instance() {{(pid=71113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 09:56:00 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:56:00 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Took 1.12 seconds to deallocate network for instance.
Jul 31 09:56:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-31ba4e49-5b40-43a9-9904-6b2fe7153ba8 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:56:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-31ba4e49-5b40-43a9-9904-6b2fe7153ba8 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:56:00 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-31ba4e49-5b40-43a9-9904-6b2fe7153ba8 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:56:00 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-31ba4e49-5b40-43a9-9904-6b2fe7153ba8 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:56:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-31ba4e49-5b40-43a9-9904-6b2fe7153ba8 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.342s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:56:01 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-31ba4e49-5b40-43a9-9904-6b2fe7153ba8 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Deleted allocations for instance 1112a49d-27bd-4fc8-bae6-ec1decbb47db
Jul 31 09:56:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-31ba4e49-5b40-43a9-9904-6b2fe7153ba8 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "1112a49d-27bd-4fc8-bae6-ec1decbb47db" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.699s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:56:01 user nova-compute[71113]: DEBUG nova.compute.manager [req-760623b0-5092-4c85-a211-3c08ec1ea0fd req-80ecb901-5efb-4d0c-9fe2-3ce5aa281f0f service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received event network-vif-plugged-685563e0-3264-4974-9df4-c9187df31d0b {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:56:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-760623b0-5092-4c85-a211-3c08ec1ea0fd req-80ecb901-5efb-4d0c-9fe2-3ce5aa281f0f service nova] Acquiring lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:56:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-760623b0-5092-4c85-a211-3c08ec1ea0fd req-80ecb901-5efb-4d0c-9fe2-3ce5aa281f0f service nova] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:56:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-760623b0-5092-4c85-a211-3c08ec1ea0fd req-80ecb901-5efb-4d0c-9fe2-3ce5aa281f0f service nova] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:56:01 user nova-compute[71113]: DEBUG nova.compute.manager [req-760623b0-5092-4c85-a211-3c08ec1ea0fd req-80ecb901-5efb-4d0c-9fe2-3ce5aa281f0f service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] No waiting events found dispatching network-vif-plugged-685563e0-3264-4974-9df4-c9187df31d0b {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:56:01 user nova-compute[71113]: WARNING nova.compute.manager [req-760623b0-5092-4c85-a211-3c08ec1ea0fd req-80ecb901-5efb-4d0c-9fe2-3ce5aa281f0f service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received unexpected event network-vif-plugged-685563e0-3264-4974-9df4-c9187df31d0b for instance with vm_state active and task_state deleting.
Jul 31 09:56:01 user nova-compute[71113]: DEBUG nova.compute.manager [req-3a14f8c3-65a1-4171-b5fd-d1d3b396b374 req-9d75e648-64ff-4673-93cb-f1665e3740c0 service nova] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Received event network-vif-deleted-647f984e-a9e3-4e49-9877-75ad4826e467 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:56:02 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:56:03 user nova-compute[71113]: DEBUG nova.compute.manager [req-ca64ec90-a925-492d-8f17-5ab28cf536fb req-00d1c275-21c1-4446-b2e7-592ce05975e9 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received event network-vif-deleted-4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:56:03 user nova-compute[71113]: INFO nova.compute.manager [req-ca64ec90-a925-492d-8f17-5ab28cf536fb req-00d1c275-21c1-4446-b2e7-592ce05975e9 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Neutron deleted interface 4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e; detaching it from the instance and deleting it from the info cache
Jul 31 09:56:03 user nova-compute[71113]: DEBUG nova.network.neutron [req-ca64ec90-a925-492d-8f17-5ab28cf536fb req-00d1c275-21c1-4446-b2e7-592ce05975e9 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Updating instance_info_cache with network_info: [{"id": "6f734493-7794-4e1e-a68b-4ce6995dadef", "address": "fa:16:3e:77:21:46", "network": {"id": "93576160-6eb8-473f-ad25-fc3bb5e10825", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155060213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f734493-77", "ovs_interfaceid": "6f734493-7794-4e1e-a68b-4ce6995dadef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8354cc56-3d78-4f7a-b2fa-ee95e704d67c", "address": "fa:16:3e:51:5b:97", "network": {"id": "93576160-6eb8-473f-ad25-fc3bb5e10825", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155060213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8354cc56-3d", "ovs_interfaceid": "8354cc56-3d78-4f7a-b2fa-ee95e704d67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cb50bad1-1e1e-4138-8b0b-f7dc17d0d760", "address": "fa:16:3e:64:4b:9d", "network": {"id": "93576160-6eb8-473f-ad25-fc3bb5e10825", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155060213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb50bad1-1e", "ovs_interfaceid": "cb50bad1-1e1e-4138-8b0b-f7dc17d0d760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "685563e0-3264-4974-9df4-c9187df31d0b", "address": "fa:16:3e:b6:98:ef", "network": {"id": "93576160-6eb8-473f-ad25-fc3bb5e10825", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155060213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap685563e0-32", "ovs_interfaceid": "685563e0-3264-4974-9df4-c9187df31d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "113cfbd7-7a98-4be6-af79-76777a24650c", "address": "fa:16:3e:1a:85:42", "network": {"id": "b15c2d5a-d882-480a-9d49-9f6991094b80", "bridge": "br-int", "label": "tempest-device-tagging-net2-323585513", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap113cfbd7-7a", "ovs_interfaceid": "113cfbd7-7a98-4be6-af79-76777a24650c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bcad9d15-2562-4660-93b0-91a32ac0c390", "address": "fa:16:3e:0f:b0:dc", "network": {"id": "b15c2d5a-d882-480a-9d49-9f6991094b80", "bridge": "br-int", "label": "tempest-device-tagging-net2-323585513", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcad9d15-25", "ovs_interfaceid": "bcad9d15-2562-4660-93b0-91a32ac0c390", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:56:03 user nova-compute[71113]: DEBUG nova.compute.manager [req-ca64ec90-a925-492d-8f17-5ab28cf536fb req-00d1c275-21c1-4446-b2e7-592ce05975e9 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Detach interface failed, port_id=4dcc0c50-3d89-4ac3-a176-f8cdcf163d7e, reason: Instance eb68aada-46ba-4798-a16e-bb2cacfcd747 could not be found. {{(pid=71113) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 09:56:03 user nova-compute[71113]: DEBUG nova.compute.manager [req-ca64ec90-a925-492d-8f17-5ab28cf536fb req-00d1c275-21c1-4446-b2e7-592ce05975e9 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received event network-vif-deleted-113cfbd7-7a98-4be6-af79-76777a24650c {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:56:03 user nova-compute[71113]: INFO nova.compute.manager [req-ca64ec90-a925-492d-8f17-5ab28cf536fb req-00d1c275-21c1-4446-b2e7-592ce05975e9 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Neutron deleted interface 113cfbd7-7a98-4be6-af79-76777a24650c; detaching it from the instance and deleting it from the info cache
Jul 31 09:56:03 user nova-compute[71113]: DEBUG nova.network.neutron [req-ca64ec90-a925-492d-8f17-5ab28cf536fb req-00d1c275-21c1-4446-b2e7-592ce05975e9 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Updating instance_info_cache with network_info: [{"id": "6f734493-7794-4e1e-a68b-4ce6995dadef", "address": "fa:16:3e:77:21:46", "network": {"id": "93576160-6eb8-473f-ad25-fc3bb5e10825", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155060213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f734493-77", "ovs_interfaceid": "6f734493-7794-4e1e-a68b-4ce6995dadef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8354cc56-3d78-4f7a-b2fa-ee95e704d67c", "address": "fa:16:3e:51:5b:97", "network": {"id": "93576160-6eb8-473f-ad25-fc3bb5e10825", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155060213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8354cc56-3d", "ovs_interfaceid": "8354cc56-3d78-4f7a-b2fa-ee95e704d67c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cb50bad1-1e1e-4138-8b0b-f7dc17d0d760", "address": "fa:16:3e:64:4b:9d", "network": {"id": "93576160-6eb8-473f-ad25-fc3bb5e10825", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155060213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb50bad1-1e", "ovs_interfaceid": "cb50bad1-1e1e-4138-8b0b-f7dc17d0d760", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "685563e0-3264-4974-9df4-c9187df31d0b", "address": "fa:16:3e:b6:98:ef", "network": {"id": "93576160-6eb8-473f-ad25-fc3bb5e10825", "bridge": "br-int", "label": "tempest-device-tagging-net1-1155060213", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap685563e0-32", "ovs_interfaceid": "685563e0-3264-4974-9df4-c9187df31d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bcad9d15-2562-4660-93b0-91a32ac0c390", "address": "fa:16:3e:0f:b0:dc", "network": {"id": "b15c2d5a-d882-480a-9d49-9f6991094b80", "bridge": "br-int", "label": "tempest-device-tagging-net2-323585513", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4db8c3c401c94419b4f534a20d60388c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcad9d15-25", "ovs_interfaceid": "bcad9d15-2562-4660-93b0-91a32ac0c390", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:56:03 user nova-compute[71113]: DEBUG nova.compute.manager [req-ca64ec90-a925-492d-8f17-5ab28cf536fb req-00d1c275-21c1-4446-b2e7-592ce05975e9 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Detach interface failed, port_id=113cfbd7-7a98-4be6-af79-76777a24650c, reason: Instance eb68aada-46ba-4798-a16e-bb2cacfcd747 could not be found. {{(pid=71113) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 09:56:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:56:04 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:56:04 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:56:04 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Took 4.64 seconds to deallocate network for instance.
Jul 31 09:56:05 user nova-compute[71113]: DEBUG nova.compute.manager [req-61a68dd1-fe3f-4bea-bab1-5d72788bb8ad req-aa3f4f17-75a1-43f0-9f12-c52445224294 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received event network-vif-deleted-685563e0-3264-4974-9df4-c9187df31d0b {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:56:05 user nova-compute[71113]: DEBUG nova.compute.manager [req-61a68dd1-fe3f-4bea-bab1-5d72788bb8ad req-aa3f4f17-75a1-43f0-9f12-c52445224294 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received event network-vif-deleted-bcad9d15-2562-4660-93b0-91a32ac0c390 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:56:05 user nova-compute[71113]: DEBUG nova.compute.manager [req-61a68dd1-fe3f-4bea-bab1-5d72788bb8ad req-aa3f4f17-75a1-43f0-9f12-c52445224294 service nova] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Received event network-vif-deleted-cb50bad1-1e1e-4138-8b0b-f7dc17d0d760 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:56:05 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:56:05 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:56:05 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:56:05 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:56:05 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:56:05 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:56:05 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:56:05 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 09:56:05 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 09:56:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92d25a03-98ce-4bde-a3cc-20313ae77d41/disk.rescue --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:56:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92d25a03-98ce-4bde-a3cc-20313ae77d41/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:56:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92d25a03-98ce-4bde-a3cc-20313ae77d41/disk.rescue --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:56:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92d25a03-98ce-4bde-a3cc-20313ae77d41/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:56:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4df9380-7882-48a6-ba64-bb17429e54ac/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:56:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4df9380-7882-48a6-ba64-bb17429e54ac/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:56:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4df9380-7882-48a6-ba64-bb17429e54ac/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:56:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4df9380-7882-48a6-ba64-bb17429e54ac/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:56:06 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 09:56:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:56:06 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690797351.5523977, 8d2948be-3ebb-4067-a0c8-e2ca884814ff => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:56:06 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] VM Stopped (Lifecycle Event)
Jul 31 09:56:06 user nova-compute[71113]: DEBUG nova.compute.manager [None req-c0e596f4-9555-40ae-a75b-f381d6aad410 None None] [instance: 8d2948be-3ebb-4067-a0c8-e2ca884814ff] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:56:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:56:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:56:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:56:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:56:07 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:56:07 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:56:07 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:56:07 user nova-compute[71113]: INFO nova.compute.manager [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Took 2.91 seconds to detach 3 volumes for instance.
Jul 31 09:56:07 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:56:07 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:56:07 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=8080MB free_disk=25.492286682128906GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 09:56:07 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:56:07 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:56:07 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:56:07 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 0ea0401b-26c2-4655-956b-1bc000debd53 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:56:07 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance f4df9380-7882-48a6-ba64-bb17429e54ac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:56:07 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 3157a7a6-b8a9-4e2d-a157-360bce4c625d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:56:07 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 92d25a03-98ce-4bde-a3cc-20313ae77d41 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:56:07 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance eb68aada-46ba-4798-a16e-bb2cacfcd747 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:56:07 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance a950d710-4596-4355-ac31-568c7728335a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:56:07 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 09:56:07 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 09:56:08 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:56:08 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:56:08 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 09:56:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.375s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:56:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.304s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:56:08 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:56:08 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:56:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.233s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:56:08 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Deleted allocations for instance eb68aada-46ba-4798-a16e-bb2cacfcd747
Jul 31 09:56:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f45c8a39-0bce-401e-b323-ea32b49a6874 tempest-TaggedBootDevicesTest-477255538 tempest-TaggedBootDevicesTest-477255538-project-member] Lock "eb68aada-46ba-4798-a16e-bb2cacfcd747" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.992s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:56:09 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:56:09 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:56:09 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 09:56:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:56:10 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:56:10 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 09:56:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "refresh_cache-f4df9380-7882-48a6-ba64-bb17429e54ac" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:56:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquired lock "refresh_cache-f4df9380-7882-48a6-ba64-bb17429e54ac" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:56:10 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Forcefully refreshing network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 09:56:11 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Updating instance_info_cache with network_info: [{"id": "14c27534-a6d1-4bfe-a5cf-1a4d9b573303", "address": "fa:16:3e:00:6e:63", "network": {"id": "4ab5c9f4-e78f-4bf2-bc82-ef698b714952", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1047934668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f88c00df40f46178f46c09cf14b88d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c27534-a6", "ovs_interfaceid": "14c27534-a6d1-4bfe-a5cf-1a4d9b573303", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:56:11 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Releasing lock "refresh_cache-f4df9380-7882-48a6-ba64-bb17429e54ac" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:56:11 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Updated the network info_cache for instance {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 09:56:11 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:56:12 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:56:13 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690797358.2888126, eb68aada-46ba-4798-a16e-bb2cacfcd747 => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:56:13 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] VM Stopped (Lifecycle Event)
Jul 31 09:56:13 user nova-compute[71113]: DEBUG nova.compute.manager [None req-d75d1c58-e0da-42a3-8228-48fd0a8ea6a1 None None] [instance: eb68aada-46ba-4798-a16e-bb2cacfcd747] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:56:13 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:56:14 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690797359.2754798, 1112a49d-27bd-4fc8-bae6-ec1decbb47db => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:56:14 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] VM Stopped (Lifecycle Event)
Jul 31 09:56:14 user nova-compute[71113]: DEBUG nova.compute.manager [None req-faca3dc2-3194-41c4-9332-cd62f7d19ff1 None None] [instance: 1112a49d-27bd-4fc8-bae6-ec1decbb47db] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:56:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:56:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:56:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:56:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:56:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:56:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:56:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:56:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:56:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:56:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:56:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:56:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:56:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:56:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:56:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:56:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:56:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:56:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:56:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:56:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:56:44 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Acquiring lock "208130bc-5ece-4683-aa83-505ee89a8ba5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:56:44 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "208130bc-5ece-4683-aa83-505ee89a8ba5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:56:45 user nova-compute[71113]: DEBUG nova.compute.manager [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Starting instance... {{(pid=71113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 09:56:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:56:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:56:45 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 09:56:45 user nova-compute[71113]: INFO nova.compute.claims [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Claim successful on node user
Jul 31 09:56:45 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:56:45 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:56:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.323s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:56:45 user nova-compute[71113]: DEBUG nova.compute.manager [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Start building networks asynchronously for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 09:56:45 user nova-compute[71113]: DEBUG nova.compute.manager [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Allocating IP information in the background. {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 09:56:45 user nova-compute[71113]: DEBUG nova.network.neutron [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] allocate_for_instance() {{(pid=71113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 09:56:45 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 09:56:45 user nova-compute[71113]: DEBUG nova.compute.manager [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Start building block device mappings for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 09:56:45 user nova-compute[71113]: DEBUG nova.compute.manager [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Start spawning the instance on the hypervisor. {{(pid=71113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 09:56:45 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 09:56:45 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Creating image(s)
Jul 31 09:56:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Acquiring lock "/opt/stack/data/nova/instances/208130bc-5ece-4683-aa83-505ee89a8ba5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:56:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "/opt/stack/data/nova/instances/208130bc-5ece-4683-aa83-505ee89a8ba5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:56:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "/opt/stack/data/nova/instances/208130bc-5ece-4683-aa83-505ee89a8ba5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:56:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:56:45 user nova-compute[71113]: DEBUG nova.policy [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b5199c7da0634b6e8111782122adcf70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4461b48e5470471d8fe1b61fb8af9c8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71113) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 09:56:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.148s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:56:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Acquiring lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:56:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:56:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:56:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.134s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:56:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/208130bc-5ece-4683-aa83-505ee89a8ba5/disk 1073741824 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:56:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/208130bc-5ece-4683-aa83-505ee89a8ba5/disk 1073741824" returned: 0 in 0.051s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:56:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:56:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:56:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.149s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:56:46 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Checking if we can resize image /opt/stack/data/nova/instances/208130bc-5ece-4683-aa83-505ee89a8ba5/disk. size=1073741824 {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 09:56:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/208130bc-5ece-4683-aa83-505ee89a8ba5/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:56:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/208130bc-5ece-4683-aa83-505ee89a8ba5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:56:46 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Cannot resize image /opt/stack/data/nova/instances/208130bc-5ece-4683-aa83-505ee89a8ba5/disk to a smaller size. {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 09:56:46 user nova-compute[71113]: DEBUG nova.objects.instance [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lazy-loading 'migration_context' on Instance uuid 208130bc-5ece-4683-aa83-505ee89a8ba5 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:56:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Created local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 09:56:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Ensure instance console log exists: /opt/stack/data/nova/instances/208130bc-5ece-4683-aa83-505ee89a8ba5/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 09:56:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:56:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:56:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:56:47 user nova-compute[71113]: DEBUG nova.network.neutron [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Successfully created port: d8cb465d-1593-4491-b337-8528c1bcfb3e {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 09:56:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:56:48 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:56:49 user nova-compute[71113]: DEBUG nova.network.neutron [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Successfully updated port: d8cb465d-1593-4491-b337-8528c1bcfb3e {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 09:56:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Acquiring lock "refresh_cache-208130bc-5ece-4683-aa83-505ee89a8ba5" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:56:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Acquired lock "refresh_cache-208130bc-5ece-4683-aa83-505ee89a8ba5" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:56:49 user nova-compute[71113]: DEBUG nova.network.neutron [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 09:56:49 user nova-compute[71113]: DEBUG nova.network.neutron [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 09:56:49 user nova-compute[71113]: DEBUG nova.compute.manager [req-ec850319-808f-4a16-994f-119fa27c37d7 req-4d95787f-4972-4512-af50-afcbb6e047b8 service nova] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Received event network-changed-d8cb465d-1593-4491-b337-8528c1bcfb3e {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:56:49 user nova-compute[71113]: DEBUG nova.compute.manager [req-ec850319-808f-4a16-994f-119fa27c37d7 req-4d95787f-4972-4512-af50-afcbb6e047b8 service nova] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Refreshing instance network info cache due to event network-changed-d8cb465d-1593-4491-b337-8528c1bcfb3e. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:56:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ec850319-808f-4a16-994f-119fa27c37d7 req-4d95787f-4972-4512-af50-afcbb6e047b8 service nova] Acquiring lock "refresh_cache-208130bc-5ece-4683-aa83-505ee89a8ba5" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:56:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:56:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:56:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:56:49 user nova-compute[71113]: DEBUG nova.network.neutron [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Updating instance_info_cache with network_info: [{"id": "d8cb465d-1593-4491-b337-8528c1bcfb3e", "address": "fa:16:3e:bb:b2:fd", "network": {"id": "e498d93a-703d-4d19-9adf-61469f37d4da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1320431580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4461b48e5470471d8fe1b61fb8af9c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8cb465d-15", "ovs_interfaceid": "d8cb465d-1593-4491-b337-8528c1bcfb3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:56:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Releasing lock "refresh_cache-208130bc-5ece-4683-aa83-505ee89a8ba5" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:56:49 user nova-compute[71113]: DEBUG nova.compute.manager [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Instance network_info: |[{"id": "d8cb465d-1593-4491-b337-8528c1bcfb3e", "address": "fa:16:3e:bb:b2:fd", "network": {"id": "e498d93a-703d-4d19-9adf-61469f37d4da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1320431580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4461b48e5470471d8fe1b61fb8af9c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8cb465d-15", "ovs_interfaceid": "d8cb465d-1593-4491-b337-8528c1bcfb3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 09:56:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ec850319-808f-4a16-994f-119fa27c37d7 req-4d95787f-4972-4512-af50-afcbb6e047b8 service nova] Acquired lock "refresh_cache-208130bc-5ece-4683-aa83-505ee89a8ba5" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:56:49 user nova-compute[71113]: DEBUG nova.network.neutron [req-ec850319-808f-4a16-994f-119fa27c37d7 req-4d95787f-4972-4512-af50-afcbb6e047b8 service nova] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Refreshing network info cache for port d8cb465d-1593-4491-b337-8528c1bcfb3e {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:56:49 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Start _get_guest_xml network_info=[{"id": "d8cb465d-1593-4491-b337-8528c1bcfb3e", "address": "fa:16:3e:bb:b2:fd", "network": {"id": "e498d93a-703d-4d19-9adf-61469f37d4da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1320431580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4461b48e5470471d8fe1b61fb8af9c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8cb465d-15", "ovs_interfaceid": "d8cb465d-1593-4491-b337-8528c1bcfb3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'image_id': '078646fe-b504-41ed-a147-61072e903e51'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 09:56:49 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:56:49 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:56:49 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 09:56:49 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 09:56:49 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 09:56:49 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 09:56:49 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 09:56:49 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 09:56:49 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 09:56:49 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 09:56:49 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 09:56:49 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 09:56:49 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 09:56:49 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 09:56:49 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 09:56:49 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 09:56:49 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 09:56:49 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 09:56:49 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:56:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-97586711',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-97586711',id=24,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+v3MPsTIfHcpTY6Yc9MWbbovJf56dPzvszMKErbyp/5ES3uvJPZ3C4p1soQ6orjbgw1Ikn6UYVzPxqHqb5fC5p2P+Nz5lCYomH/HxtkCE/snnyG2rynWTcNbrs5qIdaQ==',key_name='tempest-keypair-1581132008',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4461b48e5470471d8fe1b61fb8af9c8d',ramdisk_id='',reservation_id='r-q8o5zbgt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-960167684',owner_user_name='tempest-AttachVolumeShelveTestJSON-960167684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:56:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5199c7da0634b6e8111782122adcf70',uuid=208130bc-5ece-4683-aa83-505ee89a8ba5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8cb465d-1593-4491-b337-8528c1bcfb3e", "address": "fa:16:3e:bb:b2:fd", "network": {"id": "e498d93a-703d-4d19-9adf-61469f37d4da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1320431580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4461b48e5470471d8fe1b61fb8af9c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8cb465d-15", "ovs_interfaceid": "d8cb465d-1593-4491-b337-8528c1bcfb3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 09:56:49 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Converting VIF {"id": "d8cb465d-1593-4491-b337-8528c1bcfb3e", "address": "fa:16:3e:bb:b2:fd", "network": {"id": "e498d93a-703d-4d19-9adf-61469f37d4da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1320431580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4461b48e5470471d8fe1b61fb8af9c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8cb465d-15", "ovs_interfaceid": "d8cb465d-1593-4491-b337-8528c1bcfb3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:56:49 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:b2:fd,bridge_name='br-int',has_traffic_filtering=True,id=d8cb465d-1593-4491-b337-8528c1bcfb3e,network=Network(e498d93a-703d-4d19-9adf-61469f37d4da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8cb465d-15') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:56:49 user nova-compute[71113]: DEBUG nova.objects.instance [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lazy-loading 'pci_devices' on Instance uuid 208130bc-5ece-4683-aa83-505ee89a8ba5 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:56:49 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] End _get_guest_xml xml=<domain type="kvm">
Jul 31 09:56:49 user nova-compute[71113]:   <uuid>208130bc-5ece-4683-aa83-505ee89a8ba5</uuid>
Jul 31 09:56:49 user nova-compute[71113]:   <name>instance-00000018</name>
Jul 31 09:56:49 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 09:56:49 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 09:56:49 user nova-compute[71113]:   <metadata>
Jul 31 09:56:49 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 09:56:49 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 09:56:49 user nova-compute[71113]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-97586711</nova:name>
Jul 31 09:56:49 user nova-compute[71113]:       <nova:creationTime>2023-07-31 09:56:49</nova:creationTime>
Jul 31 09:56:49 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 09:56:49 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 09:56:49 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 09:56:49 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 09:56:49 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 09:56:49 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 09:56:49 user nova-compute[71113]:       </nova:flavor>
Jul 31 09:56:49 user nova-compute[71113]:       <nova:owner>
Jul 31 09:56:49 user nova-compute[71113]:         <nova:user uuid="b5199c7da0634b6e8111782122adcf70">tempest-AttachVolumeShelveTestJSON-960167684-project-member</nova:user>
Jul 31 09:56:49 user nova-compute[71113]:         <nova:project uuid="4461b48e5470471d8fe1b61fb8af9c8d">tempest-AttachVolumeShelveTestJSON-960167684</nova:project>
Jul 31 09:56:49 user nova-compute[71113]:       </nova:owner>
Jul 31 09:56:49 user nova-compute[71113]:       <nova:root type="image" uuid="078646fe-b504-41ed-a147-61072e903e51"/>
Jul 31 09:56:49 user nova-compute[71113]:       <nova:ports>
Jul 31 09:56:49 user nova-compute[71113]:         <nova:port uuid="d8cb465d-1593-4491-b337-8528c1bcfb3e">
Jul 31 09:56:49 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 31 09:56:49 user nova-compute[71113]:         </nova:port>
Jul 31 09:56:49 user nova-compute[71113]:       </nova:ports>
Jul 31 09:56:49 user nova-compute[71113]:     </nova:instance>
Jul 31 09:56:49 user nova-compute[71113]:   </metadata>
Jul 31 09:56:49 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 09:56:49 user nova-compute[71113]:     <system>
Jul 31 09:56:49 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 09:56:49 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 09:56:49 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 09:56:49 user nova-compute[71113]:       <entry name="serial">208130bc-5ece-4683-aa83-505ee89a8ba5</entry>
Jul 31 09:56:49 user nova-compute[71113]:       <entry name="uuid">208130bc-5ece-4683-aa83-505ee89a8ba5</entry>
Jul 31 09:56:49 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 09:56:49 user nova-compute[71113]:     </system>
Jul 31 09:56:49 user nova-compute[71113]:   </sysinfo>
Jul 31 09:56:49 user nova-compute[71113]:   <os>
Jul 31 09:56:49 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 09:56:49 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 09:56:49 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 09:56:49 user nova-compute[71113]:   </os>
Jul 31 09:56:49 user nova-compute[71113]:   <features>
Jul 31 09:56:49 user nova-compute[71113]:     <acpi/>
Jul 31 09:56:49 user nova-compute[71113]:     <apic/>
Jul 31 09:56:49 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 09:56:49 user nova-compute[71113]:   </features>
Jul 31 09:56:49 user nova-compute[71113]:   <clock offset="utc">
Jul 31 09:56:49 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 09:56:49 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 09:56:49 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 09:56:49 user nova-compute[71113]:   </clock>
Jul 31 09:56:49 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 09:56:49 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 09:56:49 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 09:56:49 user nova-compute[71113]:   </cpu>
Jul 31 09:56:49 user nova-compute[71113]:   <devices>
Jul 31 09:56:49 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 09:56:49 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 09:56:49 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/208130bc-5ece-4683-aa83-505ee89a8ba5/disk"/>
Jul 31 09:56:49 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 09:56:49 user nova-compute[71113]:     </disk>
Jul 31 09:56:49 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 09:56:49 user nova-compute[71113]:       <mac address="fa:16:3e:bb:b2:fd"/>
Jul 31 09:56:49 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:56:49 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 09:56:49 user nova-compute[71113]:       <target dev="tapd8cb465d-15"/>
Jul 31 09:56:49 user nova-compute[71113]:     </interface>
Jul 31 09:56:49 user nova-compute[71113]:     <serial type="pty">
Jul 31 09:56:49 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/208130bc-5ece-4683-aa83-505ee89a8ba5/console.log" append="off"/>
Jul 31 09:56:49 user nova-compute[71113]:     </serial>
Jul 31 09:56:49 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 09:56:49 user nova-compute[71113]:     <video>
Jul 31 09:56:49 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:56:49 user nova-compute[71113]:     </video>
Jul 31 09:56:49 user nova-compute[71113]:     <rng model="virtio">
Jul 31 09:56:49 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 09:56:49 user nova-compute[71113]:     </rng>
Jul 31 09:56:49 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 09:56:49 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 09:56:49 user nova-compute[71113]:       <stats period="10"/>
Jul 31 09:56:49 user nova-compute[71113]:     </memballoon>
Jul 31 09:56:49 user nova-compute[71113]:   </devices>
Jul 31 09:56:49 user nova-compute[71113]: </domain>
Jul 31 09:56:49 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 09:56:49 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:56:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-97586711',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-97586711',id=24,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+v3MPsTIfHcpTY6Yc9MWbbovJf56dPzvszMKErbyp/5ES3uvJPZ3C4p1soQ6orjbgw1Ikn6UYVzPxqHqb5fC5p2P+Nz5lCYomH/HxtkCE/snnyG2rynWTcNbrs5qIdaQ==',key_name='tempest-keypair-1581132008',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4461b48e5470471d8fe1b61fb8af9c8d',ramdisk_id='',reservation_id='r-q8o5zbgt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-960167684',owner_user_name='tempest-AttachVolumeShelveTestJSON-960167684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:56:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5199c7da0634b6e8111782122adcf70',uuid=208130bc-5ece-4683-aa83-505ee89a8ba5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8cb465d-1593-4491-b337-8528c1bcfb3e", "address": "fa:16:3e:bb:b2:fd", "network": {"id": "e498d93a-703d-4d19-9adf-61469f37d4da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1320431580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4461b48e5470471d8fe1b61fb8af9c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8cb465d-15", "ovs_interfaceid": "d8cb465d-1593-4491-b337-8528c1bcfb3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 09:56:49 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Converting VIF {"id": "d8cb465d-1593-4491-b337-8528c1bcfb3e", "address": "fa:16:3e:bb:b2:fd", "network": {"id": "e498d93a-703d-4d19-9adf-61469f37d4da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1320431580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4461b48e5470471d8fe1b61fb8af9c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8cb465d-15", "ovs_interfaceid": "d8cb465d-1593-4491-b337-8528c1bcfb3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:56:49 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:b2:fd,bridge_name='br-int',has_traffic_filtering=True,id=d8cb465d-1593-4491-b337-8528c1bcfb3e,network=Network(e498d93a-703d-4d19-9adf-61469f37d4da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8cb465d-15') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:56:49 user nova-compute[71113]: DEBUG os_vif [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:b2:fd,bridge_name='br-int',has_traffic_filtering=True,id=d8cb465d-1593-4491-b337-8528c1bcfb3e,network=Network(e498d93a-703d-4d19-9adf-61469f37d4da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8cb465d-15') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 09:56:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:56:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:56:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 09:56:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:56:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd8cb465d-15, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:56:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd8cb465d-15, col_values=(('external_ids', {'iface-id': 'd8cb465d-1593-4491-b337-8528c1bcfb3e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:b2:fd', 'vm-uuid': '208130bc-5ece-4683-aa83-505ee89a8ba5'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:56:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:56:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:56:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:56:49 user nova-compute[71113]: INFO os_vif [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:b2:fd,bridge_name='br-int',has_traffic_filtering=True,id=d8cb465d-1593-4491-b337-8528c1bcfb3e,network=Network(e498d93a-703d-4d19-9adf-61469f37d4da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8cb465d-15')
Jul 31 09:56:49 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:56:49 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] No VIF found with MAC fa:16:3e:bb:b2:fd, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 09:56:50 user nova-compute[71113]: DEBUG nova.network.neutron [req-ec850319-808f-4a16-994f-119fa27c37d7 req-4d95787f-4972-4512-af50-afcbb6e047b8 service nova] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Updated VIF entry in instance network info cache for port d8cb465d-1593-4491-b337-8528c1bcfb3e. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:56:50 user nova-compute[71113]: DEBUG nova.network.neutron [req-ec850319-808f-4a16-994f-119fa27c37d7 req-4d95787f-4972-4512-af50-afcbb6e047b8 service nova] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Updating instance_info_cache with network_info: [{"id": "d8cb465d-1593-4491-b337-8528c1bcfb3e", "address": "fa:16:3e:bb:b2:fd", "network": {"id": "e498d93a-703d-4d19-9adf-61469f37d4da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1320431580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4461b48e5470471d8fe1b61fb8af9c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8cb465d-15", "ovs_interfaceid": "d8cb465d-1593-4491-b337-8528c1bcfb3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:56:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ec850319-808f-4a16-994f-119fa27c37d7 req-4d95787f-4972-4512-af50-afcbb6e047b8 service nova] Releasing lock "refresh_cache-208130bc-5ece-4683-aa83-505ee89a8ba5" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:56:51 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:56:51 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:56:52 user nova-compute[71113]: DEBUG nova.compute.manager [req-f516fb55-3a97-41f8-832a-00ea4f70cc71 req-0b844f8c-78d2-4fea-bb08-0fe4854c71c7 service nova] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Received event network-vif-plugged-d8cb465d-1593-4491-b337-8528c1bcfb3e {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:56:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f516fb55-3a97-41f8-832a-00ea4f70cc71 req-0b844f8c-78d2-4fea-bb08-0fe4854c71c7 service nova] Acquiring lock "208130bc-5ece-4683-aa83-505ee89a8ba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:56:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f516fb55-3a97-41f8-832a-00ea4f70cc71 req-0b844f8c-78d2-4fea-bb08-0fe4854c71c7 service nova] Lock "208130bc-5ece-4683-aa83-505ee89a8ba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:56:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f516fb55-3a97-41f8-832a-00ea4f70cc71 req-0b844f8c-78d2-4fea-bb08-0fe4854c71c7 service nova] Lock "208130bc-5ece-4683-aa83-505ee89a8ba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:56:52 user nova-compute[71113]: DEBUG nova.compute.manager [req-f516fb55-3a97-41f8-832a-00ea4f70cc71 req-0b844f8c-78d2-4fea-bb08-0fe4854c71c7 service nova] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] No waiting events found dispatching network-vif-plugged-d8cb465d-1593-4491-b337-8528c1bcfb3e {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:56:52 user nova-compute[71113]: WARNING nova.compute.manager [req-f516fb55-3a97-41f8-832a-00ea4f70cc71 req-0b844f8c-78d2-4fea-bb08-0fe4854c71c7 service nova] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Received unexpected event network-vif-plugged-d8cb465d-1593-4491-b337-8528c1bcfb3e for instance with vm_state building and task_state spawning.
Jul 31 09:56:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:56:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:56:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:56:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:56:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:56:53 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797413.6534078, 208130bc-5ece-4683-aa83-505ee89a8ba5 => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:56:53 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] VM Resumed (Lifecycle Event)
Jul 31 09:56:53 user nova-compute[71113]: DEBUG nova.compute.manager [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 09:56:53 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 09:56:53 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Instance spawned successfully.
Jul 31 09:56:53 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 09:56:53 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:56:53 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:56:53 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Found default for hw_cdrom_bus of ide {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:56:53 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Found default for hw_disk_bus of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:56:53 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Found default for hw_input_bus of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:56:53 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Found default for hw_pointer_model of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:56:53 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Found default for hw_video_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:56:53 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Found default for hw_vif_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:56:53 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:56:53 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797413.6544209, 208130bc-5ece-4683-aa83-505ee89a8ba5 => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:56:53 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] VM Started (Lifecycle Event)
Jul 31 09:56:53 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:56:53 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:56:53 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:56:53 user nova-compute[71113]: INFO nova.compute.manager [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Took 8.15 seconds to spawn the instance on the hypervisor.
Jul 31 09:56:53 user nova-compute[71113]: DEBUG nova.compute.manager [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:56:53 user nova-compute[71113]: INFO nova.compute.manager [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Took 8.87 seconds to build instance.
Jul 31 09:56:53 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:56:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-245ba2b8-b5cf-4bd4-bba2-dcc13e882c14 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "208130bc-5ece-4683-aa83-505ee89a8ba5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.996s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:56:54 user nova-compute[71113]: DEBUG nova.compute.manager [req-747ec4a9-aaa3-438a-a28e-9074df2849cc req-ee31aa8c-1783-46ba-8ce1-95ee1168e44b service nova] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Received event network-vif-plugged-d8cb465d-1593-4491-b337-8528c1bcfb3e {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:56:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-747ec4a9-aaa3-438a-a28e-9074df2849cc req-ee31aa8c-1783-46ba-8ce1-95ee1168e44b service nova] Acquiring lock "208130bc-5ece-4683-aa83-505ee89a8ba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:56:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-747ec4a9-aaa3-438a-a28e-9074df2849cc req-ee31aa8c-1783-46ba-8ce1-95ee1168e44b service nova] Lock "208130bc-5ece-4683-aa83-505ee89a8ba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:56:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-747ec4a9-aaa3-438a-a28e-9074df2849cc req-ee31aa8c-1783-46ba-8ce1-95ee1168e44b service nova] Lock "208130bc-5ece-4683-aa83-505ee89a8ba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:56:54 user nova-compute[71113]: DEBUG nova.compute.manager [req-747ec4a9-aaa3-438a-a28e-9074df2849cc req-ee31aa8c-1783-46ba-8ce1-95ee1168e44b service nova] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] No waiting events found dispatching network-vif-plugged-d8cb465d-1593-4491-b337-8528c1bcfb3e {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:56:54 user nova-compute[71113]: WARNING nova.compute.manager [req-747ec4a9-aaa3-438a-a28e-9074df2849cc req-ee31aa8c-1783-46ba-8ce1-95ee1168e44b service nova] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Received unexpected event network-vif-plugged-d8cb465d-1593-4491-b337-8528c1bcfb3e for instance with vm_state active and task_state None.
Jul 31 09:56:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:56:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:56:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:56:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Acquiring lock "5f69d43c-f8a3-4fed-a737-389c217970d8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:56:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Lock "5f69d43c-f8a3-4fed-a737-389c217970d8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:56:56 user nova-compute[71113]: DEBUG nova.compute.manager [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Starting instance... {{(pid=71113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 09:56:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:56:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:56:56 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 09:56:56 user nova-compute[71113]: INFO nova.compute.claims [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Claim successful on node user
Jul 31 09:56:56 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:56:56 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:56:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.578s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:56:57 user nova-compute[71113]: DEBUG nova.compute.manager [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Start building networks asynchronously for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 09:56:57 user nova-compute[71113]: DEBUG nova.compute.manager [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Allocating IP information in the background. {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 09:56:57 user nova-compute[71113]: DEBUG nova.network.neutron [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] allocate_for_instance() {{(pid=71113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 09:56:57 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 09:56:57 user nova-compute[71113]: DEBUG nova.compute.manager [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Start building block device mappings for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 09:56:57 user nova-compute[71113]: DEBUG nova.policy [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '652ff6eb4a134b36810f8db3e29fc2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb7c2bc45154315952e1485b921a1c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71113) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 09:56:57 user nova-compute[71113]: DEBUG nova.compute.manager [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Start spawning the instance on the hypervisor. {{(pid=71113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 09:56:57 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 09:56:57 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Creating image(s)
Jul 31 09:56:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Acquiring lock "/opt/stack/data/nova/instances/5f69d43c-f8a3-4fed-a737-389c217970d8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:56:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Lock "/opt/stack/data/nova/instances/5f69d43c-f8a3-4fed-a737-389c217970d8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:56:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Lock "/opt/stack/data/nova/instances/5f69d43c-f8a3-4fed-a737-389c217970d8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:56:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:56:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.184s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:56:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Acquiring lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:56:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:56:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:56:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.157s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:56:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/5f69d43c-f8a3-4fed-a737-389c217970d8/disk 1073741824 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:56:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/5f69d43c-f8a3-4fed-a737-389c217970d8/disk 1073741824" returned: 0 in 0.094s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:56:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:56:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:56:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.199s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:56:57 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5f69d43c-f8a3-4fed-a737-389c217970d8/disk. size=1073741824 {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 09:56:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f69d43c-f8a3-4fed-a737-389c217970d8/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:56:58 user nova-compute[71113]: DEBUG nova.network.neutron [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Successfully created port: 1343cd85-d61a-4c60-bd8f-50712b92b769 {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 09:56:58 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f69d43c-f8a3-4fed-a737-389c217970d8/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:56:58 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Cannot resize image /opt/stack/data/nova/instances/5f69d43c-f8a3-4fed-a737-389c217970d8/disk to a smaller size. {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 09:56:58 user nova-compute[71113]: DEBUG nova.objects.instance [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Lazy-loading 'migration_context' on Instance uuid 5f69d43c-f8a3-4fed-a737-389c217970d8 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:56:58 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Created local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 09:56:58 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Ensure instance console log exists: /opt/stack/data/nova/instances/5f69d43c-f8a3-4fed-a737-389c217970d8/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 09:56:58 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:56:58 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:56:58 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:56:58 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Acquiring lock "9745ff0d-8320-4689-8326-c18752c6e6ae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:56:58 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Lock "9745ff0d-8320-4689-8326-c18752c6e6ae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:56:58 user nova-compute[71113]: DEBUG nova.compute.manager [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Starting instance... {{(pid=71113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Acquiring lock "bc9b4047-7408-40a1-b38c-59695faffafb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "bc9b4047-7408-40a1-b38c-59695faffafb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 09:56:59 user nova-compute[71113]: INFO nova.compute.claims [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Claim successful on node user
Jul 31 09:56:59 user nova-compute[71113]: DEBUG nova.compute.manager [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Starting instance... {{(pid=71113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG nova.network.neutron [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Successfully updated port: 1343cd85-d61a-4c60-bd8f-50712b92b769 {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Acquiring lock "refresh_cache-5f69d43c-f8a3-4fed-a737-389c217970d8" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Acquired lock "refresh_cache-5f69d43c-f8a3-4fed-a737-389c217970d8" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG nova.network.neutron [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG nova.compute.manager [req-0d10fc34-eea0-49d9-b502-f8281da53795 req-6302eea0-51ae-41b4-916c-94c0cdc77b80 service nova] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Received event network-changed-1343cd85-d61a-4c60-bd8f-50712b92b769 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG nova.compute.manager [req-0d10fc34-eea0-49d9-b502-f8281da53795 req-6302eea0-51ae-41b4-916c-94c0cdc77b80 service nova] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Refreshing instance network info cache due to event network-changed-1343cd85-d61a-4c60-bd8f-50712b92b769. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-0d10fc34-eea0-49d9-b502-f8281da53795 req-6302eea0-51ae-41b4-916c-94c0cdc77b80 service nova] Acquiring lock "refresh_cache-5f69d43c-f8a3-4fed-a737-389c217970d8" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG nova.network.neutron [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG nova.network.neutron [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Updating instance_info_cache with network_info: [{"id": "1343cd85-d61a-4c60-bd8f-50712b92b769", "address": "fa:16:3e:99:54:a7", "network": {"id": "869b89d2-908a-456e-8b07-c4c72cab7202", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1845798715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4eb7c2bc45154315952e1485b921a1c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1343cd85-d6", "ovs_interfaceid": "1343cd85-d61a-4c60-bd8f-50712b92b769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Releasing lock "refresh_cache-5f69d43c-f8a3-4fed-a737-389c217970d8" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG nova.compute.manager [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Instance network_info: |[{"id": "1343cd85-d61a-4c60-bd8f-50712b92b769", "address": "fa:16:3e:99:54:a7", "network": {"id": "869b89d2-908a-456e-8b07-c4c72cab7202", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1845798715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4eb7c2bc45154315952e1485b921a1c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1343cd85-d6", "ovs_interfaceid": "1343cd85-d61a-4c60-bd8f-50712b92b769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-0d10fc34-eea0-49d9-b502-f8281da53795 req-6302eea0-51ae-41b4-916c-94c0cdc77b80 service nova] Acquired lock "refresh_cache-5f69d43c-f8a3-4fed-a737-389c217970d8" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG nova.network.neutron [req-0d10fc34-eea0-49d9-b502-f8281da53795 req-6302eea0-51ae-41b4-916c-94c0cdc77b80 service nova] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Refreshing network info cache for port 1343cd85-d61a-4c60-bd8f-50712b92b769 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Start _get_guest_xml network_info=[{"id": "1343cd85-d61a-4c60-bd8f-50712b92b769", "address": "fa:16:3e:99:54:a7", "network": {"id": "869b89d2-908a-456e-8b07-c4c72cab7202", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1845798715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4eb7c2bc45154315952e1485b921a1c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1343cd85-d6", "ovs_interfaceid": "1343cd85-d61a-4c60-bd8f-50712b92b769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'image_id': '078646fe-b504-41ed-a147-61072e903e51'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.476s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG nova.compute.manager [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Start building networks asynchronously for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.337s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:56:59 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:56:59 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:56:59 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 09:56:59 user nova-compute[71113]: INFO nova.compute.claims [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Claim successful on node user
Jul 31 09:56:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:56:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-70152317',display_name='tempest-VolumesActionsTest-instance-70152317',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-70152317',id=25,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4eb7c2bc45154315952e1485b921a1c1',ramdisk_id='',reservation_id='r-wf5z49a2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1059930490',owner_user_name='tempest-VolumesActionsTest-1059930490-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:56:57Z,user_data=None,user_id='652ff6eb4a134b36810f8db3e29fc2f8',uuid=5f69d43c-f8a3-4fed-a737-389c217970d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1343cd85-d61a-4c60-bd8f-50712b92b769", "address": "fa:16:3e:99:54:a7", "network": {"id": "869b89d2-908a-456e-8b07-c4c72cab7202", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1845798715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4eb7c2bc45154315952e1485b921a1c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1343cd85-d6", "ovs_interfaceid": "1343cd85-d61a-4c60-bd8f-50712b92b769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Converting VIF {"id": "1343cd85-d61a-4c60-bd8f-50712b92b769", "address": "fa:16:3e:99:54:a7", "network": {"id": "869b89d2-908a-456e-8b07-c4c72cab7202", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1845798715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4eb7c2bc45154315952e1485b921a1c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1343cd85-d6", "ovs_interfaceid": "1343cd85-d61a-4c60-bd8f-50712b92b769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:54:a7,bridge_name='br-int',has_traffic_filtering=True,id=1343cd85-d61a-4c60-bd8f-50712b92b769,network=Network(869b89d2-908a-456e-8b07-c4c72cab7202),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1343cd85-d6') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG nova.objects.instance [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Lazy-loading 'pci_devices' on Instance uuid 5f69d43c-f8a3-4fed-a737-389c217970d8 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] End _get_guest_xml xml=<domain type="kvm">
Jul 31 09:56:59 user nova-compute[71113]:   <uuid>5f69d43c-f8a3-4fed-a737-389c217970d8</uuid>
Jul 31 09:56:59 user nova-compute[71113]:   <name>instance-00000019</name>
Jul 31 09:56:59 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 09:56:59 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 09:56:59 user nova-compute[71113]:   <metadata>
Jul 31 09:56:59 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 09:56:59 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 09:56:59 user nova-compute[71113]:       <nova:name>tempest-VolumesActionsTest-instance-70152317</nova:name>
Jul 31 09:56:59 user nova-compute[71113]:       <nova:creationTime>2023-07-31 09:56:59</nova:creationTime>
Jul 31 09:56:59 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 09:56:59 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 09:56:59 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 09:56:59 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 09:56:59 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 09:56:59 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 09:56:59 user nova-compute[71113]:       </nova:flavor>
Jul 31 09:56:59 user nova-compute[71113]:       <nova:owner>
Jul 31 09:56:59 user nova-compute[71113]:         <nova:user uuid="652ff6eb4a134b36810f8db3e29fc2f8">tempest-VolumesActionsTest-1059930490-project-member</nova:user>
Jul 31 09:56:59 user nova-compute[71113]:         <nova:project uuid="4eb7c2bc45154315952e1485b921a1c1">tempest-VolumesActionsTest-1059930490</nova:project>
Jul 31 09:56:59 user nova-compute[71113]:       </nova:owner>
Jul 31 09:56:59 user nova-compute[71113]:       <nova:root type="image" uuid="078646fe-b504-41ed-a147-61072e903e51"/>
Jul 31 09:56:59 user nova-compute[71113]:       <nova:ports>
Jul 31 09:56:59 user nova-compute[71113]:         <nova:port uuid="1343cd85-d61a-4c60-bd8f-50712b92b769">
Jul 31 09:56:59 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 31 09:56:59 user nova-compute[71113]:         </nova:port>
Jul 31 09:56:59 user nova-compute[71113]:       </nova:ports>
Jul 31 09:56:59 user nova-compute[71113]:     </nova:instance>
Jul 31 09:56:59 user nova-compute[71113]:   </metadata>
Jul 31 09:56:59 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 09:56:59 user nova-compute[71113]:     <system>
Jul 31 09:56:59 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 09:56:59 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 09:56:59 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 09:56:59 user nova-compute[71113]:       <entry name="serial">5f69d43c-f8a3-4fed-a737-389c217970d8</entry>
Jul 31 09:56:59 user nova-compute[71113]:       <entry name="uuid">5f69d43c-f8a3-4fed-a737-389c217970d8</entry>
Jul 31 09:56:59 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 09:56:59 user nova-compute[71113]:     </system>
Jul 31 09:56:59 user nova-compute[71113]:   </sysinfo>
Jul 31 09:56:59 user nova-compute[71113]:   <os>
Jul 31 09:56:59 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 09:56:59 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 09:56:59 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 09:56:59 user nova-compute[71113]:   </os>
Jul 31 09:56:59 user nova-compute[71113]:   <features>
Jul 31 09:56:59 user nova-compute[71113]:     <acpi/>
Jul 31 09:56:59 user nova-compute[71113]:     <apic/>
Jul 31 09:56:59 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 09:56:59 user nova-compute[71113]:   </features>
Jul 31 09:56:59 user nova-compute[71113]:   <clock offset="utc">
Jul 31 09:56:59 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 09:56:59 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 09:56:59 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 09:56:59 user nova-compute[71113]:   </clock>
Jul 31 09:56:59 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 09:56:59 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 09:56:59 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 09:56:59 user nova-compute[71113]:   </cpu>
Jul 31 09:56:59 user nova-compute[71113]:   <devices>
Jul 31 09:56:59 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 09:56:59 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 09:56:59 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/5f69d43c-f8a3-4fed-a737-389c217970d8/disk"/>
Jul 31 09:56:59 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 09:56:59 user nova-compute[71113]:     </disk>
Jul 31 09:56:59 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 09:56:59 user nova-compute[71113]:       <mac address="fa:16:3e:99:54:a7"/>
Jul 31 09:56:59 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:56:59 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 09:56:59 user nova-compute[71113]:       <target dev="tap1343cd85-d6"/>
Jul 31 09:56:59 user nova-compute[71113]:     </interface>
Jul 31 09:56:59 user nova-compute[71113]:     <serial type="pty">
Jul 31 09:56:59 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/5f69d43c-f8a3-4fed-a737-389c217970d8/console.log" append="off"/>
Jul 31 09:56:59 user nova-compute[71113]:     </serial>
Jul 31 09:56:59 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 09:56:59 user nova-compute[71113]:     <video>
Jul 31 09:56:59 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:56:59 user nova-compute[71113]:     </video>
Jul 31 09:56:59 user nova-compute[71113]:     <rng model="virtio">
Jul 31 09:56:59 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 09:56:59 user nova-compute[71113]:     </rng>
Jul 31 09:56:59 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 09:56:59 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 09:56:59 user nova-compute[71113]:       <stats period="10"/>
Jul 31 09:56:59 user nova-compute[71113]:     </memballoon>
Jul 31 09:56:59 user nova-compute[71113]:   </devices>
Jul 31 09:56:59 user nova-compute[71113]: </domain>
Jul 31 09:56:59 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:56:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-70152317',display_name='tempest-VolumesActionsTest-instance-70152317',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-70152317',id=25,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4eb7c2bc45154315952e1485b921a1c1',ramdisk_id='',reservation_id='r-wf5z49a2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1059930490',owner_user_name='tempest-VolumesActionsTest-1059930490-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:56:57Z,user_data=None,user_id='652ff6eb4a134b36810f8db3e29fc2f8',uuid=5f69d43c-f8a3-4fed-a737-389c217970d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1343cd85-d61a-4c60-bd8f-50712b92b769", "address": "fa:16:3e:99:54:a7", "network": {"id": "869b89d2-908a-456e-8b07-c4c72cab7202", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1845798715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4eb7c2bc45154315952e1485b921a1c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1343cd85-d6", "ovs_interfaceid": "1343cd85-d61a-4c60-bd8f-50712b92b769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Converting VIF {"id": "1343cd85-d61a-4c60-bd8f-50712b92b769", "address": "fa:16:3e:99:54:a7", "network": {"id": "869b89d2-908a-456e-8b07-c4c72cab7202", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1845798715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4eb7c2bc45154315952e1485b921a1c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1343cd85-d6", "ovs_interfaceid": "1343cd85-d61a-4c60-bd8f-50712b92b769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:54:a7,bridge_name='br-int',has_traffic_filtering=True,id=1343cd85-d61a-4c60-bd8f-50712b92b769,network=Network(869b89d2-908a-456e-8b07-c4c72cab7202),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1343cd85-d6') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG os_vif [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:54:a7,bridge_name='br-int',has_traffic_filtering=True,id=1343cd85-d61a-4c60-bd8f-50712b92b769,network=Network(869b89d2-908a-456e-8b07-c4c72cab7202),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1343cd85-d6') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG nova.compute.manager [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Allocating IP information in the background. {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG nova.network.neutron [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] allocate_for_instance() {{(pid=71113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 09:56:59 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 09:56:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1343cd85-d6, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1343cd85-d6, col_values=(('external_ids', {'iface-id': '1343cd85-d61a-4c60-bd8f-50712b92b769', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:54:a7', 'vm-uuid': '5f69d43c-f8a3-4fed-a737-389c217970d8'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:56:59 user nova-compute[71113]: INFO os_vif [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:54:a7,bridge_name='br-int',has_traffic_filtering=True,id=1343cd85-d61a-4c60-bd8f-50712b92b769,network=Network(869b89d2-908a-456e-8b07-c4c72cab7202),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1343cd85-d6')
Jul 31 09:56:59 user nova-compute[71113]: DEBUG nova.compute.manager [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Start building block device mappings for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG nova.policy [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2ccaa676a1b94ce9a9c7e7ac1eea4725', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df6061a98f3f47c49667a1af078fd72e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71113) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] No VIF found with MAC fa:16:3e:99:54:a7, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG nova.compute.manager [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Start spawning the instance on the hypervisor. {{(pid=71113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 09:56:59 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Creating image(s)
Jul 31 09:56:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Acquiring lock "/opt/stack/data/nova/instances/9745ff0d-8320-4689-8326-c18752c6e6ae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Lock "/opt/stack/data/nova/instances/9745ff0d-8320-4689-8326-c18752c6e6ae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Lock "/opt/stack/data/nova/instances/9745ff0d-8320-4689-8326-c18752c6e6ae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:56:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.181s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Acquiring lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:57:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:57:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:00 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:57:00 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:57:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.153s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/9745ff0d-8320-4689-8326-c18752c6e6ae/disk 1073741824 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:00 user nova-compute[71113]: DEBUG nova.network.neutron [req-0d10fc34-eea0-49d9-b502-f8281da53795 req-6302eea0-51ae-41b4-916c-94c0cdc77b80 service nova] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Updated VIF entry in instance network info cache for port 1343cd85-d61a-4c60-bd8f-50712b92b769. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:57:00 user nova-compute[71113]: DEBUG nova.network.neutron [req-0d10fc34-eea0-49d9-b502-f8281da53795 req-6302eea0-51ae-41b4-916c-94c0cdc77b80 service nova] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Updating instance_info_cache with network_info: [{"id": "1343cd85-d61a-4c60-bd8f-50712b92b769", "address": "fa:16:3e:99:54:a7", "network": {"id": "869b89d2-908a-456e-8b07-c4c72cab7202", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1845798715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4eb7c2bc45154315952e1485b921a1c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1343cd85-d6", "ovs_interfaceid": "1343cd85-d61a-4c60-bd8f-50712b92b769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:57:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.773s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:57:00 user nova-compute[71113]: DEBUG nova.compute.manager [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Start building networks asynchronously for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 09:57:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-0d10fc34-eea0-49d9-b502-f8281da53795 req-6302eea0-51ae-41b4-916c-94c0cdc77b80 service nova] Releasing lock "refresh_cache-5f69d43c-f8a3-4fed-a737-389c217970d8" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:57:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/9745ff0d-8320-4689-8326-c18752c6e6ae/disk 1073741824" returned: 0 in 0.095s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:57:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:00 user nova-compute[71113]: DEBUG nova.compute.manager [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Allocating IP information in the background. {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 09:57:00 user nova-compute[71113]: DEBUG nova.network.neutron [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] allocate_for_instance() {{(pid=71113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 09:57:00 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 09:57:00 user nova-compute[71113]: DEBUG nova.compute.manager [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Start building block device mappings for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 09:57:00 user nova-compute[71113]: DEBUG nova.policy [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '07e8e7f9b62d452a88a29f333177c9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae93d4fff5e4990bd9fe78e71d6d2d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71113) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 09:57:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.222s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:00 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9745ff0d-8320-4689-8326-c18752c6e6ae/disk. size=1073741824 {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 09:57:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9745ff0d-8320-4689-8326-c18752c6e6ae/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:00 user nova-compute[71113]: DEBUG nova.compute.manager [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Start spawning the instance on the hypervisor. {{(pid=71113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 09:57:00 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 09:57:00 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Creating image(s)
Jul 31 09:57:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Acquiring lock "/opt/stack/data/nova/instances/bc9b4047-7408-40a1-b38c-59695faffafb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:57:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "/opt/stack/data/nova/instances/bc9b4047-7408-40a1-b38c-59695faffafb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:57:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "/opt/stack/data/nova/instances/bc9b4047-7408-40a1-b38c-59695faffafb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:57:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9745ff0d-8320-4689-8326-c18752c6e6ae/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:00 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Cannot resize image /opt/stack/data/nova/instances/9745ff0d-8320-4689-8326-c18752c6e6ae/disk to a smaller size. {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 09:57:00 user nova-compute[71113]: DEBUG nova.objects.instance [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Lazy-loading 'migration_context' on Instance uuid 9745ff0d-8320-4689-8326-c18752c6e6ae {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:57:00 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Created local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 09:57:00 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Ensure instance console log exists: /opt/stack/data/nova/instances/9745ff0d-8320-4689-8326-c18752c6e6ae/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 09:57:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:57:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:57:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:57:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.188s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Acquiring lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:57:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:57:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:00 user nova-compute[71113]: DEBUG nova.network.neutron [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Successfully created port: 04c596fd-1d1a-426e-8d57-043b36bad9b6 {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 09:57:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.185s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/bc9b4047-7408-40a1-b38c-59695faffafb/disk 1073741824 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/bc9b4047-7408-40a1-b38c-59695faffafb/disk 1073741824" returned: 0 in 0.061s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:57:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.173s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:01 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bc9b4047-7408-40a1-b38c-59695faffafb/disk. size=1073741824 {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 09:57:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc9b4047-7408-40a1-b38c-59695faffafb/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:01 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:01 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc9b4047-7408-40a1-b38c-59695faffafb/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:01 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Cannot resize image /opt/stack/data/nova/instances/bc9b4047-7408-40a1-b38c-59695faffafb/disk to a smaller size. {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 09:57:01 user nova-compute[71113]: DEBUG nova.objects.instance [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lazy-loading 'migration_context' on Instance uuid bc9b4047-7408-40a1-b38c-59695faffafb {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:57:01 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Created local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 09:57:01 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Ensure instance console log exists: /opt/stack/data/nova/instances/bc9b4047-7408-40a1-b38c-59695faffafb/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 09:57:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:57:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:57:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:57:01 user nova-compute[71113]: DEBUG nova.network.neutron [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Successfully created port: 023cf8aa-3275-4fa5-89fc-81eb12bc8835 {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 09:57:01 user nova-compute[71113]: DEBUG nova.compute.manager [req-ded16798-476a-49ec-8b53-0cb659485185 req-2f684556-8290-4b27-8d38-3e2f223022f2 service nova] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Received event network-vif-plugged-1343cd85-d61a-4c60-bd8f-50712b92b769 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:57:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ded16798-476a-49ec-8b53-0cb659485185 req-2f684556-8290-4b27-8d38-3e2f223022f2 service nova] Acquiring lock "5f69d43c-f8a3-4fed-a737-389c217970d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:57:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ded16798-476a-49ec-8b53-0cb659485185 req-2f684556-8290-4b27-8d38-3e2f223022f2 service nova] Lock "5f69d43c-f8a3-4fed-a737-389c217970d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:57:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ded16798-476a-49ec-8b53-0cb659485185 req-2f684556-8290-4b27-8d38-3e2f223022f2 service nova] Lock "5f69d43c-f8a3-4fed-a737-389c217970d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:57:01 user nova-compute[71113]: DEBUG nova.compute.manager [req-ded16798-476a-49ec-8b53-0cb659485185 req-2f684556-8290-4b27-8d38-3e2f223022f2 service nova] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] No waiting events found dispatching network-vif-plugged-1343cd85-d61a-4c60-bd8f-50712b92b769 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:57:01 user nova-compute[71113]: WARNING nova.compute.manager [req-ded16798-476a-49ec-8b53-0cb659485185 req-2f684556-8290-4b27-8d38-3e2f223022f2 service nova] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Received unexpected event network-vif-plugged-1343cd85-d61a-4c60-bd8f-50712b92b769 for instance with vm_state building and task_state spawning.
Jul 31 09:57:02 user nova-compute[71113]: DEBUG nova.network.neutron [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Successfully updated port: 04c596fd-1d1a-426e-8d57-043b36bad9b6 {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 09:57:02 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Acquiring lock "refresh_cache-9745ff0d-8320-4689-8326-c18752c6e6ae" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:57:02 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Acquired lock "refresh_cache-9745ff0d-8320-4689-8326-c18752c6e6ae" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:57:02 user nova-compute[71113]: DEBUG nova.network.neutron [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 09:57:02 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:02 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:02 user nova-compute[71113]: DEBUG nova.network.neutron [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 09:57:02 user nova-compute[71113]: DEBUG nova.compute.manager [req-3bb3b450-b27d-4ce3-b611-d16102d96da3 req-dd2fe35b-5277-4b3d-8607-e768d11a1df3 service nova] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Received event network-changed-04c596fd-1d1a-426e-8d57-043b36bad9b6 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:57:02 user nova-compute[71113]: DEBUG nova.compute.manager [req-3bb3b450-b27d-4ce3-b611-d16102d96da3 req-dd2fe35b-5277-4b3d-8607-e768d11a1df3 service nova] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Refreshing instance network info cache due to event network-changed-04c596fd-1d1a-426e-8d57-043b36bad9b6. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:57:02 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3bb3b450-b27d-4ce3-b611-d16102d96da3 req-dd2fe35b-5277-4b3d-8607-e768d11a1df3 service nova] Acquiring lock "refresh_cache-9745ff0d-8320-4689-8326-c18752c6e6ae" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:57:02 user nova-compute[71113]: DEBUG nova.network.neutron [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Successfully updated port: 023cf8aa-3275-4fa5-89fc-81eb12bc8835 {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 09:57:02 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Acquiring lock "refresh_cache-bc9b4047-7408-40a1-b38c-59695faffafb" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:57:02 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Acquired lock "refresh_cache-bc9b4047-7408-40a1-b38c-59695faffafb" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:57:02 user nova-compute[71113]: DEBUG nova.network.neutron [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 09:57:02 user nova-compute[71113]: DEBUG nova.network.neutron [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Updating instance_info_cache with network_info: [{"id": "04c596fd-1d1a-426e-8d57-043b36bad9b6", "address": "fa:16:3e:52:17:a1", "network": {"id": "86306292-9a3b-4b6f-bf9f-b18bbe38fbb7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1087389621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df6061a98f3f47c49667a1af078fd72e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04c596fd-1d", "ovs_interfaceid": "04c596fd-1d1a-426e-8d57-043b36bad9b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:57:02 user nova-compute[71113]: DEBUG nova.compute.manager [req-5ecb8c37-2679-4c2d-8160-805a17cca858 req-2d090956-26b0-4e4b-a3fb-b059722045da service nova] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Received event network-changed-023cf8aa-3275-4fa5-89fc-81eb12bc8835 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:57:02 user nova-compute[71113]: DEBUG nova.compute.manager [req-5ecb8c37-2679-4c2d-8160-805a17cca858 req-2d090956-26b0-4e4b-a3fb-b059722045da service nova] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Refreshing instance network info cache due to event network-changed-023cf8aa-3275-4fa5-89fc-81eb12bc8835. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:57:02 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-5ecb8c37-2679-4c2d-8160-805a17cca858 req-2d090956-26b0-4e4b-a3fb-b059722045da service nova] Acquiring lock "refresh_cache-bc9b4047-7408-40a1-b38c-59695faffafb" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:57:02 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Releasing lock "refresh_cache-9745ff0d-8320-4689-8326-c18752c6e6ae" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:57:02 user nova-compute[71113]: DEBUG nova.compute.manager [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Instance network_info: |[{"id": "04c596fd-1d1a-426e-8d57-043b36bad9b6", "address": "fa:16:3e:52:17:a1", "network": {"id": "86306292-9a3b-4b6f-bf9f-b18bbe38fbb7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1087389621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df6061a98f3f47c49667a1af078fd72e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04c596fd-1d", "ovs_interfaceid": "04c596fd-1d1a-426e-8d57-043b36bad9b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 09:57:02 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3bb3b450-b27d-4ce3-b611-d16102d96da3 req-dd2fe35b-5277-4b3d-8607-e768d11a1df3 service nova] Acquired lock "refresh_cache-9745ff0d-8320-4689-8326-c18752c6e6ae" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:57:02 user nova-compute[71113]: DEBUG nova.network.neutron [req-3bb3b450-b27d-4ce3-b611-d16102d96da3 req-dd2fe35b-5277-4b3d-8607-e768d11a1df3 service nova] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Refreshing network info cache for port 04c596fd-1d1a-426e-8d57-043b36bad9b6 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:57:02 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Start _get_guest_xml network_info=[{"id": "04c596fd-1d1a-426e-8d57-043b36bad9b6", "address": "fa:16:3e:52:17:a1", "network": {"id": "86306292-9a3b-4b6f-bf9f-b18bbe38fbb7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1087389621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df6061a98f3f47c49667a1af078fd72e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04c596fd-1d", "ovs_interfaceid": "04c596fd-1d1a-426e-8d57-043b36bad9b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'image_id': '078646fe-b504-41ed-a147-61072e903e51'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 09:57:02 user nova-compute[71113]: DEBUG nova.network.neutron [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 09:57:02 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:57:02 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:57:02 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 09:57:02 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 09:57:02 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 09:57:02 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 09:57:02 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 09:57:02 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 09:57:02 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 09:57:02 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 09:57:02 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 09:57:02 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 09:57:02 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 09:57:02 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 09:57:02 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 09:57:02 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 09:57:02 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 09:57:02 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 09:57:02 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:56:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1253964756',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1253964756',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1253964',id=26,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDl/XpFc4pfXjpPwp+RIvQDEA+6kveQO+O8J3/GNj9j2gLG4XqbmFB5u0pgmhoQoRLGg8K0FR01uY5h4fqS+yG9EzaEQxn8so/vcLEQzd50n8T6jhuKOqyaui9hU3ZT+Lg==',key_name='tempest-keypair-751638056',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df6061a98f3f47c49667a1af078fd72e',ramdisk_id='',reservation_id='r-jwk6rvl4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1753977418',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:57:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ccaa676a1b94ce9a9c7e7ac1eea4725',uuid=9745ff0d-8320-4689-8326-c18752c6e6ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04c596fd-1d1a-426e-8d57-043b36bad9b6", "address": "fa:16:3e:52:17:a1", "network": {"id": "86306292-9a3b-4b6f-bf9f-b18bbe38fbb7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1087389621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df6061a98f3f47c49667a1af078fd72e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04c596fd-1d", "ovs_interfaceid": "04c596fd-1d1a-426e-8d57-043b36bad9b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 09:57:02 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Converting VIF {"id": "04c596fd-1d1a-426e-8d57-043b36bad9b6", "address": "fa:16:3e:52:17:a1", "network": {"id": "86306292-9a3b-4b6f-bf9f-b18bbe38fbb7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1087389621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df6061a98f3f47c49667a1af078fd72e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04c596fd-1d", "ovs_interfaceid": "04c596fd-1d1a-426e-8d57-043b36bad9b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:57:02 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:17:a1,bridge_name='br-int',has_traffic_filtering=True,id=04c596fd-1d1a-426e-8d57-043b36bad9b6,network=Network(86306292-9a3b-4b6f-bf9f-b18bbe38fbb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04c596fd-1d') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:57:02 user nova-compute[71113]: DEBUG nova.objects.instance [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Lazy-loading 'pci_devices' on Instance uuid 9745ff0d-8320-4689-8326-c18752c6e6ae {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:57:02 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] End _get_guest_xml xml=<domain type="kvm">
Jul 31 09:57:02 user nova-compute[71113]:   <uuid>9745ff0d-8320-4689-8326-c18752c6e6ae</uuid>
Jul 31 09:57:02 user nova-compute[71113]:   <name>instance-0000001a</name>
Jul 31 09:57:02 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 09:57:02 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 09:57:02 user nova-compute[71113]:   <metadata>
Jul 31 09:57:02 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 09:57:02 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 09:57:02 user nova-compute[71113]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1253964756</nova:name>
Jul 31 09:57:02 user nova-compute[71113]:       <nova:creationTime>2023-07-31 09:57:02</nova:creationTime>
Jul 31 09:57:02 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 09:57:02 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 09:57:02 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 09:57:02 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 09:57:02 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 09:57:02 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 09:57:02 user nova-compute[71113]:       </nova:flavor>
Jul 31 09:57:02 user nova-compute[71113]:       <nova:owner>
Jul 31 09:57:02 user nova-compute[71113]:         <nova:user uuid="2ccaa676a1b94ce9a9c7e7ac1eea4725">tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member</nova:user>
Jul 31 09:57:02 user nova-compute[71113]:         <nova:project uuid="df6061a98f3f47c49667a1af078fd72e">tempest-TestServerVolumeAttachScenarioOldVersion-1753977418</nova:project>
Jul 31 09:57:02 user nova-compute[71113]:       </nova:owner>
Jul 31 09:57:02 user nova-compute[71113]:       <nova:root type="image" uuid="078646fe-b504-41ed-a147-61072e903e51"/>
Jul 31 09:57:02 user nova-compute[71113]:       <nova:ports>
Jul 31 09:57:02 user nova-compute[71113]:         <nova:port uuid="04c596fd-1d1a-426e-8d57-043b36bad9b6">
Jul 31 09:57:02 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 31 09:57:02 user nova-compute[71113]:         </nova:port>
Jul 31 09:57:02 user nova-compute[71113]:       </nova:ports>
Jul 31 09:57:02 user nova-compute[71113]:     </nova:instance>
Jul 31 09:57:02 user nova-compute[71113]:   </metadata>
Jul 31 09:57:02 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 09:57:02 user nova-compute[71113]:     <system>
Jul 31 09:57:02 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 09:57:02 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 09:57:02 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 09:57:02 user nova-compute[71113]:       <entry name="serial">9745ff0d-8320-4689-8326-c18752c6e6ae</entry>
Jul 31 09:57:02 user nova-compute[71113]:       <entry name="uuid">9745ff0d-8320-4689-8326-c18752c6e6ae</entry>
Jul 31 09:57:02 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 09:57:02 user nova-compute[71113]:     </system>
Jul 31 09:57:02 user nova-compute[71113]:   </sysinfo>
Jul 31 09:57:02 user nova-compute[71113]:   <os>
Jul 31 09:57:02 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 09:57:02 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 09:57:02 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 09:57:02 user nova-compute[71113]:   </os>
Jul 31 09:57:02 user nova-compute[71113]:   <features>
Jul 31 09:57:02 user nova-compute[71113]:     <acpi/>
Jul 31 09:57:02 user nova-compute[71113]:     <apic/>
Jul 31 09:57:02 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 09:57:02 user nova-compute[71113]:   </features>
Jul 31 09:57:02 user nova-compute[71113]:   <clock offset="utc">
Jul 31 09:57:02 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 09:57:02 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 09:57:02 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 09:57:02 user nova-compute[71113]:   </clock>
Jul 31 09:57:02 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 09:57:02 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 09:57:02 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 09:57:02 user nova-compute[71113]:   </cpu>
Jul 31 09:57:02 user nova-compute[71113]:   <devices>
Jul 31 09:57:02 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 09:57:02 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 09:57:02 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/9745ff0d-8320-4689-8326-c18752c6e6ae/disk"/>
Jul 31 09:57:02 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 09:57:02 user nova-compute[71113]:     </disk>
Jul 31 09:57:02 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 09:57:02 user nova-compute[71113]:       <mac address="fa:16:3e:52:17:a1"/>
Jul 31 09:57:02 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:57:02 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 09:57:02 user nova-compute[71113]:       <target dev="tap04c596fd-1d"/>
Jul 31 09:57:02 user nova-compute[71113]:     </interface>
Jul 31 09:57:02 user nova-compute[71113]:     <serial type="pty">
Jul 31 09:57:02 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/9745ff0d-8320-4689-8326-c18752c6e6ae/console.log" append="off"/>
Jul 31 09:57:02 user nova-compute[71113]:     </serial>
Jul 31 09:57:02 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 09:57:02 user nova-compute[71113]:     <video>
Jul 31 09:57:02 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:57:02 user nova-compute[71113]:     </video>
Jul 31 09:57:02 user nova-compute[71113]:     <rng model="virtio">
Jul 31 09:57:02 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 09:57:02 user nova-compute[71113]:     </rng>
Jul 31 09:57:02 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 09:57:02 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 09:57:02 user nova-compute[71113]:       <stats period="10"/>
Jul 31 09:57:02 user nova-compute[71113]:     </memballoon>
Jul 31 09:57:02 user nova-compute[71113]:   </devices>
Jul 31 09:57:02 user nova-compute[71113]: </domain>
Jul 31 09:57:02 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 09:57:02 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:56:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1253964756',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1253964756',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1253964',id=26,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDl/XpFc4pfXjpPwp+RIvQDEA+6kveQO+O8J3/GNj9j2gLG4XqbmFB5u0pgmhoQoRLGg8K0FR01uY5h4fqS+yG9EzaEQxn8so/vcLEQzd50n8T6jhuKOqyaui9hU3ZT+Lg==',key_name='tempest-keypair-751638056',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df6061a98f3f47c49667a1af078fd72e',ramdisk_id='',reservation_id='r-jwk6rvl4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1753977418',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:57:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ccaa676a1b94ce9a9c7e7ac1eea4725',uuid=9745ff0d-8320-4689-8326-c18752c6e6ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04c596fd-1d1a-426e-8d57-043b36bad9b6", "address": "fa:16:3e:52:17:a1", "network": {"id": "86306292-9a3b-4b6f-bf9f-b18bbe38fbb7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1087389621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df6061a98f3f47c49667a1af078fd72e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04c596fd-1d", "ovs_interfaceid": "04c596fd-1d1a-426e-8d57-043b36bad9b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 09:57:02 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Converting VIF {"id": "04c596fd-1d1a-426e-8d57-043b36bad9b6", "address": "fa:16:3e:52:17:a1", "network": {"id": "86306292-9a3b-4b6f-bf9f-b18bbe38fbb7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1087389621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df6061a98f3f47c49667a1af078fd72e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04c596fd-1d", "ovs_interfaceid": "04c596fd-1d1a-426e-8d57-043b36bad9b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:57:02 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:17:a1,bridge_name='br-int',has_traffic_filtering=True,id=04c596fd-1d1a-426e-8d57-043b36bad9b6,network=Network(86306292-9a3b-4b6f-bf9f-b18bbe38fbb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04c596fd-1d') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:57:02 user nova-compute[71113]: DEBUG os_vif [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:17:a1,bridge_name='br-int',has_traffic_filtering=True,id=04c596fd-1d1a-426e-8d57-043b36bad9b6,network=Network(86306292-9a3b-4b6f-bf9f-b18bbe38fbb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04c596fd-1d') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 09:57:02 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:02 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:57:02 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 09:57:02 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:02 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap04c596fd-1d, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:57:02 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap04c596fd-1d, col_values=(('external_ids', {'iface-id': '04c596fd-1d1a-426e-8d57-043b36bad9b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:17:a1', 'vm-uuid': '9745ff0d-8320-4689-8326-c18752c6e6ae'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:57:02 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:02 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:57:02 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:02 user nova-compute[71113]: INFO os_vif [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:17:a1,bridge_name='br-int',has_traffic_filtering=True,id=04c596fd-1d1a-426e-8d57-043b36bad9b6,network=Network(86306292-9a3b-4b6f-bf9f-b18bbe38fbb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04c596fd-1d')
Jul 31 09:57:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:57:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] No VIF found with MAC fa:16:3e:52:17:a1, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 09:57:03 user nova-compute[71113]: DEBUG nova.network.neutron [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Updating instance_info_cache with network_info: [{"id": "023cf8aa-3275-4fa5-89fc-81eb12bc8835", "address": "fa:16:3e:b9:09:59", "network": {"id": "26352e29-fc15-48ac-be14-8af7a0c80219", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866093358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bae93d4fff5e4990bd9fe78e71d6d2d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap023cf8aa-32", "ovs_interfaceid": "023cf8aa-3275-4fa5-89fc-81eb12bc8835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:57:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Releasing lock "refresh_cache-bc9b4047-7408-40a1-b38c-59695faffafb" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:57:03 user nova-compute[71113]: DEBUG nova.compute.manager [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Instance network_info: |[{"id": "023cf8aa-3275-4fa5-89fc-81eb12bc8835", "address": "fa:16:3e:b9:09:59", "network": {"id": "26352e29-fc15-48ac-be14-8af7a0c80219", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866093358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bae93d4fff5e4990bd9fe78e71d6d2d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap023cf8aa-32", "ovs_interfaceid": "023cf8aa-3275-4fa5-89fc-81eb12bc8835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 09:57:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-5ecb8c37-2679-4c2d-8160-805a17cca858 req-2d090956-26b0-4e4b-a3fb-b059722045da service nova] Acquired lock "refresh_cache-bc9b4047-7408-40a1-b38c-59695faffafb" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:57:03 user nova-compute[71113]: DEBUG nova.network.neutron [req-5ecb8c37-2679-4c2d-8160-805a17cca858 req-2d090956-26b0-4e4b-a3fb-b059722045da service nova] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Refreshing network info cache for port 023cf8aa-3275-4fa5-89fc-81eb12bc8835 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:57:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Start _get_guest_xml network_info=[{"id": "023cf8aa-3275-4fa5-89fc-81eb12bc8835", "address": "fa:16:3e:b9:09:59", "network": {"id": "26352e29-fc15-48ac-be14-8af7a0c80219", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866093358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bae93d4fff5e4990bd9fe78e71d6d2d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap023cf8aa-32", "ovs_interfaceid": "023cf8aa-3275-4fa5-89fc-81eb12bc8835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'image_id': '078646fe-b504-41ed-a147-61072e903e51'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 09:57:03 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:57:03 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:57:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 09:57:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 09:57:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 09:57:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 09:57:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 09:57:03 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 09:57:03 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 09:57:03 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 09:57:03 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 09:57:03 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 09:57:03 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 09:57:03 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 09:57:03 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 09:57:03 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 09:57:03 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 09:57:03 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 09:57:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:56:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1509937668',display_name='tempest-AttachVolumeTestJSON-server-1509937668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1509937668',id=27,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoy+Hs+bfe1IZrhIpXFdgvapbdLt/DaH/UOAPIEBCI/YgBOFSbTsI1O4d6Q7HqxcwqIi0rTWYgoRSaQBtuYzeHTXsPC8CcA2xKVnnl9MwG6wGoYIKDKt5rjIPxG+QjYCA==',key_name='tempest-keypair-1081233508',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bae93d4fff5e4990bd9fe78e71d6d2d2',ramdisk_id='',reservation_id='r-cfi0baxe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1230374483',owner_user_name='tempest-AttachVolumeTestJSON-1230374483-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:57:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07e8e7f9b62d452a88a29f333177c9d2',uuid=bc9b4047-7408-40a1-b38c-59695faffafb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "023cf8aa-3275-4fa5-89fc-81eb12bc8835", "address": "fa:16:3e:b9:09:59", "network": {"id": "26352e29-fc15-48ac-be14-8af7a0c80219", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866093358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bae93d4fff5e4990bd9fe78e71d6d2d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap023cf8aa-32", "ovs_interfaceid": "023cf8aa-3275-4fa5-89fc-81eb12bc8835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 09:57:03 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Converting VIF {"id": "023cf8aa-3275-4fa5-89fc-81eb12bc8835", "address": "fa:16:3e:b9:09:59", "network": {"id": "26352e29-fc15-48ac-be14-8af7a0c80219", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866093358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bae93d4fff5e4990bd9fe78e71d6d2d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap023cf8aa-32", "ovs_interfaceid": "023cf8aa-3275-4fa5-89fc-81eb12bc8835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:57:03 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:09:59,bridge_name='br-int',has_traffic_filtering=True,id=023cf8aa-3275-4fa5-89fc-81eb12bc8835,network=Network(26352e29-fc15-48ac-be14-8af7a0c80219),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap023cf8aa-32') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:57:03 user nova-compute[71113]: DEBUG nova.objects.instance [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lazy-loading 'pci_devices' on Instance uuid bc9b4047-7408-40a1-b38c-59695faffafb {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:57:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] End _get_guest_xml xml=<domain type="kvm">
Jul 31 09:57:03 user nova-compute[71113]:   <uuid>bc9b4047-7408-40a1-b38c-59695faffafb</uuid>
Jul 31 09:57:03 user nova-compute[71113]:   <name>instance-0000001b</name>
Jul 31 09:57:03 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 09:57:03 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 09:57:03 user nova-compute[71113]:   <metadata>
Jul 31 09:57:03 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 09:57:03 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 09:57:03 user nova-compute[71113]:       <nova:name>tempest-AttachVolumeTestJSON-server-1509937668</nova:name>
Jul 31 09:57:03 user nova-compute[71113]:       <nova:creationTime>2023-07-31 09:57:03</nova:creationTime>
Jul 31 09:57:03 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 09:57:03 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 09:57:03 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 09:57:03 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 09:57:03 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 09:57:03 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 09:57:03 user nova-compute[71113]:       </nova:flavor>
Jul 31 09:57:03 user nova-compute[71113]:       <nova:owner>
Jul 31 09:57:03 user nova-compute[71113]:         <nova:user uuid="07e8e7f9b62d452a88a29f333177c9d2">tempest-AttachVolumeTestJSON-1230374483-project-member</nova:user>
Jul 31 09:57:03 user nova-compute[71113]:         <nova:project uuid="bae93d4fff5e4990bd9fe78e71d6d2d2">tempest-AttachVolumeTestJSON-1230374483</nova:project>
Jul 31 09:57:03 user nova-compute[71113]:       </nova:owner>
Jul 31 09:57:03 user nova-compute[71113]:       <nova:root type="image" uuid="078646fe-b504-41ed-a147-61072e903e51"/>
Jul 31 09:57:03 user nova-compute[71113]:       <nova:ports>
Jul 31 09:57:03 user nova-compute[71113]:         <nova:port uuid="023cf8aa-3275-4fa5-89fc-81eb12bc8835">
Jul 31 09:57:03 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 31 09:57:03 user nova-compute[71113]:         </nova:port>
Jul 31 09:57:03 user nova-compute[71113]:       </nova:ports>
Jul 31 09:57:03 user nova-compute[71113]:     </nova:instance>
Jul 31 09:57:03 user nova-compute[71113]:   </metadata>
Jul 31 09:57:03 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 09:57:03 user nova-compute[71113]:     <system>
Jul 31 09:57:03 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 09:57:03 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 09:57:03 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 09:57:03 user nova-compute[71113]:       <entry name="serial">bc9b4047-7408-40a1-b38c-59695faffafb</entry>
Jul 31 09:57:03 user nova-compute[71113]:       <entry name="uuid">bc9b4047-7408-40a1-b38c-59695faffafb</entry>
Jul 31 09:57:03 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 09:57:03 user nova-compute[71113]:     </system>
Jul 31 09:57:03 user nova-compute[71113]:   </sysinfo>
Jul 31 09:57:03 user nova-compute[71113]:   <os>
Jul 31 09:57:03 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 09:57:03 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 09:57:03 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 09:57:03 user nova-compute[71113]:   </os>
Jul 31 09:57:03 user nova-compute[71113]:   <features>
Jul 31 09:57:03 user nova-compute[71113]:     <acpi/>
Jul 31 09:57:03 user nova-compute[71113]:     <apic/>
Jul 31 09:57:03 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 09:57:03 user nova-compute[71113]:   </features>
Jul 31 09:57:03 user nova-compute[71113]:   <clock offset="utc">
Jul 31 09:57:03 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 09:57:03 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 09:57:03 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 09:57:03 user nova-compute[71113]:   </clock>
Jul 31 09:57:03 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 09:57:03 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 09:57:03 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 09:57:03 user nova-compute[71113]:   </cpu>
Jul 31 09:57:03 user nova-compute[71113]:   <devices>
Jul 31 09:57:03 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 09:57:03 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 09:57:03 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/bc9b4047-7408-40a1-b38c-59695faffafb/disk"/>
Jul 31 09:57:03 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 09:57:03 user nova-compute[71113]:     </disk>
Jul 31 09:57:03 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 09:57:03 user nova-compute[71113]:       <mac address="fa:16:3e:b9:09:59"/>
Jul 31 09:57:03 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:57:03 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 09:57:03 user nova-compute[71113]:       <target dev="tap023cf8aa-32"/>
Jul 31 09:57:03 user nova-compute[71113]:     </interface>
Jul 31 09:57:03 user nova-compute[71113]:     <serial type="pty">
Jul 31 09:57:03 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/bc9b4047-7408-40a1-b38c-59695faffafb/console.log" append="off"/>
Jul 31 09:57:03 user nova-compute[71113]:     </serial>
Jul 31 09:57:03 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 09:57:03 user nova-compute[71113]:     <video>
Jul 31 09:57:03 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:57:03 user nova-compute[71113]:     </video>
Jul 31 09:57:03 user nova-compute[71113]:     <rng model="virtio">
Jul 31 09:57:03 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 09:57:03 user nova-compute[71113]:     </rng>
Jul 31 09:57:03 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 09:57:03 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 09:57:03 user nova-compute[71113]:       <stats period="10"/>
Jul 31 09:57:03 user nova-compute[71113]:     </memballoon>
Jul 31 09:57:03 user nova-compute[71113]:   </devices>
Jul 31 09:57:03 user nova-compute[71113]: </domain>
Jul 31 09:57:03 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 09:57:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:56:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1509937668',display_name='tempest-AttachVolumeTestJSON-server-1509937668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1509937668',id=27,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoy+Hs+bfe1IZrhIpXFdgvapbdLt/DaH/UOAPIEBCI/YgBOFSbTsI1O4d6Q7HqxcwqIi0rTWYgoRSaQBtuYzeHTXsPC8CcA2xKVnnl9MwG6wGoYIKDKt5rjIPxG+QjYCA==',key_name='tempest-keypair-1081233508',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bae93d4fff5e4990bd9fe78e71d6d2d2',ramdisk_id='',reservation_id='r-cfi0baxe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1230374483',owner_user_name='tempest-AttachVolumeTestJSON-1230374483-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:57:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07e8e7f9b62d452a88a29f333177c9d2',uuid=bc9b4047-7408-40a1-b38c-59695faffafb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "023cf8aa-3275-4fa5-89fc-81eb12bc8835", "address": "fa:16:3e:b9:09:59", "network": {"id": "26352e29-fc15-48ac-be14-8af7a0c80219", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866093358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bae93d4fff5e4990bd9fe78e71d6d2d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap023cf8aa-32", "ovs_interfaceid": "023cf8aa-3275-4fa5-89fc-81eb12bc8835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 09:57:03 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Converting VIF {"id": "023cf8aa-3275-4fa5-89fc-81eb12bc8835", "address": "fa:16:3e:b9:09:59", "network": {"id": "26352e29-fc15-48ac-be14-8af7a0c80219", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866093358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bae93d4fff5e4990bd9fe78e71d6d2d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap023cf8aa-32", "ovs_interfaceid": "023cf8aa-3275-4fa5-89fc-81eb12bc8835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:57:03 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:09:59,bridge_name='br-int',has_traffic_filtering=True,id=023cf8aa-3275-4fa5-89fc-81eb12bc8835,network=Network(26352e29-fc15-48ac-be14-8af7a0c80219),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap023cf8aa-32') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:57:03 user nova-compute[71113]: DEBUG os_vif [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:09:59,bridge_name='br-int',has_traffic_filtering=True,id=023cf8aa-3275-4fa5-89fc-81eb12bc8835,network=Network(26352e29-fc15-48ac-be14-8af7a0c80219),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap023cf8aa-32') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 09:57:03 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:03 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:57:03 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 09:57:03 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:03 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap023cf8aa-32, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:57:03 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap023cf8aa-32, col_values=(('external_ids', {'iface-id': '023cf8aa-3275-4fa5-89fc-81eb12bc8835', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:09:59', 'vm-uuid': 'bc9b4047-7408-40a1-b38c-59695faffafb'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:57:03 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:03 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:57:03 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:03 user nova-compute[71113]: INFO os_vif [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:09:59,bridge_name='br-int',has_traffic_filtering=True,id=023cf8aa-3275-4fa5-89fc-81eb12bc8835,network=Network(26352e29-fc15-48ac-be14-8af7a0c80219),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap023cf8aa-32')
Jul 31 09:57:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:57:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] No VIF found with MAC fa:16:3e:b9:09:59, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 09:57:03 user nova-compute[71113]: DEBUG nova.network.neutron [req-3bb3b450-b27d-4ce3-b611-d16102d96da3 req-dd2fe35b-5277-4b3d-8607-e768d11a1df3 service nova] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Updated VIF entry in instance network info cache for port 04c596fd-1d1a-426e-8d57-043b36bad9b6. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:57:03 user nova-compute[71113]: DEBUG nova.network.neutron [req-3bb3b450-b27d-4ce3-b611-d16102d96da3 req-dd2fe35b-5277-4b3d-8607-e768d11a1df3 service nova] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Updating instance_info_cache with network_info: [{"id": "04c596fd-1d1a-426e-8d57-043b36bad9b6", "address": "fa:16:3e:52:17:a1", "network": {"id": "86306292-9a3b-4b6f-bf9f-b18bbe38fbb7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1087389621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df6061a98f3f47c49667a1af078fd72e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04c596fd-1d", "ovs_interfaceid": "04c596fd-1d1a-426e-8d57-043b36bad9b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:57:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3bb3b450-b27d-4ce3-b611-d16102d96da3 req-dd2fe35b-5277-4b3d-8607-e768d11a1df3 service nova] Releasing lock "refresh_cache-9745ff0d-8320-4689-8326-c18752c6e6ae" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:57:03 user nova-compute[71113]: DEBUG nova.network.neutron [req-5ecb8c37-2679-4c2d-8160-805a17cca858 req-2d090956-26b0-4e4b-a3fb-b059722045da service nova] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Updated VIF entry in instance network info cache for port 023cf8aa-3275-4fa5-89fc-81eb12bc8835. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:57:03 user nova-compute[71113]: DEBUG nova.network.neutron [req-5ecb8c37-2679-4c2d-8160-805a17cca858 req-2d090956-26b0-4e4b-a3fb-b059722045da service nova] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Updating instance_info_cache with network_info: [{"id": "023cf8aa-3275-4fa5-89fc-81eb12bc8835", "address": "fa:16:3e:b9:09:59", "network": {"id": "26352e29-fc15-48ac-be14-8af7a0c80219", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866093358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bae93d4fff5e4990bd9fe78e71d6d2d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap023cf8aa-32", "ovs_interfaceid": "023cf8aa-3275-4fa5-89fc-81eb12bc8835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:57:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-5ecb8c37-2679-4c2d-8160-805a17cca858 req-2d090956-26b0-4e4b-a3fb-b059722045da service nova] Releasing lock "refresh_cache-bc9b4047-7408-40a1-b38c-59695faffafb" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:57:03 user nova-compute[71113]: DEBUG nova.compute.manager [req-7d16f5ed-162e-48b9-8e8f-2d1f476621f0 req-cab9241c-1bad-45e4-b3ac-87c481cac16a service nova] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Received event network-vif-plugged-1343cd85-d61a-4c60-bd8f-50712b92b769 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:57:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7d16f5ed-162e-48b9-8e8f-2d1f476621f0 req-cab9241c-1bad-45e4-b3ac-87c481cac16a service nova] Acquiring lock "5f69d43c-f8a3-4fed-a737-389c217970d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:57:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7d16f5ed-162e-48b9-8e8f-2d1f476621f0 req-cab9241c-1bad-45e4-b3ac-87c481cac16a service nova] Lock "5f69d43c-f8a3-4fed-a737-389c217970d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:57:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7d16f5ed-162e-48b9-8e8f-2d1f476621f0 req-cab9241c-1bad-45e4-b3ac-87c481cac16a service nova] Lock "5f69d43c-f8a3-4fed-a737-389c217970d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:57:03 user nova-compute[71113]: DEBUG nova.compute.manager [req-7d16f5ed-162e-48b9-8e8f-2d1f476621f0 req-cab9241c-1bad-45e4-b3ac-87c481cac16a service nova] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] No waiting events found dispatching network-vif-plugged-1343cd85-d61a-4c60-bd8f-50712b92b769 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:57:03 user nova-compute[71113]: WARNING nova.compute.manager [req-7d16f5ed-162e-48b9-8e8f-2d1f476621f0 req-cab9241c-1bad-45e4-b3ac-87c481cac16a service nova] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Received unexpected event network-vif-plugged-1343cd85-d61a-4c60-bd8f-50712b92b769 for instance with vm_state building and task_state spawning.
Jul 31 09:57:04 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797424.1223218, 5f69d43c-f8a3-4fed-a737-389c217970d8 => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:57:04 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] VM Resumed (Lifecycle Event)
Jul 31 09:57:04 user nova-compute[71113]: DEBUG nova.compute.manager [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 09:57:04 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 09:57:04 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Instance spawned successfully.
Jul 31 09:57:04 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 09:57:04 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:57:04 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Found default for hw_cdrom_bus of ide {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:57:04 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Found default for hw_disk_bus of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:57:04 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Found default for hw_input_bus of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:57:04 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Found default for hw_pointer_model of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:57:04 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Found default for hw_video_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:57:04 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Found default for hw_vif_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:57:04 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:57:04 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:57:04 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797424.1260715, 5f69d43c-f8a3-4fed-a737-389c217970d8 => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:57:04 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] VM Started (Lifecycle Event)
Jul 31 09:57:04 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:57:04 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:57:04 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:57:04 user nova-compute[71113]: INFO nova.compute.manager [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Took 7.05 seconds to spawn the instance on the hypervisor.
Jul 31 09:57:04 user nova-compute[71113]: DEBUG nova.compute.manager [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:57:04 user nova-compute[71113]: INFO nova.compute.manager [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Took 8.07 seconds to build instance.
Jul 31 09:57:04 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-2dc4009f-3ba3-4189-b060-e33e4331c3a7 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Lock "5f69d43c-f8a3-4fed-a737-389c217970d8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.237s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:57:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:04 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:57:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:05 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:57:05 user nova-compute[71113]: DEBUG nova.compute.manager [req-d8ad16c1-f152-4ce2-b03e-d21470b59ccf req-92d81a63-4f54-4abc-9997-3fbb2d91177b service nova] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Received event network-vif-plugged-04c596fd-1d1a-426e-8d57-043b36bad9b6 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:57:05 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-d8ad16c1-f152-4ce2-b03e-d21470b59ccf req-92d81a63-4f54-4abc-9997-3fbb2d91177b service nova] Acquiring lock "9745ff0d-8320-4689-8326-c18752c6e6ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:57:05 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-d8ad16c1-f152-4ce2-b03e-d21470b59ccf req-92d81a63-4f54-4abc-9997-3fbb2d91177b service nova] Lock "9745ff0d-8320-4689-8326-c18752c6e6ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:57:05 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-d8ad16c1-f152-4ce2-b03e-d21470b59ccf req-92d81a63-4f54-4abc-9997-3fbb2d91177b service nova] Lock "9745ff0d-8320-4689-8326-c18752c6e6ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:57:05 user nova-compute[71113]: DEBUG nova.compute.manager [req-d8ad16c1-f152-4ce2-b03e-d21470b59ccf req-92d81a63-4f54-4abc-9997-3fbb2d91177b service nova] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] No waiting events found dispatching network-vif-plugged-04c596fd-1d1a-426e-8d57-043b36bad9b6 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:57:05 user nova-compute[71113]: WARNING nova.compute.manager [req-d8ad16c1-f152-4ce2-b03e-d21470b59ccf req-92d81a63-4f54-4abc-9997-3fbb2d91177b service nova] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Received unexpected event network-vif-plugged-04c596fd-1d1a-426e-8d57-043b36bad9b6 for instance with vm_state building and task_state spawning.
Jul 31 09:57:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:07 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:07 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:07 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:07 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:07 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:57:07 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:57:07 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:57:07 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:57:07 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 09:57:07 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:57:07 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:57:07 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:57:07 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:57:07 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 09:57:08 user nova-compute[71113]: DEBUG nova.compute.manager [req-77ca2969-725d-4c4c-ab1a-8276b06438bd req-364d106c-59c3-40c0-a774-d2f1753eba8b service nova] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Received event network-vif-plugged-04c596fd-1d1a-426e-8d57-043b36bad9b6 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:57:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-77ca2969-725d-4c4c-ab1a-8276b06438bd req-364d106c-59c3-40c0-a774-d2f1753eba8b service nova] Acquiring lock "9745ff0d-8320-4689-8326-c18752c6e6ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:57:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-77ca2969-725d-4c4c-ab1a-8276b06438bd req-364d106c-59c3-40c0-a774-d2f1753eba8b service nova] Lock "9745ff0d-8320-4689-8326-c18752c6e6ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:57:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-77ca2969-725d-4c4c-ab1a-8276b06438bd req-364d106c-59c3-40c0-a774-d2f1753eba8b service nova] Lock "9745ff0d-8320-4689-8326-c18752c6e6ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:57:08 user nova-compute[71113]: DEBUG nova.compute.manager [req-77ca2969-725d-4c4c-ab1a-8276b06438bd req-364d106c-59c3-40c0-a774-d2f1753eba8b service nova] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] No waiting events found dispatching network-vif-plugged-04c596fd-1d1a-426e-8d57-043b36bad9b6 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:57:08 user nova-compute[71113]: WARNING nova.compute.manager [req-77ca2969-725d-4c4c-ab1a-8276b06438bd req-364d106c-59c3-40c0-a774-d2f1753eba8b service nova] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Received unexpected event network-vif-plugged-04c596fd-1d1a-426e-8d57-043b36bad9b6 for instance with vm_state building and task_state spawning.
Jul 31 09:57:08 user nova-compute[71113]: DEBUG nova.compute.manager [req-77ca2969-725d-4c4c-ab1a-8276b06438bd req-364d106c-59c3-40c0-a774-d2f1753eba8b service nova] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Received event network-vif-plugged-023cf8aa-3275-4fa5-89fc-81eb12bc8835 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:57:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-77ca2969-725d-4c4c-ab1a-8276b06438bd req-364d106c-59c3-40c0-a774-d2f1753eba8b service nova] Acquiring lock "bc9b4047-7408-40a1-b38c-59695faffafb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:57:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-77ca2969-725d-4c4c-ab1a-8276b06438bd req-364d106c-59c3-40c0-a774-d2f1753eba8b service nova] Lock "bc9b4047-7408-40a1-b38c-59695faffafb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:57:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-77ca2969-725d-4c4c-ab1a-8276b06438bd req-364d106c-59c3-40c0-a774-d2f1753eba8b service nova] Lock "bc9b4047-7408-40a1-b38c-59695faffafb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:57:08 user nova-compute[71113]: DEBUG nova.compute.manager [req-77ca2969-725d-4c4c-ab1a-8276b06438bd req-364d106c-59c3-40c0-a774-d2f1753eba8b service nova] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] No waiting events found dispatching network-vif-plugged-023cf8aa-3275-4fa5-89fc-81eb12bc8835 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:57:08 user nova-compute[71113]: WARNING nova.compute.manager [req-77ca2969-725d-4c4c-ab1a-8276b06438bd req-364d106c-59c3-40c0-a774-d2f1753eba8b service nova] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Received unexpected event network-vif-plugged-023cf8aa-3275-4fa5-89fc-81eb12bc8835 for instance with vm_state building and task_state spawning.
Jul 31 09:57:08 user nova-compute[71113]: DEBUG nova.compute.manager [req-77ca2969-725d-4c4c-ab1a-8276b06438bd req-364d106c-59c3-40c0-a774-d2f1753eba8b service nova] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Received event network-vif-plugged-023cf8aa-3275-4fa5-89fc-81eb12bc8835 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:57:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-77ca2969-725d-4c4c-ab1a-8276b06438bd req-364d106c-59c3-40c0-a774-d2f1753eba8b service nova] Acquiring lock "bc9b4047-7408-40a1-b38c-59695faffafb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:57:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-77ca2969-725d-4c4c-ab1a-8276b06438bd req-364d106c-59c3-40c0-a774-d2f1753eba8b service nova] Lock "bc9b4047-7408-40a1-b38c-59695faffafb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:57:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-77ca2969-725d-4c4c-ab1a-8276b06438bd req-364d106c-59c3-40c0-a774-d2f1753eba8b service nova] Lock "bc9b4047-7408-40a1-b38c-59695faffafb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:57:08 user nova-compute[71113]: DEBUG nova.compute.manager [req-77ca2969-725d-4c4c-ab1a-8276b06438bd req-364d106c-59c3-40c0-a774-d2f1753eba8b service nova] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] No waiting events found dispatching network-vif-plugged-023cf8aa-3275-4fa5-89fc-81eb12bc8835 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:57:08 user nova-compute[71113]: WARNING nova.compute.manager [req-77ca2969-725d-4c4c-ab1a-8276b06438bd req-364d106c-59c3-40c0-a774-d2f1753eba8b service nova] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Received unexpected event network-vif-plugged-023cf8aa-3275-4fa5-89fc-81eb12bc8835 for instance with vm_state building and task_state spawning.
Jul 31 09:57:08 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 09:57:08 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92d25a03-98ce-4bde-a3cc-20313ae77d41/disk.rescue --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:08 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92d25a03-98ce-4bde-a3cc-20313ae77d41/disk.rescue --force-share --output=json" returned: 0 in 0.153s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:08 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92d25a03-98ce-4bde-a3cc-20313ae77d41/disk.rescue --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:08 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:08 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:08 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:08 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92d25a03-98ce-4bde-a3cc-20313ae77d41/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:08 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4df9380-7882-48a6-ba64-bb17429e54ac/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:08 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4df9380-7882-48a6-ba64-bb17429e54ac/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:08 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4df9380-7882-48a6-ba64-bb17429e54ac/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:08 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:08 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4df9380-7882-48a6-ba64-bb17429e54ac/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:08 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f69d43c-f8a3-4fed-a737-389c217970d8/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f69d43c-f8a3-4fed-a737-389c217970d8/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f69d43c-f8a3-4fed-a737-389c217970d8/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:09 user nova-compute[71113]: DEBUG nova.compute.manager [req-f952821a-6318-4478-9d53-738dd61b613b req-1e6589ef-7a8e-4538-a1dd-75ecb200d679 service nova] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Received event network-changed-5408a169-bdde-42da-be35-24006f474bc6 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:57:09 user nova-compute[71113]: DEBUG nova.compute.manager [req-f952821a-6318-4478-9d53-738dd61b613b req-1e6589ef-7a8e-4538-a1dd-75ecb200d679 service nova] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Refreshing instance network info cache due to event network-changed-5408a169-bdde-42da-be35-24006f474bc6. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:57:09 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f952821a-6318-4478-9d53-738dd61b613b req-1e6589ef-7a8e-4538-a1dd-75ecb200d679 service nova] Acquiring lock "refresh_cache-0ea0401b-26c2-4655-956b-1bc000debd53" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:57:09 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f952821a-6318-4478-9d53-738dd61b613b req-1e6589ef-7a8e-4538-a1dd-75ecb200d679 service nova] Acquired lock "refresh_cache-0ea0401b-26c2-4655-956b-1bc000debd53" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:57:09 user nova-compute[71113]: DEBUG nova.network.neutron [req-f952821a-6318-4478-9d53-738dd61b613b req-1e6589ef-7a8e-4538-a1dd-75ecb200d679 service nova] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Refreshing network info cache for port 5408a169-bdde-42da-be35-24006f474bc6 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:57:09 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797429.2895873, bc9b4047-7408-40a1-b38c-59695faffafb => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:57:09 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] VM Resumed (Lifecycle Event)
Jul 31 09:57:09 user nova-compute[71113]: DEBUG nova.compute.manager [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 09:57:09 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 09:57:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f69d43c-f8a3-4fed-a737-389c217970d8/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:09 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:57:09 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Instance spawned successfully.
Jul 31 09:57:09 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 09:57:09 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:57:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9745ff0d-8320-4689-8326-c18752c6e6ae/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:09 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:57:09 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797429.299149, bc9b4047-7408-40a1-b38c-59695faffafb => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:57:09 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] VM Started (Lifecycle Event)
Jul 31 09:57:09 user nova-compute[71113]: DEBUG nova.compute.manager [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 09:57:09 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 09:57:09 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:57:09 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Found default for hw_cdrom_bus of ide {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:57:09 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Found default for hw_disk_bus of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:57:09 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Found default for hw_input_bus of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:57:09 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Found default for hw_pointer_model of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:57:09 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Found default for hw_video_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:57:09 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Found default for hw_vif_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:57:09 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Instance spawned successfully.
Jul 31 09:57:09 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 09:57:09 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:57:09 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:57:09 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797429.4199338, 9745ff0d-8320-4689-8326-c18752c6e6ae => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:57:09 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] VM Resumed (Lifecycle Event)
Jul 31 09:57:09 user nova-compute[71113]: INFO nova.compute.manager [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Took 8.94 seconds to spawn the instance on the hypervisor.
Jul 31 09:57:09 user nova-compute[71113]: DEBUG nova.compute.manager [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:57:09 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Found default for hw_cdrom_bus of ide {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:57:09 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Found default for hw_disk_bus of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:57:09 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Found default for hw_input_bus of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:57:09 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Found default for hw_pointer_model of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:57:09 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Found default for hw_video_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:57:09 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Found default for hw_vif_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:57:09 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:57:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9745ff0d-8320-4689-8326-c18752c6e6ae/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9745ff0d-8320-4689-8326-c18752c6e6ae/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:09 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:57:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:09 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:57:09 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797429.4216492, 9745ff0d-8320-4689-8326-c18752c6e6ae => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:57:09 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] VM Started (Lifecycle Event)
Jul 31 09:57:09 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:57:09 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:57:09 user nova-compute[71113]: INFO nova.compute.manager [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Took 9.91 seconds to spawn the instance on the hypervisor.
Jul 31 09:57:09 user nova-compute[71113]: DEBUG nova.compute.manager [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:57:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9745ff0d-8320-4689-8326-c18752c6e6ae/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:09 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:57:09 user nova-compute[71113]: INFO nova.compute.manager [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Took 10.69 seconds to build instance.
Jul 31 09:57:09 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9ec65ad5-c8ae-4feb-9d47-4fbfccf4be87 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "bc9b4047-7408-40a1-b38c-59695faffafb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.836s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:57:09 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 09:57:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:10 user nova-compute[71113]: INFO nova.compute.manager [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Took 11.03 seconds to build instance.
Jul 31 09:57:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-751c6e57-6b1e-4d91-b89d-c9ba4c92a3e4 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Lock "9745ff0d-8320-4689-8326-c18752c6e6ae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.171s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:57:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc9b4047-7408-40a1-b38c-59695faffafb/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc9b4047-7408-40a1-b38c-59695faffafb/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc9b4047-7408-40a1-b38c-59695faffafb/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc9b4047-7408-40a1-b38c-59695faffafb/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:11 user nova-compute[71113]: DEBUG nova.network.neutron [req-f952821a-6318-4478-9d53-738dd61b613b req-1e6589ef-7a8e-4538-a1dd-75ecb200d679 service nova] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Updated VIF entry in instance network info cache for port 5408a169-bdde-42da-be35-24006f474bc6. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:57:11 user nova-compute[71113]: DEBUG nova.network.neutron [req-f952821a-6318-4478-9d53-738dd61b613b req-1e6589ef-7a8e-4538-a1dd-75ecb200d679 service nova] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Updating instance_info_cache with network_info: [{"id": "5408a169-bdde-42da-be35-24006f474bc6", "address": "fa:16:3e:77:a3:62", "network": {"id": "cc84435f-b983-425d-bad0-36039e592e25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1662840158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f7a5479fd014325b8790a80b2405d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5408a169-bd", "ovs_interfaceid": "5408a169-bdde-42da-be35-24006f474bc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:57:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:11 user nova-compute[71113]: DEBUG nova.compute.manager [req-b37078e9-4f95-4f9a-836e-f6b2c499d42f req-339e7c0a-aac1-4d51-9c4f-7dd9b825450c service nova] [instance: a950d710-4596-4355-ac31-568c7728335a] Received event network-changed-469843c1-3548-4bae-90bb-7fd1f5ac0052 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:57:11 user nova-compute[71113]: DEBUG nova.compute.manager [req-b37078e9-4f95-4f9a-836e-f6b2c499d42f req-339e7c0a-aac1-4d51-9c4f-7dd9b825450c service nova] [instance: a950d710-4596-4355-ac31-568c7728335a] Refreshing instance network info cache due to event network-changed-469843c1-3548-4bae-90bb-7fd1f5ac0052. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:57:11 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-b37078e9-4f95-4f9a-836e-f6b2c499d42f req-339e7c0a-aac1-4d51-9c4f-7dd9b825450c service nova] Acquiring lock "refresh_cache-a950d710-4596-4355-ac31-568c7728335a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:57:11 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-b37078e9-4f95-4f9a-836e-f6b2c499d42f req-339e7c0a-aac1-4d51-9c4f-7dd9b825450c service nova] Acquired lock "refresh_cache-a950d710-4596-4355-ac31-568c7728335a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:57:11 user nova-compute[71113]: DEBUG nova.network.neutron [req-b37078e9-4f95-4f9a-836e-f6b2c499d42f req-339e7c0a-aac1-4d51-9c4f-7dd9b825450c service nova] [instance: a950d710-4596-4355-ac31-568c7728335a] Refreshing network info cache for port 469843c1-3548-4bae-90bb-7fd1f5ac0052 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:57:11 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f952821a-6318-4478-9d53-738dd61b613b req-1e6589ef-7a8e-4538-a1dd-75ecb200d679 service nova] Releasing lock "refresh_cache-0ea0401b-26c2-4655-956b-1bc000debd53" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:57:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/208130bc-5ece-4683-aa83-505ee89a8ba5/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/208130bc-5ece-4683-aa83-505ee89a8ba5/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/208130bc-5ece-4683-aa83-505ee89a8ba5/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/208130bc-5ece-4683-aa83-505ee89a8ba5/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:12 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:57:12 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:57:12 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=7790MB free_disk=25.454734802246094GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 09:57:12 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:57:12 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:57:12 user nova-compute[71113]: DEBUG nova.compute.manager [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Stashing vm_state: active {{(pid=71113) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Jul 31 09:57:12 user nova-compute[71113]: INFO nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: a950d710-4596-4355-ac31-568c7728335a] Updating resource usage from migration 933d9c4b-c0c8-4ce0-8243-03d233c9b509
Jul 31 09:57:12 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:57:12 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 0ea0401b-26c2-4655-956b-1bc000debd53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:57:12 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance f4df9380-7882-48a6-ba64-bb17429e54ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:57:12 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 3157a7a6-b8a9-4e2d-a157-360bce4c625d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:57:12 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 92d25a03-98ce-4bde-a3cc-20313ae77d41 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:57:12 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 208130bc-5ece-4683-aa83-505ee89a8ba5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:57:12 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 5f69d43c-f8a3-4fed-a737-389c217970d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:57:12 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 9745ff0d-8320-4689-8326-c18752c6e6ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:57:12 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance bc9b4047-7408-40a1-b38c-59695faffafb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:57:12 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Migration 933d9c4b-c0c8-4ce0-8243-03d233c9b509 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Jul 31 09:57:12 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance a950d710-4596-4355-ac31-568c7728335a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:57:12 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 09:57:12 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 09:57:12 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Refreshing inventories for resource provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 31 09:57:12 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Updating ProviderTree inventory for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 31 09:57:12 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Updating inventory in ProviderTree for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 31 09:57:12 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Refreshing aggregate associations for resource provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05, aggregates: None {{(pid=71113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 31 09:57:12 user nova-compute[71113]: DEBUG nova.network.neutron [req-b37078e9-4f95-4f9a-836e-f6b2c499d42f req-339e7c0a-aac1-4d51-9c4f-7dd9b825450c service nova] [instance: a950d710-4596-4355-ac31-568c7728335a] Updated VIF entry in instance network info cache for port 469843c1-3548-4bae-90bb-7fd1f5ac0052. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:57:12 user nova-compute[71113]: DEBUG nova.network.neutron [req-b37078e9-4f95-4f9a-836e-f6b2c499d42f req-339e7c0a-aac1-4d51-9c4f-7dd9b825450c service nova] [instance: a950d710-4596-4355-ac31-568c7728335a] Updating instance_info_cache with network_info: [{"id": "469843c1-3548-4bae-90bb-7fd1f5ac0052", "address": "fa:16:3e:08:cb:ac", "network": {"id": "cc84435f-b983-425d-bad0-36039e592e25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1662840158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f7a5479fd014325b8790a80b2405d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469843c1-35", "ovs_interfaceid": "469843c1-3548-4bae-90bb-7fd1f5ac0052", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:57:12 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Refreshing trait associations for resource provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE2,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS {{(pid=71113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 31 09:57:12 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-b37078e9-4f95-4f9a-836e-f6b2c499d42f req-339e7c0a-aac1-4d51-9c4f-7dd9b825450c service nova] Releasing lock "refresh_cache-a950d710-4596-4355-ac31-568c7728335a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:57:13 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:13 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:57:13 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:57:13 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 09:57:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.018s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:57:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.775s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:57:13 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:57:13 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Cleaning up deleted instances {{(pid=71113) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 31 09:57:13 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] There are 0 instances to clean {{(pid=71113) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 31 09:57:13 user nova-compute[71113]: DEBUG nova.objects.instance [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lazy-loading 'pci_requests' on Instance uuid a950d710-4596-4355-ac31-568c7728335a {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:57:13 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 09:57:13 user nova-compute[71113]: INFO nova.compute.claims [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Claim successful on node user
Jul 31 09:57:13 user nova-compute[71113]: DEBUG nova.objects.instance [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lazy-loading 'resources' on Instance uuid a950d710-4596-4355-ac31-568c7728335a {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:57:13 user nova-compute[71113]: DEBUG nova.objects.instance [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lazy-loading 'pci_devices' on Instance uuid a950d710-4596-4355-ac31-568c7728335a {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:57:13 user nova-compute[71113]: INFO nova.compute.resource_tracker [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Updating resource usage from migration 933d9c4b-c0c8-4ce0-8243-03d233c9b509
Jul 31 09:57:13 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:14 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:57:14 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:57:14 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.683s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:57:14 user nova-compute[71113]: INFO nova.compute.manager [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Migrating
Jul 31 09:57:14 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Acquiring lock "refresh_cache-a950d710-4596-4355-ac31-568c7728335a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:57:14 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Acquired lock "refresh_cache-a950d710-4596-4355-ac31-568c7728335a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:57:14 user nova-compute[71113]: DEBUG nova.network.neutron [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 09:57:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:14 user nova-compute[71113]: DEBUG nova.network.neutron [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Updating instance_info_cache with network_info: [{"id": "469843c1-3548-4bae-90bb-7fd1f5ac0052", "address": "fa:16:3e:08:cb:ac", "network": {"id": "cc84435f-b983-425d-bad0-36039e592e25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1662840158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f7a5479fd014325b8790a80b2405d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469843c1-35", "ovs_interfaceid": "469843c1-3548-4bae-90bb-7fd1f5ac0052", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:57:14 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Releasing lock "refresh_cache-a950d710-4596-4355-ac31-568c7728335a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:57:14 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Starting migrate_disk_and_power_off {{(pid=71113) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Jul 31 09:57:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:15 user nova-compute[71113]: DEBUG nova.compute.manager [req-1b19b70c-600e-4b3c-a242-3670762c9dc3 req-2e054580-a048-442f-acef-549c98208a29 service nova] [instance: a950d710-4596-4355-ac31-568c7728335a] Received event network-vif-unplugged-469843c1-3548-4bae-90bb-7fd1f5ac0052 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:57:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1b19b70c-600e-4b3c-a242-3670762c9dc3 req-2e054580-a048-442f-acef-549c98208a29 service nova] Acquiring lock "a950d710-4596-4355-ac31-568c7728335a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:57:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1b19b70c-600e-4b3c-a242-3670762c9dc3 req-2e054580-a048-442f-acef-549c98208a29 service nova] Lock "a950d710-4596-4355-ac31-568c7728335a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:57:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1b19b70c-600e-4b3c-a242-3670762c9dc3 req-2e054580-a048-442f-acef-549c98208a29 service nova] Lock "a950d710-4596-4355-ac31-568c7728335a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:57:15 user nova-compute[71113]: DEBUG nova.compute.manager [req-1b19b70c-600e-4b3c-a242-3670762c9dc3 req-2e054580-a048-442f-acef-549c98208a29 service nova] [instance: a950d710-4596-4355-ac31-568c7728335a] No waiting events found dispatching network-vif-unplugged-469843c1-3548-4bae-90bb-7fd1f5ac0052 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:57:15 user nova-compute[71113]: WARNING nova.compute.manager [req-1b19b70c-600e-4b3c-a242-3670762c9dc3 req-2e054580-a048-442f-acef-549c98208a29 service nova] [instance: a950d710-4596-4355-ac31-568c7728335a] Received unexpected event network-vif-unplugged-469843c1-3548-4bae-90bb-7fd1f5ac0052 for instance with vm_state active and task_state resize_migrating.
Jul 31 09:57:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:16 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: a950d710-4596-4355-ac31-568c7728335a] Instance destroyed successfully.
Jul 31 09:57:16 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:55:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-834893459',display_name='tempest-ServerActionsTestOtherA-server-834893459',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-834893459',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5EE1xUvLRoodLjDMpmYpiUOpJ4L9wfbpJsZ+HUVFxXJGKbpzcG8jQIKPQ0cQElq3F/Fhyr7R6+c9C8jzz21FzCpd/o9T+iI7W2nanWOzhB0iUhT1vp4Ko8/FdZGlABXg==',key_name='tempest-keypair-58057469',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:55:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9f7a5479fd014325b8790a80b2405d1d',ramdisk_id='',reservation_id='r-l0unkf5n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2065923437',owner_user_name='tempest-ServerActionsTestOtherA-2065923437-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:57:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7029dd8d775d4c14bb349b72b1171d5f',uuid=a950d710-4596-4355-ac31-568c7728335a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "469843c1-3548-4bae-90bb-7fd1f5ac0052", "address": "fa:16:3e:08:cb:ac", "network": {"id": "cc84435f-b983-425d-bad0-36039e592e25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1662840158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1662840158-network", "vif_mac": "fa:16:3e:08:cb:ac"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f7a5479fd014325b8790a80b2405d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469843c1-35", "ovs_interfaceid": "469843c1-3548-4bae-90bb-7fd1f5ac0052", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 09:57:16 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Converting VIF {"id": "469843c1-3548-4bae-90bb-7fd1f5ac0052", "address": "fa:16:3e:08:cb:ac", "network": {"id": "cc84435f-b983-425d-bad0-36039e592e25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1662840158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1662840158-network", "vif_mac": "fa:16:3e:08:cb:ac"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f7a5479fd014325b8790a80b2405d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469843c1-35", "ovs_interfaceid": "469843c1-3548-4bae-90bb-7fd1f5ac0052", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:57:16 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:cb:ac,bridge_name='br-int',has_traffic_filtering=True,id=469843c1-3548-4bae-90bb-7fd1f5ac0052,network=Network(cc84435f-b983-425d-bad0-36039e592e25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469843c1-35') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:57:16 user nova-compute[71113]: DEBUG os_vif [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:cb:ac,bridge_name='br-int',has_traffic_filtering=True,id=469843c1-3548-4bae-90bb-7fd1f5ac0052,network=Network(cc84435f-b983-425d-bad0-36039e592e25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469843c1-35') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 09:57:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap469843c1-35, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:57:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:57:16 user nova-compute[71113]: INFO os_vif [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:cb:ac,bridge_name='br-int',has_traffic_filtering=True,id=469843c1-3548-4bae-90bb-7fd1f5ac0052,network=Network(cc84435f-b983-425d-bad0-36039e592e25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469843c1-35')
Jul 31 09:57:16 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 09:57:16 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vwYotCOs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:57:16 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:57:16 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:57:16 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:57:16 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 09:57:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:16 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6819e27a-26ae-44be-833b-16150b8b230b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:57:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:16 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16ad903-3e1b-4e3a-92ef-d1acea6e1ddd]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:57:16 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:57:16 user nova-compute[71113]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)
Jul 31 09:57:16 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:57:16 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:57:16 user nova-compute[71113]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)
Jul 31 09:57:16 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:57:16 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7916f9b400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38'): ({'sdb'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 09:57:16 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Removing single pathed devices sdb {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 09:57:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:16 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc8477d-d047-48ff-a1e9-0661c97119b2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:57:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.037s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:16 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aaea994-1d36-4704-bf9f-f1354d2b8712]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:57:16 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Flushing IO for device /dev/sdb {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 09:57:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:16 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c68e188-4bb8-424e-b623-42b9b9d7a45f]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:57:16 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 09:57:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.060s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:16 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[131f6cc6-f4de-4534-904a-1a8550f1ee76]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:57:16 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 09:57:16 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] SCSI volumes sdb have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 09:57:16 user nova-compute[71113]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOaff69371-0ceceab6735c88fb', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_aff69371', '/dev/disk/by-id/scsi-23063656365616236') {{(pid=81983) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 31 09:57:16 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4886f28-4938-4eb0-9a02-33727494db01]: (4, None) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:57:16 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 09:57:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:16 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60dc294-c694-4174-9043-701d681c56b6]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:57:16 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:57:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:16 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9820698-36a7-4e26-a44b-ab3ddaf4d45f]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:57:16 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38, portal: 172.16.0.220,3260]
Jul 31 09:57:16 user nova-compute[71113]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38, portal: 172.16.0.220,3260] successful.
Jul 31 09:57:16 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:57:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:16 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b557fdb5-1101-48a0-afcb-0691b471a3bc]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:57:16 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:57:16 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.402s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:57:16 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] <== disconnect_volume: return (405ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:57:16 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 09:57:16 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 09:57:17 user nova-compute[71113]: DEBUG nova.compute.manager [req-e10fed41-a331-43a2-aa69-a3d5d174d405 req-5bdb9757-36b9-4a28-b0f1-1e8b855f2d91 service nova] [instance: a950d710-4596-4355-ac31-568c7728335a] Received event network-vif-plugged-469843c1-3548-4bae-90bb-7fd1f5ac0052 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:57:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e10fed41-a331-43a2-aa69-a3d5d174d405 req-5bdb9757-36b9-4a28-b0f1-1e8b855f2d91 service nova] Acquiring lock "a950d710-4596-4355-ac31-568c7728335a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:57:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e10fed41-a331-43a2-aa69-a3d5d174d405 req-5bdb9757-36b9-4a28-b0f1-1e8b855f2d91 service nova] Lock "a950d710-4596-4355-ac31-568c7728335a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:57:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e10fed41-a331-43a2-aa69-a3d5d174d405 req-5bdb9757-36b9-4a28-b0f1-1e8b855f2d91 service nova] Lock "a950d710-4596-4355-ac31-568c7728335a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:57:17 user nova-compute[71113]: DEBUG nova.compute.manager [req-e10fed41-a331-43a2-aa69-a3d5d174d405 req-5bdb9757-36b9-4a28-b0f1-1e8b855f2d91 service nova] [instance: a950d710-4596-4355-ac31-568c7728335a] No waiting events found dispatching network-vif-plugged-469843c1-3548-4bae-90bb-7fd1f5ac0052 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:57:17 user nova-compute[71113]: WARNING nova.compute.manager [req-e10fed41-a331-43a2-aa69-a3d5d174d405 req-5bdb9757-36b9-4a28-b0f1-1e8b855f2d91 service nova] [instance: a950d710-4596-4355-ac31-568c7728335a] Received unexpected event network-vif-plugged-469843c1-3548-4bae-90bb-7fd1f5ac0052 for instance with vm_state active and task_state resize_migrating.
Jul 31 09:57:17 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:57:17 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:57:17 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 09:57:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "refresh_cache-3157a7a6-b8a9-4e2d-a157-360bce4c625d" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:57:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquired lock "refresh_cache-3157a7a6-b8a9-4e2d-a157-360bce4c625d" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:57:17 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Forcefully refreshing network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 09:57:17 user nova-compute[71113]: DEBUG nova.network.neutron [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Port 469843c1-3548-4bae-90bb-7fd1f5ac0052 binding to destination host user is already ACTIVE {{(pid=71113) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 31 09:57:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Acquiring lock "a950d710-4596-4355-ac31-568c7728335a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:57:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "a950d710-4596-4355-ac31-568c7728335a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:57:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "a950d710-4596-4355-ac31-568c7728335a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:57:18 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Updating instance_info_cache with network_info: [{"id": "179480f5-30b9-4a11-9771-95d88f21574f", "address": "fa:16:3e:42:ea:05", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap179480f5-30", "ovs_interfaceid": "179480f5-30b9-4a11-9771-95d88f21574f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:57:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Acquiring lock "refresh_cache-a950d710-4596-4355-ac31-568c7728335a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:57:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Acquired lock "refresh_cache-a950d710-4596-4355-ac31-568c7728335a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:57:18 user nova-compute[71113]: DEBUG nova.network.neutron [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 09:57:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Releasing lock "refresh_cache-3157a7a6-b8a9-4e2d-a157-360bce4c625d" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:57:18 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Updated the network info_cache for instance {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 09:57:18 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:57:19 user nova-compute[71113]: DEBUG nova.network.neutron [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Updating instance_info_cache with network_info: [{"id": "469843c1-3548-4bae-90bb-7fd1f5ac0052", "address": "fa:16:3e:08:cb:ac", "network": {"id": "cc84435f-b983-425d-bad0-36039e592e25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1662840158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f7a5479fd014325b8790a80b2405d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469843c1-35", "ovs_interfaceid": "469843c1-3548-4bae-90bb-7fd1f5ac0052", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:57:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Releasing lock "refresh_cache-a950d710-4596-4355-ac31-568c7728335a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:57:19 user nova-compute[71113]: DEBUG os_brick.utils [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:57:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:19 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6caeacc-a1c3-4ecb-965c-9a41995e7bd1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:57:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:19 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b854b167-8fd5-48c7-b36f-8d3f0355da22]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:57:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.028s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:19 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[33952039-eb81-448c-94fe-8a770c5dbd1e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:57:19 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b400b0d-0a55-4762-940b-f651a953703a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:57:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:57:19 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 09:57:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:57:19 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 09:57:19 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d92f7b-f3a6-49f5-940b-f1c129aaec5d]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:57:19 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 09:57:19 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 09:57:19 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 09:57:19 user nova-compute[71113]: DEBUG os_brick.utils [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] <== get_connector_properties: return (190ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:57:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:20 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:57:20 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71113) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 31 09:57:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:30 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690797435.966461, a950d710-4596-4355-ac31-568c7728335a => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:57:30 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: a950d710-4596-4355-ac31-568c7728335a] VM Stopped (Lifecycle Event)
Jul 31 09:57:30 user nova-compute[71113]: DEBUG nova.compute.manager [None req-9c0f9a06-b66e-43aa-8132-dc51614b8167 None None] [instance: a950d710-4596-4355-ac31-568c7728335a] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:57:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:31 user nova-compute[71113]: DEBUG nova.compute.manager [None req-9c0f9a06-b66e-43aa-8132-dc51614b8167 None None] [instance: a950d710-4596-4355-ac31-568c7728335a] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:57:31 user nova-compute[71113]: INFO nova.compute.manager [None req-9c0f9a06-b66e-43aa-8132-dc51614b8167 None None] [instance: a950d710-4596-4355-ac31-568c7728335a] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 31 09:57:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Starting finish_migration {{(pid=71113) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Instance directory exists: not creating {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 31 09:57:36 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Creating image(s)
Jul 31 09:57:36 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Did not create local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Ensure instance console log exists: /opt/stack/data/nova/instances/a950d710-4596-4355-ac31-568c7728335a/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Start _get_guest_xml network_info=[{"id": "469843c1-3548-4bae-90bb-7fd1f5ac0052", "address": "fa:16:3e:08:cb:ac", "network": {"id": "cc84435f-b983-425d-bad0-36039e592e25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1662840158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1662840158-network", "vif_mac": "fa:16:3e:08:cb:ac"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f7a5479fd014325b8790a80b2405d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469843c1-35", "ovs_interfaceid": "469843c1-3548-4bae-90bb-7fd1f5ac0052", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '9d802cd1-4d96-40d1-9588-ba0cfbc8906c', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vwYotCOs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'a950d710-4596-4355-ac31-568c7728335a', 'attached_at': '2023-07-31T09:57:36.000000', 'detached_at': '', 'volume_id': '78ea4913-8d79-4c9a-9324-c2d9f86c6d38', 'serial': '78ea4913-8d79-4c9a-9324-c2d9f86c6d38'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 09:57:36 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:57:36 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:57:36 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG nova.objects.instance [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lazy-loading 'vcpu_model' on Instance uuid a950d710-4596-4355-ac31-568c7728335a {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vwYotCOs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:57:36 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:57:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:57:36 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:57:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:57:36 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 09:57:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d528a21-2536-45f3-92e9-92bd6462b2da]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 09:57:36 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a583bc63-b8fe-46fd-b95f-955a73ef85d6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38] added
Jul 31 09:57:36 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d172c76-81a4-463b-ba4b-8f394b20c19d]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[da635e80-0046-4f27-99a0-3ec83d6349da]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vwYotCOs {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vwYotCOs" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82d8ea0-80f4-40b5-922f-edaac4383b50]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vwYotCOs'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[321cacc6-213c-4dad-8c1c-24685d5b7e57]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[baea7610-d7b5-4c61-92ac-ae903cbc4df7]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:57:36 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:57:36 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[24bf9243-4a05-4432-8971-179bbffdadcc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38, portal: 172.16.0.220,3260]
Jul 31 09:57:36 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38, portal: 172.16.0.220,3260] successful.
Jul 31 09:57:36 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[146245cb-fdec-4add-8d8f-cbf694d15c96]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a65e8e2-eca4-4060-8f68-d6254772dcc5]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:57:36 user nova-compute[71113]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)
Jul 31 09:57:36 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:57:36 user nova-compute[71113]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)
Jul 31 09:57:36 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] HCTL ('33', '-', '-', 0) found on session 30 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[358e4f98-d08b-4ee2-9ae6-85aca01eb9dd]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 09:57:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vwYotCOs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 09:57:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:57:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '23063656365616236', 'path': '/dev/sdb'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:57:37 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063656365616236', 'path': '/dev/sdb'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 09:57:37 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:55:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-834893459',display_name='tempest-ServerActionsTestOtherA-server-834893459',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-834893459',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5EE1xUvLRoodLjDMpmYpiUOpJ4L9wfbpJsZ+HUVFxXJGKbpzcG8jQIKPQ0cQElq3F/Fhyr7R6+c9C8jzz21FzCpd/o9T+iI7W2nanWOzhB0iUhT1vp4Ko8/FdZGlABXg==',key_name='tempest-keypair-58057469',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:55:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9f7a5479fd014325b8790a80b2405d1d',ramdisk_id='',reservation_id='r-l0unkf5n',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2065923437',owner_user_name='tempest-ServerActionsTestOtherA-2065923437-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:57:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7029dd8d775d4c14bb349b72b1171d5f',uuid=a950d710-4596-4355-ac31-568c7728335a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "469843c1-3548-4bae-90bb-7fd1f5ac0052", "address": "fa:16:3e:08:cb:ac", "network": {"id": "cc84435f-b983-425d-bad0-36039e592e25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1662840158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1662840158-network", "vif_mac": "fa:16:3e:08:cb:ac"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f7a5479fd014325b8790a80b2405d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469843c1-35", "ovs_interfaceid": "469843c1-3548-4bae-90bb-7fd1f5ac0052", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 09:57:37 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Converting VIF {"id": "469843c1-3548-4bae-90bb-7fd1f5ac0052", "address": "fa:16:3e:08:cb:ac", "network": {"id": "cc84435f-b983-425d-bad0-36039e592e25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1662840158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1662840158-network", "vif_mac": "fa:16:3e:08:cb:ac"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f7a5479fd014325b8790a80b2405d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469843c1-35", "ovs_interfaceid": "469843c1-3548-4bae-90bb-7fd1f5ac0052", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:57:37 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:cb:ac,bridge_name='br-int',has_traffic_filtering=True,id=469843c1-3548-4bae-90bb-7fd1f5ac0052,network=Network(cc84435f-b983-425d-bad0-36039e592e25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469843c1-35') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:57:37 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] End _get_guest_xml xml=<domain type="kvm">
Jul 31 09:57:37 user nova-compute[71113]:   <uuid>a950d710-4596-4355-ac31-568c7728335a</uuid>
Jul 31 09:57:37 user nova-compute[71113]:   <name>instance-00000017</name>
Jul 31 09:57:37 user nova-compute[71113]:   <memory>2097152</memory>
Jul 31 09:57:37 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 09:57:37 user nova-compute[71113]:   <metadata>
Jul 31 09:57:37 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 09:57:37 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 09:57:37 user nova-compute[71113]:       <nova:name>tempest-ServerActionsTestOtherA-server-834893459</nova:name>
Jul 31 09:57:37 user nova-compute[71113]:       <nova:creationTime>2023-07-31 09:57:36</nova:creationTime>
Jul 31 09:57:37 user nova-compute[71113]:       <nova:flavor name="m1.small">
Jul 31 09:57:37 user nova-compute[71113]:         <nova:memory>2048</nova:memory>
Jul 31 09:57:37 user nova-compute[71113]:         <nova:disk>20</nova:disk>
Jul 31 09:57:37 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 09:57:37 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 09:57:37 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 09:57:37 user nova-compute[71113]:       </nova:flavor>
Jul 31 09:57:37 user nova-compute[71113]:       <nova:owner>
Jul 31 09:57:37 user nova-compute[71113]:         <nova:user uuid="7029dd8d775d4c14bb349b72b1171d5f">tempest-ServerActionsTestOtherA-2065923437-project-member</nova:user>
Jul 31 09:57:37 user nova-compute[71113]:         <nova:project uuid="9f7a5479fd014325b8790a80b2405d1d">tempest-ServerActionsTestOtherA-2065923437</nova:project>
Jul 31 09:57:37 user nova-compute[71113]:       </nova:owner>
Jul 31 09:57:37 user nova-compute[71113]:       <nova:ports>
Jul 31 09:57:37 user nova-compute[71113]:         <nova:port uuid="469843c1-3548-4bae-90bb-7fd1f5ac0052">
Jul 31 09:57:37 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 31 09:57:37 user nova-compute[71113]:         </nova:port>
Jul 31 09:57:37 user nova-compute[71113]:       </nova:ports>
Jul 31 09:57:37 user nova-compute[71113]:     </nova:instance>
Jul 31 09:57:37 user nova-compute[71113]:   </metadata>
Jul 31 09:57:37 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 09:57:37 user nova-compute[71113]:     <system>
Jul 31 09:57:37 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 09:57:37 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 09:57:37 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 09:57:37 user nova-compute[71113]:       <entry name="serial">a950d710-4596-4355-ac31-568c7728335a</entry>
Jul 31 09:57:37 user nova-compute[71113]:       <entry name="uuid">a950d710-4596-4355-ac31-568c7728335a</entry>
Jul 31 09:57:37 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 09:57:37 user nova-compute[71113]:     </system>
Jul 31 09:57:37 user nova-compute[71113]:   </sysinfo>
Jul 31 09:57:37 user nova-compute[71113]:   <os>
Jul 31 09:57:37 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 09:57:37 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 09:57:37 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 09:57:37 user nova-compute[71113]:   </os>
Jul 31 09:57:37 user nova-compute[71113]:   <features>
Jul 31 09:57:37 user nova-compute[71113]:     <acpi/>
Jul 31 09:57:37 user nova-compute[71113]:     <apic/>
Jul 31 09:57:37 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 09:57:37 user nova-compute[71113]:   </features>
Jul 31 09:57:37 user nova-compute[71113]:   <clock offset="utc">
Jul 31 09:57:37 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 09:57:37 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 09:57:37 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 09:57:37 user nova-compute[71113]:   </clock>
Jul 31 09:57:37 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 09:57:37 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 09:57:37 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 09:57:37 user nova-compute[71113]:   </cpu>
Jul 31 09:57:37 user nova-compute[71113]:   <devices>
Jul 31 09:57:37 user nova-compute[71113]:     <disk type="block" device="disk">
Jul 31 09:57:37 user nova-compute[71113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:57:37 user nova-compute[71113]:       <source dev="/dev/sdb"/>
Jul 31 09:57:37 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 09:57:37 user nova-compute[71113]:       <serial>78ea4913-8d79-4c9a-9324-c2d9f86c6d38</serial>
Jul 31 09:57:37 user nova-compute[71113]:     </disk>
Jul 31 09:57:37 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 09:57:37 user nova-compute[71113]:       <mac address="fa:16:3e:08:cb:ac"/>
Jul 31 09:57:37 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:57:37 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 09:57:37 user nova-compute[71113]:       <target dev="tap469843c1-35"/>
Jul 31 09:57:37 user nova-compute[71113]:     </interface>
Jul 31 09:57:37 user nova-compute[71113]:     <serial type="pty">
Jul 31 09:57:37 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/a950d710-4596-4355-ac31-568c7728335a/console.log" append="off"/>
Jul 31 09:57:37 user nova-compute[71113]:     </serial>
Jul 31 09:57:37 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 09:57:37 user nova-compute[71113]:     <video>
Jul 31 09:57:37 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:57:37 user nova-compute[71113]:     </video>
Jul 31 09:57:37 user nova-compute[71113]:     <rng model="virtio">
Jul 31 09:57:37 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 09:57:37 user nova-compute[71113]:     </rng>
Jul 31 09:57:37 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 09:57:37 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 09:57:37 user nova-compute[71113]:       <stats period="10"/>
Jul 31 09:57:37 user nova-compute[71113]:     </memballoon>
Jul 31 09:57:37 user nova-compute[71113]:   </devices>
Jul 31 09:57:37 user nova-compute[71113]: </domain>
Jul 31 09:57:37 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 09:57:37 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:55:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-834893459',display_name='tempest-ServerActionsTestOtherA-server-834893459',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-834893459',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5EE1xUvLRoodLjDMpmYpiUOpJ4L9wfbpJsZ+HUVFxXJGKbpzcG8jQIKPQ0cQElq3F/Fhyr7R6+c9C8jzz21FzCpd/o9T+iI7W2nanWOzhB0iUhT1vp4Ko8/FdZGlABXg==',key_name='tempest-keypair-58057469',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:55:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9f7a5479fd014325b8790a80b2405d1d',ramdisk_id='',reservation_id='r-l0unkf5n',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2065923437',owner_user_name='tempest-ServerActionsTestOtherA-2065923437-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:57:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7029dd8d775d4c14bb349b72b1171d5f',uuid=a950d710-4596-4355-ac31-568c7728335a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "469843c1-3548-4bae-90bb-7fd1f5ac0052", "address": "fa:16:3e:08:cb:ac", "network": {"id": "cc84435f-b983-425d-bad0-36039e592e25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1662840158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1662840158-network", "vif_mac": "fa:16:3e:08:cb:ac"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f7a5479fd014325b8790a80b2405d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469843c1-35", "ovs_interfaceid": "469843c1-3548-4bae-90bb-7fd1f5ac0052", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 09:57:37 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Converting VIF {"id": "469843c1-3548-4bae-90bb-7fd1f5ac0052", "address": "fa:16:3e:08:cb:ac", "network": {"id": "cc84435f-b983-425d-bad0-36039e592e25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1662840158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1662840158-network", "vif_mac": "fa:16:3e:08:cb:ac"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f7a5479fd014325b8790a80b2405d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469843c1-35", "ovs_interfaceid": "469843c1-3548-4bae-90bb-7fd1f5ac0052", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:57:37 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:cb:ac,bridge_name='br-int',has_traffic_filtering=True,id=469843c1-3548-4bae-90bb-7fd1f5ac0052,network=Network(cc84435f-b983-425d-bad0-36039e592e25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469843c1-35') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:57:37 user nova-compute[71113]: DEBUG os_vif [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:cb:ac,bridge_name='br-int',has_traffic_filtering=True,id=469843c1-3548-4bae-90bb-7fd1f5ac0052,network=Network(cc84435f-b983-425d-bad0-36039e592e25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469843c1-35') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 09:57:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:57:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 09:57:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap469843c1-35, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:57:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap469843c1-35, col_values=(('external_ids', {'iface-id': '469843c1-3548-4bae-90bb-7fd1f5ac0052', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:cb:ac', 'vm-uuid': 'a950d710-4596-4355-ac31-568c7728335a'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:57:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:57:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:37 user nova-compute[71113]: INFO os_vif [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:cb:ac,bridge_name='br-int',has_traffic_filtering=True,id=469843c1-3548-4bae-90bb-7fd1f5ac0052,network=Network(cc84435f-b983-425d-bad0-36039e592e25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469843c1-35')
Jul 31 09:57:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Acquiring lock "c4b88201-04dc-4da9-b213-c50cdf274f4e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:57:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lock "c4b88201-04dc-4da9-b213-c50cdf274f4e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:57:38 user nova-compute[71113]: DEBUG nova.compute.manager [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Starting instance... {{(pid=71113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 09:57:38 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:57:38 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] No VIF found with MAC fa:16:3e:08:cb:ac, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 09:57:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:57:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:57:38 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 09:57:38 user nova-compute[71113]: INFO nova.compute.claims [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Claim successful on node user
Jul 31 09:57:38 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:57:38 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:57:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.448s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:57:38 user nova-compute[71113]: DEBUG nova.compute.manager [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Start building networks asynchronously for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 09:57:38 user nova-compute[71113]: DEBUG nova.compute.manager [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Allocating IP information in the background. {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 09:57:38 user nova-compute[71113]: DEBUG nova.network.neutron [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] allocate_for_instance() {{(pid=71113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 09:57:38 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 09:57:38 user nova-compute[71113]: DEBUG nova.compute.manager [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Start building block device mappings for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 09:57:38 user nova-compute[71113]: INFO nova.compute.manager [None req-6ed4f2a3-526e-4c7b-b6c7-8b08acf5f405 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Unrescuing
Jul 31 09:57:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-6ed4f2a3-526e-4c7b-b6c7-8b08acf5f405 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquiring lock "refresh_cache-92d25a03-98ce-4bde-a3cc-20313ae77d41" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:57:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-6ed4f2a3-526e-4c7b-b6c7-8b08acf5f405 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquired lock "refresh_cache-92d25a03-98ce-4bde-a3cc-20313ae77d41" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:57:38 user nova-compute[71113]: DEBUG nova.network.neutron [None req-6ed4f2a3-526e-4c7b-b6c7-8b08acf5f405 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 09:57:38 user nova-compute[71113]: DEBUG nova.compute.manager [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Start spawning the instance on the hypervisor. {{(pid=71113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 09:57:38 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 09:57:38 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Creating image(s)
Jul 31 09:57:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Acquiring lock "/opt/stack/data/nova/instances/c4b88201-04dc-4da9-b213-c50cdf274f4e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:57:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lock "/opt/stack/data/nova/instances/c4b88201-04dc-4da9-b213-c50cdf274f4e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:57:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lock "/opt/stack/data/nova/instances/c4b88201-04dc-4da9-b213-c50cdf274f4e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:57:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.151s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Acquiring lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:57:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:57:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:39 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.172s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:39 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/c4b88201-04dc-4da9-b213-c50cdf274f4e/disk 1073741824 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:39 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/c4b88201-04dc-4da9-b213-c50cdf274f4e/disk 1073741824" returned: 0 in 0.055s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:57:39 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:39 user nova-compute[71113]: DEBUG nova.network.neutron [None req-6ed4f2a3-526e-4c7b-b6c7-8b08acf5f405 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Updating instance_info_cache with network_info: [{"id": "e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d", "address": "fa:16:3e:2c:5b:c3", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape82fc7e2-25", "ovs_interfaceid": "e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:57:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-6ed4f2a3-526e-4c7b-b6c7-8b08acf5f405 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Releasing lock "refresh_cache-92d25a03-98ce-4bde-a3cc-20313ae77d41" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:57:39 user nova-compute[71113]: DEBUG nova.objects.instance [None req-6ed4f2a3-526e-4c7b-b6c7-8b08acf5f405 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lazy-loading 'flavor' on Instance uuid 92d25a03-98ce-4bde-a3cc-20313ae77d41 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:57:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:39 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.146s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:39 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c4b88201-04dc-4da9-b213-c50cdf274f4e/disk. size=1073741824 {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 09:57:39 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b88201-04dc-4da9-b213-c50cdf274f4e/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:39 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b88201-04dc-4da9-b213-c50cdf274f4e/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:39 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Cannot resize image /opt/stack/data/nova/instances/c4b88201-04dc-4da9-b213-c50cdf274f4e/disk to a smaller size. {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 09:57:39 user nova-compute[71113]: DEBUG nova.objects.instance [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lazy-loading 'migration_context' on Instance uuid c4b88201-04dc-4da9-b213-c50cdf274f4e {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:57:39 user nova-compute[71113]: DEBUG nova.policy [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ba2fd55dd96b4c49bb0c1c98c0a724d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b02badf8ea4f32a5e259c25120eac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71113) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 09:57:39 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Created local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 09:57:39 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Ensure instance console log exists: /opt/stack/data/nova/instances/c4b88201-04dc-4da9-b213-c50cdf274f4e/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 09:57:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:57:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:57:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:57:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:39 user nova-compute[71113]: DEBUG nova.compute.manager [req-619bad51-bbd5-4964-ae1d-f6d8dc07ff13 req-df3d1282-a12b-418f-a98a-6677306067fc service nova] [instance: a950d710-4596-4355-ac31-568c7728335a] Received event network-vif-plugged-469843c1-3548-4bae-90bb-7fd1f5ac0052 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:57:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-619bad51-bbd5-4964-ae1d-f6d8dc07ff13 req-df3d1282-a12b-418f-a98a-6677306067fc service nova] Acquiring lock "a950d710-4596-4355-ac31-568c7728335a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:57:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-619bad51-bbd5-4964-ae1d-f6d8dc07ff13 req-df3d1282-a12b-418f-a98a-6677306067fc service nova] Lock "a950d710-4596-4355-ac31-568c7728335a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:57:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-619bad51-bbd5-4964-ae1d-f6d8dc07ff13 req-df3d1282-a12b-418f-a98a-6677306067fc service nova] Lock "a950d710-4596-4355-ac31-568c7728335a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:57:39 user nova-compute[71113]: DEBUG nova.compute.manager [req-619bad51-bbd5-4964-ae1d-f6d8dc07ff13 req-df3d1282-a12b-418f-a98a-6677306067fc service nova] [instance: a950d710-4596-4355-ac31-568c7728335a] No waiting events found dispatching network-vif-plugged-469843c1-3548-4bae-90bb-7fd1f5ac0052 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:57:39 user nova-compute[71113]: WARNING nova.compute.manager [req-619bad51-bbd5-4964-ae1d-f6d8dc07ff13 req-df3d1282-a12b-418f-a98a-6677306067fc service nova] [instance: a950d710-4596-4355-ac31-568c7728335a] Received unexpected event network-vif-plugged-469843c1-3548-4bae-90bb-7fd1f5ac0052 for instance with vm_state active and task_state resize_finish.
Jul 31 09:57:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:39 user nova-compute[71113]: DEBUG nova.compute.manager [req-ccc70755-cad9-4a6d-8d77-73a750a08277 req-dd9182c9-fec4-4bd9-9a85-f9c577c492e2 service nova] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Received event network-vif-unplugged-e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:57:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ccc70755-cad9-4a6d-8d77-73a750a08277 req-dd9182c9-fec4-4bd9-9a85-f9c577c492e2 service nova] Acquiring lock "92d25a03-98ce-4bde-a3cc-20313ae77d41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:57:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ccc70755-cad9-4a6d-8d77-73a750a08277 req-dd9182c9-fec4-4bd9-9a85-f9c577c492e2 service nova] Lock "92d25a03-98ce-4bde-a3cc-20313ae77d41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:57:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ccc70755-cad9-4a6d-8d77-73a750a08277 req-dd9182c9-fec4-4bd9-9a85-f9c577c492e2 service nova] Lock "92d25a03-98ce-4bde-a3cc-20313ae77d41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:57:39 user nova-compute[71113]: DEBUG nova.compute.manager [req-ccc70755-cad9-4a6d-8d77-73a750a08277 req-dd9182c9-fec4-4bd9-9a85-f9c577c492e2 service nova] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] No waiting events found dispatching network-vif-unplugged-e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:57:39 user nova-compute[71113]: WARNING nova.compute.manager [req-ccc70755-cad9-4a6d-8d77-73a750a08277 req-dd9182c9-fec4-4bd9-9a85-f9c577c492e2 service nova] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Received unexpected event network-vif-unplugged-e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d for instance with vm_state rescued and task_state unrescuing.
Jul 31 09:57:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:40 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:40 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Instance destroyed successfully.
Jul 31 09:57:40 user nova-compute[71113]: DEBUG nova.network.neutron [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Successfully created port: b9c0f910-2e85-41e6-903c-4b678d4fbe5e {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 09:57:41 user nova-compute[71113]: DEBUG nova.network.neutron [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Successfully updated port: b9c0f910-2e85-41e6-903c-4b678d4fbe5e {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 09:57:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Acquiring lock "refresh_cache-c4b88201-04dc-4da9-b213-c50cdf274f4e" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:57:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Acquired lock "refresh_cache-c4b88201-04dc-4da9-b213-c50cdf274f4e" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:57:41 user nova-compute[71113]: DEBUG nova.network.neutron [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 09:57:41 user nova-compute[71113]: DEBUG nova.compute.manager [req-0cb7ee32-e58e-4f79-8073-e87631efb5c7 req-707fe427-60a4-4ae5-b735-0a24b3918e32 service nova] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Received event network-changed-b9c0f910-2e85-41e6-903c-4b678d4fbe5e {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:57:41 user nova-compute[71113]: DEBUG nova.compute.manager [req-0cb7ee32-e58e-4f79-8073-e87631efb5c7 req-707fe427-60a4-4ae5-b735-0a24b3918e32 service nova] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Refreshing instance network info cache due to event network-changed-b9c0f910-2e85-41e6-903c-4b678d4fbe5e. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:57:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-0cb7ee32-e58e-4f79-8073-e87631efb5c7 req-707fe427-60a4-4ae5-b735-0a24b3918e32 service nova] Acquiring lock "refresh_cache-c4b88201-04dc-4da9-b213-c50cdf274f4e" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:57:41 user nova-compute[71113]: DEBUG nova.network.neutron [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 09:57:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:41 user nova-compute[71113]: DEBUG nova.compute.manager [req-6dfd8ca6-0acd-42a2-929b-8ef25da4c169 req-c23da219-f789-4db2-8143-d6a7b1c3e138 service nova] [instance: a950d710-4596-4355-ac31-568c7728335a] Received event network-vif-plugged-469843c1-3548-4bae-90bb-7fd1f5ac0052 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:57:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-6dfd8ca6-0acd-42a2-929b-8ef25da4c169 req-c23da219-f789-4db2-8143-d6a7b1c3e138 service nova] Acquiring lock "a950d710-4596-4355-ac31-568c7728335a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:57:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-6dfd8ca6-0acd-42a2-929b-8ef25da4c169 req-c23da219-f789-4db2-8143-d6a7b1c3e138 service nova] Lock "a950d710-4596-4355-ac31-568c7728335a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:57:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-6dfd8ca6-0acd-42a2-929b-8ef25da4c169 req-c23da219-f789-4db2-8143-d6a7b1c3e138 service nova] Lock "a950d710-4596-4355-ac31-568c7728335a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:57:41 user nova-compute[71113]: DEBUG nova.compute.manager [req-6dfd8ca6-0acd-42a2-929b-8ef25da4c169 req-c23da219-f789-4db2-8143-d6a7b1c3e138 service nova] [instance: a950d710-4596-4355-ac31-568c7728335a] No waiting events found dispatching network-vif-plugged-469843c1-3548-4bae-90bb-7fd1f5ac0052 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:57:41 user nova-compute[71113]: WARNING nova.compute.manager [req-6dfd8ca6-0acd-42a2-929b-8ef25da4c169 req-c23da219-f789-4db2-8143-d6a7b1c3e138 service nova] [instance: a950d710-4596-4355-ac31-568c7728335a] Received unexpected event network-vif-plugged-469843c1-3548-4bae-90bb-7fd1f5ac0052 for instance with vm_state active and task_state resize_finish.
Jul 31 09:57:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:41 user nova-compute[71113]: DEBUG nova.compute.manager [req-63d063b9-c5ef-4fdc-84e2-c7cddc05a380 req-56b1cef3-cf29-4c2b-a85f-44831c423091 service nova] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Received event network-vif-plugged-e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:57:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-63d063b9-c5ef-4fdc-84e2-c7cddc05a380 req-56b1cef3-cf29-4c2b-a85f-44831c423091 service nova] Acquiring lock "92d25a03-98ce-4bde-a3cc-20313ae77d41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:57:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-63d063b9-c5ef-4fdc-84e2-c7cddc05a380 req-56b1cef3-cf29-4c2b-a85f-44831c423091 service nova] Lock "92d25a03-98ce-4bde-a3cc-20313ae77d41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:57:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-63d063b9-c5ef-4fdc-84e2-c7cddc05a380 req-56b1cef3-cf29-4c2b-a85f-44831c423091 service nova] Lock "92d25a03-98ce-4bde-a3cc-20313ae77d41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:57:41 user nova-compute[71113]: DEBUG nova.compute.manager [req-63d063b9-c5ef-4fdc-84e2-c7cddc05a380 req-56b1cef3-cf29-4c2b-a85f-44831c423091 service nova] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] No waiting events found dispatching network-vif-plugged-e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:57:41 user nova-compute[71113]: WARNING nova.compute.manager [req-63d063b9-c5ef-4fdc-84e2-c7cddc05a380 req-56b1cef3-cf29-4c2b-a85f-44831c423091 service nova] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Received unexpected event network-vif-plugged-e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d for instance with vm_state rescued and task_state unrescuing.
Jul 31 09:57:41 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797461.8373294, a950d710-4596-4355-ac31-568c7728335a => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:57:41 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: a950d710-4596-4355-ac31-568c7728335a] VM Resumed (Lifecycle Event)
Jul 31 09:57:41 user nova-compute[71113]: DEBUG nova.compute.manager [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 09:57:41 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: a950d710-4596-4355-ac31-568c7728335a] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:57:41 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: a950d710-4596-4355-ac31-568c7728335a] Instance running successfully.
Jul 31 09:57:41 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Failed to set time: agent not configured {{(pid=71113) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Jul 31 09:57:41 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-849d3668-711a-4752-a8f9-2c0771046550 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] finish_migration finished successfully. {{(pid=71113) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Jul 31 09:57:41 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: a950d710-4596-4355-ac31-568c7728335a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:57:41 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: a950d710-4596-4355-ac31-568c7728335a] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 31 09:57:41 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797461.8379972, a950d710-4596-4355-ac31-568c7728335a => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:57:41 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: a950d710-4596-4355-ac31-568c7728335a] VM Started (Lifecycle Event)
Jul 31 09:57:41 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: a950d710-4596-4355-ac31-568c7728335a] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:57:41 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: a950d710-4596-4355-ac31-568c7728335a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:57:41 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: a950d710-4596-4355-ac31-568c7728335a] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 31 09:57:42 user nova-compute[71113]: DEBUG nova.network.neutron [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Updating instance_info_cache with network_info: [{"id": "b9c0f910-2e85-41e6-903c-4b678d4fbe5e", "address": "fa:16:3e:1b:88:27", "network": {"id": "5f333808-4342-4014-9221-7ccd394eff66", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-42408734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4b02badf8ea4f32a5e259c25120eac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9c0f910-2e", "ovs_interfaceid": "b9c0f910-2e85-41e6-903c-4b678d4fbe5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:57:42 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Releasing lock "refresh_cache-c4b88201-04dc-4da9-b213-c50cdf274f4e" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:57:42 user nova-compute[71113]: DEBUG nova.compute.manager [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Instance network_info: |[{"id": "b9c0f910-2e85-41e6-903c-4b678d4fbe5e", "address": "fa:16:3e:1b:88:27", "network": {"id": "5f333808-4342-4014-9221-7ccd394eff66", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-42408734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4b02badf8ea4f32a5e259c25120eac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9c0f910-2e", "ovs_interfaceid": "b9c0f910-2e85-41e6-903c-4b678d4fbe5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 09:57:42 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-0cb7ee32-e58e-4f79-8073-e87631efb5c7 req-707fe427-60a4-4ae5-b735-0a24b3918e32 service nova] Acquired lock "refresh_cache-c4b88201-04dc-4da9-b213-c50cdf274f4e" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:57:42 user nova-compute[71113]: DEBUG nova.network.neutron [req-0cb7ee32-e58e-4f79-8073-e87631efb5c7 req-707fe427-60a4-4ae5-b735-0a24b3918e32 service nova] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Refreshing network info cache for port b9c0f910-2e85-41e6-903c-4b678d4fbe5e {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:57:42 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Start _get_guest_xml network_info=[{"id": "b9c0f910-2e85-41e6-903c-4b678d4fbe5e", "address": "fa:16:3e:1b:88:27", "network": {"id": "5f333808-4342-4014-9221-7ccd394eff66", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-42408734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4b02badf8ea4f32a5e259c25120eac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9c0f910-2e", "ovs_interfaceid": "b9c0f910-2e85-41e6-903c-4b678d4fbe5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'image_id': '078646fe-b504-41ed-a147-61072e903e51'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 09:57:42 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:57:42 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:57:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:42 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 09:57:42 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 09:57:42 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 09:57:42 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 09:57:42 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 09:57:42 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 09:57:42 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 09:57:42 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 09:57:42 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 09:57:42 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 09:57:42 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 09:57:42 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 09:57:42 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 09:57:42 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 09:57:42 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 09:57:42 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 09:57:42 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:57:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-272327487',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-272327487',id=28,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQSFRbgG8fn20fSbYTtr/mryCM3cS66xKkFgDl4Atxq0gS6Iyk/4ZDiDclIbL4yIv6KMdHi13hHC1nM1eapV8B93tENKeE5RNaQPY6ACbEOrENq7vJJh7Cmwq1mUx9W+g==',key_name='tempest-keypair-1850268314',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4b02badf8ea4f32a5e259c25120eac7',ramdisk_id='',reservation_id='r-4m2ef3pd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1497143588',owner_user_name='tempest-ServerActionsV293TestJSON-1497143588-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:57:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba2fd55dd96b4c49bb0c1c98c0a724d4',uuid=c4b88201-04dc-4da9-b213-c50cdf274f4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9c0f910-2e85-41e6-903c-4b678d4fbe5e", "address": "fa:16:3e:1b:88:27", "network": {"id": "5f333808-4342-4014-9221-7ccd394eff66", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-42408734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4b02badf8ea4f32a5e259c25120eac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9c0f910-2e", "ovs_interfaceid": "b9c0f910-2e85-41e6-903c-4b678d4fbe5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 09:57:42 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Converting VIF {"id": "b9c0f910-2e85-41e6-903c-4b678d4fbe5e", "address": "fa:16:3e:1b:88:27", "network": {"id": "5f333808-4342-4014-9221-7ccd394eff66", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-42408734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4b02badf8ea4f32a5e259c25120eac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9c0f910-2e", "ovs_interfaceid": "b9c0f910-2e85-41e6-903c-4b678d4fbe5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:57:42 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:88:27,bridge_name='br-int',has_traffic_filtering=True,id=b9c0f910-2e85-41e6-903c-4b678d4fbe5e,network=Network(5f333808-4342-4014-9221-7ccd394eff66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9c0f910-2e') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:57:42 user nova-compute[71113]: DEBUG nova.objects.instance [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lazy-loading 'pci_devices' on Instance uuid c4b88201-04dc-4da9-b213-c50cdf274f4e {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:57:42 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] End _get_guest_xml xml=<domain type="kvm">
Jul 31 09:57:42 user nova-compute[71113]:   <uuid>c4b88201-04dc-4da9-b213-c50cdf274f4e</uuid>
Jul 31 09:57:42 user nova-compute[71113]:   <name>instance-0000001c</name>
Jul 31 09:57:42 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 09:57:42 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 09:57:42 user nova-compute[71113]:   <metadata>
Jul 31 09:57:42 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 09:57:42 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 09:57:42 user nova-compute[71113]:       <nova:name>tempest-ServerActionsV293TestJSON-server-272327487</nova:name>
Jul 31 09:57:42 user nova-compute[71113]:       <nova:creationTime>2023-07-31 09:57:42</nova:creationTime>
Jul 31 09:57:42 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 09:57:42 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 09:57:42 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 09:57:42 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 09:57:42 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 09:57:42 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 09:57:42 user nova-compute[71113]:       </nova:flavor>
Jul 31 09:57:42 user nova-compute[71113]:       <nova:owner>
Jul 31 09:57:42 user nova-compute[71113]:         <nova:user uuid="ba2fd55dd96b4c49bb0c1c98c0a724d4">tempest-ServerActionsV293TestJSON-1497143588-project-member</nova:user>
Jul 31 09:57:42 user nova-compute[71113]:         <nova:project uuid="e4b02badf8ea4f32a5e259c25120eac7">tempest-ServerActionsV293TestJSON-1497143588</nova:project>
Jul 31 09:57:42 user nova-compute[71113]:       </nova:owner>
Jul 31 09:57:42 user nova-compute[71113]:       <nova:root type="image" uuid="078646fe-b504-41ed-a147-61072e903e51"/>
Jul 31 09:57:42 user nova-compute[71113]:       <nova:ports>
Jul 31 09:57:42 user nova-compute[71113]:         <nova:port uuid="b9c0f910-2e85-41e6-903c-4b678d4fbe5e">
Jul 31 09:57:42 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 31 09:57:42 user nova-compute[71113]:         </nova:port>
Jul 31 09:57:42 user nova-compute[71113]:       </nova:ports>
Jul 31 09:57:42 user nova-compute[71113]:     </nova:instance>
Jul 31 09:57:42 user nova-compute[71113]:   </metadata>
Jul 31 09:57:42 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 09:57:42 user nova-compute[71113]:     <system>
Jul 31 09:57:42 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 09:57:42 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 09:57:42 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 09:57:42 user nova-compute[71113]:       <entry name="serial">c4b88201-04dc-4da9-b213-c50cdf274f4e</entry>
Jul 31 09:57:42 user nova-compute[71113]:       <entry name="uuid">c4b88201-04dc-4da9-b213-c50cdf274f4e</entry>
Jul 31 09:57:42 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 09:57:42 user nova-compute[71113]:     </system>
Jul 31 09:57:42 user nova-compute[71113]:   </sysinfo>
Jul 31 09:57:42 user nova-compute[71113]:   <os>
Jul 31 09:57:42 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 09:57:42 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 09:57:42 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 09:57:42 user nova-compute[71113]:   </os>
Jul 31 09:57:42 user nova-compute[71113]:   <features>
Jul 31 09:57:42 user nova-compute[71113]:     <acpi/>
Jul 31 09:57:42 user nova-compute[71113]:     <apic/>
Jul 31 09:57:42 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 09:57:42 user nova-compute[71113]:   </features>
Jul 31 09:57:42 user nova-compute[71113]:   <clock offset="utc">
Jul 31 09:57:42 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 09:57:42 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 09:57:42 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 09:57:42 user nova-compute[71113]:   </clock>
Jul 31 09:57:42 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 09:57:42 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 09:57:42 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 09:57:42 user nova-compute[71113]:   </cpu>
Jul 31 09:57:42 user nova-compute[71113]:   <devices>
Jul 31 09:57:42 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 09:57:42 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 09:57:42 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/c4b88201-04dc-4da9-b213-c50cdf274f4e/disk"/>
Jul 31 09:57:42 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 09:57:42 user nova-compute[71113]:     </disk>
Jul 31 09:57:42 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 09:57:42 user nova-compute[71113]:       <mac address="fa:16:3e:1b:88:27"/>
Jul 31 09:57:42 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:57:42 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 09:57:42 user nova-compute[71113]:       <target dev="tapb9c0f910-2e"/>
Jul 31 09:57:42 user nova-compute[71113]:     </interface>
Jul 31 09:57:42 user nova-compute[71113]:     <serial type="pty">
Jul 31 09:57:42 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/c4b88201-04dc-4da9-b213-c50cdf274f4e/console.log" append="off"/>
Jul 31 09:57:42 user nova-compute[71113]:     </serial>
Jul 31 09:57:42 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 09:57:42 user nova-compute[71113]:     <video>
Jul 31 09:57:42 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:57:42 user nova-compute[71113]:     </video>
Jul 31 09:57:42 user nova-compute[71113]:     <rng model="virtio">
Jul 31 09:57:42 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 09:57:42 user nova-compute[71113]:     </rng>
Jul 31 09:57:42 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 09:57:42 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 09:57:42 user nova-compute[71113]:       <stats period="10"/>
Jul 31 09:57:42 user nova-compute[71113]:     </memballoon>
Jul 31 09:57:42 user nova-compute[71113]:   </devices>
Jul 31 09:57:42 user nova-compute[71113]: </domain>
Jul 31 09:57:42 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 09:57:42 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:57:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-272327487',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-272327487',id=28,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQSFRbgG8fn20fSbYTtr/mryCM3cS66xKkFgDl4Atxq0gS6Iyk/4ZDiDclIbL4yIv6KMdHi13hHC1nM1eapV8B93tENKeE5RNaQPY6ACbEOrENq7vJJh7Cmwq1mUx9W+g==',key_name='tempest-keypair-1850268314',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4b02badf8ea4f32a5e259c25120eac7',ramdisk_id='',reservation_id='r-4m2ef3pd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1497143588',owner_user_name='tempest-ServerActionsV293TestJSON-1497143588-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:57:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba2fd55dd96b4c49bb0c1c98c0a724d4',uuid=c4b88201-04dc-4da9-b213-c50cdf274f4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9c0f910-2e85-41e6-903c-4b678d4fbe5e", "address": "fa:16:3e:1b:88:27", "network": {"id": "5f333808-4342-4014-9221-7ccd394eff66", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-42408734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4b02badf8ea4f32a5e259c25120eac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9c0f910-2e", "ovs_interfaceid": "b9c0f910-2e85-41e6-903c-4b678d4fbe5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 09:57:42 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Converting VIF {"id": "b9c0f910-2e85-41e6-903c-4b678d4fbe5e", "address": "fa:16:3e:1b:88:27", "network": {"id": "5f333808-4342-4014-9221-7ccd394eff66", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-42408734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4b02badf8ea4f32a5e259c25120eac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9c0f910-2e", "ovs_interfaceid": "b9c0f910-2e85-41e6-903c-4b678d4fbe5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:57:42 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:88:27,bridge_name='br-int',has_traffic_filtering=True,id=b9c0f910-2e85-41e6-903c-4b678d4fbe5e,network=Network(5f333808-4342-4014-9221-7ccd394eff66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9c0f910-2e') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:57:42 user nova-compute[71113]: DEBUG os_vif [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:88:27,bridge_name='br-int',has_traffic_filtering=True,id=b9c0f910-2e85-41e6-903c-4b678d4fbe5e,network=Network(5f333808-4342-4014-9221-7ccd394eff66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9c0f910-2e') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 09:57:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:57:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 09:57:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb9c0f910-2e, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:57:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb9c0f910-2e, col_values=(('external_ids', {'iface-id': 'b9c0f910-2e85-41e6-903c-4b678d4fbe5e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:88:27', 'vm-uuid': 'c4b88201-04dc-4da9-b213-c50cdf274f4e'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:57:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:57:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:42 user nova-compute[71113]: INFO os_vif [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:88:27,bridge_name='br-int',has_traffic_filtering=True,id=b9c0f910-2e85-41e6-903c-4b678d4fbe5e,network=Network(5f333808-4342-4014-9221-7ccd394eff66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9c0f910-2e')
Jul 31 09:57:42 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:57:42 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] No VIF found with MAC fa:16:3e:1b:88:27, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 09:57:42 user nova-compute[71113]: DEBUG nova.network.neutron [req-0cb7ee32-e58e-4f79-8073-e87631efb5c7 req-707fe427-60a4-4ae5-b735-0a24b3918e32 service nova] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Updated VIF entry in instance network info cache for port b9c0f910-2e85-41e6-903c-4b678d4fbe5e. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:57:42 user nova-compute[71113]: DEBUG nova.network.neutron [req-0cb7ee32-e58e-4f79-8073-e87631efb5c7 req-707fe427-60a4-4ae5-b735-0a24b3918e32 service nova] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Updating instance_info_cache with network_info: [{"id": "b9c0f910-2e85-41e6-903c-4b678d4fbe5e", "address": "fa:16:3e:1b:88:27", "network": {"id": "5f333808-4342-4014-9221-7ccd394eff66", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-42408734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4b02badf8ea4f32a5e259c25120eac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9c0f910-2e", "ovs_interfaceid": "b9c0f910-2e85-41e6-903c-4b678d4fbe5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:57:42 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-0cb7ee32-e58e-4f79-8073-e87631efb5c7 req-707fe427-60a4-4ae5-b735-0a24b3918e32 service nova] Releasing lock "refresh_cache-c4b88201-04dc-4da9-b213-c50cdf274f4e" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:57:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:43 user nova-compute[71113]: DEBUG nova.compute.manager [req-ca6154d2-09fa-42ea-a499-78637e3fa4ae req-56579966-ffd4-4497-9a02-cae9aff99622 service nova] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Received event network-vif-plugged-e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:57:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ca6154d2-09fa-42ea-a499-78637e3fa4ae req-56579966-ffd4-4497-9a02-cae9aff99622 service nova] Acquiring lock "92d25a03-98ce-4bde-a3cc-20313ae77d41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:57:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ca6154d2-09fa-42ea-a499-78637e3fa4ae req-56579966-ffd4-4497-9a02-cae9aff99622 service nova] Lock "92d25a03-98ce-4bde-a3cc-20313ae77d41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:57:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ca6154d2-09fa-42ea-a499-78637e3fa4ae req-56579966-ffd4-4497-9a02-cae9aff99622 service nova] Lock "92d25a03-98ce-4bde-a3cc-20313ae77d41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:57:43 user nova-compute[71113]: DEBUG nova.compute.manager [req-ca6154d2-09fa-42ea-a499-78637e3fa4ae req-56579966-ffd4-4497-9a02-cae9aff99622 service nova] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] No waiting events found dispatching network-vif-plugged-e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:57:43 user nova-compute[71113]: WARNING nova.compute.manager [req-ca6154d2-09fa-42ea-a499-78637e3fa4ae req-56579966-ffd4-4497-9a02-cae9aff99622 service nova] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Received unexpected event network-vif-plugged-e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d for instance with vm_state rescued and task_state unrescuing.
Jul 31 09:57:43 user nova-compute[71113]: DEBUG nova.compute.manager [req-ca6154d2-09fa-42ea-a499-78637e3fa4ae req-56579966-ffd4-4497-9a02-cae9aff99622 service nova] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Received event network-vif-plugged-e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:57:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ca6154d2-09fa-42ea-a499-78637e3fa4ae req-56579966-ffd4-4497-9a02-cae9aff99622 service nova] Acquiring lock "92d25a03-98ce-4bde-a3cc-20313ae77d41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:57:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ca6154d2-09fa-42ea-a499-78637e3fa4ae req-56579966-ffd4-4497-9a02-cae9aff99622 service nova] Lock "92d25a03-98ce-4bde-a3cc-20313ae77d41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:57:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ca6154d2-09fa-42ea-a499-78637e3fa4ae req-56579966-ffd4-4497-9a02-cae9aff99622 service nova] Lock "92d25a03-98ce-4bde-a3cc-20313ae77d41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:57:43 user nova-compute[71113]: DEBUG nova.compute.manager [req-ca6154d2-09fa-42ea-a499-78637e3fa4ae req-56579966-ffd4-4497-9a02-cae9aff99622 service nova] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] No waiting events found dispatching network-vif-plugged-e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:57:43 user nova-compute[71113]: WARNING nova.compute.manager [req-ca6154d2-09fa-42ea-a499-78637e3fa4ae req-56579966-ffd4-4497-9a02-cae9aff99622 service nova] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Received unexpected event network-vif-plugged-e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d for instance with vm_state rescued and task_state unrescuing.
Jul 31 09:57:44 user nova-compute[71113]: DEBUG nova.compute.manager [req-65380b86-d65f-4414-8424-c74ba10f461a req-a55f81f2-04b6-45e6-a015-f7a3c32db156 service nova] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Received event network-vif-plugged-b9c0f910-2e85-41e6-903c-4b678d4fbe5e {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:57:44 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-65380b86-d65f-4414-8424-c74ba10f461a req-a55f81f2-04b6-45e6-a015-f7a3c32db156 service nova] Acquiring lock "c4b88201-04dc-4da9-b213-c50cdf274f4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:57:44 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-65380b86-d65f-4414-8424-c74ba10f461a req-a55f81f2-04b6-45e6-a015-f7a3c32db156 service nova] Lock "c4b88201-04dc-4da9-b213-c50cdf274f4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:57:44 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-65380b86-d65f-4414-8424-c74ba10f461a req-a55f81f2-04b6-45e6-a015-f7a3c32db156 service nova] Lock "c4b88201-04dc-4da9-b213-c50cdf274f4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:57:44 user nova-compute[71113]: DEBUG nova.compute.manager [req-65380b86-d65f-4414-8424-c74ba10f461a req-a55f81f2-04b6-45e6-a015-f7a3c32db156 service nova] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] No waiting events found dispatching network-vif-plugged-b9c0f910-2e85-41e6-903c-4b678d4fbe5e {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:57:44 user nova-compute[71113]: WARNING nova.compute.manager [req-65380b86-d65f-4414-8424-c74ba10f461a req-a55f81f2-04b6-45e6-a015-f7a3c32db156 service nova] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Received unexpected event network-vif-plugged-b9c0f910-2e85-41e6-903c-4b678d4fbe5e for instance with vm_state building and task_state spawning.
Jul 31 09:57:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:44 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Removed pending event for 92d25a03-98ce-4bde-a3cc-20313ae77d41 due to event {{(pid=71113) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 31 09:57:44 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797464.501896, 92d25a03-98ce-4bde-a3cc-20313ae77d41 => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:57:44 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] VM Resumed (Lifecycle Event)
Jul 31 09:57:44 user nova-compute[71113]: DEBUG nova.compute.manager [None req-6ed4f2a3-526e-4c7b-b6c7-8b08acf5f405 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:57:44 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:57:44 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:57:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:44 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 31 09:57:44 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797464.5045128, 92d25a03-98ce-4bde-a3cc-20313ae77d41 => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:57:44 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] VM Started (Lifecycle Event)
Jul 31 09:57:44 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:57:44 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:57:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:46 user nova-compute[71113]: DEBUG nova.compute.manager [req-474c7aa7-84d2-46e7-8a08-2cfe256edc24 req-0c033975-9c78-46ce-bf77-81a1e575c0de service nova] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Received event network-vif-plugged-b9c0f910-2e85-41e6-903c-4b678d4fbe5e {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:57:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-474c7aa7-84d2-46e7-8a08-2cfe256edc24 req-0c033975-9c78-46ce-bf77-81a1e575c0de service nova] Acquiring lock "c4b88201-04dc-4da9-b213-c50cdf274f4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:57:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-474c7aa7-84d2-46e7-8a08-2cfe256edc24 req-0c033975-9c78-46ce-bf77-81a1e575c0de service nova] Lock "c4b88201-04dc-4da9-b213-c50cdf274f4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:57:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-474c7aa7-84d2-46e7-8a08-2cfe256edc24 req-0c033975-9c78-46ce-bf77-81a1e575c0de service nova] Lock "c4b88201-04dc-4da9-b213-c50cdf274f4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:57:46 user nova-compute[71113]: DEBUG nova.compute.manager [req-474c7aa7-84d2-46e7-8a08-2cfe256edc24 req-0c033975-9c78-46ce-bf77-81a1e575c0de service nova] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] No waiting events found dispatching network-vif-plugged-b9c0f910-2e85-41e6-903c-4b678d4fbe5e {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:57:46 user nova-compute[71113]: WARNING nova.compute.manager [req-474c7aa7-84d2-46e7-8a08-2cfe256edc24 req-0c033975-9c78-46ce-bf77-81a1e575c0de service nova] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Received unexpected event network-vif-plugged-b9c0f910-2e85-41e6-903c-4b678d4fbe5e for instance with vm_state building and task_state spawning.
Jul 31 09:57:46 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797466.2210488, c4b88201-04dc-4da9-b213-c50cdf274f4e => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:57:46 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] VM Resumed (Lifecycle Event)
Jul 31 09:57:46 user nova-compute[71113]: DEBUG nova.compute.manager [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 09:57:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 09:57:46 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Instance spawned successfully.
Jul 31 09:57:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 09:57:46 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:57:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Found default for hw_cdrom_bus of ide {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:57:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Found default for hw_disk_bus of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:57:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Found default for hw_input_bus of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:57:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Found default for hw_pointer_model of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:57:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Found default for hw_video_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:57:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Found default for hw_vif_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:57:46 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:57:46 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:57:46 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797466.222355, c4b88201-04dc-4da9-b213-c50cdf274f4e => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:57:46 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] VM Started (Lifecycle Event)
Jul 31 09:57:46 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:57:46 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:57:46 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:57:46 user nova-compute[71113]: INFO nova.compute.manager [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Took 7.73 seconds to spawn the instance on the hypervisor.
Jul 31 09:57:46 user nova-compute[71113]: DEBUG nova.compute.manager [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:57:46 user nova-compute[71113]: INFO nova.compute.manager [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Took 8.60 seconds to build instance.
Jul 31 09:57:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-40f4306b-15a9-4722-baf5-b0d9274ba15d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lock "c4b88201-04dc-4da9-b213-c50cdf274f4e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.706s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:57:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "0104663a-99d2-494c-bfb8-16f14f3f8f38" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:57:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "0104663a-99d2-494c-bfb8-16f14f3f8f38" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:57:48 user nova-compute[71113]: DEBUG nova.compute.manager [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Starting instance... {{(pid=71113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 09:57:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:57:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:57:48 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 09:57:48 user nova-compute[71113]: INFO nova.compute.claims [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Claim successful on node user
Jul 31 09:57:48 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:57:48 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:57:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.565s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:57:48 user nova-compute[71113]: DEBUG nova.compute.manager [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Start building networks asynchronously for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 09:57:49 user nova-compute[71113]: DEBUG nova.compute.manager [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Allocating IP information in the background. {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 09:57:49 user nova-compute[71113]: DEBUG nova.network.neutron [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] allocate_for_instance() {{(pid=71113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 09:57:49 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 09:57:49 user nova-compute[71113]: DEBUG nova.compute.manager [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Start building block device mappings for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 09:57:49 user nova-compute[71113]: INFO nova.virt.block_device [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Booting with volume snapshot 303e683c-8420-4613-b088-b476e2fe3dc7 at /dev/vda
Jul 31 09:57:49 user nova-compute[71113]: DEBUG nova.policy [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a58fe92488ed47b696fc5d6d990b1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa2add2e2a24b9cb8e48042b06931d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71113) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 09:57:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:49 user nova-compute[71113]: DEBUG nova.network.neutron [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Successfully created port: 5bb08dc2-dad5-451e-909d-111b94035438 {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 09:57:50 user nova-compute[71113]: DEBUG nova.network.neutron [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Successfully updated port: 5bb08dc2-dad5-451e-909d-111b94035438 {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 09:57:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "refresh_cache-0104663a-99d2-494c-bfb8-16f14f3f8f38" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:57:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquired lock "refresh_cache-0104663a-99d2-494c-bfb8-16f14f3f8f38" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:57:50 user nova-compute[71113]: DEBUG nova.network.neutron [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 09:57:50 user nova-compute[71113]: DEBUG nova.compute.manager [req-b108ff6c-160e-45eb-9b3f-2101613eceec req-01c83235-4901-4baf-a39a-460e245c411c service nova] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Received event network-changed-5bb08dc2-dad5-451e-909d-111b94035438 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:57:50 user nova-compute[71113]: DEBUG nova.compute.manager [req-b108ff6c-160e-45eb-9b3f-2101613eceec req-01c83235-4901-4baf-a39a-460e245c411c service nova] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Refreshing instance network info cache due to event network-changed-5bb08dc2-dad5-451e-909d-111b94035438. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:57:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-b108ff6c-160e-45eb-9b3f-2101613eceec req-01c83235-4901-4baf-a39a-460e245c411c service nova] Acquiring lock "refresh_cache-0104663a-99d2-494c-bfb8-16f14f3f8f38" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:57:50 user nova-compute[71113]: DEBUG nova.network.neutron [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 09:57:51 user nova-compute[71113]: DEBUG nova.network.neutron [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Updating instance_info_cache with network_info: [{"id": "5bb08dc2-dad5-451e-909d-111b94035438", "address": "fa:16:3e:93:8f:b4", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bb08dc2-da", "ovs_interfaceid": "5bb08dc2-dad5-451e-909d-111b94035438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:57:51 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Releasing lock "refresh_cache-0104663a-99d2-494c-bfb8-16f14f3f8f38" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:57:51 user nova-compute[71113]: DEBUG nova.compute.manager [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Instance network_info: |[{"id": "5bb08dc2-dad5-451e-909d-111b94035438", "address": "fa:16:3e:93:8f:b4", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bb08dc2-da", "ovs_interfaceid": "5bb08dc2-dad5-451e-909d-111b94035438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 09:57:51 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-b108ff6c-160e-45eb-9b3f-2101613eceec req-01c83235-4901-4baf-a39a-460e245c411c service nova] Acquired lock "refresh_cache-0104663a-99d2-494c-bfb8-16f14f3f8f38" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:57:51 user nova-compute[71113]: DEBUG nova.network.neutron [req-b108ff6c-160e-45eb-9b3f-2101613eceec req-01c83235-4901-4baf-a39a-460e245c411c service nova] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Refreshing network info cache for port 5bb08dc2-dad5-451e-909d-111b94035438 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:57:51 user nova-compute[71113]: DEBUG nova.network.neutron [req-b108ff6c-160e-45eb-9b3f-2101613eceec req-01c83235-4901-4baf-a39a-460e245c411c service nova] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Updated VIF entry in instance network info cache for port 5bb08dc2-dad5-451e-909d-111b94035438. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:57:51 user nova-compute[71113]: DEBUG nova.network.neutron [req-b108ff6c-160e-45eb-9b3f-2101613eceec req-01c83235-4901-4baf-a39a-460e245c411c service nova] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Updating instance_info_cache with network_info: [{"id": "5bb08dc2-dad5-451e-909d-111b94035438", "address": "fa:16:3e:93:8f:b4", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bb08dc2-da", "ovs_interfaceid": "5bb08dc2-dad5-451e-909d-111b94035438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:57:51 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-b108ff6c-160e-45eb-9b3f-2101613eceec req-01c83235-4901-4baf-a39a-460e245c411c service nova] Releasing lock "refresh_cache-0104663a-99d2-494c-bfb8-16f14f3f8f38" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:57:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:54 user nova-compute[71113]: DEBUG os_brick.utils [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:57:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.040s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:54 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3a3319-6e63-4cae-80ab-b8f6e963320d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:57:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:54 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[60bb85bf-66e9-448d-86fd-4508e08222b0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:57:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:57:54 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f929e3b3-87a5-4b34-97e5-b3ad1c97ea31]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:57:54 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddfd61a2-1eb3-4a8f-a00c-f044dd6675dc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:57:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:57:55 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 09:57:55 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:57:55 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:57:55 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 09:57:55 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[417f2e58-366d-4314-87d9-0c3fee4344ea]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:57:55 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 09:57:55 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 09:57:55 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 09:57:55 user nova-compute[71113]: DEBUG os_brick.utils [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:57:55 user nova-compute[71113]: DEBUG nova.virt.block_device [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Updating existing volume attachment record: 08f68d23-5d73-458a-9cb7-cbd8984e183f {{(pid=71113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 09:57:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:57:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:58:02 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG nova.compute.manager [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Start spawning the instance on the hypervisor. {{(pid=71113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 09:58:03 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Creating image(s)
Jul 31 09:58:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Did not create local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Ensure instance console log exists: /opt/stack/data/nova/instances/0104663a-99d2-494c-bfb8-16f14f3f8f38/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Start _get_guest_xml network_info=[{"id": "5bb08dc2-dad5-451e-909d-111b94035438", "address": "fa:16:3e:93:8f:b4", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bb08dc2-da", "ovs_interfaceid": "5bb08dc2-dad5-451e-909d-111b94035438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '08f68d23-5d73-458a-9cb7-cbd8984e183f', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nWeZiVPS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0104663a-99d2-494c-bfb8-16f14f3f8f38', 'attached_at': '', 'detached_at': '', 'volume_id': 'c78df559-0825-4eac-b883-90838ecae617', 'serial': 'c78df559-0825-4eac-b883-90838ecae617'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 09:58:03 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:58:03 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:58:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nWeZiVPS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:58:03 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:58:03 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:58:03 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:58:03 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:58:03 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 09:58:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617 -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b512a1-8e37-4ae1-8454-3f21d3f939a4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 09:58:03 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617 -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c495a3-29b0-4654-952b-ec10ffdc235d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617] added
Jul 31 09:58:03 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8332b1-7758-4768-86e1-0f173be37f3e]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3619f184-4a13-4513-8ed7-5612c9458ba5]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nWeZiVPS {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nWeZiVPS" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeea004d-7110-40e1-acc0-51083518a2a0]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nWeZiVPS'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2496a87-27fb-43d9-b1b6-25a4316ae6dc]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f2fd85-bd79-4bb7-9875-d735cec2dff4]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:58:03 user nova-compute[71113]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)
Jul 31 09:58:03 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:58:03 user nova-compute[71113]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)
Jul 31 09:58:03 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617 -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5722ca99-7e28-437c-adf7-68185168dd0c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617, portal: 172.16.0.220,3260]
Jul 31 09:58:03 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617, portal: 172.16.0.220,3260] successful.
Jul 31 09:58:03 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aaa8041-0ab7-498e-8930-54a8dc2318e3]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[807421de-22a9-49a7-923b-31b0af774880]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:58:03 user nova-compute[71113]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)
Jul 31 09:58:03 user nova-compute[71113]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617 (non-flash)
Jul 31 09:58:03 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:58:03 user nova-compute[71113]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)
Jul 31 09:58:03 user nova-compute[71113]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617 (non-flash)
Jul 31 09:58:03 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] HCTL ('34', '-', '-', 0) found on session 31 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[01bdbb1f-79e6-46dd-906c-7bf825aab63e]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:58:03 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Searching for a device in session 31 and hctl ['34', '*', '*', 0] yield: None {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 09:58:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:58:04 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Searching for a device in session 31 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 09:58:04 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nWeZiVPS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 09:58:04 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:58:04 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '26635653138643761', 'path': '/dev/sdc'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:58:04 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635653138643761', 'path': '/dev/sdc'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 09:58:04 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:57:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1227571820',display_name='tempest-TestVolumeBootPattern-server-1227571820',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1227571820',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3aa2add2e2a24b9cb8e48042b06931d3',ramdisk_id='',reservation_id='r-0fjjexc7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1754399827',owner_user_name='tempest-TestVolumeBootPattern-1754399827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:57:49Z,user_data=None,user_id='a58fe92488ed47b696fc5d6d990b1acd',uuid=0104663a-99d2-494c-bfb8-16f14f3f8f38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5bb08dc2-dad5-451e-909d-111b94035438", "address": "fa:16:3e:93:8f:b4", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bb08dc2-da", "ovs_interfaceid": "5bb08dc2-dad5-451e-909d-111b94035438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 09:58:04 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Converting VIF {"id": "5bb08dc2-dad5-451e-909d-111b94035438", "address": "fa:16:3e:93:8f:b4", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bb08dc2-da", "ovs_interfaceid": "5bb08dc2-dad5-451e-909d-111b94035438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:58:04 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:8f:b4,bridge_name='br-int',has_traffic_filtering=True,id=5bb08dc2-dad5-451e-909d-111b94035438,network=Network(fa792d7a-ddf6-4a2d-acb9-802f8daf87ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bb08dc2-da') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:58:04 user nova-compute[71113]: DEBUG nova.objects.instance [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lazy-loading 'pci_devices' on Instance uuid 0104663a-99d2-494c-bfb8-16f14f3f8f38 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:58:04 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] End _get_guest_xml xml=<domain type="kvm">
Jul 31 09:58:04 user nova-compute[71113]:   <uuid>0104663a-99d2-494c-bfb8-16f14f3f8f38</uuid>
Jul 31 09:58:04 user nova-compute[71113]:   <name>instance-0000001d</name>
Jul 31 09:58:04 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 09:58:04 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 09:58:04 user nova-compute[71113]:   <metadata>
Jul 31 09:58:04 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 09:58:04 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 09:58:04 user nova-compute[71113]:       <nova:name>tempest-TestVolumeBootPattern-server-1227571820</nova:name>
Jul 31 09:58:04 user nova-compute[71113]:       <nova:creationTime>2023-07-31 09:58:03</nova:creationTime>
Jul 31 09:58:04 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 09:58:04 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 09:58:04 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 09:58:04 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 09:58:04 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 09:58:04 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 09:58:04 user nova-compute[71113]:       </nova:flavor>
Jul 31 09:58:04 user nova-compute[71113]:       <nova:owner>
Jul 31 09:58:04 user nova-compute[71113]:         <nova:user uuid="a58fe92488ed47b696fc5d6d990b1acd">tempest-TestVolumeBootPattern-1754399827-project-member</nova:user>
Jul 31 09:58:04 user nova-compute[71113]:         <nova:project uuid="3aa2add2e2a24b9cb8e48042b06931d3">tempest-TestVolumeBootPattern-1754399827</nova:project>
Jul 31 09:58:04 user nova-compute[71113]:       </nova:owner>
Jul 31 09:58:04 user nova-compute[71113]:       <nova:ports>
Jul 31 09:58:04 user nova-compute[71113]:         <nova:port uuid="5bb08dc2-dad5-451e-909d-111b94035438">
Jul 31 09:58:04 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 31 09:58:04 user nova-compute[71113]:         </nova:port>
Jul 31 09:58:04 user nova-compute[71113]:       </nova:ports>
Jul 31 09:58:04 user nova-compute[71113]:     </nova:instance>
Jul 31 09:58:04 user nova-compute[71113]:   </metadata>
Jul 31 09:58:04 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 09:58:04 user nova-compute[71113]:     <system>
Jul 31 09:58:04 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 09:58:04 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 09:58:04 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 09:58:04 user nova-compute[71113]:       <entry name="serial">0104663a-99d2-494c-bfb8-16f14f3f8f38</entry>
Jul 31 09:58:04 user nova-compute[71113]:       <entry name="uuid">0104663a-99d2-494c-bfb8-16f14f3f8f38</entry>
Jul 31 09:58:04 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 09:58:04 user nova-compute[71113]:     </system>
Jul 31 09:58:04 user nova-compute[71113]:   </sysinfo>
Jul 31 09:58:04 user nova-compute[71113]:   <os>
Jul 31 09:58:04 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 09:58:04 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 09:58:04 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 09:58:04 user nova-compute[71113]:   </os>
Jul 31 09:58:04 user nova-compute[71113]:   <features>
Jul 31 09:58:04 user nova-compute[71113]:     <acpi/>
Jul 31 09:58:04 user nova-compute[71113]:     <apic/>
Jul 31 09:58:04 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 09:58:04 user nova-compute[71113]:   </features>
Jul 31 09:58:04 user nova-compute[71113]:   <clock offset="utc">
Jul 31 09:58:04 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 09:58:04 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 09:58:04 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 09:58:04 user nova-compute[71113]:   </clock>
Jul 31 09:58:04 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 09:58:04 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 09:58:04 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 09:58:04 user nova-compute[71113]:   </cpu>
Jul 31 09:58:04 user nova-compute[71113]:   <devices>
Jul 31 09:58:04 user nova-compute[71113]:     <disk type="block" device="disk">
Jul 31 09:58:04 user nova-compute[71113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:58:04 user nova-compute[71113]:       <source dev="/dev/sdc"/>
Jul 31 09:58:04 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 09:58:04 user nova-compute[71113]:       <serial>c78df559-0825-4eac-b883-90838ecae617</serial>
Jul 31 09:58:04 user nova-compute[71113]:     </disk>
Jul 31 09:58:04 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 09:58:04 user nova-compute[71113]:       <mac address="fa:16:3e:93:8f:b4"/>
Jul 31 09:58:04 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:58:04 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 09:58:04 user nova-compute[71113]:       <target dev="tap5bb08dc2-da"/>
Jul 31 09:58:04 user nova-compute[71113]:     </interface>
Jul 31 09:58:04 user nova-compute[71113]:     <serial type="pty">
Jul 31 09:58:04 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/0104663a-99d2-494c-bfb8-16f14f3f8f38/console.log" append="off"/>
Jul 31 09:58:04 user nova-compute[71113]:     </serial>
Jul 31 09:58:04 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 09:58:04 user nova-compute[71113]:     <video>
Jul 31 09:58:04 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:58:04 user nova-compute[71113]:     </video>
Jul 31 09:58:04 user nova-compute[71113]:     <rng model="virtio">
Jul 31 09:58:04 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 09:58:04 user nova-compute[71113]:     </rng>
Jul 31 09:58:04 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 09:58:04 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 09:58:04 user nova-compute[71113]:       <stats period="10"/>
Jul 31 09:58:04 user nova-compute[71113]:     </memballoon>
Jul 31 09:58:04 user nova-compute[71113]:   </devices>
Jul 31 09:58:04 user nova-compute[71113]: </domain>
Jul 31 09:58:04 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 09:58:04 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:57:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1227571820',display_name='tempest-TestVolumeBootPattern-server-1227571820',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1227571820',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3aa2add2e2a24b9cb8e48042b06931d3',ramdisk_id='',reservation_id='r-0fjjexc7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1754399827',owner_user_name='tempest-TestVolumeBootPattern-1754399827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:57:49Z,user_data=None,user_id='a58fe92488ed47b696fc5d6d990b1acd',uuid=0104663a-99d2-494c-bfb8-16f14f3f8f38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5bb08dc2-dad5-451e-909d-111b94035438", "address": "fa:16:3e:93:8f:b4", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bb08dc2-da", "ovs_interfaceid": "5bb08dc2-dad5-451e-909d-111b94035438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 09:58:04 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Converting VIF {"id": "5bb08dc2-dad5-451e-909d-111b94035438", "address": "fa:16:3e:93:8f:b4", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bb08dc2-da", "ovs_interfaceid": "5bb08dc2-dad5-451e-909d-111b94035438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:58:04 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:8f:b4,bridge_name='br-int',has_traffic_filtering=True,id=5bb08dc2-dad5-451e-909d-111b94035438,network=Network(fa792d7a-ddf6-4a2d-acb9-802f8daf87ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bb08dc2-da') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:58:04 user nova-compute[71113]: DEBUG os_vif [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:8f:b4,bridge_name='br-int',has_traffic_filtering=True,id=5bb08dc2-dad5-451e-909d-111b94035438,network=Network(fa792d7a-ddf6-4a2d-acb9-802f8daf87ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bb08dc2-da') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 09:58:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:58:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:58:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 09:58:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:58:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5bb08dc2-da, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:58:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5bb08dc2-da, col_values=(('external_ids', {'iface-id': '5bb08dc2-dad5-451e-909d-111b94035438', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:8f:b4', 'vm-uuid': '0104663a-99d2-494c-bfb8-16f14f3f8f38'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:58:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:58:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:58:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:58:04 user nova-compute[71113]: INFO os_vif [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:8f:b4,bridge_name='br-int',has_traffic_filtering=True,id=5bb08dc2-dad5-451e-909d-111b94035438,network=Network(fa792d7a-ddf6-4a2d-acb9-802f8daf87ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bb08dc2-da')
Jul 31 09:58:05 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:58:05 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] No VIF found with MAC fa:16:3e:93:8f:b4, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 09:58:05 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:58:06 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:58:06 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:58:06 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:58:06 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:58:06 user nova-compute[71113]: DEBUG nova.compute.manager [req-caaa6c14-c0c2-4630-9bd8-c0a655c635c0 req-5dd4b168-a2c1-4f0d-8344-1098c1935029 service nova] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Received event network-vif-plugged-5bb08dc2-dad5-451e-909d-111b94035438 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:58:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-caaa6c14-c0c2-4630-9bd8-c0a655c635c0 req-5dd4b168-a2c1-4f0d-8344-1098c1935029 service nova] Acquiring lock "0104663a-99d2-494c-bfb8-16f14f3f8f38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:58:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-caaa6c14-c0c2-4630-9bd8-c0a655c635c0 req-5dd4b168-a2c1-4f0d-8344-1098c1935029 service nova] Lock "0104663a-99d2-494c-bfb8-16f14f3f8f38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:58:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-caaa6c14-c0c2-4630-9bd8-c0a655c635c0 req-5dd4b168-a2c1-4f0d-8344-1098c1935029 service nova] Lock "0104663a-99d2-494c-bfb8-16f14f3f8f38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:58:06 user nova-compute[71113]: DEBUG nova.compute.manager [req-caaa6c14-c0c2-4630-9bd8-c0a655c635c0 req-5dd4b168-a2c1-4f0d-8344-1098c1935029 service nova] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] No waiting events found dispatching network-vif-plugged-5bb08dc2-dad5-451e-909d-111b94035438 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:58:06 user nova-compute[71113]: WARNING nova.compute.manager [req-caaa6c14-c0c2-4630-9bd8-c0a655c635c0 req-5dd4b168-a2c1-4f0d-8344-1098c1935029 service nova] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Received unexpected event network-vif-plugged-5bb08dc2-dad5-451e-909d-111b94035438 for instance with vm_state building and task_state spawning.
Jul 31 09:58:06 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:58:06 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:58:06 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:58:06 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:58:06 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:58:07 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:58:08 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797488.3318734, 0104663a-99d2-494c-bfb8-16f14f3f8f38 => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:58:08 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] VM Resumed (Lifecycle Event)
Jul 31 09:58:08 user nova-compute[71113]: DEBUG nova.compute.manager [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 09:58:08 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 09:58:08 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Instance spawned successfully.
Jul 31 09:58:08 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 09:58:08 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:58:08 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:58:08 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Found default for hw_cdrom_bus of ide {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:58:08 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Found default for hw_disk_bus of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:58:08 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Found default for hw_input_bus of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:58:08 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Found default for hw_pointer_model of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:58:08 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Found default for hw_video_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:58:08 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Found default for hw_vif_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:58:08 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:58:08 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797488.335273, 0104663a-99d2-494c-bfb8-16f14f3f8f38 => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:58:08 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] VM Started (Lifecycle Event)
Jul 31 09:58:08 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:58:08 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:58:08 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:58:08 user nova-compute[71113]: INFO nova.compute.manager [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Took 4.90 seconds to spawn the instance on the hypervisor.
Jul 31 09:58:08 user nova-compute[71113]: DEBUG nova.compute.manager [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:58:08 user nova-compute[71113]: INFO nova.compute.manager [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Took 20.16 seconds to build instance.
Jul 31 09:58:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-dcb9d908-fbca-43bc-864d-de2bfee0dcb8 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "0104663a-99d2-494c-bfb8-16f14f3f8f38" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.255s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:58:08 user nova-compute[71113]: DEBUG nova.compute.manager [req-956fb0e2-9f35-40fe-9d77-35cf5a7400f7 req-3983cdad-8156-4201-8bbc-a6573db1d1d6 service nova] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Received event network-vif-plugged-5bb08dc2-dad5-451e-909d-111b94035438 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:58:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-956fb0e2-9f35-40fe-9d77-35cf5a7400f7 req-3983cdad-8156-4201-8bbc-a6573db1d1d6 service nova] Acquiring lock "0104663a-99d2-494c-bfb8-16f14f3f8f38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:58:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-956fb0e2-9f35-40fe-9d77-35cf5a7400f7 req-3983cdad-8156-4201-8bbc-a6573db1d1d6 service nova] Lock "0104663a-99d2-494c-bfb8-16f14f3f8f38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:58:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-956fb0e2-9f35-40fe-9d77-35cf5a7400f7 req-3983cdad-8156-4201-8bbc-a6573db1d1d6 service nova] Lock "0104663a-99d2-494c-bfb8-16f14f3f8f38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:58:08 user nova-compute[71113]: DEBUG nova.compute.manager [req-956fb0e2-9f35-40fe-9d77-35cf5a7400f7 req-3983cdad-8156-4201-8bbc-a6573db1d1d6 service nova] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] No waiting events found dispatching network-vif-plugged-5bb08dc2-dad5-451e-909d-111b94035438 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:58:08 user nova-compute[71113]: WARNING nova.compute.manager [req-956fb0e2-9f35-40fe-9d77-35cf5a7400f7 req-3983cdad-8156-4201-8bbc-a6573db1d1d6 service nova] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Received unexpected event network-vif-plugged-5bb08dc2-dad5-451e-909d-111b94035438 for instance with vm_state active and task_state None.
Jul 31 09:58:08 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:58:08 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:58:08 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:58:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:58:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:58:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:58:08 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 09:58:08 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 09:58:08 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4df9380-7882-48a6-ba64-bb17429e54ac/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:58:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4df9380-7882-48a6-ba64-bb17429e54ac/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:58:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4df9380-7882-48a6-ba64-bb17429e54ac/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:58:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4df9380-7882-48a6-ba64-bb17429e54ac/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:58:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f69d43c-f8a3-4fed-a737-389c217970d8/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:58:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f69d43c-f8a3-4fed-a737-389c217970d8/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:58:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f69d43c-f8a3-4fed-a737-389c217970d8/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:58:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f69d43c-f8a3-4fed-a737-389c217970d8/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:58:09 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 09:58:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b88201-04dc-4da9-b213-c50cdf274f4e/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:58:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b88201-04dc-4da9-b213-c50cdf274f4e/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:58:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b88201-04dc-4da9-b213-c50cdf274f4e/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:58:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:58:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b88201-04dc-4da9-b213-c50cdf274f4e/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:58:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9745ff0d-8320-4689-8326-c18752c6e6ae/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:58:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:58:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9745ff0d-8320-4689-8326-c18752c6e6ae/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:58:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9745ff0d-8320-4689-8326-c18752c6e6ae/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:58:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9745ff0d-8320-4689-8326-c18752c6e6ae/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:58:10 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 09:58:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:58:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:58:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:58:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:58:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc9b4047-7408-40a1-b38c-59695faffafb/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:58:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc9b4047-7408-40a1-b38c-59695faffafb/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:58:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc9b4047-7408-40a1-b38c-59695faffafb/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:58:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc9b4047-7408-40a1-b38c-59695faffafb/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:58:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:58:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:58:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:58:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:58:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/208130bc-5ece-4683-aa83-505ee89a8ba5/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:58:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/208130bc-5ece-4683-aa83-505ee89a8ba5/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:58:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/208130bc-5ece-4683-aa83-505ee89a8ba5/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:58:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/208130bc-5ece-4683-aa83-505ee89a8ba5/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:58:11 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:58:11 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:58:11 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=7293MB free_disk=25.30138397216797GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 09:58:11 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:58:11 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:58:12 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Applying migration context for instance a950d710-4596-4355-ac31-568c7728335a as it has an incoming, in-progress migration 933d9c4b-c0c8-4ce0-8243-03d233c9b509. Migration status is finished {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Jul 31 09:58:12 user nova-compute[71113]: INFO nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: a950d710-4596-4355-ac31-568c7728335a] Updating resource usage from migration 933d9c4b-c0c8-4ce0-8243-03d233c9b509
Jul 31 09:58:12 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 0ea0401b-26c2-4655-956b-1bc000debd53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:58:12 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance f4df9380-7882-48a6-ba64-bb17429e54ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:58:12 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 3157a7a6-b8a9-4e2d-a157-360bce4c625d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:58:12 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 92d25a03-98ce-4bde-a3cc-20313ae77d41 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:58:12 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 208130bc-5ece-4683-aa83-505ee89a8ba5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:58:12 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 5f69d43c-f8a3-4fed-a737-389c217970d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:58:12 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 9745ff0d-8320-4689-8326-c18752c6e6ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:58:12 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance bc9b4047-7408-40a1-b38c-59695faffafb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:58:12 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Migration 933d9c4b-c0c8-4ce0-8243-03d233c9b509 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Jul 31 09:58:12 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance a950d710-4596-4355-ac31-568c7728335a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:58:12 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance c4b88201-04dc-4da9-b213-c50cdf274f4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:58:12 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 0104663a-99d2-494c-bfb8-16f14f3f8f38 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:58:12 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 09:58:12 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 09:58:12 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:58:12 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:58:12 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 09:58:12 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.500s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:58:13 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:58:13 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:58:13 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 09:58:13 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Didn't find any instances for network info cache update. {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 09:58:13 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:58:13 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 09:58:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:58:14 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:58:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:58:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:58:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:58:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 09:58:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 09:58:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 09:58:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:58:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:58:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:58:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:58:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:58:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:58:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:58:36 user nova-compute[71113]: DEBUG nova.compute.manager [req-b074bec8-8230-4372-9fcc-dcc0c2b2d568 req-ea2d8501-0244-4c79-961b-eec48c1e0cc9 service nova] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Received event network-changed-d8cb465d-1593-4491-b337-8528c1bcfb3e {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:58:36 user nova-compute[71113]: DEBUG nova.compute.manager [req-b074bec8-8230-4372-9fcc-dcc0c2b2d568 req-ea2d8501-0244-4c79-961b-eec48c1e0cc9 service nova] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Refreshing instance network info cache due to event network-changed-d8cb465d-1593-4491-b337-8528c1bcfb3e. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:58:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-b074bec8-8230-4372-9fcc-dcc0c2b2d568 req-ea2d8501-0244-4c79-961b-eec48c1e0cc9 service nova] Acquiring lock "refresh_cache-208130bc-5ece-4683-aa83-505ee89a8ba5" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:58:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-b074bec8-8230-4372-9fcc-dcc0c2b2d568 req-ea2d8501-0244-4c79-961b-eec48c1e0cc9 service nova] Acquired lock "refresh_cache-208130bc-5ece-4683-aa83-505ee89a8ba5" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:58:36 user nova-compute[71113]: DEBUG nova.network.neutron [req-b074bec8-8230-4372-9fcc-dcc0c2b2d568 req-ea2d8501-0244-4c79-961b-eec48c1e0cc9 service nova] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Refreshing network info cache for port d8cb465d-1593-4491-b337-8528c1bcfb3e {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:58:37 user nova-compute[71113]: DEBUG nova.network.neutron [req-b074bec8-8230-4372-9fcc-dcc0c2b2d568 req-ea2d8501-0244-4c79-961b-eec48c1e0cc9 service nova] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Updated VIF entry in instance network info cache for port d8cb465d-1593-4491-b337-8528c1bcfb3e. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:58:37 user nova-compute[71113]: DEBUG nova.network.neutron [req-b074bec8-8230-4372-9fcc-dcc0c2b2d568 req-ea2d8501-0244-4c79-961b-eec48c1e0cc9 service nova] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Updating instance_info_cache with network_info: [{"id": "d8cb465d-1593-4491-b337-8528c1bcfb3e", "address": "fa:16:3e:bb:b2:fd", "network": {"id": "e498d93a-703d-4d19-9adf-61469f37d4da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1320431580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4461b48e5470471d8fe1b61fb8af9c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8cb465d-15", "ovs_interfaceid": "d8cb465d-1593-4491-b337-8528c1bcfb3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:58:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-b074bec8-8230-4372-9fcc-dcc0c2b2d568 req-ea2d8501-0244-4c79-961b-eec48c1e0cc9 service nova] Releasing lock "refresh_cache-208130bc-5ece-4683-aa83-505ee89a8ba5" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:58:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:58:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:58:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-32636365-e384-437d-9d4d-ac90c6ff825f tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Acquiring lock "208130bc-5ece-4683-aa83-505ee89a8ba5" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:58:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-32636365-e384-437d-9d4d-ac90c6ff825f tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "208130bc-5ece-4683-aa83-505ee89a8ba5" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:58:41 user nova-compute[71113]: INFO nova.compute.manager [None req-32636365-e384-437d-9d4d-ac90c6ff825f tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Shelving
Jul 31 09:58:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:58:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:58:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:58:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:58:41 user nova-compute[71113]: DEBUG nova.compute.manager [req-3c8cb5d4-fd1a-4a63-8b2e-1b35b96ad56f req-da0a1026-e319-42df-93c5-7bb170bb79dc service nova] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Received event network-vif-unplugged-d8cb465d-1593-4491-b337-8528c1bcfb3e {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:58:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3c8cb5d4-fd1a-4a63-8b2e-1b35b96ad56f req-da0a1026-e319-42df-93c5-7bb170bb79dc service nova] Acquiring lock "208130bc-5ece-4683-aa83-505ee89a8ba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:58:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3c8cb5d4-fd1a-4a63-8b2e-1b35b96ad56f req-da0a1026-e319-42df-93c5-7bb170bb79dc service nova] Lock "208130bc-5ece-4683-aa83-505ee89a8ba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:58:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3c8cb5d4-fd1a-4a63-8b2e-1b35b96ad56f req-da0a1026-e319-42df-93c5-7bb170bb79dc service nova] Lock "208130bc-5ece-4683-aa83-505ee89a8ba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:58:41 user nova-compute[71113]: DEBUG nova.compute.manager [req-3c8cb5d4-fd1a-4a63-8b2e-1b35b96ad56f req-da0a1026-e319-42df-93c5-7bb170bb79dc service nova] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] No waiting events found dispatching network-vif-unplugged-d8cb465d-1593-4491-b337-8528c1bcfb3e {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:58:41 user nova-compute[71113]: WARNING nova.compute.manager [req-3c8cb5d4-fd1a-4a63-8b2e-1b35b96ad56f req-da0a1026-e319-42df-93c5-7bb170bb79dc service nova] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Received unexpected event network-vif-unplugged-d8cb465d-1593-4491-b337-8528c1bcfb3e for instance with vm_state active and task_state shelving.
Jul 31 09:58:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:58:42 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Instance destroyed successfully.
Jul 31 09:58:42 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-32636365-e384-437d-9d4d-ac90c6ff825f tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Beginning cold snapshot process
Jul 31 09:58:42 user nova-compute[71113]: DEBUG nova.privsep.utils [None req-32636365-e384-437d-9d4d-ac90c6ff825f tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71113) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 09:58:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-32636365-e384-437d-9d4d-ac90c6ff825f tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/208130bc-5ece-4683-aa83-505ee89a8ba5/disk /opt/stack/data/nova/instances/snapshots/tmp8j8ez0a3/58248ced2f16429886e00ed02699d8cb {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:58:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-32636365-e384-437d-9d4d-ac90c6ff825f tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/208130bc-5ece-4683-aa83-505ee89a8ba5/disk /opt/stack/data/nova/instances/snapshots/tmp8j8ez0a3/58248ced2f16429886e00ed02699d8cb" returned: 0 in 0.589s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:58:42 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-32636365-e384-437d-9d4d-ac90c6ff825f tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Snapshot extracted, beginning image upload
Jul 31 09:58:43 user nova-compute[71113]: DEBUG nova.compute.manager [req-cebe8d28-27b2-4d2b-ad20-17511604ac8f req-4ef7cee2-37ea-47b4-a709-8d040c5808e6 service nova] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Received event network-vif-plugged-d8cb465d-1593-4491-b337-8528c1bcfb3e {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:58:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-cebe8d28-27b2-4d2b-ad20-17511604ac8f req-4ef7cee2-37ea-47b4-a709-8d040c5808e6 service nova] Acquiring lock "208130bc-5ece-4683-aa83-505ee89a8ba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:58:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-cebe8d28-27b2-4d2b-ad20-17511604ac8f req-4ef7cee2-37ea-47b4-a709-8d040c5808e6 service nova] Lock "208130bc-5ece-4683-aa83-505ee89a8ba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:58:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-cebe8d28-27b2-4d2b-ad20-17511604ac8f req-4ef7cee2-37ea-47b4-a709-8d040c5808e6 service nova] Lock "208130bc-5ece-4683-aa83-505ee89a8ba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:58:43 user nova-compute[71113]: DEBUG nova.compute.manager [req-cebe8d28-27b2-4d2b-ad20-17511604ac8f req-4ef7cee2-37ea-47b4-a709-8d040c5808e6 service nova] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] No waiting events found dispatching network-vif-plugged-d8cb465d-1593-4491-b337-8528c1bcfb3e {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:58:43 user nova-compute[71113]: WARNING nova.compute.manager [req-cebe8d28-27b2-4d2b-ad20-17511604ac8f req-4ef7cee2-37ea-47b4-a709-8d040c5808e6 service nova] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Received unexpected event network-vif-plugged-d8cb465d-1593-4491-b337-8528c1bcfb3e for instance with vm_state active and task_state shelving_image_uploading.
Jul 31 09:58:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:58:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:58:45 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-32636365-e384-437d-9d4d-ac90c6ff825f tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Snapshot image upload complete
Jul 31 09:58:45 user nova-compute[71113]: DEBUG nova.compute.manager [None req-32636365-e384-437d-9d4d-ac90c6ff825f tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:58:45 user nova-compute[71113]: INFO nova.compute.manager [None req-32636365-e384-437d-9d4d-ac90c6ff825f tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Shelve offloading
Jul 31 09:58:45 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Instance destroyed successfully.
Jul 31 09:58:45 user nova-compute[71113]: DEBUG nova.compute.manager [None req-32636365-e384-437d-9d4d-ac90c6ff825f tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:58:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-32636365-e384-437d-9d4d-ac90c6ff825f tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Acquiring lock "refresh_cache-208130bc-5ece-4683-aa83-505ee89a8ba5" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:58:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-32636365-e384-437d-9d4d-ac90c6ff825f tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Acquired lock "refresh_cache-208130bc-5ece-4683-aa83-505ee89a8ba5" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:58:45 user nova-compute[71113]: DEBUG nova.network.neutron [None req-32636365-e384-437d-9d4d-ac90c6ff825f tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 09:58:45 user nova-compute[71113]: DEBUG nova.network.neutron [None req-32636365-e384-437d-9d4d-ac90c6ff825f tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Updating instance_info_cache with network_info: [{"id": "d8cb465d-1593-4491-b337-8528c1bcfb3e", "address": "fa:16:3e:bb:b2:fd", "network": {"id": "e498d93a-703d-4d19-9adf-61469f37d4da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1320431580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4461b48e5470471d8fe1b61fb8af9c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8cb465d-15", "ovs_interfaceid": "d8cb465d-1593-4491-b337-8528c1bcfb3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:58:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-32636365-e384-437d-9d4d-ac90c6ff825f tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Releasing lock "refresh_cache-208130bc-5ece-4683-aa83-505ee89a8ba5" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:58:47 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Instance destroyed successfully.
Jul 31 09:58:47 user nova-compute[71113]: DEBUG nova.objects.instance [None req-32636365-e384-437d-9d4d-ac90c6ff825f tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lazy-loading 'resources' on Instance uuid 208130bc-5ece-4683-aa83-505ee89a8ba5 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:58:47 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-32636365-e384-437d-9d4d-ac90c6ff825f tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:56:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-97586711',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-97586711',id=24,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+v3MPsTIfHcpTY6Yc9MWbbovJf56dPzvszMKErbyp/5ES3uvJPZ3C4p1soQ6orjbgw1Ikn6UYVzPxqHqb5fC5p2P+Nz5lCYomH/HxtkCE/snnyG2rynWTcNbrs5qIdaQ==',key_name='tempest-keypair-1581132008',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:56:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='4461b48e5470471d8fe1b61fb8af9c8d',ramdisk_id='',reservation_id='r-q8o5zbgt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-960167684',owner_user_name='tempest-AttachVolumeShelveTestJSON-960167684-project-member',shelved_at='2023-07-31T09:58:45.248388',shelved_host='user',shelved_image_id='1590f363-1dcc-464d-8013-6064a867f16b'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:58:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5199c7da0634b6e8111782122adcf70',uuid=208130bc-5ece-4683-aa83-505ee89a8ba5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "d8cb465d-1593-4491-b337-8528c1bcfb3e", "address": "fa:16:3e:bb:b2:fd", "network": {"id": "e498d93a-703d-4d19-9adf-61469f37d4da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1320431580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4461b48e5470471d8fe1b61fb8af9c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8cb465d-15", "ovs_interfaceid": "d8cb465d-1593-4491-b337-8528c1bcfb3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 09:58:47 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-32636365-e384-437d-9d4d-ac90c6ff825f tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Converting VIF {"id": "d8cb465d-1593-4491-b337-8528c1bcfb3e", "address": "fa:16:3e:bb:b2:fd", "network": {"id": "e498d93a-703d-4d19-9adf-61469f37d4da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1320431580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4461b48e5470471d8fe1b61fb8af9c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8cb465d-15", "ovs_interfaceid": "d8cb465d-1593-4491-b337-8528c1bcfb3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:58:47 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-32636365-e384-437d-9d4d-ac90c6ff825f tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:b2:fd,bridge_name='br-int',has_traffic_filtering=True,id=d8cb465d-1593-4491-b337-8528c1bcfb3e,network=Network(e498d93a-703d-4d19-9adf-61469f37d4da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8cb465d-15') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:58:47 user nova-compute[71113]: DEBUG os_vif [None req-32636365-e384-437d-9d4d-ac90c6ff825f tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:b2:fd,bridge_name='br-int',has_traffic_filtering=True,id=d8cb465d-1593-4491-b337-8528c1bcfb3e,network=Network(e498d93a-703d-4d19-9adf-61469f37d4da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8cb465d-15') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 09:58:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:58:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd8cb465d-15, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:58:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:58:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:58:47 user nova-compute[71113]: DEBUG nova.compute.manager [req-25ca5ae1-80ba-4bc0-9559-2fb4a53fa830 req-3291fb17-6e16-4142-9683-c4015cee71c8 service nova] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Received event network-changed-d8cb465d-1593-4491-b337-8528c1bcfb3e {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:58:47 user nova-compute[71113]: DEBUG nova.compute.manager [req-25ca5ae1-80ba-4bc0-9559-2fb4a53fa830 req-3291fb17-6e16-4142-9683-c4015cee71c8 service nova] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Refreshing instance network info cache due to event network-changed-d8cb465d-1593-4491-b337-8528c1bcfb3e. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:58:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-25ca5ae1-80ba-4bc0-9559-2fb4a53fa830 req-3291fb17-6e16-4142-9683-c4015cee71c8 service nova] Acquiring lock "refresh_cache-208130bc-5ece-4683-aa83-505ee89a8ba5" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:58:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-25ca5ae1-80ba-4bc0-9559-2fb4a53fa830 req-3291fb17-6e16-4142-9683-c4015cee71c8 service nova] Acquired lock "refresh_cache-208130bc-5ece-4683-aa83-505ee89a8ba5" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:58:47 user nova-compute[71113]: DEBUG nova.network.neutron [req-25ca5ae1-80ba-4bc0-9559-2fb4a53fa830 req-3291fb17-6e16-4142-9683-c4015cee71c8 service nova] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Refreshing network info cache for port d8cb465d-1593-4491-b337-8528c1bcfb3e {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:58:47 user nova-compute[71113]: INFO os_vif [None req-32636365-e384-437d-9d4d-ac90c6ff825f tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:b2:fd,bridge_name='br-int',has_traffic_filtering=True,id=d8cb465d-1593-4491-b337-8528c1bcfb3e,network=Network(e498d93a-703d-4d19-9adf-61469f37d4da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8cb465d-15')
Jul 31 09:58:47 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-32636365-e384-437d-9d4d-ac90c6ff825f tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Deleting instance files /opt/stack/data/nova/instances/208130bc-5ece-4683-aa83-505ee89a8ba5_del
Jul 31 09:58:47 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-32636365-e384-437d-9d4d-ac90c6ff825f tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Deletion of /opt/stack/data/nova/instances/208130bc-5ece-4683-aa83-505ee89a8ba5_del complete
Jul 31 09:58:47 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-32636365-e384-437d-9d4d-ac90c6ff825f tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Deleted allocations for instance 208130bc-5ece-4683-aa83-505ee89a8ba5
Jul 31 09:58:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-32636365-e384-437d-9d4d-ac90c6ff825f tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:58:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-32636365-e384-437d-9d4d-ac90c6ff825f tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:58:47 user nova-compute[71113]: DEBUG nova.objects.instance [None req-32636365-e384-437d-9d4d-ac90c6ff825f tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lazy-loading 'numa_topology' on Instance uuid 208130bc-5ece-4683-aa83-505ee89a8ba5 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:58:47 user nova-compute[71113]: DEBUG nova.network.neutron [req-25ca5ae1-80ba-4bc0-9559-2fb4a53fa830 req-3291fb17-6e16-4142-9683-c4015cee71c8 service nova] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Updated VIF entry in instance network info cache for port d8cb465d-1593-4491-b337-8528c1bcfb3e. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:58:47 user nova-compute[71113]: DEBUG nova.network.neutron [req-25ca5ae1-80ba-4bc0-9559-2fb4a53fa830 req-3291fb17-6e16-4142-9683-c4015cee71c8 service nova] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Updating instance_info_cache with network_info: [{"id": "d8cb465d-1593-4491-b337-8528c1bcfb3e", "address": "fa:16:3e:bb:b2:fd", "network": {"id": "e498d93a-703d-4d19-9adf-61469f37d4da", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1320431580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4461b48e5470471d8fe1b61fb8af9c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapd8cb465d-15", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:58:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-25ca5ae1-80ba-4bc0-9559-2fb4a53fa830 req-3291fb17-6e16-4142-9683-c4015cee71c8 service nova] Releasing lock "refresh_cache-208130bc-5ece-4683-aa83-505ee89a8ba5" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:58:47 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-32636365-e384-437d-9d4d-ac90c6ff825f tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:58:47 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-32636365-e384-437d-9d4d-ac90c6ff825f tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:58:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-32636365-e384-437d-9d4d-ac90c6ff825f tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.421s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:58:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-32636365-e384-437d-9d4d-ac90c6ff825f tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "208130bc-5ece-4683-aa83-505ee89a8ba5" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.469s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:58:49 user nova-compute[71113]: DEBUG nova.compute.manager [req-e7d2fcaa-22d9-4aee-a16e-5d819de439c1 req-8850549a-b3ee-45ff-b142-25bde4d0f3c4 service nova] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Received event network-changed-04c596fd-1d1a-426e-8d57-043b36bad9b6 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:58:49 user nova-compute[71113]: DEBUG nova.compute.manager [req-e7d2fcaa-22d9-4aee-a16e-5d819de439c1 req-8850549a-b3ee-45ff-b142-25bde4d0f3c4 service nova] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Refreshing instance network info cache due to event network-changed-04c596fd-1d1a-426e-8d57-043b36bad9b6. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:58:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e7d2fcaa-22d9-4aee-a16e-5d819de439c1 req-8850549a-b3ee-45ff-b142-25bde4d0f3c4 service nova] Acquiring lock "refresh_cache-9745ff0d-8320-4689-8326-c18752c6e6ae" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:58:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e7d2fcaa-22d9-4aee-a16e-5d819de439c1 req-8850549a-b3ee-45ff-b142-25bde4d0f3c4 service nova] Acquired lock "refresh_cache-9745ff0d-8320-4689-8326-c18752c6e6ae" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:58:49 user nova-compute[71113]: DEBUG nova.network.neutron [req-e7d2fcaa-22d9-4aee-a16e-5d819de439c1 req-8850549a-b3ee-45ff-b142-25bde4d0f3c4 service nova] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Refreshing network info cache for port 04c596fd-1d1a-426e-8d57-043b36bad9b6 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:58:50 user nova-compute[71113]: DEBUG nova.compute.manager [req-af7513eb-6a64-42b1-a171-c8dda2743d60 req-457d2c20-5ca2-42be-801a-8bf911a349ac service nova] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Received event network-changed-023cf8aa-3275-4fa5-89fc-81eb12bc8835 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:58:50 user nova-compute[71113]: DEBUG nova.compute.manager [req-af7513eb-6a64-42b1-a171-c8dda2743d60 req-457d2c20-5ca2-42be-801a-8bf911a349ac service nova] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Refreshing instance network info cache due to event network-changed-023cf8aa-3275-4fa5-89fc-81eb12bc8835. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:58:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-af7513eb-6a64-42b1-a171-c8dda2743d60 req-457d2c20-5ca2-42be-801a-8bf911a349ac service nova] Acquiring lock "refresh_cache-bc9b4047-7408-40a1-b38c-59695faffafb" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:58:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-af7513eb-6a64-42b1-a171-c8dda2743d60 req-457d2c20-5ca2-42be-801a-8bf911a349ac service nova] Acquired lock "refresh_cache-bc9b4047-7408-40a1-b38c-59695faffafb" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:58:50 user nova-compute[71113]: DEBUG nova.network.neutron [req-af7513eb-6a64-42b1-a171-c8dda2743d60 req-457d2c20-5ca2-42be-801a-8bf911a349ac service nova] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Refreshing network info cache for port 023cf8aa-3275-4fa5-89fc-81eb12bc8835 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:58:50 user nova-compute[71113]: DEBUG nova.network.neutron [req-e7d2fcaa-22d9-4aee-a16e-5d819de439c1 req-8850549a-b3ee-45ff-b142-25bde4d0f3c4 service nova] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Updated VIF entry in instance network info cache for port 04c596fd-1d1a-426e-8d57-043b36bad9b6. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:58:50 user nova-compute[71113]: DEBUG nova.network.neutron [req-e7d2fcaa-22d9-4aee-a16e-5d819de439c1 req-8850549a-b3ee-45ff-b142-25bde4d0f3c4 service nova] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Updating instance_info_cache with network_info: [{"id": "04c596fd-1d1a-426e-8d57-043b36bad9b6", "address": "fa:16:3e:52:17:a1", "network": {"id": "86306292-9a3b-4b6f-bf9f-b18bbe38fbb7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1087389621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df6061a98f3f47c49667a1af078fd72e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04c596fd-1d", "ovs_interfaceid": "04c596fd-1d1a-426e-8d57-043b36bad9b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:58:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e7d2fcaa-22d9-4aee-a16e-5d819de439c1 req-8850549a-b3ee-45ff-b142-25bde4d0f3c4 service nova] Releasing lock "refresh_cache-9745ff0d-8320-4689-8326-c18752c6e6ae" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:58:50 user nova-compute[71113]: DEBUG nova.network.neutron [req-af7513eb-6a64-42b1-a171-c8dda2743d60 req-457d2c20-5ca2-42be-801a-8bf911a349ac service nova] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Updated VIF entry in instance network info cache for port 023cf8aa-3275-4fa5-89fc-81eb12bc8835. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:58:50 user nova-compute[71113]: DEBUG nova.network.neutron [req-af7513eb-6a64-42b1-a171-c8dda2743d60 req-457d2c20-5ca2-42be-801a-8bf911a349ac service nova] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Updating instance_info_cache with network_info: [{"id": "023cf8aa-3275-4fa5-89fc-81eb12bc8835", "address": "fa:16:3e:b9:09:59", "network": {"id": "26352e29-fc15-48ac-be14-8af7a0c80219", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866093358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bae93d4fff5e4990bd9fe78e71d6d2d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap023cf8aa-32", "ovs_interfaceid": "023cf8aa-3275-4fa5-89fc-81eb12bc8835", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:58:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-af7513eb-6a64-42b1-a171-c8dda2743d60 req-457d2c20-5ca2-42be-801a-8bf911a349ac service nova] Releasing lock "refresh_cache-bc9b4047-7408-40a1-b38c-59695faffafb" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:58:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:58:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9b99e7d8-5f2e-47f3-b4b4-4425a314adff tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Acquiring lock "bc9b4047-7408-40a1-b38c-59695faffafb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:58:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9b99e7d8-5f2e-47f3-b4b4-4425a314adff tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "bc9b4047-7408-40a1-b38c-59695faffafb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:58:54 user nova-compute[71113]: DEBUG nova.objects.instance [None req-9b99e7d8-5f2e-47f3-b4b4-4425a314adff tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lazy-loading 'flavor' on Instance uuid bc9b4047-7408-40a1-b38c-59695faffafb {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:58:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9b99e7d8-5f2e-47f3-b4b4-4425a314adff tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "bc9b4047-7408-40a1-b38c-59695faffafb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:58:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9b99e7d8-5f2e-47f3-b4b4-4425a314adff tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Acquiring lock "bc9b4047-7408-40a1-b38c-59695faffafb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:58:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9b99e7d8-5f2e-47f3-b4b4-4425a314adff tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "bc9b4047-7408-40a1-b38c-59695faffafb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:58:54 user nova-compute[71113]: INFO nova.compute.manager [None req-9b99e7d8-5f2e-47f3-b4b4-4425a314adff tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Attaching volume 59366e28-a349-4469-a8a6-af6b74f3ae4c to /dev/vdb
Jul 31 09:58:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0e74abcd-875d-46b8-bb48-24de1f6b1a0d tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Acquiring lock "9745ff0d-8320-4689-8326-c18752c6e6ae" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:58:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0e74abcd-875d-46b8-bb48-24de1f6b1a0d tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Lock "9745ff0d-8320-4689-8326-c18752c6e6ae" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:58:54 user nova-compute[71113]: DEBUG nova.objects.instance [None req-0e74abcd-875d-46b8-bb48-24de1f6b1a0d tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Lazy-loading 'flavor' on Instance uuid 9745ff0d-8320-4689-8326-c18752c6e6ae {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:58:54 user nova-compute[71113]: DEBUG os_brick.utils [None req-9b99e7d8-5f2e-47f3-b4b4-4425a314adff tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:58:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:58:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0e74abcd-875d-46b8-bb48-24de1f6b1a0d tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Lock "9745ff0d-8320-4689-8326-c18752c6e6ae" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:58:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:58:54 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bcf1888-2fb5-405f-8960-eba9eba5827d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:58:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:58:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:58:54 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3e98bc-5f97-44ee-84e0-5f7b9e2b5128]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:58:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:58:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:58:54 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c997771-f789-4b9c-8989-77e6082b1874]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:58:54 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf42f8d7-9468-4a97-8015-e07f31c77301]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:58:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-9b99e7d8-5f2e-47f3-b4b4-4425a314adff tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:58:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-9b99e7d8-5f2e-47f3-b4b4-4425a314adff tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:58:54 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9b99e7d8-5f2e-47f3-b4b4-4425a314adff tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 09:58:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:58:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:58:54 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 09:58:54 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f23952-4f39-4d02-8391-3f72ddde0dc2]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:58:54 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-9b99e7d8-5f2e-47f3-b4b4-4425a314adff tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 09:58:54 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-9b99e7d8-5f2e-47f3-b4b4-4425a314adff tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 09:58:54 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-9b99e7d8-5f2e-47f3-b4b4-4425a314adff tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 09:58:54 user nova-compute[71113]: DEBUG os_brick.utils [None req-9b99e7d8-5f2e-47f3-b4b4-4425a314adff tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:58:54 user nova-compute[71113]: DEBUG nova.virt.block_device [None req-9b99e7d8-5f2e-47f3-b4b4-4425a314adff tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Updating existing volume attachment record: 26697448-7e14-4bf9-83a4-e4ce2365dd4b {{(pid=71113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 09:58:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0e74abcd-875d-46b8-bb48-24de1f6b1a0d tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Acquiring lock "9745ff0d-8320-4689-8326-c18752c6e6ae" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:58:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0e74abcd-875d-46b8-bb48-24de1f6b1a0d tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Lock "9745ff0d-8320-4689-8326-c18752c6e6ae" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:58:54 user nova-compute[71113]: INFO nova.compute.manager [None req-0e74abcd-875d-46b8-bb48-24de1f6b1a0d tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Attaching volume 195ab94d-3ed8-40da-8e09-e43187cc621a to /dev/vdb
Jul 31 09:58:54 user nova-compute[71113]: DEBUG os_brick.utils [None req-0e74abcd-875d-46b8-bb48-24de1f6b1a0d tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:58:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:58:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:58:54 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a3f69e-c86e-44ce-a9b0-e2f923b3febe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:58:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:58:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:58:54 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[83af46e2-b946-4f19-b878-2bbe48cf6a82]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:58:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:58:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:58:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.095s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:58:54 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d19b2d5-3371-4cc8-b7cc-9478510a8aeb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:58:54 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc2ae5d-c1ea-4887-90a7-7e1091899f68]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:58:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0e74abcd-875d-46b8-bb48-24de1f6b1a0d tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:58:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0e74abcd-875d-46b8-bb48-24de1f6b1a0d tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:58:54 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0e74abcd-875d-46b8-bb48-24de1f6b1a0d tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 09:58:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:58:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:58:54 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 09:58:54 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2176c9-d9b9-4413-ad10-5f03b0f6d205]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:58:54 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-0e74abcd-875d-46b8-bb48-24de1f6b1a0d tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 09:58:54 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-0e74abcd-875d-46b8-bb48-24de1f6b1a0d tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 09:58:54 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-0e74abcd-875d-46b8-bb48-24de1f6b1a0d tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 09:58:54 user nova-compute[71113]: DEBUG os_brick.utils [None req-0e74abcd-875d-46b8-bb48-24de1f6b1a0d tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] <== get_connector_properties: return (238ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:58:54 user nova-compute[71113]: DEBUG nova.virt.block_device [None req-0e74abcd-875d-46b8-bb48-24de1f6b1a0d tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Updating existing volume attachment record: 7398c4aa-9e76-4a59-8163-38f1dba8bf14 {{(pid=71113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 09:58:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5e404bd0-26b2-4863-a628-2f9e4d134fa9 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Acquiring lock "f4df9380-7882-48a6-ba64-bb17429e54ac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:58:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5e404bd0-26b2-4863-a628-2f9e4d134fa9 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Lock "f4df9380-7882-48a6-ba64-bb17429e54ac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:58:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5e404bd0-26b2-4863-a628-2f9e4d134fa9 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Acquiring lock "f4df9380-7882-48a6-ba64-bb17429e54ac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:58:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5e404bd0-26b2-4863-a628-2f9e4d134fa9 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Lock "f4df9380-7882-48a6-ba64-bb17429e54ac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:58:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5e404bd0-26b2-4863-a628-2f9e4d134fa9 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Lock "f4df9380-7882-48a6-ba64-bb17429e54ac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:58:55 user nova-compute[71113]: INFO nova.compute.manager [None req-5e404bd0-26b2-4863-a628-2f9e4d134fa9 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Terminating instance
Jul 31 09:58:55 user nova-compute[71113]: DEBUG nova.compute.manager [None req-5e404bd0-26b2-4863-a628-2f9e4d134fa9 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Start destroying the instance on the hypervisor. {{(pid=71113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 09:58:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:58:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:58:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:58:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:58:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:58:56 user nova-compute[71113]: DEBUG nova.compute.manager [req-bbf174dd-a0c8-44a9-8555-0b89d6f5f224 req-619c5f8c-3a09-4544-aa4b-c4cc31f55d6e service nova] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Received event network-vif-unplugged-14c27534-a6d1-4bfe-a5cf-1a4d9b573303 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:58:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-bbf174dd-a0c8-44a9-8555-0b89d6f5f224 req-619c5f8c-3a09-4544-aa4b-c4cc31f55d6e service nova] Acquiring lock "f4df9380-7882-48a6-ba64-bb17429e54ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:58:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-bbf174dd-a0c8-44a9-8555-0b89d6f5f224 req-619c5f8c-3a09-4544-aa4b-c4cc31f55d6e service nova] Lock "f4df9380-7882-48a6-ba64-bb17429e54ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:58:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-bbf174dd-a0c8-44a9-8555-0b89d6f5f224 req-619c5f8c-3a09-4544-aa4b-c4cc31f55d6e service nova] Lock "f4df9380-7882-48a6-ba64-bb17429e54ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:58:56 user nova-compute[71113]: DEBUG nova.compute.manager [req-bbf174dd-a0c8-44a9-8555-0b89d6f5f224 req-619c5f8c-3a09-4544-aa4b-c4cc31f55d6e service nova] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] No waiting events found dispatching network-vif-unplugged-14c27534-a6d1-4bfe-a5cf-1a4d9b573303 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:58:56 user nova-compute[71113]: DEBUG nova.compute.manager [req-bbf174dd-a0c8-44a9-8555-0b89d6f5f224 req-619c5f8c-3a09-4544-aa4b-c4cc31f55d6e service nova] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Received event network-vif-unplugged-14c27534-a6d1-4bfe-a5cf-1a4d9b573303 for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 09:58:56 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Instance destroyed successfully.
Jul 31 09:58:56 user nova-compute[71113]: DEBUG nova.objects.instance [None req-5e404bd0-26b2-4863-a628-2f9e4d134fa9 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Lazy-loading 'resources' on Instance uuid f4df9380-7882-48a6-ba64-bb17429e54ac {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:58:56 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-5e404bd0-26b2-4863-a628-2f9e4d134fa9 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:49:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-306353643',display_name='tempest-ServersNegativeTestJSON-server-306353643',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-306353643',id=15,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:50:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f88c00df40f46178f46c09cf14b88d7',ramdisk_id='',reservation_id='r-npknz5z0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1314085245',owner_user_name='tempest-ServersNegativeTestJSON-1314085245-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:50:07Z,user_data=None,user_id='7b3fa9245be64500b9879cf4624ecdc9',uuid=f4df9380-7882-48a6-ba64-bb17429e54ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "14c27534-a6d1-4bfe-a5cf-1a4d9b573303", "address": "fa:16:3e:00:6e:63", "network": {"id": "4ab5c9f4-e78f-4bf2-bc82-ef698b714952", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1047934668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f88c00df40f46178f46c09cf14b88d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c27534-a6", "ovs_interfaceid": "14c27534-a6d1-4bfe-a5cf-1a4d9b573303", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 09:58:56 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-5e404bd0-26b2-4863-a628-2f9e4d134fa9 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Converting VIF {"id": "14c27534-a6d1-4bfe-a5cf-1a4d9b573303", "address": "fa:16:3e:00:6e:63", "network": {"id": "4ab5c9f4-e78f-4bf2-bc82-ef698b714952", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1047934668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f88c00df40f46178f46c09cf14b88d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c27534-a6", "ovs_interfaceid": "14c27534-a6d1-4bfe-a5cf-1a4d9b573303", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:58:56 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-5e404bd0-26b2-4863-a628-2f9e4d134fa9 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:6e:63,bridge_name='br-int',has_traffic_filtering=True,id=14c27534-a6d1-4bfe-a5cf-1a4d9b573303,network=Network(4ab5c9f4-e78f-4bf2-bc82-ef698b714952),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14c27534-a6') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:58:56 user nova-compute[71113]: DEBUG os_vif [None req-5e404bd0-26b2-4863-a628-2f9e4d134fa9 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:6e:63,bridge_name='br-int',has_traffic_filtering=True,id=14c27534-a6d1-4bfe-a5cf-1a4d9b573303,network=Network(4ab5c9f4-e78f-4bf2-bc82-ef698b714952),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14c27534-a6') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 09:58:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:58:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap14c27534-a6, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:58:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:58:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:58:56 user nova-compute[71113]: INFO os_vif [None req-5e404bd0-26b2-4863-a628-2f9e4d134fa9 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:6e:63,bridge_name='br-int',has_traffic_filtering=True,id=14c27534-a6d1-4bfe-a5cf-1a4d9b573303,network=Network(4ab5c9f4-e78f-4bf2-bc82-ef698b714952),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14c27534-a6')
Jul 31 09:58:56 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-5e404bd0-26b2-4863-a628-2f9e4d134fa9 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Deleting instance files /opt/stack/data/nova/instances/f4df9380-7882-48a6-ba64-bb17429e54ac_del
Jul 31 09:58:56 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-5e404bd0-26b2-4863-a628-2f9e4d134fa9 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Deletion of /opt/stack/data/nova/instances/f4df9380-7882-48a6-ba64-bb17429e54ac_del complete
Jul 31 09:58:56 user nova-compute[71113]: INFO nova.compute.manager [None req-5e404bd0-26b2-4863-a628-2f9e4d134fa9 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Took 0.93 seconds to destroy the instance on the hypervisor.
Jul 31 09:58:56 user nova-compute[71113]: DEBUG oslo.service.loopingcall [None req-5e404bd0-26b2-4863-a628-2f9e4d134fa9 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71113) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 09:58:56 user nova-compute[71113]: DEBUG nova.compute.manager [-] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Deallocating network for instance {{(pid=71113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 09:58:56 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] deallocate_for_instance() {{(pid=71113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 09:58:57 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690797522.1714873, 208130bc-5ece-4683-aa83-505ee89a8ba5 => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:58:57 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] VM Stopped (Lifecycle Event)
Jul 31 09:58:57 user nova-compute[71113]: DEBUG nova.compute.manager [None req-37ec9b56-cdba-4e64-a1e6-610222257ccb None None] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:58:57 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:58:57 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Took 0.65 seconds to deallocate network for instance.
Jul 31 09:58:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5e404bd0-26b2-4863-a628-2f9e4d134fa9 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:58:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5e404bd0-26b2-4863-a628-2f9e4d134fa9 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:58:57 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-5e404bd0-26b2-4863-a628-2f9e4d134fa9 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:58:57 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-5e404bd0-26b2-4863-a628-2f9e4d134fa9 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:58:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5e404bd0-26b2-4863-a628-2f9e4d134fa9 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.345s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:58:57 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-5e404bd0-26b2-4863-a628-2f9e4d134fa9 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Deleted allocations for instance f4df9380-7882-48a6-ba64-bb17429e54ac
Jul 31 09:58:58 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5e404bd0-26b2-4863-a628-2f9e4d134fa9 tempest-ServersNegativeTestJSON-1314085245 tempest-ServersNegativeTestJSON-1314085245-project-member] Lock "f4df9380-7882-48a6-ba64-bb17429e54ac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.114s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:58:58 user nova-compute[71113]: DEBUG nova.compute.manager [req-191bd9a1-b802-4ca5-9632-2318088e5211 req-66553c13-ef5a-40f4-a060-585b5033b659 service nova] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Received event network-vif-plugged-14c27534-a6d1-4bfe-a5cf-1a4d9b573303 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:58:58 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-191bd9a1-b802-4ca5-9632-2318088e5211 req-66553c13-ef5a-40f4-a060-585b5033b659 service nova] Acquiring lock "f4df9380-7882-48a6-ba64-bb17429e54ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:58:58 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-191bd9a1-b802-4ca5-9632-2318088e5211 req-66553c13-ef5a-40f4-a060-585b5033b659 service nova] Lock "f4df9380-7882-48a6-ba64-bb17429e54ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:58:58 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-191bd9a1-b802-4ca5-9632-2318088e5211 req-66553c13-ef5a-40f4-a060-585b5033b659 service nova] Lock "f4df9380-7882-48a6-ba64-bb17429e54ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:58:58 user nova-compute[71113]: DEBUG nova.compute.manager [req-191bd9a1-b802-4ca5-9632-2318088e5211 req-66553c13-ef5a-40f4-a060-585b5033b659 service nova] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] No waiting events found dispatching network-vif-plugged-14c27534-a6d1-4bfe-a5cf-1a4d9b573303 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:58:58 user nova-compute[71113]: WARNING nova.compute.manager [req-191bd9a1-b802-4ca5-9632-2318088e5211 req-66553c13-ef5a-40f4-a060-585b5033b659 service nova] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Received unexpected event network-vif-plugged-14c27534-a6d1-4bfe-a5cf-1a4d9b573303 for instance with vm_state deleted and task_state None.
Jul 31 09:58:58 user nova-compute[71113]: DEBUG nova.compute.manager [req-191bd9a1-b802-4ca5-9632-2318088e5211 req-66553c13-ef5a-40f4-a060-585b5033b659 service nova] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Received event network-vif-deleted-14c27534-a6d1-4bfe-a5cf-1a4d9b573303 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:58:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:01 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f670ea0d-aad9-4523-9c41-88756ed814f2 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Acquiring lock "a950d710-4596-4355-ac31-568c7728335a" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:59:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f670ea0d-aad9-4523-9c41-88756ed814f2 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "a950d710-4596-4355-ac31-568c7728335a" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:59:01 user nova-compute[71113]: DEBUG nova.compute.manager [None req-f670ea0d-aad9-4523-9c41-88756ed814f2 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Going to confirm migration 2 {{(pid=71113) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f670ea0d-aad9-4523-9c41-88756ed814f2 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Acquiring lock "refresh_cache-a950d710-4596-4355-ac31-568c7728335a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f670ea0d-aad9-4523-9c41-88756ed814f2 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Acquired lock "refresh_cache-a950d710-4596-4355-ac31-568c7728335a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG nova.network.neutron [None req-f670ea0d-aad9-4523-9c41-88756ed814f2 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG nova.objects.instance [None req-f670ea0d-aad9-4523-9c41-88756ed814f2 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lazy-loading 'info_cache' on Instance uuid a950d710-4596-4355-ac31-568c7728335a {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b45dca39-e069-4a8d-874a-e139142d7e13 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Acquiring lock "5f69d43c-f8a3-4fed-a737-389c217970d8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b45dca39-e069-4a8d-874a-e139142d7e13 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Lock "5f69d43c-f8a3-4fed-a737-389c217970d8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b45dca39-e069-4a8d-874a-e139142d7e13 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Acquiring lock "5f69d43c-f8a3-4fed-a737-389c217970d8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b45dca39-e069-4a8d-874a-e139142d7e13 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Lock "5f69d43c-f8a3-4fed-a737-389c217970d8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b45dca39-e069-4a8d-874a-e139142d7e13 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Lock "5f69d43c-f8a3-4fed-a737-389c217970d8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:59:02 user nova-compute[71113]: INFO nova.compute.manager [None req-b45dca39-e069-4a8d-874a-e139142d7e13 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Terminating instance
Jul 31 09:59:02 user nova-compute[71113]: DEBUG nova.compute.manager [None req-b45dca39-e069-4a8d-874a-e139142d7e13 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Start destroying the instance on the hypervisor. {{(pid=71113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b99e7d8-5f2e-47f3-b4b4-4425a314adff tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b99e7d8-5f2e-47f3-b4b4-4425a314adff tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'swPhTmcK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:59:02 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-9b99e7d8-5f2e-47f3-b4b4-4425a314adff tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:59:02 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-9b99e7d8-5f2e-47f3-b4b4-4425a314adff tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-9b99e7d8-5f2e-47f3-b4b4-4425a314adff tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:59:02 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-9b99e7d8-5f2e-47f3-b4b4-4425a314adff tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:59:02 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-9b99e7d8-5f2e-47f3-b4b4-4425a314adff tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-9b99e7d8-5f2e-47f3-b4b4-4425a314adff tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:59:02 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-9b99e7d8-5f2e-47f3-b4b4-4425a314adff tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 09:59:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a243322-51d1-4992-a8b7-2c08d30a7f5c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b99e7d8-5f2e-47f3-b4b4-4425a314adff tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 09:59:02 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2b50e3-46f4-470c-8fc1-d825dda15fe2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b99e7d8-5f2e-47f3-b4b4-4425a314adff tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c] added
Jul 31 09:59:02 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG nova.compute.manager [req-3ed1b6ba-1684-43ae-afac-8421b0892cca req-b7a4f89e-da20-49fa-818e-eaf729a2c5d1 service nova] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Received event network-vif-unplugged-1343cd85-d61a-4c60-bd8f-50712b92b769 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3ed1b6ba-1684-43ae-afac-8421b0892cca req-b7a4f89e-da20-49fa-818e-eaf729a2c5d1 service nova] Acquiring lock "5f69d43c-f8a3-4fed-a737-389c217970d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3ed1b6ba-1684-43ae-afac-8421b0892cca req-b7a4f89e-da20-49fa-818e-eaf729a2c5d1 service nova] Lock "5f69d43c-f8a3-4fed-a737-389c217970d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3ed1b6ba-1684-43ae-afac-8421b0892cca req-b7a4f89e-da20-49fa-818e-eaf729a2c5d1 service nova] Lock "5f69d43c-f8a3-4fed-a737-389c217970d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG nova.compute.manager [req-3ed1b6ba-1684-43ae-afac-8421b0892cca req-b7a4f89e-da20-49fa-818e-eaf729a2c5d1 service nova] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] No waiting events found dispatching network-vif-unplugged-1343cd85-d61a-4c60-bd8f-50712b92b769 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG nova.compute.manager [req-3ed1b6ba-1684-43ae-afac-8421b0892cca req-b7a4f89e-da20-49fa-818e-eaf729a2c5d1 service nova] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Received event network-vif-unplugged-1343cd85-d61a-4c60-bd8f-50712b92b769 for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0522b1-907d-455e-a1ff-ece3a325b277]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b99e7d8-5f2e-47f3-b4b4-4425a314adff tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6ac07d-3e74-49bf-a5fa-d42d711e76c2]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b99e7d8-5f2e-47f3-b4b4-4425a314adff tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v swPhTmcK {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v swPhTmcK" returned: 0 in 0.028s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1cbe8f9-90f5-408e-8e39-741a5164849d]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b99e7d8-5f2e-47f3-b4b4-4425a314adff tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'swPhTmcK'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.034s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b59932-7106-4434-942d-2804424be9d0]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b99e7d8-5f2e-47f3-b4b4-4425a314adff tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc886a0c-53f6-4d41-9c7b-4dfb29e86997]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b99e7d8-5f2e-47f3-b4b4-4425a314adff tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:59:02 user nova-compute[71113]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)
Jul 31 09:59:02 user nova-compute[71113]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617 (non-flash)
Jul 31 09:59:02 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b99e7d8-5f2e-47f3-b4b4-4425a314adff tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:59:02 user nova-compute[71113]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)
Jul 31 09:59:02 user nova-compute[71113]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617 (non-flash)
Jul 31 09:59:02 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[feed014b-31c9-4139-92db-93cccb042126]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b99e7d8-5f2e-47f3-b4b4-4425a314adff tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c, portal: 172.16.0.220,3260]
Jul 31 09:59:02 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c, portal: 172.16.0.220,3260] successful.
Jul 31 09:59:02 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4d6346-7f78-4e80-b55c-318314829ac8]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b99e7d8-5f2e-47f3-b4b4-4425a314adff tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:02 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Instance destroyed successfully.
Jul 31 09:59:02 user nova-compute[71113]: DEBUG nova.objects.instance [None req-b45dca39-e069-4a8d-874a-e139142d7e13 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Lazy-loading 'resources' on Instance uuid 5f69d43c-f8a3-4fed-a737-389c217970d8 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-b45dca39-e069-4a8d-874a-e139142d7e13 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:56:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-70152317',display_name='tempest-VolumesActionsTest-instance-70152317',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-70152317',id=25,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:57:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4eb7c2bc45154315952e1485b921a1c1',ramdisk_id='',reservation_id='r-wf5z49a2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1059930490',owner_user_name='tempest-VolumesActionsTest-1059930490-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:57:04Z,user_data=None,user_id='652ff6eb4a134b36810f8db3e29fc2f8',uuid=5f69d43c-f8a3-4fed-a737-389c217970d8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1343cd85-d61a-4c60-bd8f-50712b92b769", "address": "fa:16:3e:99:54:a7", "network": {"id": "869b89d2-908a-456e-8b07-c4c72cab7202", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1845798715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4eb7c2bc45154315952e1485b921a1c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1343cd85-d6", "ovs_interfaceid": "1343cd85-d61a-4c60-bd8f-50712b92b769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-b45dca39-e069-4a8d-874a-e139142d7e13 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Converting VIF {"id": "1343cd85-d61a-4c60-bd8f-50712b92b769", "address": "fa:16:3e:99:54:a7", "network": {"id": "869b89d2-908a-456e-8b07-c4c72cab7202", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1845798715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4eb7c2bc45154315952e1485b921a1c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1343cd85-d6", "ovs_interfaceid": "1343cd85-d61a-4c60-bd8f-50712b92b769", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-b45dca39-e069-4a8d-874a-e139142d7e13 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:54:a7,bridge_name='br-int',has_traffic_filtering=True,id=1343cd85-d61a-4c60-bd8f-50712b92b769,network=Network(869b89d2-908a-456e-8b07-c4c72cab7202),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1343cd85-d6') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG os_vif [None req-b45dca39-e069-4a8d-874a-e139142d7e13 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:54:a7,bridge_name='br-int',has_traffic_filtering=True,id=1343cd85-d61a-4c60-bd8f-50712b92b769,network=Network(869b89d2-908a-456e-8b07-c4c72cab7202),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1343cd85-d6') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1343cd85-d6, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36bcf1c-06f9-407f-b832-aefc1137fcd6]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b99e7d8-5f2e-47f3-b4b4-4425a314adff tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:59:02 user nova-compute[71113]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)
Jul 31 09:59:02 user nova-compute[71113]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617 (non-flash)
Jul 31 09:59:02 user nova-compute[71113]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c (non-flash)
Jul 31 09:59:02 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b99e7d8-5f2e-47f3-b4b4-4425a314adff tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:59:02 user nova-compute[71113]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)
Jul 31 09:59:02 user nova-compute[71113]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617 (non-flash)
Jul 31 09:59:02 user nova-compute[71113]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c (non-flash)
Jul 31 09:59:02 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-9b99e7d8-5f2e-47f3-b4b4-4425a314adff tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.415s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b99e7d8-5f2e-47f3-b4b4-4425a314adff tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-9b99e7d8-5f2e-47f3-b4b4-4425a314adff tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] HCTL ('35', '-', '-', 0) found on session 32 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-9b99e7d8-5f2e-47f3-b4b4-4425a314adff tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:59:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:02 user nova-compute[71113]: INFO os_vif [None req-b45dca39-e069-4a8d-874a-e139142d7e13 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:54:a7,bridge_name='br-int',has_traffic_filtering=True,id=1343cd85-d61a-4c60-bd8f-50712b92b769,network=Network(869b89d2-908a-456e-8b07-c4c72cab7202),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1343cd85-d6')
Jul 31 09:59:02 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-b45dca39-e069-4a8d-874a-e139142d7e13 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Deleting instance files /opt/stack/data/nova/instances/5f69d43c-f8a3-4fed-a737-389c217970d8_del
Jul 31 09:59:02 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-b45dca39-e069-4a8d-874a-e139142d7e13 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Deletion of /opt/stack/data/nova/instances/5f69d43c-f8a3-4fed-a737-389c217970d8_del complete
Jul 31 09:59:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:03 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86810f6-b4c1-4d80-8aca-e688c61c8137]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:03 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-9b99e7d8-5f2e-47f3-b4b4-4425a314adff tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 09:59:03 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b99e7d8-5f2e-47f3-b4b4-4425a314adff tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'swPhTmcK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 09:59:03 user nova-compute[71113]: DEBUG nova.network.neutron [None req-f670ea0d-aad9-4523-9c41-88756ed814f2 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Updating instance_info_cache with network_info: [{"id": "469843c1-3548-4bae-90bb-7fd1f5ac0052", "address": "fa:16:3e:08:cb:ac", "network": {"id": "cc84435f-b983-425d-bad0-36039e592e25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1662840158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f7a5479fd014325b8790a80b2405d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469843c1-35", "ovs_interfaceid": "469843c1-3548-4bae-90bb-7fd1f5ac0052", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:59:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f670ea0d-aad9-4523-9c41-88756ed814f2 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Releasing lock "refresh_cache-a950d710-4596-4355-ac31-568c7728335a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:59:03 user nova-compute[71113]: DEBUG nova.objects.instance [None req-f670ea0d-aad9-4523-9c41-88756ed814f2 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lazy-loading 'migration_context' on Instance uuid a950d710-4596-4355-ac31-568c7728335a {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:59:03 user nova-compute[71113]: INFO nova.compute.manager [None req-b45dca39-e069-4a8d-874a-e139142d7e13 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Took 0.71 seconds to destroy the instance on the hypervisor.
Jul 31 09:59:03 user nova-compute[71113]: DEBUG oslo.service.loopingcall [None req-b45dca39-e069-4a8d-874a-e139142d7e13 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71113) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 09:59:03 user nova-compute[71113]: DEBUG nova.compute.manager [-] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Deallocating network for instance {{(pid=71113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 09:59:03 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] deallocate_for_instance() {{(pid=71113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 09:59:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f670ea0d-aad9-4523-9c41-88756ed814f2 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:59:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f670ea0d-aad9-4523-9c41-88756ed814f2 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:59:03 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-f670ea0d-aad9-4523-9c41-88756ed814f2 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:59:03 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-f670ea0d-aad9-4523-9c41-88756ed814f2 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:59:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f670ea0d-aad9-4523-9c41-88756ed814f2 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.419s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:59:03 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:59:03 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Took 0.54 seconds to deallocate network for instance.
Jul 31 09:59:03 user nova-compute[71113]: DEBUG nova.compute.manager [req-29217d25-331d-4e3d-8250-b9bf469798a0 req-491aac18-cc54-4026-a957-7ba71f5a37a7 service nova] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Received event network-vif-deleted-1343cd85-d61a-4c60-bd8f-50712b92b769 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:59:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b45dca39-e069-4a8d-874a-e139142d7e13 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:59:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b45dca39-e069-4a8d-874a-e139142d7e13 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:59:03 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-f670ea0d-aad9-4523-9c41-88756ed814f2 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Deleted allocation for migration 933d9c4b-c0c8-4ce0-8243-03d233c9b509
Jul 31 09:59:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f670ea0d-aad9-4523-9c41-88756ed814f2 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "a950d710-4596-4355-ac31-568c7728335a" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.814s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:59:03 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-b45dca39-e069-4a8d-874a-e139142d7e13 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:59:03 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-b45dca39-e069-4a8d-874a-e139142d7e13 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:59:04 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-9b99e7d8-5f2e-47f3-b4b4-4425a314adff tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.460s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:59:04 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b99e7d8-5f2e-47f3-b4b4-4425a314adff tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] <== connect_volume: return (1462ms) {'type': 'block', 'scsi_wwn': '23238373332636562', 'path': '/dev/sdd'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:59:04 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b99e7d8-5f2e-47f3-b4b4-4425a314adff tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238373332636562', 'path': '/dev/sdd'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 09:59:04 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b45dca39-e069-4a8d-874a-e139142d7e13 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.372s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:59:04 user nova-compute[71113]: DEBUG nova.objects.instance [None req-9b99e7d8-5f2e-47f3-b4b4-4425a314adff tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lazy-loading 'flavor' on Instance uuid bc9b4047-7408-40a1-b38c-59695faffafb {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:59:04 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-b45dca39-e069-4a8d-874a-e139142d7e13 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Deleted allocations for instance 5f69d43c-f8a3-4fed-a737-389c217970d8
Jul 31 09:59:04 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-9b99e7d8-5f2e-47f3-b4b4-4425a314adff tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 09:59:04 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:59:04 user nova-compute[71113]:   <source dev="/dev/sdd"/>
Jul 31 09:59:04 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 09:59:04 user nova-compute[71113]:   <serial>59366e28-a349-4469-a8a6-af6b74f3ae4c</serial>
Jul 31 09:59:04 user nova-compute[71113]: </disk>
Jul 31 09:59:04 user nova-compute[71113]:  {{(pid=71113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 09:59:04 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b45dca39-e069-4a8d-874a-e139142d7e13 tempest-VolumesActionsTest-1059930490 tempest-VolumesActionsTest-1059930490-project-member] Lock "5f69d43c-f8a3-4fed-a737-389c217970d8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.820s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:59:04 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-9b99e7d8-5f2e-47f3-b4b4-4425a314adff tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:59:04 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-9b99e7d8-5f2e-47f3-b4b4-4425a314adff tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:59:04 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-9b99e7d8-5f2e-47f3-b4b4-4425a314adff tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] No VIF found with MAC fa:16:3e:b9:09:59, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 09:59:04 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9b99e7d8-5f2e-47f3-b4b4-4425a314adff tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "bc9b4047-7408-40a1-b38c-59695faffafb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.322s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:59:04 user nova-compute[71113]: DEBUG nova.compute.manager [req-e3443344-9c9c-4e5f-a977-2701c8149845 req-f186577a-00b7-49b1-9835-acca5bd78704 service nova] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Received event network-vif-plugged-1343cd85-d61a-4c60-bd8f-50712b92b769 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:59:04 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e3443344-9c9c-4e5f-a977-2701c8149845 req-f186577a-00b7-49b1-9835-acca5bd78704 service nova] Acquiring lock "5f69d43c-f8a3-4fed-a737-389c217970d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:59:04 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e3443344-9c9c-4e5f-a977-2701c8149845 req-f186577a-00b7-49b1-9835-acca5bd78704 service nova] Lock "5f69d43c-f8a3-4fed-a737-389c217970d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:59:04 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e3443344-9c9c-4e5f-a977-2701c8149845 req-f186577a-00b7-49b1-9835-acca5bd78704 service nova] Lock "5f69d43c-f8a3-4fed-a737-389c217970d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:59:04 user nova-compute[71113]: DEBUG nova.compute.manager [req-e3443344-9c9c-4e5f-a977-2701c8149845 req-f186577a-00b7-49b1-9835-acca5bd78704 service nova] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] No waiting events found dispatching network-vif-plugged-1343cd85-d61a-4c60-bd8f-50712b92b769 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:59:04 user nova-compute[71113]: WARNING nova.compute.manager [req-e3443344-9c9c-4e5f-a977-2701c8149845 req-f186577a-00b7-49b1-9835-acca5bd78704 service nova] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Received unexpected event network-vif-plugged-1343cd85-d61a-4c60-bd8f-50712b92b769 for instance with vm_state deleted and task_state None.
Jul 31 09:59:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:07 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:59:07 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:59:07 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:08 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:59:08 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e74abcd-875d-46b8-bb48-24de1f6b1a0d tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e74abcd-875d-46b8-bb48-24de1f6b1a0d tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:195ab94d-3ed8-40da-8e09-e43187cc621a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jmylJNfn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:59:09 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-0e74abcd-875d-46b8-bb48-24de1f6b1a0d tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:59:09 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-0e74abcd-875d-46b8-bb48-24de1f6b1a0d tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-0e74abcd-875d-46b8-bb48-24de1f6b1a0d tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:59:09 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-0e74abcd-875d-46b8-bb48-24de1f6b1a0d tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:59:09 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-0e74abcd-875d-46b8-bb48-24de1f6b1a0d tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:195ab94d-3ed8-40da-8e09-e43187cc621a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-0e74abcd-875d-46b8-bb48-24de1f6b1a0d tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:195ab94d-3ed8-40da-8e09-e43187cc621a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:59:09 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-0e74abcd-875d-46b8-bb48-24de1f6b1a0d tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 09:59:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:195ab94d-3ed8-40da-8e09-e43187cc621a -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:195ab94d-3ed8-40da-8e09-e43187cc621a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22c7191-652e-4b90-b024-6999810ebd8f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e74abcd-875d-46b8-bb48-24de1f6b1a0d tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 09:59:09 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:195ab94d-3ed8-40da-8e09-e43187cc621a -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:195ab94d-3ed8-40da-8e09-e43187cc621a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9e22f0-96c2-4ebb-95ac-1adf4e815c28]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:195ab94d-3ed8-40da-8e09-e43187cc621a] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e74abcd-875d-46b8-bb48-24de1f6b1a0d tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:195ab94d-3ed8-40da-8e09-e43187cc621a] added
Jul 31 09:59:09 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:195ab94d-3ed8-40da-8e09-e43187cc621a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:195ab94d-3ed8-40da-8e09-e43187cc621a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc1a0b7-dc4a-42b9-ad56-5c25480023bf]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e74abcd-875d-46b8-bb48-24de1f6b1a0d tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:195ab94d-3ed8-40da-8e09-e43187cc621a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:195ab94d-3ed8-40da-8e09-e43187cc621a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f707ce0d-0c24-404a-a136-dce56d1d50de]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e74abcd-875d-46b8-bb48-24de1f6b1a0d tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:195ab94d-3ed8-40da-8e09-e43187cc621a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jmylJNfn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:195ab94d-3ed8-40da-8e09-e43187cc621a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jmylJNfn" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[038751f1-a86f-4102-a5a2-a4480fc62dff]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e74abcd-875d-46b8-bb48-24de1f6b1a0d tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jmylJNfn'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:195ab94d-3ed8-40da-8e09-e43187cc621a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:195ab94d-3ed8-40da-8e09-e43187cc621a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ce17ef-d76a-4837-815b-fe1d3ad965fb]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e74abcd-875d-46b8-bb48-24de1f6b1a0d tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1ee578-5c20-45d2-9063-206feff22480]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e74abcd-875d-46b8-bb48-24de1f6b1a0d tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:59:09 user nova-compute[71113]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)
Jul 31 09:59:09 user nova-compute[71113]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617 (non-flash)
Jul 31 09:59:09 user nova-compute[71113]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c (non-flash)
Jul 31 09:59:09 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e74abcd-875d-46b8-bb48-24de1f6b1a0d tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:59:09 user nova-compute[71113]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)
Jul 31 09:59:09 user nova-compute[71113]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617 (non-flash)
Jul 31 09:59:09 user nova-compute[71113]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c (non-flash)
Jul 31 09:59:09 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:195ab94d-3ed8-40da-8e09-e43187cc621a -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:195ab94d-3ed8-40da-8e09-e43187cc621a -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[359422d8-7a89-4ed9-b8cb-05b6db31ba9a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:195ab94d-3ed8-40da-8e09-e43187cc621a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:195ab94d-3ed8-40da-8e09-e43187cc621a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e74abcd-875d-46b8-bb48-24de1f6b1a0d tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:195ab94d-3ed8-40da-8e09-e43187cc621a, portal: 172.16.0.220,3260]
Jul 31 09:59:09 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:195ab94d-3ed8-40da-8e09-e43187cc621a, portal: 172.16.0.220,3260] successful.
Jul 31 09:59:09 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:195ab94d-3ed8-40da-8e09-e43187cc621a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:195ab94d-3ed8-40da-8e09-e43187cc621a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7e4415-72a8-4fb2-9637-035b4c1c1603]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e74abcd-875d-46b8-bb48-24de1f6b1a0d tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0aef0c-21af-4068-99af-4fbdfa7393e8]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:195ab94d-3ed8-40da-8e09-e43187cc621a (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e74abcd-875d-46b8-bb48-24de1f6b1a0d tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:59:09 user nova-compute[71113]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)
Jul 31 09:59:09 user nova-compute[71113]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617 (non-flash)
Jul 31 09:59:09 user nova-compute[71113]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c (non-flash)
Jul 31 09:59:09 user nova-compute[71113]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:195ab94d-3ed8-40da-8e09-e43187cc621a (non-flash)
Jul 31 09:59:09 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e74abcd-875d-46b8-bb48-24de1f6b1a0d tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:59:09 user nova-compute[71113]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)
Jul 31 09:59:09 user nova-compute[71113]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617 (non-flash)
Jul 31 09:59:09 user nova-compute[71113]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c (non-flash)
Jul 31 09:59:09 user nova-compute[71113]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:195ab94d-3ed8-40da-8e09-e43187cc621a (non-flash)
Jul 31 09:59:09 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-0e74abcd-875d-46b8-bb48-24de1f6b1a0d tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:195ab94d-3ed8-40da-8e09-e43187cc621a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e74abcd-875d-46b8-bb48-24de1f6b1a0d tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-0e74abcd-875d-46b8-bb48-24de1f6b1a0d tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] HCTL ('37', '-', '-', 0) found on session 33 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-0e74abcd-875d-46b8-bb48-24de1f6b1a0d tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[80485747-b755-4047-b146-6d64f991d44b]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-0e74abcd-875d-46b8-bb48-24de1f6b1a0d tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Searching for a device in session 33 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e74abcd-875d-46b8-bb48-24de1f6b1a0d tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jmylJNfn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 09:59:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b88201-04dc-4da9-b213-c50cdf274f4e/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-fc8d7329-1d2d-4468-b2ae-f3450738ebbb tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Acquiring lock "bc9b4047-7408-40a1-b38c-59695faffafb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:59:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-fc8d7329-1d2d-4468-b2ae-f3450738ebbb tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "bc9b4047-7408-40a1-b38c-59695faffafb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:59:10 user nova-compute[71113]: DEBUG nova.objects.instance [None req-fc8d7329-1d2d-4468-b2ae-f3450738ebbb tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lazy-loading 'flavor' on Instance uuid bc9b4047-7408-40a1-b38c-59695faffafb {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:59:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b88201-04dc-4da9-b213-c50cdf274f4e/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b88201-04dc-4da9-b213-c50cdf274f4e/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-fc8d7329-1d2d-4468-b2ae-f3450738ebbb tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "bc9b4047-7408-40a1-b38c-59695faffafb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.092s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:59:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b88201-04dc-4da9-b213-c50cdf274f4e/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9745ff0d-8320-4689-8326-c18752c6e6ae/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9745ff0d-8320-4689-8326-c18752c6e6ae/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9745ff0d-8320-4689-8326-c18752c6e6ae/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:10 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-0e74abcd-875d-46b8-bb48-24de1f6b1a0d tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:59:10 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e74abcd-875d-46b8-bb48-24de1f6b1a0d tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '23565316161613430', 'path': '/dev/sdf'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:59:10 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e74abcd-875d-46b8-bb48-24de1f6b1a0d tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565316161613430', 'path': '/dev/sdf'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 09:59:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-fc8d7329-1d2d-4468-b2ae-f3450738ebbb tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Acquiring lock "bc9b4047-7408-40a1-b38c-59695faffafb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:59:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-fc8d7329-1d2d-4468-b2ae-f3450738ebbb tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "bc9b4047-7408-40a1-b38c-59695faffafb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:59:10 user nova-compute[71113]: INFO nova.compute.manager [None req-fc8d7329-1d2d-4468-b2ae-f3450738ebbb tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Attaching volume 57bc77b0-8874-4b20-9351-3f85a8a225ce to /dev/vdc
Jul 31 09:59:10 user nova-compute[71113]: DEBUG nova.objects.instance [None req-0e74abcd-875d-46b8-bb48-24de1f6b1a0d tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Lazy-loading 'flavor' on Instance uuid 9745ff0d-8320-4689-8326-c18752c6e6ae {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:59:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9745ff0d-8320-4689-8326-c18752c6e6ae/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:10 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-0e74abcd-875d-46b8-bb48-24de1f6b1a0d tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 09:59:10 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:59:10 user nova-compute[71113]:   <source dev="/dev/sdf"/>
Jul 31 09:59:10 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 09:59:10 user nova-compute[71113]:   <serial>195ab94d-3ed8-40da-8e09-e43187cc621a</serial>
Jul 31 09:59:10 user nova-compute[71113]: </disk>
Jul 31 09:59:10 user nova-compute[71113]:  {{(pid=71113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 09:59:10 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 09:59:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:10 user nova-compute[71113]: DEBUG os_brick.utils [None req-fc8d7329-1d2d-4468-b2ae-f3450738ebbb tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:59:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:10 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[313eb2c8-2f88-4917-8f90-1a8578070453]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:10 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ef5eae-a765-446b-a829-ae6d67580b15]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:10 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf30b09-70a4-423a-9807-3ff418c084a7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:10 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3089a9d9-3745-45b0-9803-ab0a6b97fba0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-fc8d7329-1d2d-4468-b2ae-f3450738ebbb tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-fc8d7329-1d2d-4468-b2ae-f3450738ebbb tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:59:10 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fc8d7329-1d2d-4468-b2ae-f3450738ebbb tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 09:59:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:59:10 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 09:59:10 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc223c3b-11ba-4799-8168-9ccde1fac519]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:10 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-fc8d7329-1d2d-4468-b2ae-f3450738ebbb tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 09:59:10 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-fc8d7329-1d2d-4468-b2ae-f3450738ebbb tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 09:59:10 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-fc8d7329-1d2d-4468-b2ae-f3450738ebbb tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 09:59:10 user nova-compute[71113]: DEBUG os_brick.utils [None req-fc8d7329-1d2d-4468-b2ae-f3450738ebbb tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] <== get_connector_properties: return (169ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:59:10 user nova-compute[71113]: DEBUG nova.virt.block_device [None req-fc8d7329-1d2d-4468-b2ae-f3450738ebbb tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Updating existing volume attachment record: 16d6d193-df98-4b7e-baae-6f66e39b4432 {{(pid=71113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 09:59:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc9b4047-7408-40a1-b38c-59695faffafb/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:10 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0e74abcd-875d-46b8-bb48-24de1f6b1a0d tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:59:10 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0e74abcd-875d-46b8-bb48-24de1f6b1a0d tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:59:10 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0e74abcd-875d-46b8-bb48-24de1f6b1a0d tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] No VIF found with MAC fa:16:3e:52:17:a1, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 09:59:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc9b4047-7408-40a1-b38c-59695faffafb/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc9b4047-7408-40a1-b38c-59695faffafb/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc9b4047-7408-40a1-b38c-59695faffafb/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:11 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 09:59:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:11 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0e74abcd-875d-46b8-bb48-24de1f6b1a0d tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Lock "9745ff0d-8320-4689-8326-c18752c6e6ae" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.610s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:59:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:11 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690797536.6874278, f4df9380-7882-48a6-ba64-bb17429e54ac => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:59:11 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] VM Stopped (Lifecycle Event)
Jul 31 09:59:11 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:59:11 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:59:11 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=7628MB free_disk=25.333282470703125GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 09:59:11 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:59:11 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:59:11 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ed4ebf79-e6a7-4dfc-8027-cf028dcc88fa None None] [instance: f4df9380-7882-48a6-ba64-bb17429e54ac] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:59:12 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 0ea0401b-26c2-4655-956b-1bc000debd53 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:59:12 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 3157a7a6-b8a9-4e2d-a157-360bce4c625d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:59:12 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 92d25a03-98ce-4bde-a3cc-20313ae77d41 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:59:12 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 9745ff0d-8320-4689-8326-c18752c6e6ae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:59:12 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance bc9b4047-7408-40a1-b38c-59695faffafb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:59:12 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance a950d710-4596-4355-ac31-568c7728335a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:59:12 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance c4b88201-04dc-4da9-b213-c50cdf274f4e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:59:12 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 0104663a-99d2-494c-bfb8-16f14f3f8f38 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 09:59:12 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 09:59:12 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 09:59:12 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:59:12 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:59:12 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 09:59:12 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.464s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:59:12 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-3ee4e062-b4ab-4989-b115-c6acdd7aeb95 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Acquiring lock "9745ff0d-8320-4689-8326-c18752c6e6ae" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:59:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-3ee4e062-b4ab-4989-b115-c6acdd7aeb95 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Lock "9745ff0d-8320-4689-8326-c18752c6e6ae" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:59:13 user nova-compute[71113]: INFO nova.compute.manager [None req-3ee4e062-b4ab-4989-b115-c6acdd7aeb95 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Detaching volume 195ab94d-3ed8-40da-8e09-e43187cc621a
Jul 31 09:59:13 user nova-compute[71113]: INFO nova.virt.block_device [None req-3ee4e062-b4ab-4989-b115-c6acdd7aeb95 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Attempting to driver detach volume 195ab94d-3ed8-40da-8e09-e43187cc621a from mountpoint /dev/vdb
Jul 31 09:59:13 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-3ee4e062-b4ab-4989-b115-c6acdd7aeb95 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Attempting to detach device vdb from instance 9745ff0d-8320-4689-8326-c18752c6e6ae from the persistent domain config. {{(pid=71113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 09:59:13 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-3ee4e062-b4ab-4989-b115-c6acdd7aeb95 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 09:59:13 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:59:13 user nova-compute[71113]:   <source dev="/dev/sdf"/>
Jul 31 09:59:13 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 09:59:13 user nova-compute[71113]:   <serial>195ab94d-3ed8-40da-8e09-e43187cc621a</serial>
Jul 31 09:59:13 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 09:59:13 user nova-compute[71113]: </disk>
Jul 31 09:59:13 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 09:59:13 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-3ee4e062-b4ab-4989-b115-c6acdd7aeb95 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Successfully detached device vdb from instance 9745ff0d-8320-4689-8326-c18752c6e6ae from the persistent domain config.
Jul 31 09:59:13 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-3ee4e062-b4ab-4989-b115-c6acdd7aeb95 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9745ff0d-8320-4689-8326-c18752c6e6ae from the live domain config. {{(pid=71113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 09:59:13 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-3ee4e062-b4ab-4989-b115-c6acdd7aeb95 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 09:59:13 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:59:13 user nova-compute[71113]:   <source dev="/dev/sdf"/>
Jul 31 09:59:13 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 09:59:13 user nova-compute[71113]:   <serial>195ab94d-3ed8-40da-8e09-e43187cc621a</serial>
Jul 31 09:59:13 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 09:59:13 user nova-compute[71113]: </disk>
Jul 31 09:59:13 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 09:59:13 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:59:13 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:59:13 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 09:59:13 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Received event <DeviceRemovedEvent: 1690797553.7003415, 9745ff0d-8320-4689-8326-c18752c6e6ae => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71113) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 09:59:13 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-3ee4e062-b4ab-4989-b115-c6acdd7aeb95 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9745ff0d-8320-4689-8326-c18752c6e6ae {{(pid=71113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 09:59:13 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-3ee4e062-b4ab-4989-b115-c6acdd7aeb95 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Successfully detached device vdb from instance 9745ff0d-8320-4689-8326-c18752c6e6ae from the live domain config.
Jul 31 09:59:13 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ee4e062-b4ab-4989-b115-c6acdd7aeb95 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 09:59:13 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee4e062-b4ab-4989-b115-c6acdd7aeb95 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:195ab94d-3ed8-40da-8e09-e43187cc621a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jmylJNfn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:59:13 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-3ee4e062-b4ab-4989-b115-c6acdd7aeb95 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:59:13 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-3ee4e062-b4ab-4989-b115-c6acdd7aeb95 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:59:13 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-3ee4e062-b4ab-4989-b115-c6acdd7aeb95 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:59:13 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee4e062-b4ab-4989-b115-c6acdd7aeb95 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:195ab94d-3ed8-40da-8e09-e43187cc621a', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 09:59:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:13 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:59:13 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 09:59:13 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Rebuilding the list of instances to heal {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 09:59:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:13 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[06dafa3c-f68b-476e-a35a-da4ac0aaa06b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:195ab94d-3ed8-40da-8e09-e43187cc621a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:13 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7bdb86-823d-45b1-93c3-a93b1594bdf3]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:195ab94d-3ed8-40da-8e09-e43187cc621a (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:13 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee4e062-b4ab-4989-b115-c6acdd7aeb95 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:59:13 user nova-compute[71113]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)
Jul 31 09:59:13 user nova-compute[71113]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617 (non-flash)
Jul 31 09:59:13 user nova-compute[71113]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c (non-flash)
Jul 31 09:59:13 user nova-compute[71113]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:195ab94d-3ed8-40da-8e09-e43187cc621a (non-flash)
Jul 31 09:59:13 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:59:13 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee4e062-b4ab-4989-b115-c6acdd7aeb95 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:59:13 user nova-compute[71113]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)
Jul 31 09:59:13 user nova-compute[71113]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617 (non-flash)
Jul 31 09:59:13 user nova-compute[71113]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c (non-flash)
Jul 31 09:59:13 user nova-compute[71113]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:195ab94d-3ed8-40da-8e09-e43187cc621a (non-flash)
Jul 31 09:59:13 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:59:13 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee4e062-b4ab-4989-b115-c6acdd7aeb95 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79083adea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:195ab94d-3ed8-40da-8e09-e43187cc621a'): ({'sdf'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 09:59:13 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-3ee4e062-b4ab-4989-b115-c6acdd7aeb95 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Removing single pathed devices sdf {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 09:59:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:13 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5cd30c4-1a76-49b8-9569-240fa3cdaa9a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "refresh_cache-0ea0401b-26c2-4655-956b-1bc000debd53" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:59:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquired lock "refresh_cache-0ea0401b-26c2-4655-956b-1bc000debd53" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:59:13 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Forcefully refreshing network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 09:59:13 user nova-compute[71113]: DEBUG nova.objects.instance [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lazy-loading 'info_cache' on Instance uuid 0ea0401b-26c2-4655-956b-1bc000debd53 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:59:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:13 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[620babd5-29cc-4996-bc15-6471b85281d2]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:13 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-3ee4e062-b4ab-4989-b115-c6acdd7aeb95 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Flushing IO for device /dev/sdf {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 09:59:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:13 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bcc9e6f-48f0-4a95-981c-59d5f773f600]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:13 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-3ee4e062-b4ab-4989-b115-c6acdd7aeb95 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 09:59:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:13 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c372104-c1f1-4a7c-86c5-00a475e93056]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:13 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-3ee4e062-b4ab-4989-b115-c6acdd7aeb95 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 09:59:13 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-3ee4e062-b4ab-4989-b115-c6acdd7aeb95 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] SCSI volumes sdf have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 09:59:13 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee4e062-b4ab-4989-b115-c6acdd7aeb95 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:195ab94d-3ed8-40da-8e09-e43187cc621a')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 09:59:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:195ab94d-3ed8-40da-8e09-e43187cc621a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:195ab94d-3ed8-40da-8e09-e43187cc621a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:13 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a0e589-d007-46f8-9b09-48ab6cca9940]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:13 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee4e062-b4ab-4989-b115-c6acdd7aeb95 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:59:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:195ab94d-3ed8-40da-8e09-e43187cc621a -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:195ab94d-3ed8-40da-8e09-e43187cc621a -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:13 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[53369120-71b0-4a18-9c18-874b37b2d92a]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:195ab94d-3ed8-40da-8e09-e43187cc621a, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:195ab94d-3ed8-40da-8e09-e43187cc621a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:13 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee4e062-b4ab-4989-b115-c6acdd7aeb95 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:195ab94d-3ed8-40da-8e09-e43187cc621a, portal: 172.16.0.220,3260]
Jul 31 09:59:13 user nova-compute[71113]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:195ab94d-3ed8-40da-8e09-e43187cc621a, portal: 172.16.0.220,3260] successful.
Jul 31 09:59:13 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:59:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:195ab94d-3ed8-40da-8e09-e43187cc621a -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:195ab94d-3ed8-40da-8e09-e43187cc621a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:14 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b1aed9-599a-4ac2-ae53-d6831e79ce24]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:14 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee4e062-b4ab-4989-b115-c6acdd7aeb95 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:59:14 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-3ee4e062-b4ab-4989-b115-c6acdd7aeb95 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:59:14 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee4e062-b4ab-4989-b115-c6acdd7aeb95 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] <== disconnect_volume: return (310ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:59:14 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ee4e062-b4ab-4989-b115-c6acdd7aeb95 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 09:59:14 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Updating instance_info_cache with network_info: [{"id": "5408a169-bdde-42da-be35-24006f474bc6", "address": "fa:16:3e:77:a3:62", "network": {"id": "cc84435f-b983-425d-bad0-36039e592e25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1662840158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f7a5479fd014325b8790a80b2405d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5408a169-bd", "ovs_interfaceid": "5408a169-bdde-42da-be35-24006f474bc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:59:14 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Releasing lock "refresh_cache-0ea0401b-26c2-4655-956b-1bc000debd53" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:59:14 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Updated the network info_cache for instance {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 09:59:14 user nova-compute[71113]: DEBUG nova.objects.instance [None req-3ee4e062-b4ab-4989-b115-c6acdd7aeb95 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Lazy-loading 'flavor' on Instance uuid 9745ff0d-8320-4689-8326-c18752c6e6ae {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:59:14 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-3ee4e062-b4ab-4989-b115-c6acdd7aeb95 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Lock "9745ff0d-8320-4689-8326-c18752c6e6ae" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.608s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:59:17 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 09:59:17 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690797542.9495387, 5f69d43c-f8a3-4fed-a737-389c217970d8 => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:59:17 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] VM Stopped (Lifecycle Event)
Jul 31 09:59:17 user nova-compute[71113]: DEBUG nova.compute.manager [None req-3e3a9f5f-ddeb-4ee7-9630-ebf2cae7b551 None None] [instance: 5f69d43c-f8a3-4fed-a737-389c217970d8] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:59:17 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:59:17 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:17 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 09:59:17 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 09:59:17 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 09:59:17 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:18 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc8d7329-1d2d-4468-b2ae-f3450738ebbb tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 09:59:18 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc8d7329-1d2d-4468-b2ae-f3450738ebbb tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:57bc77b0-8874-4b20-9351-3f85a8a225ce'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WklAnefQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:59:18 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-fc8d7329-1d2d-4468-b2ae-f3450738ebbb tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:59:18 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-fc8d7329-1d2d-4468-b2ae-f3450738ebbb tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:59:18 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-fc8d7329-1d2d-4468-b2ae-f3450738ebbb tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:59:18 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-fc8d7329-1d2d-4468-b2ae-f3450738ebbb tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:59:18 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-fc8d7329-1d2d-4468-b2ae-f3450738ebbb tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57bc77b0-8874-4b20-9351-3f85a8a225ce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:59:18 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-fc8d7329-1d2d-4468-b2ae-f3450738ebbb tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57bc77b0-8874-4b20-9351-3f85a8a225ce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:59:18 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-fc8d7329-1d2d-4468-b2ae-f3450738ebbb tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 09:59:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bc77b0-8874-4b20-9351-3f85a8a225ce -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bc77b0-8874-4b20-9351-3f85a8a225ce -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:18 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cbe1be2-2558-4fdc-b93f-f4280cac9123]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:18 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc8d7329-1d2d-4468-b2ae-f3450738ebbb tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 09:59:18 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:59:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bc77b0-8874-4b20-9351-3f85a8a225ce -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bc77b0-8874-4b20-9351-3f85a8a225ce -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:18 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[54da451e-9857-4499-9988-c181994c914a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57bc77b0-8874-4b20-9351-3f85a8a225ce] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:18 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc8d7329-1d2d-4468-b2ae-f3450738ebbb tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57bc77b0-8874-4b20-9351-3f85a8a225ce] added
Jul 31 09:59:18 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:59:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bc77b0-8874-4b20-9351-3f85a8a225ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bc77b0-8874-4b20-9351-3f85a8a225ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:18 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c66c262-600c-43a0-af31-f2e9b6ed722f]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:18 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc8d7329-1d2d-4468-b2ae-f3450738ebbb tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:59:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bc77b0-8874-4b20-9351-3f85a8a225ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bc77b0-8874-4b20-9351-3f85a8a225ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:18 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[98bbca51-0ee8-41ac-89f4-b799bc9e6da4]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:18 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc8d7329-1d2d-4468-b2ae-f3450738ebbb tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:59:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bc77b0-8874-4b20-9351-3f85a8a225ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WklAnefQ {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bc77b0-8874-4b20-9351-3f85a8a225ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WklAnefQ" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:18 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdab87b7-a613-40ec-a863-ace0fb904b65]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:18 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc8d7329-1d2d-4468-b2ae-f3450738ebbb tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WklAnefQ'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:59:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bc77b0-8874-4b20-9351-3f85a8a225ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bc77b0-8874-4b20-9351-3f85a8a225ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:18 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9681e2-930a-4a91-8fdf-5e1a55dc40f5]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:18 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc8d7329-1d2d-4468-b2ae-f3450738ebbb tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:59:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:18 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e22d47c-4dc6-4982-9f66-c5da2be76d3b]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:18 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc8d7329-1d2d-4468-b2ae-f3450738ebbb tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:59:18 user nova-compute[71113]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)
Jul 31 09:59:18 user nova-compute[71113]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617 (non-flash)
Jul 31 09:59:18 user nova-compute[71113]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c (non-flash)
Jul 31 09:59:18 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:59:18 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc8d7329-1d2d-4468-b2ae-f3450738ebbb tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:59:18 user nova-compute[71113]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)
Jul 31 09:59:18 user nova-compute[71113]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617 (non-flash)
Jul 31 09:59:18 user nova-compute[71113]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c (non-flash)
Jul 31 09:59:18 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:59:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bc77b0-8874-4b20-9351-3f85a8a225ce -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bc77b0-8874-4b20-9351-3f85a8a225ce -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:18 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ca14f9-d35a-44d4-b0e2-4fa05bd715c6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:57bc77b0-8874-4b20-9351-3f85a8a225ce, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:57bc77b0-8874-4b20-9351-3f85a8a225ce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:18 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc8d7329-1d2d-4468-b2ae-f3450738ebbb tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:57bc77b0-8874-4b20-9351-3f85a8a225ce, portal: 172.16.0.220,3260]
Jul 31 09:59:18 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:57bc77b0-8874-4b20-9351-3f85a8a225ce, portal: 172.16.0.220,3260] successful.
Jul 31 09:59:18 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:59:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bc77b0-8874-4b20-9351-3f85a8a225ce -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bc77b0-8874-4b20-9351-3f85a8a225ce -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:18 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcc9cda-e154-47ee-875d-9996a9e170e1]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:18 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc8d7329-1d2d-4468-b2ae-f3450738ebbb tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:59:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:18 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58bf1a3-17e9-444d-b99d-79a0c09d6bed]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc77b0-8874-4b20-9351-3f85a8a225ce (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:18 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc8d7329-1d2d-4468-b2ae-f3450738ebbb tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:59:18 user nova-compute[71113]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)
Jul 31 09:59:18 user nova-compute[71113]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617 (non-flash)
Jul 31 09:59:18 user nova-compute[71113]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c (non-flash)
Jul 31 09:59:18 user nova-compute[71113]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc77b0-8874-4b20-9351-3f85a8a225ce (non-flash)
Jul 31 09:59:18 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:59:18 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc8d7329-1d2d-4468-b2ae-f3450738ebbb tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:59:18 user nova-compute[71113]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)
Jul 31 09:59:18 user nova-compute[71113]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617 (non-flash)
Jul 31 09:59:18 user nova-compute[71113]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c (non-flash)
Jul 31 09:59:18 user nova-compute[71113]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc77b0-8874-4b20-9351-3f85a8a225ce (non-flash)
Jul 31 09:59:18 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:59:18 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-fc8d7329-1d2d-4468-b2ae-f3450738ebbb tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57bc77b0-8874-4b20-9351-3f85a8a225ce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:59:18 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc8d7329-1d2d-4468-b2ae-f3450738ebbb tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 09:59:18 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-fc8d7329-1d2d-4468-b2ae-f3450738ebbb tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] HCTL ('37', '-', '-', 0) found on session 34 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 09:59:18 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-fc8d7329-1d2d-4468-b2ae-f3450738ebbb tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 09:59:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:18 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b757f5b-9754-4d3d-9837-ef162ea08c22]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:18 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-fc8d7329-1d2d-4468-b2ae-f3450738ebbb tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Searching for a device in session 34 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 09:59:18 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc8d7329-1d2d-4468-b2ae-f3450738ebbb tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WklAnefQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 09:59:19 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-fc8d7329-1d2d-4468-b2ae-f3450738ebbb tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:59:19 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc8d7329-1d2d-4468-b2ae-f3450738ebbb tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '26632306264313965', 'path': '/dev/sdf'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:59:19 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc8d7329-1d2d-4468-b2ae-f3450738ebbb tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632306264313965', 'path': '/dev/sdf'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 09:59:19 user nova-compute[71113]: DEBUG nova.objects.instance [None req-fc8d7329-1d2d-4468-b2ae-f3450738ebbb tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lazy-loading 'flavor' on Instance uuid bc9b4047-7408-40a1-b38c-59695faffafb {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:59:19 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-fc8d7329-1d2d-4468-b2ae-f3450738ebbb tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 09:59:19 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:59:19 user nova-compute[71113]:   <source dev="/dev/sdf"/>
Jul 31 09:59:19 user nova-compute[71113]:   <target dev="vdc" bus="virtio"/>
Jul 31 09:59:19 user nova-compute[71113]:   <serial>57bc77b0-8874-4b20-9351-3f85a8a225ce</serial>
Jul 31 09:59:19 user nova-compute[71113]: </disk>
Jul 31 09:59:19 user nova-compute[71113]:  {{(pid=71113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 09:59:19 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-fc8d7329-1d2d-4468-b2ae-f3450738ebbb tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:59:19 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-fc8d7329-1d2d-4468-b2ae-f3450738ebbb tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:59:19 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-fc8d7329-1d2d-4468-b2ae-f3450738ebbb tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:59:19 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-fc8d7329-1d2d-4468-b2ae-f3450738ebbb tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] No VIF found with MAC fa:16:3e:b9:09:59, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 09:59:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-fc8d7329-1d2d-4468-b2ae-f3450738ebbb tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "bc9b4047-7408-40a1-b38c-59695faffafb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.490s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:59:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c492e878-f8d3-4dd7-b8b2-0aa1e70aa517 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Acquiring lock "bc9b4047-7408-40a1-b38c-59695faffafb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:59:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c492e878-f8d3-4dd7-b8b2-0aa1e70aa517 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "bc9b4047-7408-40a1-b38c-59695faffafb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:59:21 user nova-compute[71113]: INFO nova.compute.manager [None req-c492e878-f8d3-4dd7-b8b2-0aa1e70aa517 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Detaching volume 59366e28-a349-4469-a8a6-af6b74f3ae4c
Jul 31 09:59:21 user nova-compute[71113]: INFO nova.virt.block_device [None req-c492e878-f8d3-4dd7-b8b2-0aa1e70aa517 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Attempting to driver detach volume 59366e28-a349-4469-a8a6-af6b74f3ae4c from mountpoint /dev/vdb
Jul 31 09:59:21 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-c492e878-f8d3-4dd7-b8b2-0aa1e70aa517 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Attempting to detach device vdb from instance bc9b4047-7408-40a1-b38c-59695faffafb from the persistent domain config. {{(pid=71113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 09:59:21 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-c492e878-f8d3-4dd7-b8b2-0aa1e70aa517 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 09:59:21 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:59:21 user nova-compute[71113]:   <source dev="/dev/sdd"/>
Jul 31 09:59:21 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 09:59:21 user nova-compute[71113]:   <serial>59366e28-a349-4469-a8a6-af6b74f3ae4c</serial>
Jul 31 09:59:21 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 09:59:21 user nova-compute[71113]: </disk>
Jul 31 09:59:21 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 09:59:21 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-c492e878-f8d3-4dd7-b8b2-0aa1e70aa517 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Successfully detached device vdb from instance bc9b4047-7408-40a1-b38c-59695faffafb from the persistent domain config.
Jul 31 09:59:21 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-c492e878-f8d3-4dd7-b8b2-0aa1e70aa517 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bc9b4047-7408-40a1-b38c-59695faffafb from the live domain config. {{(pid=71113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 09:59:21 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-c492e878-f8d3-4dd7-b8b2-0aa1e70aa517 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 09:59:21 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:59:21 user nova-compute[71113]:   <source dev="/dev/sdd"/>
Jul 31 09:59:21 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 09:59:21 user nova-compute[71113]:   <serial>59366e28-a349-4469-a8a6-af6b74f3ae4c</serial>
Jul 31 09:59:21 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 09:59:21 user nova-compute[71113]: </disk>
Jul 31 09:59:21 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 09:59:21 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Received event <DeviceRemovedEvent: 1690797561.9863336, bc9b4047-7408-40a1-b38c-59695faffafb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71113) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 09:59:21 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-c492e878-f8d3-4dd7-b8b2-0aa1e70aa517 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bc9b4047-7408-40a1-b38c-59695faffafb {{(pid=71113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 09:59:21 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-c492e878-f8d3-4dd7-b8b2-0aa1e70aa517 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Successfully detached device vdb from instance bc9b4047-7408-40a1-b38c-59695faffafb from the live domain config.
Jul 31 09:59:21 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c492e878-f8d3-4dd7-b8b2-0aa1e70aa517 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 09:59:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c492e878-f8d3-4dd7-b8b2-0aa1e70aa517 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'swPhTmcK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:59:21 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-c492e878-f8d3-4dd7-b8b2-0aa1e70aa517 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:59:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-c492e878-f8d3-4dd7-b8b2-0aa1e70aa517 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:59:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-c492e878-f8d3-4dd7-b8b2-0aa1e70aa517 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:59:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c492e878-f8d3-4dd7-b8b2-0aa1e70aa517 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 09:59:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:22 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4383fb6-e89c-48ec-a7ac-a716dcbfc28a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57bc77b0-8874-4b20-9351-3f85a8a225ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:22 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec8b366-6266-4b38-8e20-779197ca847f]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc77b0-8874-4b20-9351-3f85a8a225ce (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c492e878-f8d3-4dd7-b8b2-0aa1e70aa517 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:59:22 user nova-compute[71113]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)
Jul 31 09:59:22 user nova-compute[71113]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617 (non-flash)
Jul 31 09:59:22 user nova-compute[71113]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c (non-flash)
Jul 31 09:59:22 user nova-compute[71113]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc77b0-8874-4b20-9351-3f85a8a225ce (non-flash)
Jul 31 09:59:22 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:59:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c492e878-f8d3-4dd7-b8b2-0aa1e70aa517 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:59:22 user nova-compute[71113]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)
Jul 31 09:59:22 user nova-compute[71113]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617 (non-flash)
Jul 31 09:59:22 user nova-compute[71113]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c (non-flash)
Jul 31 09:59:22 user nova-compute[71113]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc77b0-8874-4b20-9351-3f85a8a225ce (non-flash)
Jul 31 09:59:22 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:59:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c492e878-f8d3-4dd7-b8b2-0aa1e70aa517 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f78f0653130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c'): ({'sdd'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 09:59:22 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-c492e878-f8d3-4dd7-b8b2-0aa1e70aa517 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Removing single pathed devices sdd {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 09:59:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:22 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2df26c4-433e-48ee-8ad1-7fd16fcc81c0]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:22 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e538019-c427-48da-9144-585c403d15d5]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:22 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-c492e878-f8d3-4dd7-b8b2-0aa1e70aa517 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Flushing IO for device /dev/sdd {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 09:59:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:22 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9391942-ed53-4980-9b09-2359a05887b5]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:22 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-c492e878-f8d3-4dd7-b8b2-0aa1e70aa517 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 09:59:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:22 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[35521648-d988-4f96-a8dd-5f02f23b0818]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:22 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-c492e878-f8d3-4dd7-b8b2-0aa1e70aa517 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 09:59:22 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-c492e878-f8d3-4dd7-b8b2-0aa1e70aa517 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] SCSI volumes sdd have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 09:59:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c492e878-f8d3-4dd7-b8b2-0aa1e70aa517 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 09:59:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:22 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e28a17-cc9c-4091-88ff-afea82a477ff]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c492e878-f8d3-4dd7-b8b2-0aa1e70aa517 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:59:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:22 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4012561-cf73-455b-bdca-85434255a0ad]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c492e878-f8d3-4dd7-b8b2-0aa1e70aa517 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c, portal: 172.16.0.220,3260]
Jul 31 09:59:22 user nova-compute[71113]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c, portal: 172.16.0.220,3260] successful.
Jul 31 09:59:22 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:59:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59366e28-a349-4469-a8a6-af6b74f3ae4c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:22 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0172561-6419-4c4a-b01d-5ffb009935cb]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c492e878-f8d3-4dd7-b8b2-0aa1e70aa517 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:59:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-c492e878-f8d3-4dd7-b8b2-0aa1e70aa517 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:59:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c492e878-f8d3-4dd7-b8b2-0aa1e70aa517 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] <== disconnect_volume: return (284ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:59:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c492e878-f8d3-4dd7-b8b2-0aa1e70aa517 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 09:59:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:23 user nova-compute[71113]: DEBUG nova.objects.instance [None req-c492e878-f8d3-4dd7-b8b2-0aa1e70aa517 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lazy-loading 'flavor' on Instance uuid bc9b4047-7408-40a1-b38c-59695faffafb {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:59:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c492e878-f8d3-4dd7-b8b2-0aa1e70aa517 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "bc9b4047-7408-40a1-b38c-59695faffafb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.581s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:59:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-40e82bd1-78c6-4107-ba80-40e78a9f4f73 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Acquiring lock "bc9b4047-7408-40a1-b38c-59695faffafb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:59:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-40e82bd1-78c6-4107-ba80-40e78a9f4f73 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "bc9b4047-7408-40a1-b38c-59695faffafb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:59:23 user nova-compute[71113]: INFO nova.compute.manager [None req-40e82bd1-78c6-4107-ba80-40e78a9f4f73 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Detaching volume 57bc77b0-8874-4b20-9351-3f85a8a225ce
Jul 31 09:59:23 user nova-compute[71113]: INFO nova.virt.block_device [None req-40e82bd1-78c6-4107-ba80-40e78a9f4f73 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Attempting to driver detach volume 57bc77b0-8874-4b20-9351-3f85a8a225ce from mountpoint /dev/vdc
Jul 31 09:59:23 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-40e82bd1-78c6-4107-ba80-40e78a9f4f73 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Attempting to detach device vdc from instance bc9b4047-7408-40a1-b38c-59695faffafb from the persistent domain config. {{(pid=71113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 09:59:23 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-40e82bd1-78c6-4107-ba80-40e78a9f4f73 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 09:59:23 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:59:23 user nova-compute[71113]:   <source dev="/dev/sdf"/>
Jul 31 09:59:23 user nova-compute[71113]:   <target dev="vdc" bus="virtio"/>
Jul 31 09:59:23 user nova-compute[71113]:   <serial>57bc77b0-8874-4b20-9351-3f85a8a225ce</serial>
Jul 31 09:59:23 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 31 09:59:23 user nova-compute[71113]: </disk>
Jul 31 09:59:23 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 09:59:23 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-40e82bd1-78c6-4107-ba80-40e78a9f4f73 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Successfully detached device vdc from instance bc9b4047-7408-40a1-b38c-59695faffafb from the persistent domain config.
Jul 31 09:59:23 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-40e82bd1-78c6-4107-ba80-40e78a9f4f73 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance bc9b4047-7408-40a1-b38c-59695faffafb from the live domain config. {{(pid=71113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 09:59:23 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-40e82bd1-78c6-4107-ba80-40e78a9f4f73 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 09:59:23 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:59:23 user nova-compute[71113]:   <source dev="/dev/sdf"/>
Jul 31 09:59:23 user nova-compute[71113]:   <target dev="vdc" bus="virtio"/>
Jul 31 09:59:23 user nova-compute[71113]:   <serial>57bc77b0-8874-4b20-9351-3f85a8a225ce</serial>
Jul 31 09:59:23 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 31 09:59:23 user nova-compute[71113]: </disk>
Jul 31 09:59:23 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 09:59:24 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Received event <DeviceRemovedEvent: 1690797564.4075117, bc9b4047-7408-40a1-b38c-59695faffafb => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71113) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 09:59:24 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-40e82bd1-78c6-4107-ba80-40e78a9f4f73 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance bc9b4047-7408-40a1-b38c-59695faffafb {{(pid=71113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 09:59:24 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-40e82bd1-78c6-4107-ba80-40e78a9f4f73 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Successfully detached device vdc from instance bc9b4047-7408-40a1-b38c-59695faffafb from the live domain config.
Jul 31 09:59:24 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40e82bd1-78c6-4107-ba80-40e78a9f4f73 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 09:59:24 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e82bd1-78c6-4107-ba80-40e78a9f4f73 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:57bc77b0-8874-4b20-9351-3f85a8a225ce'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WklAnefQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:59:24 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-40e82bd1-78c6-4107-ba80-40e78a9f4f73 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:59:24 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-40e82bd1-78c6-4107-ba80-40e78a9f4f73 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:59:24 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-40e82bd1-78c6-4107-ba80-40e78a9f4f73 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:59:24 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e82bd1-78c6-4107-ba80-40e78a9f4f73 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57bc77b0-8874-4b20-9351-3f85a8a225ce', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 09:59:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:24 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e676fb-d359-4450-95ac-1ad33346e680]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57bc77b0-8874-4b20-9351-3f85a8a225ce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:24 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[087429b1-8614-4428-9ac8-b38e1c06e705]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc77b0-8874-4b20-9351-3f85a8a225ce (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:24 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e82bd1-78c6-4107-ba80-40e78a9f4f73 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:59:24 user nova-compute[71113]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)
Jul 31 09:59:24 user nova-compute[71113]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617 (non-flash)
Jul 31 09:59:24 user nova-compute[71113]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc77b0-8874-4b20-9351-3f85a8a225ce (non-flash)
Jul 31 09:59:24 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:59:24 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e82bd1-78c6-4107-ba80-40e78a9f4f73 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:59:24 user nova-compute[71113]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)
Jul 31 09:59:24 user nova-compute[71113]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617 (non-flash)
Jul 31 09:59:24 user nova-compute[71113]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57bc77b0-8874-4b20-9351-3f85a8a225ce (non-flash)
Jul 31 09:59:24 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:59:24 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e82bd1-78c6-4107-ba80-40e78a9f4f73 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79083ade10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57bc77b0-8874-4b20-9351-3f85a8a225ce'): ({'sdf'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 09:59:24 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-40e82bd1-78c6-4107-ba80-40e78a9f4f73 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Removing single pathed devices sdf {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 09:59:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:24 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8e29e9-4913-457c-820c-9eb8d52dfd33]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:24 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a7d5c7-13dd-416e-bcd4-ccf74147ef13]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:24 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-40e82bd1-78c6-4107-ba80-40e78a9f4f73 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Flushing IO for device /dev/sdf {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 09:59:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:24 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba14d67-7de2-4e38-89b4-39dec66c1374]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:24 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-40e82bd1-78c6-4107-ba80-40e78a9f4f73 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 09:59:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:24 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3314f9b5-6b21-41bc-abc6-31f00cd0a5cf]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:24 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-40e82bd1-78c6-4107-ba80-40e78a9f4f73 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 09:59:24 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-40e82bd1-78c6-4107-ba80-40e78a9f4f73 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] SCSI volumes sdf have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 09:59:24 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e82bd1-78c6-4107-ba80-40e78a9f4f73 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57bc77b0-8874-4b20-9351-3f85a8a225ce')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 09:59:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bc77b0-8874-4b20-9351-3f85a8a225ce -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bc77b0-8874-4b20-9351-3f85a8a225ce -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:24 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9d0d20-9238-4aa4-80b1-3c7f8ba19413]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:24 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e82bd1-78c6-4107-ba80-40e78a9f4f73 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:59:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bc77b0-8874-4b20-9351-3f85a8a225ce -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bc77b0-8874-4b20-9351-3f85a8a225ce -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:24 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[090fd33d-9394-4992-bab1-d78482648f50]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:57bc77b0-8874-4b20-9351-3f85a8a225ce, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:57bc77b0-8874-4b20-9351-3f85a8a225ce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:24 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e82bd1-78c6-4107-ba80-40e78a9f4f73 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:57bc77b0-8874-4b20-9351-3f85a8a225ce, portal: 172.16.0.220,3260]
Jul 31 09:59:24 user nova-compute[71113]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:57bc77b0-8874-4b20-9351-3f85a8a225ce, portal: 172.16.0.220,3260] successful.
Jul 31 09:59:24 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:59:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57bc77b0-8874-4b20-9351-3f85a8a225ce -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57bc77b0-8874-4b20-9351-3f85a8a225ce -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:24 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8472f4ef-3597-4fb9-9919-d9da3be0ba4c]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:24 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e82bd1-78c6-4107-ba80-40e78a9f4f73 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:59:24 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-40e82bd1-78c6-4107-ba80-40e78a9f4f73 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:59:24 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-40e82bd1-78c6-4107-ba80-40e78a9f4f73 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] <== disconnect_volume: return (296ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:59:24 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40e82bd1-78c6-4107-ba80-40e78a9f4f73 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 09:59:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:25 user nova-compute[71113]: DEBUG nova.objects.instance [None req-40e82bd1-78c6-4107-ba80-40e78a9f4f73 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lazy-loading 'flavor' on Instance uuid bc9b4047-7408-40a1-b38c-59695faffafb {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:59:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-40e82bd1-78c6-4107-ba80-40e78a9f4f73 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "bc9b4047-7408-40a1-b38c-59695faffafb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.607s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:59:26 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1322344c-d8df-4ab9-a93b-facb3c3ef2c6 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Acquiring lock "bc9b4047-7408-40a1-b38c-59695faffafb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:59:26 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1322344c-d8df-4ab9-a93b-facb3c3ef2c6 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "bc9b4047-7408-40a1-b38c-59695faffafb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:59:26 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1322344c-d8df-4ab9-a93b-facb3c3ef2c6 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Acquiring lock "bc9b4047-7408-40a1-b38c-59695faffafb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:59:26 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1322344c-d8df-4ab9-a93b-facb3c3ef2c6 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "bc9b4047-7408-40a1-b38c-59695faffafb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:59:26 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1322344c-d8df-4ab9-a93b-facb3c3ef2c6 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "bc9b4047-7408-40a1-b38c-59695faffafb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:59:26 user nova-compute[71113]: INFO nova.compute.manager [None req-1322344c-d8df-4ab9-a93b-facb3c3ef2c6 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Terminating instance
Jul 31 09:59:26 user nova-compute[71113]: DEBUG nova.compute.manager [None req-1322344c-d8df-4ab9-a93b-facb3c3ef2c6 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Start destroying the instance on the hypervisor. {{(pid=71113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 09:59:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:26 user nova-compute[71113]: DEBUG nova.compute.manager [req-ce2aced4-b51e-4068-8d55-278ccf83aba3 req-39ce224a-f30c-4985-a862-e16f02e2a6d6 service nova] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Received event network-vif-unplugged-023cf8aa-3275-4fa5-89fc-81eb12bc8835 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:59:26 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ce2aced4-b51e-4068-8d55-278ccf83aba3 req-39ce224a-f30c-4985-a862-e16f02e2a6d6 service nova] Acquiring lock "bc9b4047-7408-40a1-b38c-59695faffafb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:59:26 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ce2aced4-b51e-4068-8d55-278ccf83aba3 req-39ce224a-f30c-4985-a862-e16f02e2a6d6 service nova] Lock "bc9b4047-7408-40a1-b38c-59695faffafb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:59:26 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ce2aced4-b51e-4068-8d55-278ccf83aba3 req-39ce224a-f30c-4985-a862-e16f02e2a6d6 service nova] Lock "bc9b4047-7408-40a1-b38c-59695faffafb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:59:26 user nova-compute[71113]: DEBUG nova.compute.manager [req-ce2aced4-b51e-4068-8d55-278ccf83aba3 req-39ce224a-f30c-4985-a862-e16f02e2a6d6 service nova] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] No waiting events found dispatching network-vif-unplugged-023cf8aa-3275-4fa5-89fc-81eb12bc8835 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:59:26 user nova-compute[71113]: DEBUG nova.compute.manager [req-ce2aced4-b51e-4068-8d55-278ccf83aba3 req-39ce224a-f30c-4985-a862-e16f02e2a6d6 service nova] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Received event network-vif-unplugged-023cf8aa-3275-4fa5-89fc-81eb12bc8835 for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 09:59:27 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Instance destroyed successfully.
Jul 31 09:59:27 user nova-compute[71113]: DEBUG nova.objects.instance [None req-1322344c-d8df-4ab9-a93b-facb3c3ef2c6 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lazy-loading 'resources' on Instance uuid bc9b4047-7408-40a1-b38c-59695faffafb {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:59:27 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-1322344c-d8df-4ab9-a93b-facb3c3ef2c6 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:56:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1509937668',display_name='tempest-AttachVolumeTestJSON-server-1509937668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1509937668',id=27,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoy+Hs+bfe1IZrhIpXFdgvapbdLt/DaH/UOAPIEBCI/YgBOFSbTsI1O4d6Q7HqxcwqIi0rTWYgoRSaQBtuYzeHTXsPC8CcA2xKVnnl9MwG6wGoYIKDKt5rjIPxG+QjYCA==',key_name='tempest-keypair-1081233508',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:57:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bae93d4fff5e4990bd9fe78e71d6d2d2',ramdisk_id='',reservation_id='r-cfi0baxe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1230374483',owner_user_name='tempest-AttachVolumeTestJSON-1230374483-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:57:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07e8e7f9b62d452a88a29f333177c9d2',uuid=bc9b4047-7408-40a1-b38c-59695faffafb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "023cf8aa-3275-4fa5-89fc-81eb12bc8835", "address": "fa:16:3e:b9:09:59", "network": {"id": "26352e29-fc15-48ac-be14-8af7a0c80219", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866093358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bae93d4fff5e4990bd9fe78e71d6d2d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap023cf8aa-32", "ovs_interfaceid": "023cf8aa-3275-4fa5-89fc-81eb12bc8835", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 09:59:27 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-1322344c-d8df-4ab9-a93b-facb3c3ef2c6 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Converting VIF {"id": "023cf8aa-3275-4fa5-89fc-81eb12bc8835", "address": "fa:16:3e:b9:09:59", "network": {"id": "26352e29-fc15-48ac-be14-8af7a0c80219", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866093358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bae93d4fff5e4990bd9fe78e71d6d2d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap023cf8aa-32", "ovs_interfaceid": "023cf8aa-3275-4fa5-89fc-81eb12bc8835", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:59:27 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-1322344c-d8df-4ab9-a93b-facb3c3ef2c6 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:09:59,bridge_name='br-int',has_traffic_filtering=True,id=023cf8aa-3275-4fa5-89fc-81eb12bc8835,network=Network(26352e29-fc15-48ac-be14-8af7a0c80219),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap023cf8aa-32') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:59:27 user nova-compute[71113]: DEBUG os_vif [None req-1322344c-d8df-4ab9-a93b-facb3c3ef2c6 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:09:59,bridge_name='br-int',has_traffic_filtering=True,id=023cf8aa-3275-4fa5-89fc-81eb12bc8835,network=Network(26352e29-fc15-48ac-be14-8af7a0c80219),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap023cf8aa-32') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 09:59:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap023cf8aa-32, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:59:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:59:27 user nova-compute[71113]: INFO os_vif [None req-1322344c-d8df-4ab9-a93b-facb3c3ef2c6 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:09:59,bridge_name='br-int',has_traffic_filtering=True,id=023cf8aa-3275-4fa5-89fc-81eb12bc8835,network=Network(26352e29-fc15-48ac-be14-8af7a0c80219),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap023cf8aa-32')
Jul 31 09:59:27 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-1322344c-d8df-4ab9-a93b-facb3c3ef2c6 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Deleting instance files /opt/stack/data/nova/instances/bc9b4047-7408-40a1-b38c-59695faffafb_del
Jul 31 09:59:27 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-1322344c-d8df-4ab9-a93b-facb3c3ef2c6 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Deletion of /opt/stack/data/nova/instances/bc9b4047-7408-40a1-b38c-59695faffafb_del complete
Jul 31 09:59:27 user nova-compute[71113]: INFO nova.compute.manager [None req-1322344c-d8df-4ab9-a93b-facb3c3ef2c6 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Took 0.84 seconds to destroy the instance on the hypervisor.
Jul 31 09:59:27 user nova-compute[71113]: DEBUG oslo.service.loopingcall [None req-1322344c-d8df-4ab9-a93b-facb3c3ef2c6 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71113) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 09:59:27 user nova-compute[71113]: DEBUG nova.compute.manager [-] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Deallocating network for instance {{(pid=71113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 09:59:27 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] deallocate_for_instance() {{(pid=71113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 09:59:28 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:59:28 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Took 0.85 seconds to deallocate network for instance.
Jul 31 09:59:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1322344c-d8df-4ab9-a93b-facb3c3ef2c6 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:59:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1322344c-d8df-4ab9-a93b-facb3c3ef2c6 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:59:28 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-1322344c-d8df-4ab9-a93b-facb3c3ef2c6 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:59:28 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-1322344c-d8df-4ab9-a93b-facb3c3ef2c6 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:59:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1322344c-d8df-4ab9-a93b-facb3c3ef2c6 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.256s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:59:28 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-1322344c-d8df-4ab9-a93b-facb3c3ef2c6 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Deleted allocations for instance bc9b4047-7408-40a1-b38c-59695faffafb
Jul 31 09:59:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1322344c-d8df-4ab9-a93b-facb3c3ef2c6 tempest-AttachVolumeTestJSON-1230374483 tempest-AttachVolumeTestJSON-1230374483-project-member] Lock "bc9b4047-7408-40a1-b38c-59695faffafb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.128s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:59:28 user nova-compute[71113]: DEBUG nova.compute.manager [req-7a9dfb9f-4ad3-4541-a852-d0470006d313 req-26288812-9bd9-4374-9363-2de4bdf2a2e7 service nova] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Received event network-vif-plugged-023cf8aa-3275-4fa5-89fc-81eb12bc8835 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:59:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7a9dfb9f-4ad3-4541-a852-d0470006d313 req-26288812-9bd9-4374-9363-2de4bdf2a2e7 service nova] Acquiring lock "bc9b4047-7408-40a1-b38c-59695faffafb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:59:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7a9dfb9f-4ad3-4541-a852-d0470006d313 req-26288812-9bd9-4374-9363-2de4bdf2a2e7 service nova] Lock "bc9b4047-7408-40a1-b38c-59695faffafb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:59:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7a9dfb9f-4ad3-4541-a852-d0470006d313 req-26288812-9bd9-4374-9363-2de4bdf2a2e7 service nova] Lock "bc9b4047-7408-40a1-b38c-59695faffafb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:59:28 user nova-compute[71113]: DEBUG nova.compute.manager [req-7a9dfb9f-4ad3-4541-a852-d0470006d313 req-26288812-9bd9-4374-9363-2de4bdf2a2e7 service nova] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] No waiting events found dispatching network-vif-plugged-023cf8aa-3275-4fa5-89fc-81eb12bc8835 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:59:28 user nova-compute[71113]: WARNING nova.compute.manager [req-7a9dfb9f-4ad3-4541-a852-d0470006d313 req-26288812-9bd9-4374-9363-2de4bdf2a2e7 service nova] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Received unexpected event network-vif-plugged-023cf8aa-3275-4fa5-89fc-81eb12bc8835 for instance with vm_state deleted and task_state None.
Jul 31 09:59:28 user nova-compute[71113]: DEBUG nova.compute.manager [req-7a9dfb9f-4ad3-4541-a852-d0470006d313 req-26288812-9bd9-4374-9363-2de4bdf2a2e7 service nova] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Received event network-vif-deleted-023cf8aa-3275-4fa5-89fc-81eb12bc8835 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:59:29 user nova-compute[71113]: DEBUG nova.compute.manager [req-41ea8f76-a82f-4a26-8db4-9005cdc9bd96 req-61ad17a5-0b91-48dd-bf5b-909dd4b45b1b service nova] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Received event network-changed-b9c0f910-2e85-41e6-903c-4b678d4fbe5e {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:59:29 user nova-compute[71113]: DEBUG nova.compute.manager [req-41ea8f76-a82f-4a26-8db4-9005cdc9bd96 req-61ad17a5-0b91-48dd-bf5b-909dd4b45b1b service nova] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Refreshing instance network info cache due to event network-changed-b9c0f910-2e85-41e6-903c-4b678d4fbe5e. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:59:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-41ea8f76-a82f-4a26-8db4-9005cdc9bd96 req-61ad17a5-0b91-48dd-bf5b-909dd4b45b1b service nova] Acquiring lock "refresh_cache-c4b88201-04dc-4da9-b213-c50cdf274f4e" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:59:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-41ea8f76-a82f-4a26-8db4-9005cdc9bd96 req-61ad17a5-0b91-48dd-bf5b-909dd4b45b1b service nova] Acquired lock "refresh_cache-c4b88201-04dc-4da9-b213-c50cdf274f4e" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:59:29 user nova-compute[71113]: DEBUG nova.network.neutron [req-41ea8f76-a82f-4a26-8db4-9005cdc9bd96 req-61ad17a5-0b91-48dd-bf5b-909dd4b45b1b service nova] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Refreshing network info cache for port b9c0f910-2e85-41e6-903c-4b678d4fbe5e {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:59:29 user nova-compute[71113]: DEBUG nova.network.neutron [req-41ea8f76-a82f-4a26-8db4-9005cdc9bd96 req-61ad17a5-0b91-48dd-bf5b-909dd4b45b1b service nova] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Updated VIF entry in instance network info cache for port b9c0f910-2e85-41e6-903c-4b678d4fbe5e. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:59:29 user nova-compute[71113]: DEBUG nova.network.neutron [req-41ea8f76-a82f-4a26-8db4-9005cdc9bd96 req-61ad17a5-0b91-48dd-bf5b-909dd4b45b1b service nova] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Updating instance_info_cache with network_info: [{"id": "b9c0f910-2e85-41e6-903c-4b678d4fbe5e", "address": "fa:16:3e:1b:88:27", "network": {"id": "5f333808-4342-4014-9221-7ccd394eff66", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-42408734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4b02badf8ea4f32a5e259c25120eac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9c0f910-2e", "ovs_interfaceid": "b9c0f910-2e85-41e6-903c-4b678d4fbe5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:59:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-41ea8f76-a82f-4a26-8db4-9005cdc9bd96 req-61ad17a5-0b91-48dd-bf5b-909dd4b45b1b service nova] Releasing lock "refresh_cache-c4b88201-04dc-4da9-b213-c50cdf274f4e" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:59:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquiring lock "f020f166-07b6-4cf5-9f17-2ab108b55c30" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:59:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "f020f166-07b6-4cf5-9f17-2ab108b55c30" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:59:31 user nova-compute[71113]: DEBUG nova.compute.manager [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Starting instance... {{(pid=71113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 09:59:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:59:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:59:31 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 09:59:31 user nova-compute[71113]: INFO nova.compute.claims [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Claim successful on node user
Jul 31 09:59:31 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:59:31 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:59:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.397s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:59:31 user nova-compute[71113]: DEBUG nova.compute.manager [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Start building networks asynchronously for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 09:59:31 user nova-compute[71113]: DEBUG nova.compute.manager [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Allocating IP information in the background. {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 09:59:31 user nova-compute[71113]: DEBUG nova.network.neutron [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] allocate_for_instance() {{(pid=71113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 09:59:31 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 09:59:31 user nova-compute[71113]: DEBUG nova.compute.manager [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Start building block device mappings for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 09:59:32 user nova-compute[71113]: DEBUG nova.policy [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f4f505d5eddc4df48ec267f6f69a01f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88bbf2636f6248fcbe644af4eab0c823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71113) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 09:59:32 user nova-compute[71113]: DEBUG nova.compute.manager [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Start spawning the instance on the hypervisor. {{(pid=71113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 09:59:32 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 09:59:32 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Creating image(s)
Jul 31 09:59:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquiring lock "/opt/stack/data/nova/instances/f020f166-07b6-4cf5-9f17-2ab108b55c30/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:59:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "/opt/stack/data/nova/instances/f020f166-07b6-4cf5-9f17-2ab108b55c30/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:59:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "/opt/stack/data/nova/instances/f020f166-07b6-4cf5-9f17-2ab108b55c30/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:59:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.139s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquiring lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:59:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:59:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.138s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/f020f166-07b6-4cf5-9f17-2ab108b55c30/disk 1073741824 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/f020f166-07b6-4cf5-9f17-2ab108b55c30/disk 1073741824" returned: 0 in 0.049s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.192s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:59:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.142s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:32 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f020f166-07b6-4cf5-9f17-2ab108b55c30/disk. size=1073741824 {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 09:59:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f020f166-07b6-4cf5-9f17-2ab108b55c30/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:32 user nova-compute[71113]: DEBUG nova.network.neutron [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Successfully created port: 88414b9a-7489-4664-9eff-ef29d6fce020 {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 09:59:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f020f166-07b6-4cf5-9f17-2ab108b55c30/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:32 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Cannot resize image /opt/stack/data/nova/instances/f020f166-07b6-4cf5-9f17-2ab108b55c30/disk to a smaller size. {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 09:59:32 user nova-compute[71113]: DEBUG nova.objects.instance [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lazy-loading 'migration_context' on Instance uuid f020f166-07b6-4cf5-9f17-2ab108b55c30 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:59:32 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Created local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 09:59:32 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Ensure instance console log exists: /opt/stack/data/nova/instances/f020f166-07b6-4cf5-9f17-2ab108b55c30/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 09:59:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:59:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:59:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:59:33 user nova-compute[71113]: DEBUG nova.network.neutron [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Successfully updated port: 88414b9a-7489-4664-9eff-ef29d6fce020 {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 09:59:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquiring lock "refresh_cache-f020f166-07b6-4cf5-9f17-2ab108b55c30" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:59:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquired lock "refresh_cache-f020f166-07b6-4cf5-9f17-2ab108b55c30" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:59:33 user nova-compute[71113]: DEBUG nova.network.neutron [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 09:59:33 user nova-compute[71113]: DEBUG nova.compute.manager [req-8b670ed1-316f-4a84-b378-bf1b4ae00d5e req-517bc8c8-280a-460a-9b9d-f1b6fb137da5 service nova] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Received event network-changed-88414b9a-7489-4664-9eff-ef29d6fce020 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:59:33 user nova-compute[71113]: DEBUG nova.compute.manager [req-8b670ed1-316f-4a84-b378-bf1b4ae00d5e req-517bc8c8-280a-460a-9b9d-f1b6fb137da5 service nova] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Refreshing instance network info cache due to event network-changed-88414b9a-7489-4664-9eff-ef29d6fce020. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:59:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8b670ed1-316f-4a84-b378-bf1b4ae00d5e req-517bc8c8-280a-460a-9b9d-f1b6fb137da5 service nova] Acquiring lock "refresh_cache-f020f166-07b6-4cf5-9f17-2ab108b55c30" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:59:33 user nova-compute[71113]: DEBUG nova.network.neutron [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 09:59:33 user nova-compute[71113]: DEBUG nova.network.neutron [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Updating instance_info_cache with network_info: [{"id": "88414b9a-7489-4664-9eff-ef29d6fce020", "address": "fa:16:3e:ec:d1:0f", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88414b9a-74", "ovs_interfaceid": "88414b9a-7489-4664-9eff-ef29d6fce020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:59:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Releasing lock "refresh_cache-f020f166-07b6-4cf5-9f17-2ab108b55c30" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:59:33 user nova-compute[71113]: DEBUG nova.compute.manager [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Instance network_info: |[{"id": "88414b9a-7489-4664-9eff-ef29d6fce020", "address": "fa:16:3e:ec:d1:0f", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88414b9a-74", "ovs_interfaceid": "88414b9a-7489-4664-9eff-ef29d6fce020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 09:59:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8b670ed1-316f-4a84-b378-bf1b4ae00d5e req-517bc8c8-280a-460a-9b9d-f1b6fb137da5 service nova] Acquired lock "refresh_cache-f020f166-07b6-4cf5-9f17-2ab108b55c30" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:59:33 user nova-compute[71113]: DEBUG nova.network.neutron [req-8b670ed1-316f-4a84-b378-bf1b4ae00d5e req-517bc8c8-280a-460a-9b9d-f1b6fb137da5 service nova] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Refreshing network info cache for port 88414b9a-7489-4664-9eff-ef29d6fce020 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:59:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Start _get_guest_xml network_info=[{"id": "88414b9a-7489-4664-9eff-ef29d6fce020", "address": "fa:16:3e:ec:d1:0f", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88414b9a-74", "ovs_interfaceid": "88414b9a-7489-4664-9eff-ef29d6fce020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'image_id': '078646fe-b504-41ed-a147-61072e903e51'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 09:59:33 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:59:33 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:59:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 09:59:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 09:59:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 09:59:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 09:59:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 09:59:33 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 09:59:33 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 09:59:33 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 09:59:33 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 09:59:33 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 09:59:33 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 09:59:33 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 09:59:33 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 09:59:33 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 09:59:33 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 09:59:33 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 09:59:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:59:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-183894675',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-183894675',id=30,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88bbf2636f6248fcbe644af4eab0c823',ramdisk_id='',reservation_id='r-5drui0a6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1194948978',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:59:32Z,user_data=None,user_id='f4f505d5eddc4df48ec267f6f69a01f9',uuid=f020f166-07b6-4cf5-9f17-2ab108b55c30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88414b9a-7489-4664-9eff-ef29d6fce020", "address": "fa:16:3e:ec:d1:0f", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88414b9a-74", "ovs_interfaceid": "88414b9a-7489-4664-9eff-ef29d6fce020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 09:59:33 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Converting VIF {"id": "88414b9a-7489-4664-9eff-ef29d6fce020", "address": "fa:16:3e:ec:d1:0f", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88414b9a-74", "ovs_interfaceid": "88414b9a-7489-4664-9eff-ef29d6fce020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:59:33 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:d1:0f,bridge_name='br-int',has_traffic_filtering=True,id=88414b9a-7489-4664-9eff-ef29d6fce020,network=Network(6f88bfaa-d58d-4ac2-b43d-0689d50456ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88414b9a-74') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:59:33 user nova-compute[71113]: DEBUG nova.objects.instance [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lazy-loading 'pci_devices' on Instance uuid f020f166-07b6-4cf5-9f17-2ab108b55c30 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:59:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] End _get_guest_xml xml=<domain type="kvm">
Jul 31 09:59:33 user nova-compute[71113]:   <uuid>f020f166-07b6-4cf5-9f17-2ab108b55c30</uuid>
Jul 31 09:59:33 user nova-compute[71113]:   <name>instance-0000001e</name>
Jul 31 09:59:33 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 09:59:33 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 09:59:33 user nova-compute[71113]:   <metadata>
Jul 31 09:59:33 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 09:59:33 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 09:59:33 user nova-compute[71113]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-183894675</nova:name>
Jul 31 09:59:33 user nova-compute[71113]:       <nova:creationTime>2023-07-31 09:59:33</nova:creationTime>
Jul 31 09:59:33 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 09:59:33 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 09:59:33 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 09:59:33 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 09:59:33 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 09:59:33 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 09:59:33 user nova-compute[71113]:       </nova:flavor>
Jul 31 09:59:33 user nova-compute[71113]:       <nova:owner>
Jul 31 09:59:33 user nova-compute[71113]:         <nova:user uuid="f4f505d5eddc4df48ec267f6f69a01f9">tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member</nova:user>
Jul 31 09:59:33 user nova-compute[71113]:         <nova:project uuid="88bbf2636f6248fcbe644af4eab0c823">tempest-ServerBootFromVolumeStableRescueTest-1194948978</nova:project>
Jul 31 09:59:33 user nova-compute[71113]:       </nova:owner>
Jul 31 09:59:33 user nova-compute[71113]:       <nova:root type="image" uuid="078646fe-b504-41ed-a147-61072e903e51"/>
Jul 31 09:59:33 user nova-compute[71113]:       <nova:ports>
Jul 31 09:59:33 user nova-compute[71113]:         <nova:port uuid="88414b9a-7489-4664-9eff-ef29d6fce020">
Jul 31 09:59:33 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 31 09:59:33 user nova-compute[71113]:         </nova:port>
Jul 31 09:59:33 user nova-compute[71113]:       </nova:ports>
Jul 31 09:59:33 user nova-compute[71113]:     </nova:instance>
Jul 31 09:59:33 user nova-compute[71113]:   </metadata>
Jul 31 09:59:33 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 09:59:33 user nova-compute[71113]:     <system>
Jul 31 09:59:33 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 09:59:33 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 09:59:33 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 09:59:33 user nova-compute[71113]:       <entry name="serial">f020f166-07b6-4cf5-9f17-2ab108b55c30</entry>
Jul 31 09:59:33 user nova-compute[71113]:       <entry name="uuid">f020f166-07b6-4cf5-9f17-2ab108b55c30</entry>
Jul 31 09:59:33 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 09:59:33 user nova-compute[71113]:     </system>
Jul 31 09:59:33 user nova-compute[71113]:   </sysinfo>
Jul 31 09:59:33 user nova-compute[71113]:   <os>
Jul 31 09:59:33 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 09:59:33 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 09:59:33 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 09:59:33 user nova-compute[71113]:   </os>
Jul 31 09:59:33 user nova-compute[71113]:   <features>
Jul 31 09:59:33 user nova-compute[71113]:     <acpi/>
Jul 31 09:59:33 user nova-compute[71113]:     <apic/>
Jul 31 09:59:33 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 09:59:33 user nova-compute[71113]:   </features>
Jul 31 09:59:33 user nova-compute[71113]:   <clock offset="utc">
Jul 31 09:59:33 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 09:59:33 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 09:59:33 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 09:59:33 user nova-compute[71113]:   </clock>
Jul 31 09:59:33 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 09:59:33 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 09:59:33 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 09:59:33 user nova-compute[71113]:   </cpu>
Jul 31 09:59:33 user nova-compute[71113]:   <devices>
Jul 31 09:59:33 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 09:59:33 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 09:59:33 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/f020f166-07b6-4cf5-9f17-2ab108b55c30/disk"/>
Jul 31 09:59:33 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 09:59:33 user nova-compute[71113]:     </disk>
Jul 31 09:59:33 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 09:59:33 user nova-compute[71113]:       <mac address="fa:16:3e:ec:d1:0f"/>
Jul 31 09:59:33 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:59:33 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 09:59:33 user nova-compute[71113]:       <target dev="tap88414b9a-74"/>
Jul 31 09:59:33 user nova-compute[71113]:     </interface>
Jul 31 09:59:33 user nova-compute[71113]:     <serial type="pty">
Jul 31 09:59:33 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/f020f166-07b6-4cf5-9f17-2ab108b55c30/console.log" append="off"/>
Jul 31 09:59:33 user nova-compute[71113]:     </serial>
Jul 31 09:59:33 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 09:59:33 user nova-compute[71113]:     <video>
Jul 31 09:59:33 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:59:33 user nova-compute[71113]:     </video>
Jul 31 09:59:33 user nova-compute[71113]:     <rng model="virtio">
Jul 31 09:59:33 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 09:59:33 user nova-compute[71113]:     </rng>
Jul 31 09:59:33 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 09:59:33 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 09:59:33 user nova-compute[71113]:       <stats period="10"/>
Jul 31 09:59:33 user nova-compute[71113]:     </memballoon>
Jul 31 09:59:33 user nova-compute[71113]:   </devices>
Jul 31 09:59:33 user nova-compute[71113]: </domain>
Jul 31 09:59:33 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 09:59:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:59:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-183894675',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-183894675',id=30,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88bbf2636f6248fcbe644af4eab0c823',ramdisk_id='',reservation_id='r-5drui0a6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1194948978',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:59:32Z,user_data=None,user_id='f4f505d5eddc4df48ec267f6f69a01f9',uuid=f020f166-07b6-4cf5-9f17-2ab108b55c30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88414b9a-7489-4664-9eff-ef29d6fce020", "address": "fa:16:3e:ec:d1:0f", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88414b9a-74", "ovs_interfaceid": "88414b9a-7489-4664-9eff-ef29d6fce020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 09:59:33 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Converting VIF {"id": "88414b9a-7489-4664-9eff-ef29d6fce020", "address": "fa:16:3e:ec:d1:0f", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88414b9a-74", "ovs_interfaceid": "88414b9a-7489-4664-9eff-ef29d6fce020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:59:33 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:d1:0f,bridge_name='br-int',has_traffic_filtering=True,id=88414b9a-7489-4664-9eff-ef29d6fce020,network=Network(6f88bfaa-d58d-4ac2-b43d-0689d50456ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88414b9a-74') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:59:33 user nova-compute[71113]: DEBUG os_vif [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:d1:0f,bridge_name='br-int',has_traffic_filtering=True,id=88414b9a-7489-4664-9eff-ef29d6fce020,network=Network(6f88bfaa-d58d-4ac2-b43d-0689d50456ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88414b9a-74') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 09:59:33 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:33 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:59:33 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 09:59:33 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:33 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap88414b9a-74, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:59:33 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap88414b9a-74, col_values=(('external_ids', {'iface-id': '88414b9a-7489-4664-9eff-ef29d6fce020', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:d1:0f', 'vm-uuid': 'f020f166-07b6-4cf5-9f17-2ab108b55c30'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:59:33 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:33 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:59:33 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:33 user nova-compute[71113]: INFO os_vif [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:d1:0f,bridge_name='br-int',has_traffic_filtering=True,id=88414b9a-7489-4664-9eff-ef29d6fce020,network=Network(6f88bfaa-d58d-4ac2-b43d-0689d50456ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88414b9a-74')
Jul 31 09:59:34 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:59:34 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] No VIF found with MAC fa:16:3e:ec:d1:0f, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 09:59:34 user nova-compute[71113]: DEBUG nova.network.neutron [req-8b670ed1-316f-4a84-b378-bf1b4ae00d5e req-517bc8c8-280a-460a-9b9d-f1b6fb137da5 service nova] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Updated VIF entry in instance network info cache for port 88414b9a-7489-4664-9eff-ef29d6fce020. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:59:34 user nova-compute[71113]: DEBUG nova.network.neutron [req-8b670ed1-316f-4a84-b378-bf1b4ae00d5e req-517bc8c8-280a-460a-9b9d-f1b6fb137da5 service nova] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Updating instance_info_cache with network_info: [{"id": "88414b9a-7489-4664-9eff-ef29d6fce020", "address": "fa:16:3e:ec:d1:0f", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88414b9a-74", "ovs_interfaceid": "88414b9a-7489-4664-9eff-ef29d6fce020", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:59:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8b670ed1-316f-4a84-b378-bf1b4ae00d5e req-517bc8c8-280a-460a-9b9d-f1b6fb137da5 service nova] Releasing lock "refresh_cache-f020f166-07b6-4cf5-9f17-2ab108b55c30" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:59:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:35 user nova-compute[71113]: DEBUG nova.compute.manager [req-92d5bc08-f922-4c0b-bbe8-03e1706927d3 req-9e1fd8eb-ed18-490d-9c94-96f739236b85 service nova] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Received event network-vif-plugged-88414b9a-7489-4664-9eff-ef29d6fce020 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:59:35 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-92d5bc08-f922-4c0b-bbe8-03e1706927d3 req-9e1fd8eb-ed18-490d-9c94-96f739236b85 service nova] Acquiring lock "f020f166-07b6-4cf5-9f17-2ab108b55c30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:59:35 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-92d5bc08-f922-4c0b-bbe8-03e1706927d3 req-9e1fd8eb-ed18-490d-9c94-96f739236b85 service nova] Lock "f020f166-07b6-4cf5-9f17-2ab108b55c30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:59:35 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-92d5bc08-f922-4c0b-bbe8-03e1706927d3 req-9e1fd8eb-ed18-490d-9c94-96f739236b85 service nova] Lock "f020f166-07b6-4cf5-9f17-2ab108b55c30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:59:35 user nova-compute[71113]: DEBUG nova.compute.manager [req-92d5bc08-f922-4c0b-bbe8-03e1706927d3 req-9e1fd8eb-ed18-490d-9c94-96f739236b85 service nova] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] No waiting events found dispatching network-vif-plugged-88414b9a-7489-4664-9eff-ef29d6fce020 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:59:35 user nova-compute[71113]: WARNING nova.compute.manager [req-92d5bc08-f922-4c0b-bbe8-03e1706927d3 req-9e1fd8eb-ed18-490d-9c94-96f739236b85 service nova] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Received unexpected event network-vif-plugged-88414b9a-7489-4664-9eff-ef29d6fce020 for instance with vm_state building and task_state spawning.
Jul 31 09:59:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:37 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797577.4412892, f020f166-07b6-4cf5-9f17-2ab108b55c30 => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:59:37 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] VM Resumed (Lifecycle Event)
Jul 31 09:59:37 user nova-compute[71113]: DEBUG nova.compute.manager [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 09:59:37 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 09:59:37 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Instance spawned successfully.
Jul 31 09:59:37 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 09:59:37 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:59:37 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:59:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Acquiring lock "9b01d025-2fe7-4ed9-827d-0546134b08a7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:59:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lock "9b01d025-2fe7-4ed9-827d-0546134b08a7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:59:37 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Found default for hw_cdrom_bus of ide {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:59:37 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Found default for hw_disk_bus of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:59:37 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Found default for hw_input_bus of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:59:37 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Found default for hw_pointer_model of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:59:37 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Found default for hw_video_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:59:37 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Found default for hw_vif_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:59:37 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:59:37 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797577.4414783, f020f166-07b6-4cf5-9f17-2ab108b55c30 => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:59:37 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] VM Started (Lifecycle Event)
Jul 31 09:59:37 user nova-compute[71113]: DEBUG nova.compute.manager [req-15da4fcc-48be-4575-aa74-d98c89bab055 req-266b2068-1090-4f80-aff4-35364f580b33 service nova] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Received event network-vif-plugged-88414b9a-7489-4664-9eff-ef29d6fce020 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:59:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-15da4fcc-48be-4575-aa74-d98c89bab055 req-266b2068-1090-4f80-aff4-35364f580b33 service nova] Acquiring lock "f020f166-07b6-4cf5-9f17-2ab108b55c30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:59:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-15da4fcc-48be-4575-aa74-d98c89bab055 req-266b2068-1090-4f80-aff4-35364f580b33 service nova] Lock "f020f166-07b6-4cf5-9f17-2ab108b55c30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:59:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-15da4fcc-48be-4575-aa74-d98c89bab055 req-266b2068-1090-4f80-aff4-35364f580b33 service nova] Lock "f020f166-07b6-4cf5-9f17-2ab108b55c30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:59:37 user nova-compute[71113]: DEBUG nova.compute.manager [req-15da4fcc-48be-4575-aa74-d98c89bab055 req-266b2068-1090-4f80-aff4-35364f580b33 service nova] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] No waiting events found dispatching network-vif-plugged-88414b9a-7489-4664-9eff-ef29d6fce020 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:59:37 user nova-compute[71113]: WARNING nova.compute.manager [req-15da4fcc-48be-4575-aa74-d98c89bab055 req-266b2068-1090-4f80-aff4-35364f580b33 service nova] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Received unexpected event network-vif-plugged-88414b9a-7489-4664-9eff-ef29d6fce020 for instance with vm_state building and task_state spawning.
Jul 31 09:59:37 user nova-compute[71113]: DEBUG nova.compute.manager [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Starting instance... {{(pid=71113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 09:59:37 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:59:37 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:59:37 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:59:37 user nova-compute[71113]: INFO nova.compute.manager [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Took 5.47 seconds to spawn the instance on the hypervisor.
Jul 31 09:59:37 user nova-compute[71113]: DEBUG nova.compute.manager [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:59:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:59:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:59:37 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 09:59:37 user nova-compute[71113]: INFO nova.compute.claims [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Claim successful on node user
Jul 31 09:59:37 user nova-compute[71113]: INFO nova.compute.manager [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Took 6.21 seconds to build instance.
Jul 31 09:59:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f8d947e4-17b4-427b-9a5f-591021385c59 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "f020f166-07b6-4cf5-9f17-2ab108b55c30" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.306s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:59:38 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:59:38 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:59:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.451s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:59:38 user nova-compute[71113]: DEBUG nova.compute.manager [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Start building networks asynchronously for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 09:59:38 user nova-compute[71113]: DEBUG nova.compute.manager [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Allocating IP information in the background. {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 09:59:38 user nova-compute[71113]: DEBUG nova.network.neutron [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] allocate_for_instance() {{(pid=71113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 09:59:38 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 09:59:38 user nova-compute[71113]: DEBUG nova.compute.manager [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Start building block device mappings for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 09:59:38 user nova-compute[71113]: INFO nova.virt.block_device [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Booting with volume 4fa00a07-19dc-4a82-b9a0-6625e649403f at /dev/vda
Jul 31 09:59:38 user nova-compute[71113]: DEBUG nova.policy [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ba2fd55dd96b4c49bb0c1c98c0a724d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b02badf8ea4f32a5e259c25120eac7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71113) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 09:59:38 user nova-compute[71113]: DEBUG os_brick.utils [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:59:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:38 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3720789e-1315-40eb-955f-35821c13822b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:38 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55ac1b3-158e-4cdd-808f-f7ae64e368ed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:38 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e150bb84-a196-4f32-9d35-3dee7b9af4e8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:38 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0d2bf1-7a03-4548-9e0f-3e65b0ba2394]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:59:38 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 09:59:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 09:59:38 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 09:59:38 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a1fa87-f098-4b2d-96c8-43d249ca8555]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:38 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 09:59:38 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 09:59:38 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 09:59:38 user nova-compute[71113]: DEBUG os_brick.utils [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:59:38 user nova-compute[71113]: DEBUG nova.virt.block_device [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Updating existing volume attachment record: 68766810-96ed-422f-a2be-163184c589d5 {{(pid=71113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 09:59:38 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b6bf55d8-1827-4621-8732-af219798b470 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "0104663a-99d2-494c-bfb8-16f14f3f8f38" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:59:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b6bf55d8-1827-4621-8732-af219798b470 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "0104663a-99d2-494c-bfb8-16f14f3f8f38" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:59:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b6bf55d8-1827-4621-8732-af219798b470 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "0104663a-99d2-494c-bfb8-16f14f3f8f38-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:59:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b6bf55d8-1827-4621-8732-af219798b470 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "0104663a-99d2-494c-bfb8-16f14f3f8f38-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:59:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b6bf55d8-1827-4621-8732-af219798b470 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "0104663a-99d2-494c-bfb8-16f14f3f8f38-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:59:39 user nova-compute[71113]: INFO nova.compute.manager [None req-b6bf55d8-1827-4621-8732-af219798b470 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Terminating instance
Jul 31 09:59:39 user nova-compute[71113]: DEBUG nova.compute.manager [None req-b6bf55d8-1827-4621-8732-af219798b470 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Start destroying the instance on the hypervisor. {{(pid=71113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 09:59:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:39 user nova-compute[71113]: DEBUG nova.network.neutron [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Successfully created port: cc8f812f-2fff-475e-a41e-abf390366863 {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 09:59:39 user nova-compute[71113]: DEBUG nova.compute.manager [req-649ddb0d-80d7-4951-aef7-c44fda5a5cb3 req-7d316e39-4854-4d7b-8dae-a744b4dae58b service nova] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Received event network-vif-unplugged-5bb08dc2-dad5-451e-909d-111b94035438 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:59:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-649ddb0d-80d7-4951-aef7-c44fda5a5cb3 req-7d316e39-4854-4d7b-8dae-a744b4dae58b service nova] Acquiring lock "0104663a-99d2-494c-bfb8-16f14f3f8f38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:59:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-649ddb0d-80d7-4951-aef7-c44fda5a5cb3 req-7d316e39-4854-4d7b-8dae-a744b4dae58b service nova] Lock "0104663a-99d2-494c-bfb8-16f14f3f8f38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:59:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-649ddb0d-80d7-4951-aef7-c44fda5a5cb3 req-7d316e39-4854-4d7b-8dae-a744b4dae58b service nova] Lock "0104663a-99d2-494c-bfb8-16f14f3f8f38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:59:39 user nova-compute[71113]: DEBUG nova.compute.manager [req-649ddb0d-80d7-4951-aef7-c44fda5a5cb3 req-7d316e39-4854-4d7b-8dae-a744b4dae58b service nova] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] No waiting events found dispatching network-vif-unplugged-5bb08dc2-dad5-451e-909d-111b94035438 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:59:39 user nova-compute[71113]: DEBUG nova.compute.manager [req-649ddb0d-80d7-4951-aef7-c44fda5a5cb3 req-7d316e39-4854-4d7b-8dae-a744b4dae58b service nova] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Received event network-vif-unplugged-5bb08dc2-dad5-451e-909d-111b94035438 for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 09:59:39 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Instance destroyed successfully.
Jul 31 09:59:39 user nova-compute[71113]: DEBUG nova.objects.instance [None req-b6bf55d8-1827-4621-8732-af219798b470 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lazy-loading 'resources' on Instance uuid 0104663a-99d2-494c-bfb8-16f14f3f8f38 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:59:39 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-b6bf55d8-1827-4621-8732-af219798b470 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:57:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1227571820',display_name='tempest-TestVolumeBootPattern-server-1227571820',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1227571820',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:58:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3aa2add2e2a24b9cb8e48042b06931d3',ramdisk_id='',reservation_id='r-0fjjexc7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1754399827',owner_user_name='tempest-TestVolumeBootPattern-1754399827-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:58:08Z,user_data=None,user_id='a58fe92488ed47b696fc5d6d990b1acd',uuid=0104663a-99d2-494c-bfb8-16f14f3f8f38,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5bb08dc2-dad5-451e-909d-111b94035438", "address": "fa:16:3e:93:8f:b4", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bb08dc2-da", "ovs_interfaceid": "5bb08dc2-dad5-451e-909d-111b94035438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 09:59:39 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-b6bf55d8-1827-4621-8732-af219798b470 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Converting VIF {"id": "5bb08dc2-dad5-451e-909d-111b94035438", "address": "fa:16:3e:93:8f:b4", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bb08dc2-da", "ovs_interfaceid": "5bb08dc2-dad5-451e-909d-111b94035438", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:59:39 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-b6bf55d8-1827-4621-8732-af219798b470 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:8f:b4,bridge_name='br-int',has_traffic_filtering=True,id=5bb08dc2-dad5-451e-909d-111b94035438,network=Network(fa792d7a-ddf6-4a2d-acb9-802f8daf87ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bb08dc2-da') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:59:39 user nova-compute[71113]: DEBUG os_vif [None req-b6bf55d8-1827-4621-8732-af219798b470 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:8f:b4,bridge_name='br-int',has_traffic_filtering=True,id=5bb08dc2-dad5-451e-909d-111b94035438,network=Network(fa792d7a-ddf6-4a2d-acb9-802f8daf87ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bb08dc2-da') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 09:59:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5bb08dc2-da, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:59:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:39 user nova-compute[71113]: INFO os_vif [None req-b6bf55d8-1827-4621-8732-af219798b470 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:8f:b4,bridge_name='br-int',has_traffic_filtering=True,id=5bb08dc2-dad5-451e-909d-111b94035438,network=Network(fa792d7a-ddf6-4a2d-acb9-802f8daf87ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bb08dc2-da')
Jul 31 09:59:39 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6bf55d8-1827-4621-8732-af219798b470 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 09:59:39 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bf55d8-1827-4621-8732-af219798b470 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nWeZiVPS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:59:39 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-b6bf55d8-1827-4621-8732-af219798b470 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:59:39 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-b6bf55d8-1827-4621-8732-af219798b470 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:59:39 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-b6bf55d8-1827-4621-8732-af219798b470 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:59:39 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bf55d8-1827-4621-8732-af219798b470 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 09:59:39 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:39 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:39 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7372d362-7ed4-4b94-bb2e-35220d092710]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:39 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:39 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:39 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2beeca-6020-43ae-9ac8-11a4b2daf123]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:39 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bf55d8-1827-4621-8732-af219798b470 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:59:39 user nova-compute[71113]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)
Jul 31 09:59:39 user nova-compute[71113]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617 (non-flash)
Jul 31 09:59:39 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:59:39 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bf55d8-1827-4621-8732-af219798b470 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:59:39 user nova-compute[71113]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)
Jul 31 09:59:39 user nova-compute[71113]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617 (non-flash)
Jul 31 09:59:39 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:59:39 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bf55d8-1827-4621-8732-af219798b470 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79083923b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617'): ({'sdc'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 09:59:39 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-b6bf55d8-1827-4621-8732-af219798b470 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Removing single pathed devices sdc {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 09:59:39 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:39 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:39 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[82641b8c-4b9d-4540-8b54-f2db6f1f5673]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:39 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:39 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:39 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a57c5f-b99e-4a13-928e-02ba3b84a3a7]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:39 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-b6bf55d8-1827-4621-8732-af219798b470 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Flushing IO for device /dev/sdc {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 09:59:39 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:40 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3342fd00-513e-4429-bcb0-b0da4f0415ce]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:40 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-b6bf55d8-1827-4621-8732-af219798b470 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 09:59:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:40 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f233bb-08c4-412a-9a88-6263a0340cda]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:40 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-b6bf55d8-1827-4621-8732-af219798b470 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 09:59:40 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-b6bf55d8-1827-4621-8732-af219798b470 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] SCSI volumes sdc have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 09:59:40 user nova-compute[71113]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26635653138643761', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_3c7b810a', '/dev/disk/by-id/scsi-1SCST_BIO3c7b810a-f5e18d7abfa81e92') {{(pid=81983) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 31 09:59:40 user nova-compute[71113]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26635653138643761
Jul 31 09:59:40 user nova-compute[71113]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_3c7b810a
Jul 31 09:59:40 user nova-compute[71113]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO3c7b810a-f5e18d7abfa81e92
Jul 31 09:59:40 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[45041a92-b181-43ec-8fe4-5585754b6ab8]: (4, None) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bf55d8-1827-4621-8732-af219798b470 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 09:59:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:40 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef3e26e-6994-4ff5-afe0-85d2816586c9]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bf55d8-1827-4621-8732-af219798b470 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:59:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617 -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:40 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de5fe7e-b330-492e-b60a-9680667604a1]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bf55d8-1827-4621-8732-af219798b470 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617, portal: 172.16.0.220,3260]
Jul 31 09:59:40 user nova-compute[71113]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617, portal: 172.16.0.220,3260] successful.
Jul 31 09:59:40 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:59:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617 -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c78df559-0825-4eac-b883-90838ecae617 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:40 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee9e0a3-30d2-43ec-8190-6fecd9e87b33]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bf55d8-1827-4621-8732-af219798b470 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:59:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-b6bf55d8-1827-4621-8732-af219798b470 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:59:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6bf55d8-1827-4621-8732-af219798b470 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] <== disconnect_volume: return (365ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:59:40 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6bf55d8-1827-4621-8732-af219798b470 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 09:59:40 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-b6bf55d8-1827-4621-8732-af219798b470 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Deleting instance files /opt/stack/data/nova/instances/0104663a-99d2-494c-bfb8-16f14f3f8f38_del
Jul 31 09:59:40 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-b6bf55d8-1827-4621-8732-af219798b470 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Deletion of /opt/stack/data/nova/instances/0104663a-99d2-494c-bfb8-16f14f3f8f38_del complete
Jul 31 09:59:40 user nova-compute[71113]: INFO nova.compute.manager [None req-b6bf55d8-1827-4621-8732-af219798b470 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Took 1.27 seconds to destroy the instance on the hypervisor.
Jul 31 09:59:40 user nova-compute[71113]: DEBUG oslo.service.loopingcall [None req-b6bf55d8-1827-4621-8732-af219798b470 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71113) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 09:59:40 user nova-compute[71113]: DEBUG nova.compute.manager [-] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Deallocating network for instance {{(pid=71113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 09:59:40 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] deallocate_for_instance() {{(pid=71113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 09:59:40 user nova-compute[71113]: DEBUG nova.network.neutron [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Successfully updated port: cc8f812f-2fff-475e-a41e-abf390366863 {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 09:59:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Acquiring lock "refresh_cache-9b01d025-2fe7-4ed9-827d-0546134b08a7" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:59:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Acquired lock "refresh_cache-9b01d025-2fe7-4ed9-827d-0546134b08a7" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:59:40 user nova-compute[71113]: DEBUG nova.network.neutron [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 09:59:40 user nova-compute[71113]: DEBUG nova.network.neutron [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 09:59:40 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:59:40 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Took 0.62 seconds to deallocate network for instance.
Jul 31 09:59:40 user nova-compute[71113]: DEBUG nova.compute.manager [req-2218016e-1399-4c3f-9348-1eeff7441566 req-5025a84c-4ef1-4701-8a42-b67b692936c5 service nova] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Received event network-vif-deleted-5bb08dc2-dad5-451e-909d-111b94035438 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:59:40 user nova-compute[71113]: INFO nova.compute.manager [req-2218016e-1399-4c3f-9348-1eeff7441566 req-5025a84c-4ef1-4701-8a42-b67b692936c5 service nova] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Neutron deleted interface 5bb08dc2-dad5-451e-909d-111b94035438; detaching it from the instance and deleting it from the info cache
Jul 31 09:59:40 user nova-compute[71113]: DEBUG nova.network.neutron [req-2218016e-1399-4c3f-9348-1eeff7441566 req-5025a84c-4ef1-4701-8a42-b67b692936c5 service nova] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:59:40 user nova-compute[71113]: DEBUG nova.network.neutron [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Updating instance_info_cache with network_info: [{"id": "cc8f812f-2fff-475e-a41e-abf390366863", "address": "fa:16:3e:61:8f:df", "network": {"id": "5f333808-4342-4014-9221-7ccd394eff66", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-42408734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4b02badf8ea4f32a5e259c25120eac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc8f812f-2f", "ovs_interfaceid": "cc8f812f-2fff-475e-a41e-abf390366863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:59:40 user nova-compute[71113]: DEBUG nova.compute.manager [req-2218016e-1399-4c3f-9348-1eeff7441566 req-5025a84c-4ef1-4701-8a42-b67b692936c5 service nova] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Detach interface failed, port_id=5bb08dc2-dad5-451e-909d-111b94035438, reason: Instance 0104663a-99d2-494c-bfb8-16f14f3f8f38 could not be found. {{(pid=71113) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 09:59:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Releasing lock "refresh_cache-9b01d025-2fe7-4ed9-827d-0546134b08a7" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:59:40 user nova-compute[71113]: DEBUG nova.compute.manager [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Instance network_info: |[{"id": "cc8f812f-2fff-475e-a41e-abf390366863", "address": "fa:16:3e:61:8f:df", "network": {"id": "5f333808-4342-4014-9221-7ccd394eff66", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-42408734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4b02badf8ea4f32a5e259c25120eac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc8f812f-2f", "ovs_interfaceid": "cc8f812f-2fff-475e-a41e-abf390366863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 09:59:41 user nova-compute[71113]: DEBUG nova.compute.manager [req-3bbb5d90-58a4-4b03-b279-7047307b90c9 req-52184fdc-ccfd-453c-b73e-bafc21e3df72 service nova] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Received event network-vif-plugged-5bb08dc2-dad5-451e-909d-111b94035438 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:59:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3bbb5d90-58a4-4b03-b279-7047307b90c9 req-52184fdc-ccfd-453c-b73e-bafc21e3df72 service nova] Acquiring lock "0104663a-99d2-494c-bfb8-16f14f3f8f38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:59:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3bbb5d90-58a4-4b03-b279-7047307b90c9 req-52184fdc-ccfd-453c-b73e-bafc21e3df72 service nova] Lock "0104663a-99d2-494c-bfb8-16f14f3f8f38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:59:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3bbb5d90-58a4-4b03-b279-7047307b90c9 req-52184fdc-ccfd-453c-b73e-bafc21e3df72 service nova] Lock "0104663a-99d2-494c-bfb8-16f14f3f8f38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:59:41 user nova-compute[71113]: DEBUG nova.compute.manager [req-3bbb5d90-58a4-4b03-b279-7047307b90c9 req-52184fdc-ccfd-453c-b73e-bafc21e3df72 service nova] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] No waiting events found dispatching network-vif-plugged-5bb08dc2-dad5-451e-909d-111b94035438 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:59:41 user nova-compute[71113]: WARNING nova.compute.manager [req-3bbb5d90-58a4-4b03-b279-7047307b90c9 req-52184fdc-ccfd-453c-b73e-bafc21e3df72 service nova] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Received unexpected event network-vif-plugged-5bb08dc2-dad5-451e-909d-111b94035438 for instance with vm_state active and task_state deleting.
Jul 31 09:59:41 user nova-compute[71113]: DEBUG nova.compute.manager [req-3bbb5d90-58a4-4b03-b279-7047307b90c9 req-52184fdc-ccfd-453c-b73e-bafc21e3df72 service nova] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Received event network-changed-cc8f812f-2fff-475e-a41e-abf390366863 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:59:41 user nova-compute[71113]: DEBUG nova.compute.manager [req-3bbb5d90-58a4-4b03-b279-7047307b90c9 req-52184fdc-ccfd-453c-b73e-bafc21e3df72 service nova] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Refreshing instance network info cache due to event network-changed-cc8f812f-2fff-475e-a41e-abf390366863. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 09:59:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3bbb5d90-58a4-4b03-b279-7047307b90c9 req-52184fdc-ccfd-453c-b73e-bafc21e3df72 service nova] Acquiring lock "refresh_cache-9b01d025-2fe7-4ed9-827d-0546134b08a7" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 09:59:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3bbb5d90-58a4-4b03-b279-7047307b90c9 req-52184fdc-ccfd-453c-b73e-bafc21e3df72 service nova] Acquired lock "refresh_cache-9b01d025-2fe7-4ed9-827d-0546134b08a7" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 09:59:41 user nova-compute[71113]: DEBUG nova.network.neutron [req-3bbb5d90-58a4-4b03-b279-7047307b90c9 req-52184fdc-ccfd-453c-b73e-bafc21e3df72 service nova] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Refreshing network info cache for port cc8f812f-2fff-475e-a41e-abf390366863 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 09:59:41 user nova-compute[71113]: INFO nova.compute.manager [None req-b6bf55d8-1827-4621-8732-af219798b470 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Took 0.77 seconds to detach 1 volumes for instance.
Jul 31 09:59:41 user nova-compute[71113]: DEBUG nova.compute.manager [None req-b6bf55d8-1827-4621-8732-af219798b470 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Deleting volume: c78df559-0825-4eac-b883-90838ecae617 {{(pid=71113) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 31 09:59:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b6bf55d8-1827-4621-8732-af219798b470 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:59:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b6bf55d8-1827-4621-8732-af219798b470 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:59:42 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-b6bf55d8-1827-4621-8732-af219798b470 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 09:59:42 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-b6bf55d8-1827-4621-8732-af219798b470 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 09:59:42 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b6bf55d8-1827-4621-8732-af219798b470 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.340s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:59:42 user nova-compute[71113]: DEBUG nova.network.neutron [req-3bbb5d90-58a4-4b03-b279-7047307b90c9 req-52184fdc-ccfd-453c-b73e-bafc21e3df72 service nova] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Updated VIF entry in instance network info cache for port cc8f812f-2fff-475e-a41e-abf390366863. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 09:59:42 user nova-compute[71113]: DEBUG nova.network.neutron [req-3bbb5d90-58a4-4b03-b279-7047307b90c9 req-52184fdc-ccfd-453c-b73e-bafc21e3df72 service nova] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Updating instance_info_cache with network_info: [{"id": "cc8f812f-2fff-475e-a41e-abf390366863", "address": "fa:16:3e:61:8f:df", "network": {"id": "5f333808-4342-4014-9221-7ccd394eff66", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-42408734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4b02badf8ea4f32a5e259c25120eac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc8f812f-2f", "ovs_interfaceid": "cc8f812f-2fff-475e-a41e-abf390366863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 09:59:42 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-b6bf55d8-1827-4621-8732-af219798b470 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Deleted allocations for instance 0104663a-99d2-494c-bfb8-16f14f3f8f38
Jul 31 09:59:42 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3bbb5d90-58a4-4b03-b279-7047307b90c9 req-52184fdc-ccfd-453c-b73e-bafc21e3df72 service nova] Releasing lock "refresh_cache-9b01d025-2fe7-4ed9-827d-0546134b08a7" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 09:59:42 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690797567.2698576, bc9b4047-7408-40a1-b38c-59695faffafb => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:59:42 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] VM Stopped (Lifecycle Event)
Jul 31 09:59:42 user nova-compute[71113]: DEBUG nova.compute.manager [None req-d4e7445d-5cdd-4b87-aa3a-351098257ea5 None None] [instance: bc9b4047-7408-40a1-b38c-59695faffafb] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:59:42 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b6bf55d8-1827-4621-8732-af219798b470 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "0104663a-99d2-494c-bfb8-16f14f3f8f38" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.294s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:59:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG nova.compute.manager [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Start spawning the instance on the hypervisor. {{(pid=71113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 09:59:50 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Creating image(s)
Jul 31 09:59:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Did not create local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Ensure instance console log exists: /opt/stack/data/nova/instances/9b01d025-2fe7-4ed9-827d-0546134b08a7/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Start _get_guest_xml network_info=[{"id": "cc8f812f-2fff-475e-a41e-abf390366863", "address": "fa:16:3e:61:8f:df", "network": {"id": "5f333808-4342-4014-9221-7ccd394eff66", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-42408734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4b02badf8ea4f32a5e259c25120eac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc8f812f-2f", "ovs_interfaceid": "cc8f812f-2fff-475e-a41e-abf390366863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '68766810-96ed-422f-a2be-163184c589d5', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kSRbiupj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9b01d025-2fe7-4ed9-827d-0546134b08a7', 'attached_at': '', 'detached_at': '', 'volume_id': '4fa00a07-19dc-4a82-b9a0-6625e649403f', 'serial': '4fa00a07-19dc-4a82-b9a0-6625e649403f'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 09:59:50 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:59:50 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 09:59:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kSRbiupj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 09:59:50 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:59:50 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:59:50 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 09:59:50 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 09:59:50 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 09:59:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93fe41b-9b15-4280-aed4-99144eb776de]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 09:59:50 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[544f5ce7-2a9e-4ae6-a0a5-10d2e9fbf124]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f] added
Jul 31 09:59:50 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafa2241-b379-482f-aa1a-2534230ab807]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c291cd-819e-4265-8458-39f8a7934612]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kSRbiupj {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kSRbiupj" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea47d30-ae19-4227-b1c3-be0f44387f51]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kSRbiupj'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a447db7-b290-450a-91e7-0be643019a90]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[05092d1b-4786-402a-af8f-a4b7726826c2]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:59:50 user nova-compute[71113]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)
Jul 31 09:59:50 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:59:50 user nova-compute[71113]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)
Jul 31 09:59:50 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[38361ab5-6b18-4d8b-9769-1dbba7f2e6bc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f, portal: 172.16.0.220,3260]
Jul 31 09:59:50 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f, portal: 172.16.0.220,3260] successful.
Jul 31 09:59:50 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acb912e-9e98-4541-a8f5-d5c23bf71fef]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5689c51e-0bff-4a23-8a6e-edf0e0059532]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:59:50 user nova-compute[71113]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)
Jul 31 09:59:50 user nova-compute[71113]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f (non-flash)
Jul 31 09:59:50 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 09:59:50 user nova-compute[71113]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)
Jul 31 09:59:50 user nova-compute[71113]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f (non-flash)
Jul 31 09:59:50 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] HCTL ('34', '-', '-', 0) found on session 35 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbfda60-a05b-4eb8-bff7-34572cba98a8]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 09:59:50 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kSRbiupj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 09:59:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 09:59:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23730616262336538', 'path': '/dev/sdc'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 09:59:51 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730616262336538', 'path': '/dev/sdc'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 09:59:51 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:59:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-972438511',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-972438511',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMN/Rb0UqXjD4v1BBxetpe4UPNYObazNnGN7FxKdXTvz2iyzNZUZD6rIfXejF9ItEE9BSDAPgEkcwdmUFy1RLvhZdWlT7mUS0xbJEpPYT/4mz1Vn4Dur4VHq0XzU1g9+4Q==',key_name='tempest-keypair-1593349916',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4b02badf8ea4f32a5e259c25120eac7',ramdisk_id='',reservation_id='r-6qeaa7mv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1497143588',owner_user_name='tempest-ServerActionsV293TestJSON-1497143588-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:59:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba2fd55dd96b4c49bb0c1c98c0a724d4',uuid=9b01d025-2fe7-4ed9-827d-0546134b08a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc8f812f-2fff-475e-a41e-abf390366863", "address": "fa:16:3e:61:8f:df", "network": {"id": "5f333808-4342-4014-9221-7ccd394eff66", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-42408734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4b02badf8ea4f32a5e259c25120eac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc8f812f-2f", "ovs_interfaceid": "cc8f812f-2fff-475e-a41e-abf390366863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 09:59:51 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Converting VIF {"id": "cc8f812f-2fff-475e-a41e-abf390366863", "address": "fa:16:3e:61:8f:df", "network": {"id": "5f333808-4342-4014-9221-7ccd394eff66", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-42408734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4b02badf8ea4f32a5e259c25120eac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc8f812f-2f", "ovs_interfaceid": "cc8f812f-2fff-475e-a41e-abf390366863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:59:51 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:8f:df,bridge_name='br-int',has_traffic_filtering=True,id=cc8f812f-2fff-475e-a41e-abf390366863,network=Network(5f333808-4342-4014-9221-7ccd394eff66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc8f812f-2f') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:59:51 user nova-compute[71113]: DEBUG nova.objects.instance [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lazy-loading 'pci_devices' on Instance uuid 9b01d025-2fe7-4ed9-827d-0546134b08a7 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 09:59:51 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] End _get_guest_xml xml=<domain type="kvm">
Jul 31 09:59:51 user nova-compute[71113]:   <uuid>9b01d025-2fe7-4ed9-827d-0546134b08a7</uuid>
Jul 31 09:59:51 user nova-compute[71113]:   <name>instance-0000001f</name>
Jul 31 09:59:51 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 09:59:51 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 09:59:51 user nova-compute[71113]:   <metadata>
Jul 31 09:59:51 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 09:59:51 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 09:59:51 user nova-compute[71113]:       <nova:name>tempest-ServerActionsV293TestJSON-server-972438511</nova:name>
Jul 31 09:59:51 user nova-compute[71113]:       <nova:creationTime>2023-07-31 09:59:50</nova:creationTime>
Jul 31 09:59:51 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 09:59:51 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 09:59:51 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 09:59:51 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 09:59:51 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 09:59:51 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 09:59:51 user nova-compute[71113]:       </nova:flavor>
Jul 31 09:59:51 user nova-compute[71113]:       <nova:owner>
Jul 31 09:59:51 user nova-compute[71113]:         <nova:user uuid="ba2fd55dd96b4c49bb0c1c98c0a724d4">tempest-ServerActionsV293TestJSON-1497143588-project-member</nova:user>
Jul 31 09:59:51 user nova-compute[71113]:         <nova:project uuid="e4b02badf8ea4f32a5e259c25120eac7">tempest-ServerActionsV293TestJSON-1497143588</nova:project>
Jul 31 09:59:51 user nova-compute[71113]:       </nova:owner>
Jul 31 09:59:51 user nova-compute[71113]:       <nova:ports>
Jul 31 09:59:51 user nova-compute[71113]:         <nova:port uuid="cc8f812f-2fff-475e-a41e-abf390366863">
Jul 31 09:59:51 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 31 09:59:51 user nova-compute[71113]:         </nova:port>
Jul 31 09:59:51 user nova-compute[71113]:       </nova:ports>
Jul 31 09:59:51 user nova-compute[71113]:     </nova:instance>
Jul 31 09:59:51 user nova-compute[71113]:   </metadata>
Jul 31 09:59:51 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 09:59:51 user nova-compute[71113]:     <system>
Jul 31 09:59:51 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 09:59:51 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 09:59:51 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 09:59:51 user nova-compute[71113]:       <entry name="serial">9b01d025-2fe7-4ed9-827d-0546134b08a7</entry>
Jul 31 09:59:51 user nova-compute[71113]:       <entry name="uuid">9b01d025-2fe7-4ed9-827d-0546134b08a7</entry>
Jul 31 09:59:51 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 09:59:51 user nova-compute[71113]:     </system>
Jul 31 09:59:51 user nova-compute[71113]:   </sysinfo>
Jul 31 09:59:51 user nova-compute[71113]:   <os>
Jul 31 09:59:51 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 09:59:51 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 09:59:51 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 09:59:51 user nova-compute[71113]:   </os>
Jul 31 09:59:51 user nova-compute[71113]:   <features>
Jul 31 09:59:51 user nova-compute[71113]:     <acpi/>
Jul 31 09:59:51 user nova-compute[71113]:     <apic/>
Jul 31 09:59:51 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 09:59:51 user nova-compute[71113]:   </features>
Jul 31 09:59:51 user nova-compute[71113]:   <clock offset="utc">
Jul 31 09:59:51 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 09:59:51 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 09:59:51 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 09:59:51 user nova-compute[71113]:   </clock>
Jul 31 09:59:51 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 09:59:51 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 09:59:51 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 09:59:51 user nova-compute[71113]:   </cpu>
Jul 31 09:59:51 user nova-compute[71113]:   <devices>
Jul 31 09:59:51 user nova-compute[71113]:     <disk type="block" device="disk">
Jul 31 09:59:51 user nova-compute[71113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 09:59:51 user nova-compute[71113]:       <source dev="/dev/sdc"/>
Jul 31 09:59:51 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 09:59:51 user nova-compute[71113]:       <serial>4fa00a07-19dc-4a82-b9a0-6625e649403f</serial>
Jul 31 09:59:51 user nova-compute[71113]:     </disk>
Jul 31 09:59:51 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 09:59:51 user nova-compute[71113]:       <mac address="fa:16:3e:61:8f:df"/>
Jul 31 09:59:51 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:59:51 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 09:59:51 user nova-compute[71113]:       <target dev="tapcc8f812f-2f"/>
Jul 31 09:59:51 user nova-compute[71113]:     </interface>
Jul 31 09:59:51 user nova-compute[71113]:     <serial type="pty">
Jul 31 09:59:51 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/9b01d025-2fe7-4ed9-827d-0546134b08a7/console.log" append="off"/>
Jul 31 09:59:51 user nova-compute[71113]:     </serial>
Jul 31 09:59:51 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 09:59:51 user nova-compute[71113]:     <video>
Jul 31 09:59:51 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 09:59:51 user nova-compute[71113]:     </video>
Jul 31 09:59:51 user nova-compute[71113]:     <rng model="virtio">
Jul 31 09:59:51 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 09:59:51 user nova-compute[71113]:     </rng>
Jul 31 09:59:51 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 09:59:51 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 09:59:51 user nova-compute[71113]:       <stats period="10"/>
Jul 31 09:59:51 user nova-compute[71113]:     </memballoon>
Jul 31 09:59:51 user nova-compute[71113]:   </devices>
Jul 31 09:59:51 user nova-compute[71113]: </domain>
Jul 31 09:59:51 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 09:59:51 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:59:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-972438511',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-972438511',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMN/Rb0UqXjD4v1BBxetpe4UPNYObazNnGN7FxKdXTvz2iyzNZUZD6rIfXejF9ItEE9BSDAPgEkcwdmUFy1RLvhZdWlT7mUS0xbJEpPYT/4mz1Vn4Dur4VHq0XzU1g9+4Q==',key_name='tempest-keypair-1593349916',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4b02badf8ea4f32a5e259c25120eac7',ramdisk_id='',reservation_id='r-6qeaa7mv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1497143588',owner_user_name='tempest-ServerActionsV293TestJSON-1497143588-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T09:59:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba2fd55dd96b4c49bb0c1c98c0a724d4',uuid=9b01d025-2fe7-4ed9-827d-0546134b08a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc8f812f-2fff-475e-a41e-abf390366863", "address": "fa:16:3e:61:8f:df", "network": {"id": "5f333808-4342-4014-9221-7ccd394eff66", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-42408734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4b02badf8ea4f32a5e259c25120eac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc8f812f-2f", "ovs_interfaceid": "cc8f812f-2fff-475e-a41e-abf390366863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 09:59:51 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Converting VIF {"id": "cc8f812f-2fff-475e-a41e-abf390366863", "address": "fa:16:3e:61:8f:df", "network": {"id": "5f333808-4342-4014-9221-7ccd394eff66", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-42408734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4b02badf8ea4f32a5e259c25120eac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc8f812f-2f", "ovs_interfaceid": "cc8f812f-2fff-475e-a41e-abf390366863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 09:59:51 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:8f:df,bridge_name='br-int',has_traffic_filtering=True,id=cc8f812f-2fff-475e-a41e-abf390366863,network=Network(5f333808-4342-4014-9221-7ccd394eff66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc8f812f-2f') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 09:59:51 user nova-compute[71113]: DEBUG os_vif [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:8f:df,bridge_name='br-int',has_traffic_filtering=True,id=cc8f812f-2fff-475e-a41e-abf390366863,network=Network(5f333808-4342-4014-9221-7ccd394eff66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc8f812f-2f') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 09:59:51 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:51 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:59:51 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 09:59:51 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:51 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc8f812f-2f, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:59:51 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcc8f812f-2f, col_values=(('external_ids', {'iface-id': 'cc8f812f-2fff-475e-a41e-abf390366863', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:8f:df', 'vm-uuid': '9b01d025-2fe7-4ed9-827d-0546134b08a7'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 09:59:51 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:51 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 09:59:51 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:51 user nova-compute[71113]: INFO os_vif [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:8f:df,bridge_name='br-int',has_traffic_filtering=True,id=cc8f812f-2fff-475e-a41e-abf390366863,network=Network(5f333808-4342-4014-9221-7ccd394eff66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc8f812f-2f')
Jul 31 09:59:51 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 09:59:51 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] No VIF found with MAC fa:16:3e:61:8f:df, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 09:59:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:53 user nova-compute[71113]: DEBUG nova.compute.manager [req-f9010dbc-fcdf-41a6-9423-2c93373aaadd req-98763d31-670c-449b-b503-ee30e03eccbc service nova] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Received event network-vif-plugged-cc8f812f-2fff-475e-a41e-abf390366863 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:59:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f9010dbc-fcdf-41a6-9423-2c93373aaadd req-98763d31-670c-449b-b503-ee30e03eccbc service nova] Acquiring lock "9b01d025-2fe7-4ed9-827d-0546134b08a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:59:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f9010dbc-fcdf-41a6-9423-2c93373aaadd req-98763d31-670c-449b-b503-ee30e03eccbc service nova] Lock "9b01d025-2fe7-4ed9-827d-0546134b08a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:59:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f9010dbc-fcdf-41a6-9423-2c93373aaadd req-98763d31-670c-449b-b503-ee30e03eccbc service nova] Lock "9b01d025-2fe7-4ed9-827d-0546134b08a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:59:53 user nova-compute[71113]: DEBUG nova.compute.manager [req-f9010dbc-fcdf-41a6-9423-2c93373aaadd req-98763d31-670c-449b-b503-ee30e03eccbc service nova] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] No waiting events found dispatching network-vif-plugged-cc8f812f-2fff-475e-a41e-abf390366863 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:59:53 user nova-compute[71113]: WARNING nova.compute.manager [req-f9010dbc-fcdf-41a6-9423-2c93373aaadd req-98763d31-670c-449b-b503-ee30e03eccbc service nova] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Received unexpected event network-vif-plugged-cc8f812f-2fff-475e-a41e-abf390366863 for instance with vm_state building and task_state spawning.
Jul 31 09:59:53 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:53 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:54 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690797579.815443, 0104663a-99d2-494c-bfb8-16f14f3f8f38 => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:59:54 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] VM Stopped (Lifecycle Event)
Jul 31 09:59:54 user nova-compute[71113]: DEBUG nova.compute.manager [None req-cebd48df-0ad1-4528-b31b-59c4ce5d1a83 None None] [instance: 0104663a-99d2-494c-bfb8-16f14f3f8f38] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:59:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:55 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797595.017805, 9b01d025-2fe7-4ed9-827d-0546134b08a7 => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:59:55 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] VM Resumed (Lifecycle Event)
Jul 31 09:59:55 user nova-compute[71113]: DEBUG nova.compute.manager [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 09:59:55 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 09:59:55 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Instance spawned successfully.
Jul 31 09:59:55 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 09:59:55 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:59:55 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:59:55 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Found default for hw_cdrom_bus of ide {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:59:55 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Found default for hw_disk_bus of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:59:55 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Found default for hw_input_bus of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:59:55 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Found default for hw_pointer_model of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:59:55 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Found default for hw_video_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:59:55 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Found default for hw_vif_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 09:59:55 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:59:55 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797595.0197525, 9b01d025-2fe7-4ed9-827d-0546134b08a7 => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 09:59:55 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] VM Started (Lifecycle Event)
Jul 31 09:59:55 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:59:55 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 09:59:55 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 09:59:55 user nova-compute[71113]: INFO nova.compute.manager [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Took 4.99 seconds to spawn the instance on the hypervisor.
Jul 31 09:59:55 user nova-compute[71113]: DEBUG nova.compute.manager [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 09:59:55 user nova-compute[71113]: DEBUG nova.compute.manager [req-b80fc168-c5c4-4fb0-8bac-13fb6d7f8bf5 req-0f301cb5-00ff-4db9-9ec6-062d676fc863 service nova] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Received event network-vif-plugged-cc8f812f-2fff-475e-a41e-abf390366863 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 09:59:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-b80fc168-c5c4-4fb0-8bac-13fb6d7f8bf5 req-0f301cb5-00ff-4db9-9ec6-062d676fc863 service nova] Acquiring lock "9b01d025-2fe7-4ed9-827d-0546134b08a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 09:59:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-b80fc168-c5c4-4fb0-8bac-13fb6d7f8bf5 req-0f301cb5-00ff-4db9-9ec6-062d676fc863 service nova] Lock "9b01d025-2fe7-4ed9-827d-0546134b08a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 09:59:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-b80fc168-c5c4-4fb0-8bac-13fb6d7f8bf5 req-0f301cb5-00ff-4db9-9ec6-062d676fc863 service nova] Lock "9b01d025-2fe7-4ed9-827d-0546134b08a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:59:55 user nova-compute[71113]: DEBUG nova.compute.manager [req-b80fc168-c5c4-4fb0-8bac-13fb6d7f8bf5 req-0f301cb5-00ff-4db9-9ec6-062d676fc863 service nova] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] No waiting events found dispatching network-vif-plugged-cc8f812f-2fff-475e-a41e-abf390366863 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 09:59:55 user nova-compute[71113]: WARNING nova.compute.manager [req-b80fc168-c5c4-4fb0-8bac-13fb6d7f8bf5 req-0f301cb5-00ff-4db9-9ec6-062d676fc863 service nova] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Received unexpected event network-vif-plugged-cc8f812f-2fff-475e-a41e-abf390366863 for instance with vm_state building and task_state spawning.
Jul 31 09:59:55 user nova-compute[71113]: INFO nova.compute.manager [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Took 17.70 seconds to build instance.
Jul 31 09:59:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-803053aa-c1ab-4dc5-be33-f1dfcd4e5ae1 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lock "9b01d025-2fe7-4ed9-827d-0546134b08a7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.811s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 09:59:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 09:59:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:00:01 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:00:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:00:06 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:00:07 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-072e00b6-d81b-45c9-b7da-a313ccecd7dc tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Acquiring lock "9745ff0d-8320-4689-8326-c18752c6e6ae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:00:07 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-072e00b6-d81b-45c9-b7da-a313ccecd7dc tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Lock "9745ff0d-8320-4689-8326-c18752c6e6ae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:00:07 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-072e00b6-d81b-45c9-b7da-a313ccecd7dc tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Acquiring lock "9745ff0d-8320-4689-8326-c18752c6e6ae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:00:07 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-072e00b6-d81b-45c9-b7da-a313ccecd7dc tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Lock "9745ff0d-8320-4689-8326-c18752c6e6ae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:00:07 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-072e00b6-d81b-45c9-b7da-a313ccecd7dc tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Lock "9745ff0d-8320-4689-8326-c18752c6e6ae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:00:07 user nova-compute[71113]: INFO nova.compute.manager [None req-072e00b6-d81b-45c9-b7da-a313ccecd7dc tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Terminating instance
Jul 31 10:00:07 user nova-compute[71113]: DEBUG nova.compute.manager [None req-072e00b6-d81b-45c9-b7da-a313ccecd7dc tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Start destroying the instance on the hypervisor. {{(pid=71113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 10:00:08 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:00:08 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:00:08 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:00:08 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:00:08 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:00:08 user nova-compute[71113]: DEBUG nova.compute.manager [req-d37fdbff-b8e3-4aad-b53a-cf4d0d076284 req-993565e2-1b3c-4c02-a0b6-d5aa8e308400 service nova] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Received event network-vif-unplugged-04c596fd-1d1a-426e-8d57-043b36bad9b6 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:00:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-d37fdbff-b8e3-4aad-b53a-cf4d0d076284 req-993565e2-1b3c-4c02-a0b6-d5aa8e308400 service nova] Acquiring lock "9745ff0d-8320-4689-8326-c18752c6e6ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:00:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-d37fdbff-b8e3-4aad-b53a-cf4d0d076284 req-993565e2-1b3c-4c02-a0b6-d5aa8e308400 service nova] Lock "9745ff0d-8320-4689-8326-c18752c6e6ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:00:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-d37fdbff-b8e3-4aad-b53a-cf4d0d076284 req-993565e2-1b3c-4c02-a0b6-d5aa8e308400 service nova] Lock "9745ff0d-8320-4689-8326-c18752c6e6ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:00:08 user nova-compute[71113]: DEBUG nova.compute.manager [req-d37fdbff-b8e3-4aad-b53a-cf4d0d076284 req-993565e2-1b3c-4c02-a0b6-d5aa8e308400 service nova] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] No waiting events found dispatching network-vif-unplugged-04c596fd-1d1a-426e-8d57-043b36bad9b6 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:00:08 user nova-compute[71113]: DEBUG nova.compute.manager [req-d37fdbff-b8e3-4aad-b53a-cf4d0d076284 req-993565e2-1b3c-4c02-a0b6-d5aa8e308400 service nova] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Received event network-vif-unplugged-04c596fd-1d1a-426e-8d57-043b36bad9b6 for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 10:00:08 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Instance destroyed successfully.
Jul 31 10:00:08 user nova-compute[71113]: DEBUG nova.objects.instance [None req-072e00b6-d81b-45c9-b7da-a313ccecd7dc tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Lazy-loading 'resources' on Instance uuid 9745ff0d-8320-4689-8326-c18752c6e6ae {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:00:08 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:00:08 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-072e00b6-d81b-45c9-b7da-a313ccecd7dc tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:56:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1253964756',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1253964756',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1253964',id=26,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDl/XpFc4pfXjpPwp+RIvQDEA+6kveQO+O8J3/GNj9j2gLG4XqbmFB5u0pgmhoQoRLGg8K0FR01uY5h4fqS+yG9EzaEQxn8so/vcLEQzd50n8T6jhuKOqyaui9hU3ZT+Lg==',key_name='tempest-keypair-751638056',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:57:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df6061a98f3f47c49667a1af078fd72e',ramdisk_id='',reservation_id='r-jwk6rvl4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1753977418',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:57:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ccaa676a1b94ce9a9c7e7ac1eea4725',uuid=9745ff0d-8320-4689-8326-c18752c6e6ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04c596fd-1d1a-426e-8d57-043b36bad9b6", "address": "fa:16:3e:52:17:a1", "network": {"id": "86306292-9a3b-4b6f-bf9f-b18bbe38fbb7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1087389621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df6061a98f3f47c49667a1af078fd72e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04c596fd-1d", "ovs_interfaceid": "04c596fd-1d1a-426e-8d57-043b36bad9b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 10:00:08 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-072e00b6-d81b-45c9-b7da-a313ccecd7dc tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Converting VIF {"id": "04c596fd-1d1a-426e-8d57-043b36bad9b6", "address": "fa:16:3e:52:17:a1", "network": {"id": "86306292-9a3b-4b6f-bf9f-b18bbe38fbb7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1087389621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df6061a98f3f47c49667a1af078fd72e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04c596fd-1d", "ovs_interfaceid": "04c596fd-1d1a-426e-8d57-043b36bad9b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:00:08 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-072e00b6-d81b-45c9-b7da-a313ccecd7dc tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:17:a1,bridge_name='br-int',has_traffic_filtering=True,id=04c596fd-1d1a-426e-8d57-043b36bad9b6,network=Network(86306292-9a3b-4b6f-bf9f-b18bbe38fbb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04c596fd-1d') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:00:08 user nova-compute[71113]: DEBUG os_vif [None req-072e00b6-d81b-45c9-b7da-a313ccecd7dc tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:17:a1,bridge_name='br-int',has_traffic_filtering=True,id=04c596fd-1d1a-426e-8d57-043b36bad9b6,network=Network(86306292-9a3b-4b6f-bf9f-b18bbe38fbb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04c596fd-1d') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 10:00:08 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:00:08 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap04c596fd-1d, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:00:08 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:00:08 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:00:08 user nova-compute[71113]: INFO os_vif [None req-072e00b6-d81b-45c9-b7da-a313ccecd7dc tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:17:a1,bridge_name='br-int',has_traffic_filtering=True,id=04c596fd-1d1a-426e-8d57-043b36bad9b6,network=Network(86306292-9a3b-4b6f-bf9f-b18bbe38fbb7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04c596fd-1d')
Jul 31 10:00:08 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-072e00b6-d81b-45c9-b7da-a313ccecd7dc tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Deleting instance files /opt/stack/data/nova/instances/9745ff0d-8320-4689-8326-c18752c6e6ae_del
Jul 31 10:00:08 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-072e00b6-d81b-45c9-b7da-a313ccecd7dc tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Deletion of /opt/stack/data/nova/instances/9745ff0d-8320-4689-8326-c18752c6e6ae_del complete
Jul 31 10:00:08 user nova-compute[71113]: INFO nova.compute.manager [None req-072e00b6-d81b-45c9-b7da-a313ccecd7dc tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Took 0.95 seconds to destroy the instance on the hypervisor.
Jul 31 10:00:08 user nova-compute[71113]: DEBUG oslo.service.loopingcall [None req-072e00b6-d81b-45c9-b7da-a313ccecd7dc tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71113) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 10:00:08 user nova-compute[71113]: DEBUG nova.compute.manager [-] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Deallocating network for instance {{(pid=71113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 10:00:08 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] deallocate_for_instance() {{(pid=71113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 10:00:09 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:00:09 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:00:09 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:00:09 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Took 0.88 seconds to deallocate network for instance.
Jul 31 10:00:09 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-072e00b6-d81b-45c9-b7da-a313ccecd7dc tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:00:09 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-072e00b6-d81b-45c9-b7da-a313ccecd7dc tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:00:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:00:10 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-072e00b6-d81b-45c9-b7da-a313ccecd7dc tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:00:10 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-072e00b6-d81b-45c9-b7da-a313ccecd7dc tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:00:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-072e00b6-d81b-45c9-b7da-a313ccecd7dc tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.282s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:00:10 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-072e00b6-d81b-45c9-b7da-a313ccecd7dc tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Deleted allocations for instance 9745ff0d-8320-4689-8326-c18752c6e6ae
Jul 31 10:00:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-072e00b6-d81b-45c9-b7da-a313ccecd7dc tempest-TestServerVolumeAttachScenarioOldVersion-1753977418 tempest-TestServerVolumeAttachScenarioOldVersion-1753977418-project-member] Lock "9745ff0d-8320-4689-8326-c18752c6e6ae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.307s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:00:10 user nova-compute[71113]: DEBUG nova.compute.manager [req-0333788e-c349-4228-b2b6-3ab82fd879e4 req-f91ab7bd-b1d7-4a4c-9ef0-5e66ea16af5b service nova] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Received event network-vif-plugged-04c596fd-1d1a-426e-8d57-043b36bad9b6 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:00:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-0333788e-c349-4228-b2b6-3ab82fd879e4 req-f91ab7bd-b1d7-4a4c-9ef0-5e66ea16af5b service nova] Acquiring lock "9745ff0d-8320-4689-8326-c18752c6e6ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:00:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-0333788e-c349-4228-b2b6-3ab82fd879e4 req-f91ab7bd-b1d7-4a4c-9ef0-5e66ea16af5b service nova] Lock "9745ff0d-8320-4689-8326-c18752c6e6ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:00:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-0333788e-c349-4228-b2b6-3ab82fd879e4 req-f91ab7bd-b1d7-4a4c-9ef0-5e66ea16af5b service nova] Lock "9745ff0d-8320-4689-8326-c18752c6e6ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:00:10 user nova-compute[71113]: DEBUG nova.compute.manager [req-0333788e-c349-4228-b2b6-3ab82fd879e4 req-f91ab7bd-b1d7-4a4c-9ef0-5e66ea16af5b service nova] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] No waiting events found dispatching network-vif-plugged-04c596fd-1d1a-426e-8d57-043b36bad9b6 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:00:10 user nova-compute[71113]: WARNING nova.compute.manager [req-0333788e-c349-4228-b2b6-3ab82fd879e4 req-f91ab7bd-b1d7-4a4c-9ef0-5e66ea16af5b service nova] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Received unexpected event network-vif-plugged-04c596fd-1d1a-426e-8d57-043b36bad9b6 for instance with vm_state deleted and task_state None.
Jul 31 10:00:10 user nova-compute[71113]: DEBUG nova.compute.manager [req-0333788e-c349-4228-b2b6-3ab82fd879e4 req-f91ab7bd-b1d7-4a4c-9ef0-5e66ea16af5b service nova] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Received event network-vif-deleted-04c596fd-1d1a-426e-8d57-043b36bad9b6 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:00:10 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:00:10 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:00:10 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:00:10 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:00:10 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:00:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:00:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:00:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:00:10 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:00:10 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 10:00:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b88201-04dc-4da9-b213-c50cdf274f4e/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:00:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b88201-04dc-4da9-b213-c50cdf274f4e/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:00:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b88201-04dc-4da9-b213-c50cdf274f4e/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:00:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b88201-04dc-4da9-b213-c50cdf274f4e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:00:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f020f166-07b6-4cf5-9f17-2ab108b55c30/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:00:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f020f166-07b6-4cf5-9f17-2ab108b55c30/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:00:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f020f166-07b6-4cf5-9f17-2ab108b55c30/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:00:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f020f166-07b6-4cf5-9f17-2ab108b55c30/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:00:11 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 10:00:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:00:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:00:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:00:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:00:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:00:12 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:00:12 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:00:12 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:00:12 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 10:00:12 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:00:12 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:00:12 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=7819MB free_disk=25.347557067871094GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:00:12 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:00:12 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:00:12 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 0ea0401b-26c2-4655-956b-1bc000debd53 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:00:12 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 3157a7a6-b8a9-4e2d-a157-360bce4c625d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:00:12 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 92d25a03-98ce-4bde-a3cc-20313ae77d41 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:00:12 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance a950d710-4596-4355-ac31-568c7728335a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:00:12 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance c4b88201-04dc-4da9-b213-c50cdf274f4e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:00:12 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance f020f166-07b6-4cf5-9f17-2ab108b55c30 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:00:12 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 9b01d025-2fe7-4ed9-827d-0546134b08a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:00:12 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:00:12 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:00:12 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:00:12 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:00:12 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:00:12 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.380s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:00:13 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:00:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:00:15 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:00:15 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:00:15 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:00:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "refresh_cache-3157a7a6-b8a9-4e2d-a157-360bce4c625d" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:00:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquired lock "refresh_cache-3157a7a6-b8a9-4e2d-a157-360bce4c625d" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:00:16 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Forcefully refreshing network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 10:00:16 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Updating instance_info_cache with network_info: [{"id": "179480f5-30b9-4a11-9771-95d88f21574f", "address": "fa:16:3e:42:ea:05", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap179480f5-30", "ovs_interfaceid": "179480f5-30b9-4a11-9771-95d88f21574f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:00:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Releasing lock "refresh_cache-3157a7a6-b8a9-4e2d-a157-360bce4c625d" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:00:16 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Updated the network info_cache for instance {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 10:00:18 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:00:19 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:00:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:00:23 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690797608.7274823, 9745ff0d-8320-4689-8326-c18752c6e6ae => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:00:23 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] VM Stopped (Lifecycle Event)
Jul 31 10:00:23 user nova-compute[71113]: DEBUG nova.compute.manager [None req-05cd1351-8fc0-4c72-a80f-870030fff591 None None] [instance: 9745ff0d-8320-4689-8326-c18752c6e6ae] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:00:23 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:00:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:00:28 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:00:33 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:00:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Acquiring lock "208130bc-5ece-4683-aa83-505ee89a8ba5" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:00:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "208130bc-5ece-4683-aa83-505ee89a8ba5" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:00:34 user nova-compute[71113]: INFO nova.compute.manager [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Unshelving
Jul 31 10:00:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:00:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:00:34 user nova-compute[71113]: DEBUG nova.objects.instance [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lazy-loading 'pci_requests' on Instance uuid 208130bc-5ece-4683-aa83-505ee89a8ba5 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:00:34 user nova-compute[71113]: DEBUG nova.objects.instance [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lazy-loading 'numa_topology' on Instance uuid 208130bc-5ece-4683-aa83-505ee89a8ba5 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:00:34 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 10:00:34 user nova-compute[71113]: INFO nova.compute.claims [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Claim successful on node user
Jul 31 10:00:35 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:00:35 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:00:35 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.382s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:00:35 user nova-compute[71113]: INFO nova.network.neutron [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Updating port d8cb465d-1593-4491-b337-8528c1bcfb3e with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Jul 31 10:00:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Acquiring lock "refresh_cache-208130bc-5ece-4683-aa83-505ee89a8ba5" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:00:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Acquired lock "refresh_cache-208130bc-5ece-4683-aa83-505ee89a8ba5" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:00:36 user nova-compute[71113]: DEBUG nova.network.neutron [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 10:00:36 user nova-compute[71113]: DEBUG nova.compute.manager [req-e3a1c1f6-e9a7-4ec1-81a2-db4db2f833d7 req-40dfef65-3278-4199-8fc7-c89009d7bca6 service nova] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Received event network-changed-d8cb465d-1593-4491-b337-8528c1bcfb3e {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:00:36 user nova-compute[71113]: DEBUG nova.compute.manager [req-e3a1c1f6-e9a7-4ec1-81a2-db4db2f833d7 req-40dfef65-3278-4199-8fc7-c89009d7bca6 service nova] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Refreshing instance network info cache due to event network-changed-d8cb465d-1593-4491-b337-8528c1bcfb3e. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 10:00:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e3a1c1f6-e9a7-4ec1-81a2-db4db2f833d7 req-40dfef65-3278-4199-8fc7-c89009d7bca6 service nova] Acquiring lock "refresh_cache-208130bc-5ece-4683-aa83-505ee89a8ba5" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:00:37 user nova-compute[71113]: DEBUG nova.network.neutron [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Updating instance_info_cache with network_info: [{"id": "d8cb465d-1593-4491-b337-8528c1bcfb3e", "address": "fa:16:3e:bb:b2:fd", "network": {"id": "e498d93a-703d-4d19-9adf-61469f37d4da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1320431580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4461b48e5470471d8fe1b61fb8af9c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8cb465d-15", "ovs_interfaceid": "d8cb465d-1593-4491-b337-8528c1bcfb3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:00:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Releasing lock "refresh_cache-208130bc-5ece-4683-aa83-505ee89a8ba5" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:00:37 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 10:00:37 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Creating image(s)
Jul 31 10:00:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Acquiring lock "/opt/stack/data/nova/instances/208130bc-5ece-4683-aa83-505ee89a8ba5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:00:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "/opt/stack/data/nova/instances/208130bc-5ece-4683-aa83-505ee89a8ba5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:00:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "/opt/stack/data/nova/instances/208130bc-5ece-4683-aa83-505ee89a8ba5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:00:37 user nova-compute[71113]: DEBUG nova.objects.instance [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lazy-loading 'trusted_certs' on Instance uuid 208130bc-5ece-4683-aa83-505ee89a8ba5 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:00:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e3a1c1f6-e9a7-4ec1-81a2-db4db2f833d7 req-40dfef65-3278-4199-8fc7-c89009d7bca6 service nova] Acquired lock "refresh_cache-208130bc-5ece-4683-aa83-505ee89a8ba5" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:00:37 user nova-compute[71113]: DEBUG nova.network.neutron [req-e3a1c1f6-e9a7-4ec1-81a2-db4db2f833d7 req-40dfef65-3278-4199-8fc7-c89009d7bca6 service nova] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Refreshing network info cache for port d8cb465d-1593-4491-b337-8528c1bcfb3e {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 10:00:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Acquiring lock "9f360f67813288081219a4f2a245e1a1a18b2629" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:00:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "9f360f67813288081219a4f2a245e1a1a18b2629" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:00:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f360f67813288081219a4f2a245e1a1a18b2629.part --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:00:38 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:00:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f360f67813288081219a4f2a245e1a1a18b2629.part --force-share --output=json" returned: 0 in 0.153s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:00:38 user nova-compute[71113]: DEBUG nova.virt.images [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] 1590f363-1dcc-464d-8013-6064a867f16b was qcow2, converting to raw {{(pid=71113) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 31 10:00:38 user nova-compute[71113]: DEBUG nova.privsep.utils [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71113) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 10:00:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9f360f67813288081219a4f2a245e1a1a18b2629.part /opt/stack/data/nova/instances/_base/9f360f67813288081219a4f2a245e1a1a18b2629.converted {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:00:39 user nova-compute[71113]: DEBUG nova.network.neutron [req-e3a1c1f6-e9a7-4ec1-81a2-db4db2f833d7 req-40dfef65-3278-4199-8fc7-c89009d7bca6 service nova] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Updated VIF entry in instance network info cache for port d8cb465d-1593-4491-b337-8528c1bcfb3e. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 10:00:39 user nova-compute[71113]: DEBUG nova.network.neutron [req-e3a1c1f6-e9a7-4ec1-81a2-db4db2f833d7 req-40dfef65-3278-4199-8fc7-c89009d7bca6 service nova] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Updating instance_info_cache with network_info: [{"id": "d8cb465d-1593-4491-b337-8528c1bcfb3e", "address": "fa:16:3e:bb:b2:fd", "network": {"id": "e498d93a-703d-4d19-9adf-61469f37d4da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1320431580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4461b48e5470471d8fe1b61fb8af9c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8cb465d-15", "ovs_interfaceid": "d8cb465d-1593-4491-b337-8528c1bcfb3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:00:39 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9f360f67813288081219a4f2a245e1a1a18b2629.part /opt/stack/data/nova/instances/_base/9f360f67813288081219a4f2a245e1a1a18b2629.converted" returned: 0 in 0.498s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:00:39 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f360f67813288081219a4f2a245e1a1a18b2629.converted --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:00:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e3a1c1f6-e9a7-4ec1-81a2-db4db2f833d7 req-40dfef65-3278-4199-8fc7-c89009d7bca6 service nova] Releasing lock "refresh_cache-208130bc-5ece-4683-aa83-505ee89a8ba5" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:00:39 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f360f67813288081219a4f2a245e1a1a18b2629.converted --force-share --output=json" returned: 0 in 0.143s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:00:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "9f360f67813288081219a4f2a245e1a1a18b2629" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.069s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:00:39 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f360f67813288081219a4f2a245e1a1a18b2629 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:00:39 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f360f67813288081219a4f2a245e1a1a18b2629 --force-share --output=json" returned: 0 in 0.148s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:00:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Acquiring lock "9f360f67813288081219a4f2a245e1a1a18b2629" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:00:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "9f360f67813288081219a4f2a245e1a1a18b2629" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:00:39 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f360f67813288081219a4f2a245e1a1a18b2629 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:00:39 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f360f67813288081219a4f2a245e1a1a18b2629 --force-share --output=json" returned: 0 in 0.154s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:00:39 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f360f67813288081219a4f2a245e1a1a18b2629,backing_fmt=raw /opt/stack/data/nova/instances/208130bc-5ece-4683-aa83-505ee89a8ba5/disk 1073741824 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:00:39 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f360f67813288081219a4f2a245e1a1a18b2629,backing_fmt=raw /opt/stack/data/nova/instances/208130bc-5ece-4683-aa83-505ee89a8ba5/disk 1073741824" returned: 0 in 0.052s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:00:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "9f360f67813288081219a4f2a245e1a1a18b2629" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:00:39 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f360f67813288081219a4f2a245e1a1a18b2629 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:00:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f360f67813288081219a4f2a245e1a1a18b2629 --force-share --output=json" returned: 0 in 0.139s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:00:40 user nova-compute[71113]: DEBUG nova.objects.instance [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lazy-loading 'migration_context' on Instance uuid 208130bc-5ece-4683-aa83-505ee89a8ba5 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:00:40 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Rebasing disk image.
Jul 31 10:00:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:00:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.177s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:00:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 -F raw /opt/stack/data/nova/instances/208130bc-5ece-4683-aa83-505ee89a8ba5/disk {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:00:40 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:00:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 -F raw /opt/stack/data/nova/instances/208130bc-5ece-4683-aa83-505ee89a8ba5/disk" returned: 0 in 3.170s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:00:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Created local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 10:00:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Ensure instance console log exists: /opt/stack/data/nova/instances/208130bc-5ece-4683-aa83-505ee89a8ba5/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 10:00:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:00:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:00:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:00:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Start _get_guest_xml network_info=[{"id": "d8cb465d-1593-4491-b337-8528c1bcfb3e", "address": "fa:16:3e:bb:b2:fd", "network": {"id": "e498d93a-703d-4d19-9adf-61469f37d4da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1320431580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4461b48e5470471d8fe1b61fb8af9c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8cb465d-15", "ovs_interfaceid": "d8cb465d-1593-4491-b337-8528c1bcfb3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='e3c8b90c49b22c52b81d8d2bbda757a8',container_format='bare',created_at=2023-07-31T09:58:41Z,direct_url=<?>,disk_format='qcow2',id=1590f363-1dcc-464d-8013-6064a867f16b,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-97586711-shelved',owner='4461b48e5470471d8fe1b61fb8af9c8d',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-07-31T09:58:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'image_id': '078646fe-b504-41ed-a147-61072e903e51'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 10:00:43 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:00:43 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:00:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 10:00:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 10:00:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 10:00:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 10:00:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 10:00:43 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='e3c8b90c49b22c52b81d8d2bbda757a8',container_format='bare',created_at=2023-07-31T09:58:41Z,direct_url=<?>,disk_format='qcow2',id=1590f363-1dcc-464d-8013-6064a867f16b,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-97586711-shelved',owner='4461b48e5470471d8fe1b61fb8af9c8d',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-07-31T09:58:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 10:00:43 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 10:00:43 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 10:00:43 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 10:00:43 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 10:00:43 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 10:00:43 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 10:00:43 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 10:00:43 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 10:00:43 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 10:00:43 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 10:00:43 user nova-compute[71113]: DEBUG nova.objects.instance [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lazy-loading 'vcpu_model' on Instance uuid 208130bc-5ece-4683-aa83-505ee89a8ba5 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:00:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T09:56:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-97586711',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-97586711',id=24,image_ref='1590f363-1dcc-464d-8013-6064a867f16b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1581132008',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:56:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='4461b48e5470471d8fe1b61fb8af9c8d',ramdisk_id='',reservation_id='r-q8o5zbgt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-960167684',owner_user_name='tempest-AttachVolumeShelveTestJSON-960167684-project-member',shelved_at='2023-07-31T09:58:45.248388',shelved_host='user',shelved_image_id='1590f363-1dcc-464d-8013-6064a867f16b'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T10:00:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5199c7da0634b6e8111782122adcf70',uuid=208130bc-5ece-4683-aa83-505ee89a8ba5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d8cb465d-1593-4491-b337-8528c1bcfb3e", "address": "fa:16:3e:bb:b2:fd", "network": {"id": "e498d93a-703d-4d19-9adf-61469f37d4da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1320431580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4461b48e5470471d8fe1b61fb8af9c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8cb465d-15", "ovs_interfaceid": "d8cb465d-1593-4491-b337-8528c1bcfb3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 10:00:43 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Converting VIF {"id": "d8cb465d-1593-4491-b337-8528c1bcfb3e", "address": "fa:16:3e:bb:b2:fd", "network": {"id": "e498d93a-703d-4d19-9adf-61469f37d4da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1320431580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4461b48e5470471d8fe1b61fb8af9c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8cb465d-15", "ovs_interfaceid": "d8cb465d-1593-4491-b337-8528c1bcfb3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:00:43 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:b2:fd,bridge_name='br-int',has_traffic_filtering=True,id=d8cb465d-1593-4491-b337-8528c1bcfb3e,network=Network(e498d93a-703d-4d19-9adf-61469f37d4da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8cb465d-15') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:00:43 user nova-compute[71113]: DEBUG nova.objects.instance [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lazy-loading 'pci_devices' on Instance uuid 208130bc-5ece-4683-aa83-505ee89a8ba5 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:00:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] End _get_guest_xml xml=<domain type="kvm">
Jul 31 10:00:43 user nova-compute[71113]:   <uuid>208130bc-5ece-4683-aa83-505ee89a8ba5</uuid>
Jul 31 10:00:43 user nova-compute[71113]:   <name>instance-00000018</name>
Jul 31 10:00:43 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 10:00:43 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 10:00:43 user nova-compute[71113]:   <metadata>
Jul 31 10:00:43 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 10:00:43 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 10:00:43 user nova-compute[71113]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-97586711</nova:name>
Jul 31 10:00:43 user nova-compute[71113]:       <nova:creationTime>2023-07-31 10:00:43</nova:creationTime>
Jul 31 10:00:43 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 10:00:43 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 10:00:43 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 10:00:43 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 10:00:43 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 10:00:43 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 10:00:43 user nova-compute[71113]:       </nova:flavor>
Jul 31 10:00:43 user nova-compute[71113]:       <nova:owner>
Jul 31 10:00:43 user nova-compute[71113]:         <nova:user uuid="b5199c7da0634b6e8111782122adcf70">tempest-AttachVolumeShelveTestJSON-960167684-project-member</nova:user>
Jul 31 10:00:43 user nova-compute[71113]:         <nova:project uuid="4461b48e5470471d8fe1b61fb8af9c8d">tempest-AttachVolumeShelveTestJSON-960167684</nova:project>
Jul 31 10:00:43 user nova-compute[71113]:       </nova:owner>
Jul 31 10:00:43 user nova-compute[71113]:       <nova:root type="image" uuid="1590f363-1dcc-464d-8013-6064a867f16b"/>
Jul 31 10:00:43 user nova-compute[71113]:       <nova:ports>
Jul 31 10:00:43 user nova-compute[71113]:         <nova:port uuid="d8cb465d-1593-4491-b337-8528c1bcfb3e">
Jul 31 10:00:43 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 31 10:00:43 user nova-compute[71113]:         </nova:port>
Jul 31 10:00:43 user nova-compute[71113]:       </nova:ports>
Jul 31 10:00:43 user nova-compute[71113]:     </nova:instance>
Jul 31 10:00:43 user nova-compute[71113]:   </metadata>
Jul 31 10:00:43 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 10:00:43 user nova-compute[71113]:     <system>
Jul 31 10:00:43 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 10:00:43 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 10:00:43 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 10:00:43 user nova-compute[71113]:       <entry name="serial">208130bc-5ece-4683-aa83-505ee89a8ba5</entry>
Jul 31 10:00:43 user nova-compute[71113]:       <entry name="uuid">208130bc-5ece-4683-aa83-505ee89a8ba5</entry>
Jul 31 10:00:43 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 10:00:43 user nova-compute[71113]:     </system>
Jul 31 10:00:43 user nova-compute[71113]:   </sysinfo>
Jul 31 10:00:43 user nova-compute[71113]:   <os>
Jul 31 10:00:43 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 10:00:43 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 10:00:43 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 10:00:43 user nova-compute[71113]:   </os>
Jul 31 10:00:43 user nova-compute[71113]:   <features>
Jul 31 10:00:43 user nova-compute[71113]:     <acpi/>
Jul 31 10:00:43 user nova-compute[71113]:     <apic/>
Jul 31 10:00:43 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 10:00:43 user nova-compute[71113]:   </features>
Jul 31 10:00:43 user nova-compute[71113]:   <clock offset="utc">
Jul 31 10:00:43 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 10:00:43 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 10:00:43 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 10:00:43 user nova-compute[71113]:   </clock>
Jul 31 10:00:43 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 10:00:43 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 10:00:43 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 10:00:43 user nova-compute[71113]:   </cpu>
Jul 31 10:00:43 user nova-compute[71113]:   <devices>
Jul 31 10:00:43 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 10:00:43 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 10:00:43 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/208130bc-5ece-4683-aa83-505ee89a8ba5/disk"/>
Jul 31 10:00:43 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 10:00:43 user nova-compute[71113]:     </disk>
Jul 31 10:00:43 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 10:00:43 user nova-compute[71113]:       <mac address="fa:16:3e:bb:b2:fd"/>
Jul 31 10:00:43 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:00:43 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 10:00:43 user nova-compute[71113]:       <target dev="tapd8cb465d-15"/>
Jul 31 10:00:43 user nova-compute[71113]:     </interface>
Jul 31 10:00:43 user nova-compute[71113]:     <serial type="pty">
Jul 31 10:00:43 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/208130bc-5ece-4683-aa83-505ee89a8ba5/console.log" append="off"/>
Jul 31 10:00:43 user nova-compute[71113]:     </serial>
Jul 31 10:00:43 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 10:00:43 user nova-compute[71113]:     <video>
Jul 31 10:00:43 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:00:43 user nova-compute[71113]:     </video>
Jul 31 10:00:43 user nova-compute[71113]:     <rng model="virtio">
Jul 31 10:00:43 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 10:00:43 user nova-compute[71113]:     </rng>
Jul 31 10:00:43 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 10:00:43 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 10:00:43 user nova-compute[71113]:       <stats period="10"/>
Jul 31 10:00:43 user nova-compute[71113]:     </memballoon>
Jul 31 10:00:43 user nova-compute[71113]:   </devices>
Jul 31 10:00:43 user nova-compute[71113]: </domain>
Jul 31 10:00:43 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 10:00:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T09:56:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-97586711',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-97586711',id=24,image_ref='1590f363-1dcc-464d-8013-6064a867f16b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1581132008',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:56:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='4461b48e5470471d8fe1b61fb8af9c8d',ramdisk_id='',reservation_id='r-q8o5zbgt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-960167684',owner_user_name='tempest-AttachVolumeShelveTestJSON-960167684-project-member',shelved_at='2023-07-31T09:58:45.248388',shelved_host='user',shelved_image_id='1590f363-1dcc-464d-8013-6064a867f16b'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T10:00:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5199c7da0634b6e8111782122adcf70',uuid=208130bc-5ece-4683-aa83-505ee89a8ba5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d8cb465d-1593-4491-b337-8528c1bcfb3e", "address": "fa:16:3e:bb:b2:fd", "network": {"id": "e498d93a-703d-4d19-9adf-61469f37d4da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1320431580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4461b48e5470471d8fe1b61fb8af9c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8cb465d-15", "ovs_interfaceid": "d8cb465d-1593-4491-b337-8528c1bcfb3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 10:00:43 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Converting VIF {"id": "d8cb465d-1593-4491-b337-8528c1bcfb3e", "address": "fa:16:3e:bb:b2:fd", "network": {"id": "e498d93a-703d-4d19-9adf-61469f37d4da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1320431580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4461b48e5470471d8fe1b61fb8af9c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8cb465d-15", "ovs_interfaceid": "d8cb465d-1593-4491-b337-8528c1bcfb3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:00:43 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:b2:fd,bridge_name='br-int',has_traffic_filtering=True,id=d8cb465d-1593-4491-b337-8528c1bcfb3e,network=Network(e498d93a-703d-4d19-9adf-61469f37d4da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8cb465d-15') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:00:43 user nova-compute[71113]: DEBUG os_vif [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:b2:fd,bridge_name='br-int',has_traffic_filtering=True,id=d8cb465d-1593-4491-b337-8528c1bcfb3e,network=Network(e498d93a-703d-4d19-9adf-61469f37d4da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8cb465d-15') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 10:00:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:00:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:00:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 10:00:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:00:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd8cb465d-15, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:00:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd8cb465d-15, col_values=(('external_ids', {'iface-id': 'd8cb465d-1593-4491-b337-8528c1bcfb3e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:b2:fd', 'vm-uuid': '208130bc-5ece-4683-aa83-505ee89a8ba5'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:00:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:00:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:00:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:00:43 user nova-compute[71113]: INFO os_vif [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:b2:fd,bridge_name='br-int',has_traffic_filtering=True,id=d8cb465d-1593-4491-b337-8528c1bcfb3e,network=Network(e498d93a-703d-4d19-9adf-61469f37d4da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8cb465d-15')
Jul 31 10:00:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:00:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] No VIF found with MAC fa:16:3e:bb:b2:fd, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 10:00:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:00:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:00:45 user nova-compute[71113]: DEBUG nova.compute.manager [req-6c61929c-cc78-4a92-aa5f-be6c17837785 req-d0deee43-0ebb-47b0-9c70-c7f3007d467f service nova] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Received event network-vif-plugged-d8cb465d-1593-4491-b337-8528c1bcfb3e {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:00:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-6c61929c-cc78-4a92-aa5f-be6c17837785 req-d0deee43-0ebb-47b0-9c70-c7f3007d467f service nova] Acquiring lock "208130bc-5ece-4683-aa83-505ee89a8ba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:00:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-6c61929c-cc78-4a92-aa5f-be6c17837785 req-d0deee43-0ebb-47b0-9c70-c7f3007d467f service nova] Lock "208130bc-5ece-4683-aa83-505ee89a8ba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:00:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-6c61929c-cc78-4a92-aa5f-be6c17837785 req-d0deee43-0ebb-47b0-9c70-c7f3007d467f service nova] Lock "208130bc-5ece-4683-aa83-505ee89a8ba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:00:45 user nova-compute[71113]: DEBUG nova.compute.manager [req-6c61929c-cc78-4a92-aa5f-be6c17837785 req-d0deee43-0ebb-47b0-9c70-c7f3007d467f service nova] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] No waiting events found dispatching network-vif-plugged-d8cb465d-1593-4491-b337-8528c1bcfb3e {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:00:45 user nova-compute[71113]: WARNING nova.compute.manager [req-6c61929c-cc78-4a92-aa5f-be6c17837785 req-d0deee43-0ebb-47b0-9c70-c7f3007d467f service nova] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Received unexpected event network-vif-plugged-d8cb465d-1593-4491-b337-8528c1bcfb3e for instance with vm_state shelved_offloaded and task_state spawning.
Jul 31 10:00:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:00:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:00:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:00:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:00:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:00:47 user nova-compute[71113]: DEBUG nova.compute.manager [req-60f24f63-fa6f-4cb6-af28-91ae15197f65 req-bbdaad76-0d5b-4ff0-85dc-32b1bb8a6783 service nova] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Received event network-vif-plugged-d8cb465d-1593-4491-b337-8528c1bcfb3e {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:00:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-60f24f63-fa6f-4cb6-af28-91ae15197f65 req-bbdaad76-0d5b-4ff0-85dc-32b1bb8a6783 service nova] Acquiring lock "208130bc-5ece-4683-aa83-505ee89a8ba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:00:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-60f24f63-fa6f-4cb6-af28-91ae15197f65 req-bbdaad76-0d5b-4ff0-85dc-32b1bb8a6783 service nova] Lock "208130bc-5ece-4683-aa83-505ee89a8ba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:00:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-60f24f63-fa6f-4cb6-af28-91ae15197f65 req-bbdaad76-0d5b-4ff0-85dc-32b1bb8a6783 service nova] Lock "208130bc-5ece-4683-aa83-505ee89a8ba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:00:47 user nova-compute[71113]: DEBUG nova.compute.manager [req-60f24f63-fa6f-4cb6-af28-91ae15197f65 req-bbdaad76-0d5b-4ff0-85dc-32b1bb8a6783 service nova] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] No waiting events found dispatching network-vif-plugged-d8cb465d-1593-4491-b337-8528c1bcfb3e {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:00:47 user nova-compute[71113]: WARNING nova.compute.manager [req-60f24f63-fa6f-4cb6-af28-91ae15197f65 req-bbdaad76-0d5b-4ff0-85dc-32b1bb8a6783 service nova] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Received unexpected event network-vif-plugged-d8cb465d-1593-4491-b337-8528c1bcfb3e for instance with vm_state shelved_offloaded and task_state spawning.
Jul 31 10:00:47 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797647.4988503, 208130bc-5ece-4683-aa83-505ee89a8ba5 => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:00:47 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] VM Resumed (Lifecycle Event)
Jul 31 10:00:47 user nova-compute[71113]: DEBUG nova.compute.manager [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 10:00:47 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 10:00:47 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Instance spawned successfully.
Jul 31 10:00:47 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:00:47 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:00:47 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 10:00:47 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797647.5001707, 208130bc-5ece-4683-aa83-505ee89a8ba5 => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:00:47 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] VM Started (Lifecycle Event)
Jul 31 10:00:47 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:00:47 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:00:47 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 10:00:47 user nova-compute[71113]: DEBUG nova.compute.manager [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:00:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "fc41eb59-d988-461c-941e-551ceb174ba1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:00:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "fc41eb59-d988-461c-941e-551ceb174ba1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:00:47 user nova-compute[71113]: DEBUG nova.compute.manager [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Starting instance... {{(pid=71113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 10:00:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1720783e-d987-494c-9cf9-8f941d3c00c5 tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "208130bc-5ece-4683-aa83-505ee89a8ba5" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 13.254s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:00:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:00:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:00:47 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 10:00:47 user nova-compute[71113]: INFO nova.compute.claims [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Claim successful on node user
Jul 31 10:00:48 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:00:48 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:00:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.430s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:00:48 user nova-compute[71113]: DEBUG nova.compute.manager [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Start building networks asynchronously for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 10:00:48 user nova-compute[71113]: DEBUG nova.compute.manager [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Allocating IP information in the background. {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 10:00:48 user nova-compute[71113]: DEBUG nova.network.neutron [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] allocate_for_instance() {{(pid=71113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 10:00:48 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 10:00:48 user nova-compute[71113]: DEBUG nova.compute.manager [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Start building block device mappings for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 10:00:48 user nova-compute[71113]: DEBUG nova.policy [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a58fe92488ed47b696fc5d6d990b1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa2add2e2a24b9cb8e48042b06931d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71113) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 10:00:48 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:00:48 user nova-compute[71113]: INFO nova.virt.block_device [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Booting with volume 167f63f2-13e2-4db5-89ef-ecffce1425e2 at /dev/vda
Jul 31 10:00:48 user nova-compute[71113]: DEBUG os_brick.utils [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:00:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:00:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:00:48 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[de44ca10-ed79-42ab-9163-e508632eb567]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:00:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:00:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:00:48 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[785e7580-eede-4024-be72-6e88db55ab0b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:00:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:00:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:00:48 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e466cb4-62df-48b3-971f-22d108648a2c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:00:48 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b217ca-f933-47b1-baf1-ba851f496c71]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:00:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:00:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 10:00:48 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 10:00:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:00:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 10:00:48 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 10:00:48 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad7cfce-9fba-4ce0-98c2-78d3faadabeb]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:00:48 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 10:00:48 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 10:00:48 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 10:00:48 user nova-compute[71113]: DEBUG os_brick.utils [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:00:48 user nova-compute[71113]: DEBUG nova.virt.block_device [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Updating existing volume attachment record: 53ac8bb6-5e61-4b8e-ae69-5311a0e5aedb {{(pid=71113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 10:00:49 user nova-compute[71113]: DEBUG nova.network.neutron [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Successfully created port: 4d104a96-94cd-48ed-bab3-0f6dd4ecefba {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 10:00:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:00:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:00:50 user nova-compute[71113]: DEBUG nova.network.neutron [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Successfully updated port: 4d104a96-94cd-48ed-bab3-0f6dd4ecefba {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 10:00:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "refresh_cache-fc41eb59-d988-461c-941e-551ceb174ba1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:00:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquired lock "refresh_cache-fc41eb59-d988-461c-941e-551ceb174ba1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:00:50 user nova-compute[71113]: DEBUG nova.network.neutron [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 10:00:50 user nova-compute[71113]: DEBUG nova.compute.manager [req-0da9e25d-b58c-4a34-9377-38900c491d13 req-892649b4-6c6a-4408-aa89-d045099dc124 service nova] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Received event network-changed-4d104a96-94cd-48ed-bab3-0f6dd4ecefba {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:00:50 user nova-compute[71113]: DEBUG nova.compute.manager [req-0da9e25d-b58c-4a34-9377-38900c491d13 req-892649b4-6c6a-4408-aa89-d045099dc124 service nova] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Refreshing instance network info cache due to event network-changed-4d104a96-94cd-48ed-bab3-0f6dd4ecefba. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 10:00:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-0da9e25d-b58c-4a34-9377-38900c491d13 req-892649b4-6c6a-4408-aa89-d045099dc124 service nova] Acquiring lock "refresh_cache-fc41eb59-d988-461c-941e-551ceb174ba1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:00:50 user nova-compute[71113]: DEBUG nova.network.neutron [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 10:00:50 user nova-compute[71113]: DEBUG nova.network.neutron [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Updating instance_info_cache with network_info: [{"id": "4d104a96-94cd-48ed-bab3-0f6dd4ecefba", "address": "fa:16:3e:dc:ea:ab", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d104a96-94", "ovs_interfaceid": "4d104a96-94cd-48ed-bab3-0f6dd4ecefba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:00:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Releasing lock "refresh_cache-fc41eb59-d988-461c-941e-551ceb174ba1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:00:50 user nova-compute[71113]: DEBUG nova.compute.manager [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Instance network_info: |[{"id": "4d104a96-94cd-48ed-bab3-0f6dd4ecefba", "address": "fa:16:3e:dc:ea:ab", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d104a96-94", "ovs_interfaceid": "4d104a96-94cd-48ed-bab3-0f6dd4ecefba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 10:00:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-0da9e25d-b58c-4a34-9377-38900c491d13 req-892649b4-6c6a-4408-aa89-d045099dc124 service nova] Acquired lock "refresh_cache-fc41eb59-d988-461c-941e-551ceb174ba1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:00:50 user nova-compute[71113]: DEBUG nova.network.neutron [req-0da9e25d-b58c-4a34-9377-38900c491d13 req-892649b4-6c6a-4408-aa89-d045099dc124 service nova] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Refreshing network info cache for port 4d104a96-94cd-48ed-bab3-0f6dd4ecefba {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 10:00:51 user nova-compute[71113]: DEBUG nova.network.neutron [req-0da9e25d-b58c-4a34-9377-38900c491d13 req-892649b4-6c6a-4408-aa89-d045099dc124 service nova] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Updated VIF entry in instance network info cache for port 4d104a96-94cd-48ed-bab3-0f6dd4ecefba. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 10:00:51 user nova-compute[71113]: DEBUG nova.network.neutron [req-0da9e25d-b58c-4a34-9377-38900c491d13 req-892649b4-6c6a-4408-aa89-d045099dc124 service nova] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Updating instance_info_cache with network_info: [{"id": "4d104a96-94cd-48ed-bab3-0f6dd4ecefba", "address": "fa:16:3e:dc:ea:ab", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d104a96-94", "ovs_interfaceid": "4d104a96-94cd-48ed-bab3-0f6dd4ecefba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:00:51 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-0da9e25d-b58c-4a34-9377-38900c491d13 req-892649b4-6c6a-4408-aa89-d045099dc124 service nova] Releasing lock "refresh_cache-fc41eb59-d988-461c-941e-551ceb174ba1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:00:52 user nova-compute[71113]: INFO nova.compute.manager [None req-5aab1284-bfaa-4c83-8a11-097ca7002c0c tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Get console output
Jul 31 10:00:53 user nova-compute[71113]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Jul 31 10:00:53 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:00:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:00:57 user nova-compute[71113]: DEBUG nova.compute.manager [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Start spawning the instance on the hypervisor. {{(pid=71113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 10:00:57 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 10:00:57 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Creating image(s)
Jul 31 10:00:57 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Did not create local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 10:00:57 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Ensure instance console log exists: /opt/stack/data/nova/instances/fc41eb59-d988-461c-941e-551ceb174ba1/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 10:00:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:00:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:00:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:00:57 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Start _get_guest_xml network_info=[{"id": "4d104a96-94cd-48ed-bab3-0f6dd4ecefba", "address": "fa:16:3e:dc:ea:ab", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d104a96-94", "ovs_interfaceid": "4d104a96-94cd-48ed-bab3-0f6dd4ecefba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '53ac8bb6-5e61-4b8e-ae69-5311a0e5aedb', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eWryYgdK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fc41eb59-d988-461c-941e-551ceb174ba1', 'attached_at': '', 'detached_at': '', 'volume_id': '167f63f2-13e2-4db5-89ef-ecffce1425e2', 'serial': '167f63f2-13e2-4db5-89ef-ecffce1425e2'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 10:00:57 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:00:57 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:00:57 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 10:00:57 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 10:00:57 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 10:00:57 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 10:00:57 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 10:00:57 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 10:00:57 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 10:00:57 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 10:00:57 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 10:00:57 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 10:00:57 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 10:00:57 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 10:00:57 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 10:00:57 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 10:00:57 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 10:00:57 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 10:00:57 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 10:00:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eWryYgdK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:00:57 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:00:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:00:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:00:57 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:00:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:00:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:00:57 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 10:00:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:00:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:00:57 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[80143d75-b3c9-45c9-9073-2f06fe1ab8f3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:00:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 10:00:57 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:00:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:00:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:00:57 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5094d7-1495-4ff5-9362-176b5c233ea6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:00:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2] added
Jul 31 10:00:57 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:00:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:00:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:00:57 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19fe090-b50f-497f-b7f3-5b12ddf8ade7]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:00:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:00:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:00:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:00:57 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32b7b41-b551-4a34-a8f7-2d4d80cedb42]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:00:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:00:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eWryYgdK {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:00:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eWryYgdK" returned: 0 in 0.025s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:00:57 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d355aeb-61d4-4d74-965e-90cc9d12bd18]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:00:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eWryYgdK'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:00:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:00:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:00:57 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9596e164-303d-4dc7-9b88-8f08427e5632]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:00:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:00:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:00:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:00:57 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc06b954-8ab8-44d5-bf56-51a3bd1d0c24]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:00:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:00:57 user nova-compute[71113]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)
Jul 31 10:00:57 user nova-compute[71113]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f (non-flash)
Jul 31 10:00:57 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:00:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:00:57 user nova-compute[71113]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)
Jul 31 10:00:57 user nova-compute[71113]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f (non-flash)
Jul 31 10:00:57 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:00:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:00:58 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:00:58 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5061f4-c427-46cb-8f25-d9636560f789]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:00:58 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2, portal: 172.16.0.220,3260]
Jul 31 10:00:58 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2, portal: 172.16.0.220,3260] successful.
Jul 31 10:00:58 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:00:58 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:00:58 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:00:58 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b721a250-ef34-42c9-9d47-8b19c486c375]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:00:58 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:00:58 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:00:58 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:00:58 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb522f3-3b69-45e2-9f2b-c255f5804e06]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:00:58 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:00:58 user nova-compute[71113]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)
Jul 31 10:00:58 user nova-compute[71113]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f (non-flash)
Jul 31 10:00:58 user nova-compute[71113]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 (non-flash)
Jul 31 10:00:58 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:00:58 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:00:58 user nova-compute[71113]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)
Jul 31 10:00:58 user nova-compute[71113]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f (non-flash)
Jul 31 10:00:58 user nova-compute[71113]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 (non-flash)
Jul 31 10:00:58 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:00:58 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:00:58 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 10:00:58 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] HCTL ('35', '-', '-', 0) found on session 37 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 10:00:58 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 10:00:58 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:00:58 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:00:58 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c1fd93-3965-487c-ac72-1e37858a2c46]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:00:58 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 10:00:58 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eWryYgdK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 10:00:58 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:00:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:00:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '23533656631666464', 'path': '/dev/sdd'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:00:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533656631666464', 'path': '/dev/sdd'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 10:00:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:00:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-828587170',display_name='tempest-TestVolumeBootPattern-volume-backed-server-828587170',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-828587170',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLhTIbqoaq8DvckwA1CLo1IxIbsIRYDKIRUzLU3okDrvx1mOchmqHcrnDofr+nCkdZ/QXp4Us2t+n/RpZ1Djg3NBjXF2gSLWtp8cT9PACuyPgxM6s4H0Cpbmc1kivd2RBA==',key_name='tempest-keypair-639827778',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3aa2add2e2a24b9cb8e48042b06931d3',ramdisk_id='',reservation_id='r-iex4d838',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1754399827',owner_user_name='tempest-TestVolumeBootPattern-1754399827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T10:00:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a58fe92488ed47b696fc5d6d990b1acd',uuid=fc41eb59-d988-461c-941e-551ceb174ba1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d104a96-94cd-48ed-bab3-0f6dd4ecefba", "address": "fa:16:3e:dc:ea:ab", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d104a96-94", "ovs_interfaceid": "4d104a96-94cd-48ed-bab3-0f6dd4ecefba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 10:00:59 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Converting VIF {"id": "4d104a96-94cd-48ed-bab3-0f6dd4ecefba", "address": "fa:16:3e:dc:ea:ab", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d104a96-94", "ovs_interfaceid": "4d104a96-94cd-48ed-bab3-0f6dd4ecefba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:00:59 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:ea:ab,bridge_name='br-int',has_traffic_filtering=True,id=4d104a96-94cd-48ed-bab3-0f6dd4ecefba,network=Network(fa792d7a-ddf6-4a2d-acb9-802f8daf87ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d104a96-94') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:00:59 user nova-compute[71113]: DEBUG nova.objects.instance [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lazy-loading 'pci_devices' on Instance uuid fc41eb59-d988-461c-941e-551ceb174ba1 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:00:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] End _get_guest_xml xml=<domain type="kvm">
Jul 31 10:00:59 user nova-compute[71113]:   <uuid>fc41eb59-d988-461c-941e-551ceb174ba1</uuid>
Jul 31 10:00:59 user nova-compute[71113]:   <name>instance-00000020</name>
Jul 31 10:00:59 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 10:00:59 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 10:00:59 user nova-compute[71113]:   <metadata>
Jul 31 10:00:59 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 10:00:59 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 10:00:59 user nova-compute[71113]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-828587170</nova:name>
Jul 31 10:00:59 user nova-compute[71113]:       <nova:creationTime>2023-07-31 10:00:57</nova:creationTime>
Jul 31 10:00:59 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 10:00:59 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 10:00:59 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 10:00:59 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 10:00:59 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 10:00:59 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 10:00:59 user nova-compute[71113]:       </nova:flavor>
Jul 31 10:00:59 user nova-compute[71113]:       <nova:owner>
Jul 31 10:00:59 user nova-compute[71113]:         <nova:user uuid="a58fe92488ed47b696fc5d6d990b1acd">tempest-TestVolumeBootPattern-1754399827-project-member</nova:user>
Jul 31 10:00:59 user nova-compute[71113]:         <nova:project uuid="3aa2add2e2a24b9cb8e48042b06931d3">tempest-TestVolumeBootPattern-1754399827</nova:project>
Jul 31 10:00:59 user nova-compute[71113]:       </nova:owner>
Jul 31 10:00:59 user nova-compute[71113]:       <nova:ports>
Jul 31 10:00:59 user nova-compute[71113]:         <nova:port uuid="4d104a96-94cd-48ed-bab3-0f6dd4ecefba">
Jul 31 10:00:59 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 31 10:00:59 user nova-compute[71113]:         </nova:port>
Jul 31 10:00:59 user nova-compute[71113]:       </nova:ports>
Jul 31 10:00:59 user nova-compute[71113]:     </nova:instance>
Jul 31 10:00:59 user nova-compute[71113]:   </metadata>
Jul 31 10:00:59 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 10:00:59 user nova-compute[71113]:     <system>
Jul 31 10:00:59 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 10:00:59 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 10:00:59 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 10:00:59 user nova-compute[71113]:       <entry name="serial">fc41eb59-d988-461c-941e-551ceb174ba1</entry>
Jul 31 10:00:59 user nova-compute[71113]:       <entry name="uuid">fc41eb59-d988-461c-941e-551ceb174ba1</entry>
Jul 31 10:00:59 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 10:00:59 user nova-compute[71113]:     </system>
Jul 31 10:00:59 user nova-compute[71113]:   </sysinfo>
Jul 31 10:00:59 user nova-compute[71113]:   <os>
Jul 31 10:00:59 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 10:00:59 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 10:00:59 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 10:00:59 user nova-compute[71113]:   </os>
Jul 31 10:00:59 user nova-compute[71113]:   <features>
Jul 31 10:00:59 user nova-compute[71113]:     <acpi/>
Jul 31 10:00:59 user nova-compute[71113]:     <apic/>
Jul 31 10:00:59 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 10:00:59 user nova-compute[71113]:   </features>
Jul 31 10:00:59 user nova-compute[71113]:   <clock offset="utc">
Jul 31 10:00:59 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 10:00:59 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 10:00:59 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 10:00:59 user nova-compute[71113]:   </clock>
Jul 31 10:00:59 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 10:00:59 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 10:00:59 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 10:00:59 user nova-compute[71113]:   </cpu>
Jul 31 10:00:59 user nova-compute[71113]:   <devices>
Jul 31 10:00:59 user nova-compute[71113]:     <disk type="block" device="disk">
Jul 31 10:00:59 user nova-compute[71113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:00:59 user nova-compute[71113]:       <source dev="/dev/sdd"/>
Jul 31 10:00:59 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 10:00:59 user nova-compute[71113]:       <serial>167f63f2-13e2-4db5-89ef-ecffce1425e2</serial>
Jul 31 10:00:59 user nova-compute[71113]:     </disk>
Jul 31 10:00:59 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 10:00:59 user nova-compute[71113]:       <mac address="fa:16:3e:dc:ea:ab"/>
Jul 31 10:00:59 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:00:59 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 10:00:59 user nova-compute[71113]:       <target dev="tap4d104a96-94"/>
Jul 31 10:00:59 user nova-compute[71113]:     </interface>
Jul 31 10:00:59 user nova-compute[71113]:     <serial type="pty">
Jul 31 10:00:59 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/fc41eb59-d988-461c-941e-551ceb174ba1/console.log" append="off"/>
Jul 31 10:00:59 user nova-compute[71113]:     </serial>
Jul 31 10:00:59 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 10:00:59 user nova-compute[71113]:     <video>
Jul 31 10:00:59 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:00:59 user nova-compute[71113]:     </video>
Jul 31 10:00:59 user nova-compute[71113]:     <rng model="virtio">
Jul 31 10:00:59 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 10:00:59 user nova-compute[71113]:     </rng>
Jul 31 10:00:59 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 10:00:59 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 10:00:59 user nova-compute[71113]:       <stats period="10"/>
Jul 31 10:00:59 user nova-compute[71113]:     </memballoon>
Jul 31 10:00:59 user nova-compute[71113]:   </devices>
Jul 31 10:00:59 user nova-compute[71113]: </domain>
Jul 31 10:00:59 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 10:00:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:00:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-828587170',display_name='tempest-TestVolumeBootPattern-volume-backed-server-828587170',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-828587170',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLhTIbqoaq8DvckwA1CLo1IxIbsIRYDKIRUzLU3okDrvx1mOchmqHcrnDofr+nCkdZ/QXp4Us2t+n/RpZ1Djg3NBjXF2gSLWtp8cT9PACuyPgxM6s4H0Cpbmc1kivd2RBA==',key_name='tempest-keypair-639827778',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3aa2add2e2a24b9cb8e48042b06931d3',ramdisk_id='',reservation_id='r-iex4d838',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1754399827',owner_user_name='tempest-TestVolumeBootPattern-1754399827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T10:00:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a58fe92488ed47b696fc5d6d990b1acd',uuid=fc41eb59-d988-461c-941e-551ceb174ba1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d104a96-94cd-48ed-bab3-0f6dd4ecefba", "address": "fa:16:3e:dc:ea:ab", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d104a96-94", "ovs_interfaceid": "4d104a96-94cd-48ed-bab3-0f6dd4ecefba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 10:00:59 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Converting VIF {"id": "4d104a96-94cd-48ed-bab3-0f6dd4ecefba", "address": "fa:16:3e:dc:ea:ab", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d104a96-94", "ovs_interfaceid": "4d104a96-94cd-48ed-bab3-0f6dd4ecefba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:00:59 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:ea:ab,bridge_name='br-int',has_traffic_filtering=True,id=4d104a96-94cd-48ed-bab3-0f6dd4ecefba,network=Network(fa792d7a-ddf6-4a2d-acb9-802f8daf87ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d104a96-94') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:00:59 user nova-compute[71113]: DEBUG os_vif [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:ea:ab,bridge_name='br-int',has_traffic_filtering=True,id=4d104a96-94cd-48ed-bab3-0f6dd4ecefba,network=Network(fa792d7a-ddf6-4a2d-acb9-802f8daf87ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d104a96-94') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 10:00:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:00:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:00:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 10:00:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:00:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d104a96-94, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:00:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4d104a96-94, col_values=(('external_ids', {'iface-id': '4d104a96-94cd-48ed-bab3-0f6dd4ecefba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:ea:ab', 'vm-uuid': 'fc41eb59-d988-461c-941e-551ceb174ba1'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:00:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:00:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:00:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:00:59 user nova-compute[71113]: INFO os_vif [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:ea:ab,bridge_name='br-int',has_traffic_filtering=True,id=4d104a96-94cd-48ed-bab3-0f6dd4ecefba,network=Network(fa792d7a-ddf6-4a2d-acb9-802f8daf87ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d104a96-94')
Jul 31 10:00:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:00:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] No VIF found with MAC fa:16:3e:dc:ea:ab, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 10:01:00 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:00 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:00 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:01 user nova-compute[71113]: DEBUG nova.compute.manager [req-d9d1e132-59bf-45e9-a1a3-3a63f9840ca0 req-4b11fa19-e714-4ad2-b50e-cf8118aa9e7f service nova] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Received event network-vif-plugged-4d104a96-94cd-48ed-bab3-0f6dd4ecefba {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:01:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-d9d1e132-59bf-45e9-a1a3-3a63f9840ca0 req-4b11fa19-e714-4ad2-b50e-cf8118aa9e7f service nova] Acquiring lock "fc41eb59-d988-461c-941e-551ceb174ba1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:01:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-d9d1e132-59bf-45e9-a1a3-3a63f9840ca0 req-4b11fa19-e714-4ad2-b50e-cf8118aa9e7f service nova] Lock "fc41eb59-d988-461c-941e-551ceb174ba1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:01:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-d9d1e132-59bf-45e9-a1a3-3a63f9840ca0 req-4b11fa19-e714-4ad2-b50e-cf8118aa9e7f service nova] Lock "fc41eb59-d988-461c-941e-551ceb174ba1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:01:01 user nova-compute[71113]: DEBUG nova.compute.manager [req-d9d1e132-59bf-45e9-a1a3-3a63f9840ca0 req-4b11fa19-e714-4ad2-b50e-cf8118aa9e7f service nova] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] No waiting events found dispatching network-vif-plugged-4d104a96-94cd-48ed-bab3-0f6dd4ecefba {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:01:01 user nova-compute[71113]: WARNING nova.compute.manager [req-d9d1e132-59bf-45e9-a1a3-3a63f9840ca0 req-4b11fa19-e714-4ad2-b50e-cf8118aa9e7f service nova] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Received unexpected event network-vif-plugged-4d104a96-94cd-48ed-bab3-0f6dd4ecefba for instance with vm_state building and task_state spawning.
Jul 31 10:01:01 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:01 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:01 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:01 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:03 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:03 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797663.2159598, fc41eb59-d988-461c-941e-551ceb174ba1 => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:01:03 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] VM Resumed (Lifecycle Event)
Jul 31 10:01:03 user nova-compute[71113]: DEBUG nova.compute.manager [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 10:01:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 10:01:03 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Instance spawned successfully.
Jul 31 10:01:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 10:01:03 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:01:03 user nova-compute[71113]: DEBUG nova.compute.manager [req-77c45d5b-a5ff-4722-a3f1-144c89a9c1fb req-b45f4236-4072-4989-87c8-6fea3cd10afb service nova] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Received event network-vif-plugged-4d104a96-94cd-48ed-bab3-0f6dd4ecefba {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:01:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-77c45d5b-a5ff-4722-a3f1-144c89a9c1fb req-b45f4236-4072-4989-87c8-6fea3cd10afb service nova] Acquiring lock "fc41eb59-d988-461c-941e-551ceb174ba1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:01:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-77c45d5b-a5ff-4722-a3f1-144c89a9c1fb req-b45f4236-4072-4989-87c8-6fea3cd10afb service nova] Lock "fc41eb59-d988-461c-941e-551ceb174ba1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:01:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-77c45d5b-a5ff-4722-a3f1-144c89a9c1fb req-b45f4236-4072-4989-87c8-6fea3cd10afb service nova] Lock "fc41eb59-d988-461c-941e-551ceb174ba1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:01:03 user nova-compute[71113]: DEBUG nova.compute.manager [req-77c45d5b-a5ff-4722-a3f1-144c89a9c1fb req-b45f4236-4072-4989-87c8-6fea3cd10afb service nova] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] No waiting events found dispatching network-vif-plugged-4d104a96-94cd-48ed-bab3-0f6dd4ecefba {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:01:03 user nova-compute[71113]: WARNING nova.compute.manager [req-77c45d5b-a5ff-4722-a3f1-144c89a9c1fb req-b45f4236-4072-4989-87c8-6fea3cd10afb service nova] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Received unexpected event network-vif-plugged-4d104a96-94cd-48ed-bab3-0f6dd4ecefba for instance with vm_state building and task_state spawning.
Jul 31 10:01:03 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:01:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Found default for hw_cdrom_bus of ide {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:01:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Found default for hw_disk_bus of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:01:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Found default for hw_input_bus of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:01:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Found default for hw_pointer_model of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:01:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Found default for hw_video_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:01:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Found default for hw_vif_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:01:03 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 10:01:03 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797663.2173214, fc41eb59-d988-461c-941e-551ceb174ba1 => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:01:03 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] VM Started (Lifecycle Event)
Jul 31 10:01:03 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:01:03 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:01:03 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 10:01:03 user nova-compute[71113]: INFO nova.compute.manager [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Took 5.70 seconds to spawn the instance on the hypervisor.
Jul 31 10:01:03 user nova-compute[71113]: DEBUG nova.compute.manager [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:01:03 user nova-compute[71113]: INFO nova.compute.manager [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Took 15.52 seconds to build instance.
Jul 31 10:01:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-749d5d17-4db0-4962-bbda-5c9a8b9ad529 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "fc41eb59-d988-461c-941e-551ceb174ba1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.674s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:01:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:07 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:09 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:01:09 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:01:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:10 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:01:10 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:01:10 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:01:10 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:01:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:01:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:01:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:01:10 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:01:10 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 10:01:10 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 10:01:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/208130bc-5ece-4683-aa83-505ee89a8ba5/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/208130bc-5ece-4683-aa83-505ee89a8ba5/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/208130bc-5ece-4683-aa83-505ee89a8ba5/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/208130bc-5ece-4683-aa83-505ee89a8ba5/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b88201-04dc-4da9-b213-c50cdf274f4e/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b88201-04dc-4da9-b213-c50cdf274f4e/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b88201-04dc-4da9-b213-c50cdf274f4e/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b88201-04dc-4da9-b213-c50cdf274f4e/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f020f166-07b6-4cf5-9f17-2ab108b55c30/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f020f166-07b6-4cf5-9f17-2ab108b55c30/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f020f166-07b6-4cf5-9f17-2ab108b55c30/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f020f166-07b6-4cf5-9f17-2ab108b55c30/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:11 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 10:01:11 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:12 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:12 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:12 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:12 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:12 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:12 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:12 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:12 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 10:01:13 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:01:13 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:01:13 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=7781MB free_disk=25.307693481445312GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:01:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:01:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:01:13 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 0ea0401b-26c2-4655-956b-1bc000debd53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:01:13 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 3157a7a6-b8a9-4e2d-a157-360bce4c625d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:01:13 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 92d25a03-98ce-4bde-a3cc-20313ae77d41 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:01:13 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance a950d710-4596-4355-ac31-568c7728335a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:01:13 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance c4b88201-04dc-4da9-b213-c50cdf274f4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:01:13 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance f020f166-07b6-4cf5-9f17-2ab108b55c30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:01:13 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 9b01d025-2fe7-4ed9-827d-0546134b08a7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:01:13 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 208130bc-5ece-4683-aa83-505ee89a8ba5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:01:13 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance fc41eb59-d988-461c-941e-551ceb174ba1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:01:13 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:01:13 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:01:13 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:01:13 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:01:13 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:01:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.542s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:01:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:14 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:01:14 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:01:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "refresh_cache-92d25a03-98ce-4bde-a3cc-20313ae77d41" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:01:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquired lock "refresh_cache-92d25a03-98ce-4bde-a3cc-20313ae77d41" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:01:15 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Forcefully refreshing network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 10:01:16 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Updating instance_info_cache with network_info: [{"id": "e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d", "address": "fa:16:3e:2c:5b:c3", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape82fc7e2-25", "ovs_interfaceid": "e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:01:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Releasing lock "refresh_cache-92d25a03-98ce-4bde-a3cc-20313ae77d41" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:01:16 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Updated the network info_cache for instance {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 10:01:16 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:01:16 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:01:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:20 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:01:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:22 user nova-compute[71113]: DEBUG nova.compute.manager [None req-19da809e-bc4e-4b0d-a583-a4e68d9c77df tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:01:23 user nova-compute[71113]: INFO nova.compute.manager [None req-19da809e-bc4e-4b0d-a583-a4e68d9c77df tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] instance snapshotting
Jul 31 10:01:23 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-19da809e-bc4e-4b0d-a583-a4e68d9c77df tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Beginning live snapshot process
Jul 31 10:01:23 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-19da809e-bc4e-4b0d-a583-a4e68d9c77df tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f020f166-07b6-4cf5-9f17-2ab108b55c30/disk --force-share --output=json -f qcow2 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:23 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-19da809e-bc4e-4b0d-a583-a4e68d9c77df tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f020f166-07b6-4cf5-9f17-2ab108b55c30/disk --force-share --output=json -f qcow2" returned: 0 in 0.144s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:23 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-19da809e-bc4e-4b0d-a583-a4e68d9c77df tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f020f166-07b6-4cf5-9f17-2ab108b55c30/disk --force-share --output=json -f qcow2 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:23 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-19da809e-bc4e-4b0d-a583-a4e68d9c77df tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f020f166-07b6-4cf5-9f17-2ab108b55c30/disk --force-share --output=json -f qcow2" returned: 0 in 0.150s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:23 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-19da809e-bc4e-4b0d-a583-a4e68d9c77df tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:23 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-19da809e-bc4e-4b0d-a583-a4e68d9c77df tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.143s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:23 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-19da809e-bc4e-4b0d-a583-a4e68d9c77df tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpr4wgofk8/92ac9b69150f46dda4fd1a33bd01fbc8.delta 1073741824 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:23 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-19da809e-bc4e-4b0d-a583-a4e68d9c77df tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpr4wgofk8/92ac9b69150f46dda4fd1a33bd01fbc8.delta 1073741824" returned: 0 in 0.050s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:23 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-19da809e-bc4e-4b0d-a583-a4e68d9c77df tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 31 10:01:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:24 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-19da809e-bc4e-4b0d-a583-a4e68d9c77df tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=71113) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 10:01:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:25 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-19da809e-bc4e-4b0d-a583-a4e68d9c77df tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=71113) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 10:01:25 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-19da809e-bc4e-4b0d-a583-a4e68d9c77df tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 31 10:01:25 user nova-compute[71113]: DEBUG nova.privsep.utils [None req-19da809e-bc4e-4b0d-a583-a4e68d9c77df tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71113) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 10:01:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-19da809e-bc4e-4b0d-a583-a4e68d9c77df tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpr4wgofk8/92ac9b69150f46dda4fd1a33bd01fbc8.delta /opt/stack/data/nova/instances/snapshots/tmpr4wgofk8/92ac9b69150f46dda4fd1a33bd01fbc8 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-19da809e-bc4e-4b0d-a583-a4e68d9c77df tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpr4wgofk8/92ac9b69150f46dda4fd1a33bd01fbc8.delta /opt/stack/data/nova/instances/snapshots/tmpr4wgofk8/92ac9b69150f46dda4fd1a33bd01fbc8" returned: 0 in 0.690s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:25 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-19da809e-bc4e-4b0d-a583-a4e68d9c77df tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Snapshot extracted, beginning image upload
Jul 31 10:01:28 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-19da809e-bc4e-4b0d-a583-a4e68d9c77df tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Snapshot image upload complete
Jul 31 10:01:28 user nova-compute[71113]: INFO nova.compute.manager [None req-19da809e-bc4e-4b0d-a583-a4e68d9c77df tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Took 5.50 seconds to snapshot the instance on the hypervisor.
Jul 31 10:01:28 user nova-compute[71113]: DEBUG nova.compute.manager [req-35b6eaf2-6048-4586-a4fc-ae347f9b2565 req-5ed54168-75a8-4f90-aa8d-26ee7744c159 service nova] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Received event network-changed-cc8f812f-2fff-475e-a41e-abf390366863 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:01:28 user nova-compute[71113]: DEBUG nova.compute.manager [req-35b6eaf2-6048-4586-a4fc-ae347f9b2565 req-5ed54168-75a8-4f90-aa8d-26ee7744c159 service nova] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Refreshing instance network info cache due to event network-changed-cc8f812f-2fff-475e-a41e-abf390366863. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 10:01:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-35b6eaf2-6048-4586-a4fc-ae347f9b2565 req-5ed54168-75a8-4f90-aa8d-26ee7744c159 service nova] Acquiring lock "refresh_cache-9b01d025-2fe7-4ed9-827d-0546134b08a7" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:01:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-35b6eaf2-6048-4586-a4fc-ae347f9b2565 req-5ed54168-75a8-4f90-aa8d-26ee7744c159 service nova] Acquired lock "refresh_cache-9b01d025-2fe7-4ed9-827d-0546134b08a7" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:01:28 user nova-compute[71113]: DEBUG nova.network.neutron [req-35b6eaf2-6048-4586-a4fc-ae347f9b2565 req-5ed54168-75a8-4f90-aa8d-26ee7744c159 service nova] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Refreshing network info cache for port cc8f812f-2fff-475e-a41e-abf390366863 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 10:01:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:29 user nova-compute[71113]: DEBUG nova.network.neutron [req-35b6eaf2-6048-4586-a4fc-ae347f9b2565 req-5ed54168-75a8-4f90-aa8d-26ee7744c159 service nova] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Updated VIF entry in instance network info cache for port cc8f812f-2fff-475e-a41e-abf390366863. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 10:01:29 user nova-compute[71113]: DEBUG nova.network.neutron [req-35b6eaf2-6048-4586-a4fc-ae347f9b2565 req-5ed54168-75a8-4f90-aa8d-26ee7744c159 service nova] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Updating instance_info_cache with network_info: [{"id": "cc8f812f-2fff-475e-a41e-abf390366863", "address": "fa:16:3e:61:8f:df", "network": {"id": "5f333808-4342-4014-9221-7ccd394eff66", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-42408734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4b02badf8ea4f32a5e259c25120eac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc8f812f-2f", "ovs_interfaceid": "cc8f812f-2fff-475e-a41e-abf390366863", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:01:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-35b6eaf2-6048-4586-a4fc-ae347f9b2565 req-5ed54168-75a8-4f90-aa8d-26ee7744c159 service nova] Releasing lock "refresh_cache-9b01d025-2fe7-4ed9-827d-0546134b08a7" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:01:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:30 user nova-compute[71113]: INFO nova.compute.manager [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Rebuilding instance
Jul 31 10:01:30 user nova-compute[71113]: DEBUG nova.objects.instance [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9b01d025-2fe7-4ed9-827d-0546134b08a7 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:01:30 user nova-compute[71113]: DEBUG nova.compute.manager [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:01:30 user nova-compute[71113]: DEBUG nova.objects.instance [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lazy-loading 'pci_requests' on Instance uuid 9b01d025-2fe7-4ed9-827d-0546134b08a7 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:01:30 user nova-compute[71113]: DEBUG nova.objects.instance [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lazy-loading 'pci_devices' on Instance uuid 9b01d025-2fe7-4ed9-827d-0546134b08a7 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:01:30 user nova-compute[71113]: DEBUG nova.objects.instance [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lazy-loading 'resources' on Instance uuid 9b01d025-2fe7-4ed9-827d-0546134b08a7 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:01:30 user nova-compute[71113]: DEBUG nova.objects.instance [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lazy-loading 'migration_context' on Instance uuid 9b01d025-2fe7-4ed9-827d-0546134b08a7 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:01:30 user nova-compute[71113]: DEBUG nova.objects.instance [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71113) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Jul 31 10:01:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:30 user nova-compute[71113]: DEBUG nova.compute.manager [req-78ef875a-6977-4b73-9595-f33f127c8e0c req-f4840cdc-1746-44a9-b240-c013cbffde30 service nova] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Received event network-vif-unplugged-cc8f812f-2fff-475e-a41e-abf390366863 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:01:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-78ef875a-6977-4b73-9595-f33f127c8e0c req-f4840cdc-1746-44a9-b240-c013cbffde30 service nova] Acquiring lock "9b01d025-2fe7-4ed9-827d-0546134b08a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:01:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-78ef875a-6977-4b73-9595-f33f127c8e0c req-f4840cdc-1746-44a9-b240-c013cbffde30 service nova] Lock "9b01d025-2fe7-4ed9-827d-0546134b08a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:01:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-78ef875a-6977-4b73-9595-f33f127c8e0c req-f4840cdc-1746-44a9-b240-c013cbffde30 service nova] Lock "9b01d025-2fe7-4ed9-827d-0546134b08a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:01:30 user nova-compute[71113]: DEBUG nova.compute.manager [req-78ef875a-6977-4b73-9595-f33f127c8e0c req-f4840cdc-1746-44a9-b240-c013cbffde30 service nova] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] No waiting events found dispatching network-vif-unplugged-cc8f812f-2fff-475e-a41e-abf390366863 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:01:30 user nova-compute[71113]: WARNING nova.compute.manager [req-78ef875a-6977-4b73-9595-f33f127c8e0c req-f4840cdc-1746-44a9-b240-c013cbffde30 service nova] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Received unexpected event network-vif-unplugged-cc8f812f-2fff-475e-a41e-abf390366863 for instance with vm_state active and task_state rebuilding.
Jul 31 10:01:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:31 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Instance destroyed successfully.
Jul 31 10:01:31 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Instance destroyed successfully.
Jul 31 10:01:31 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:59:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-53810513',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-972438511',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMN/Rb0UqXjD4v1BBxetpe4UPNYObazNnGN7FxKdXTvz2iyzNZUZD6rIfXejF9ItEE9BSDAPgEkcwdmUFy1RLvhZdWlT7mUS0xbJEpPYT/4mz1Vn4Dur4VHq0XzU1g9+4Q==',key_name='tempest-keypair-1593349916',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:59:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e4b02badf8ea4f32a5e259c25120eac7',ramdisk_id='',reservation_id='r-6qeaa7mv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1497143588',owner_user_name='tempest-ServerActionsV293TestJSON-1497143588-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T10:01:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba2fd55dd96b4c49bb0c1c98c0a724d4',uuid=9b01d025-2fe7-4ed9-827d-0546134b08a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc8f812f-2fff-475e-a41e-abf390366863", "address": "fa:16:3e:61:8f:df", "network": {"id": "5f333808-4342-4014-9221-7ccd394eff66", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-42408734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4b02badf8ea4f32a5e259c25120eac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc8f812f-2f", "ovs_interfaceid": "cc8f812f-2fff-475e-a41e-abf390366863", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Converting VIF {"id": "cc8f812f-2fff-475e-a41e-abf390366863", "address": "fa:16:3e:61:8f:df", "network": {"id": "5f333808-4342-4014-9221-7ccd394eff66", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-42408734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4b02badf8ea4f32a5e259c25120eac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc8f812f-2f", "ovs_interfaceid": "cc8f812f-2fff-475e-a41e-abf390366863", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:8f:df,bridge_name='br-int',has_traffic_filtering=True,id=cc8f812f-2fff-475e-a41e-abf390366863,network=Network(5f333808-4342-4014-9221-7ccd394eff66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc8f812f-2f') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG os_vif [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:8f:df,bridge_name='br-int',has_traffic_filtering=True,id=cc8f812f-2fff-475e-a41e-abf390366863,network=Network(5f333808-4342-4014-9221-7ccd394eff66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc8f812f-2f') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc8f812f-2f, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:31 user nova-compute[71113]: INFO os_vif [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:8f:df,bridge_name='br-int',has_traffic_filtering=True,id=cc8f812f-2fff-475e-a41e-abf390366863,network=Network(5f333808-4342-4014-9221-7ccd394eff66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc8f812f-2f')
Jul 31 10:01:31 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kSRbiupj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:01:31 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 31 10:01:31 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37a0d9c-f67a-48be-84fa-da4bb4137039]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d32bee7-6400-456d-a9a7-13eb1dbb1102]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:01:31 user nova-compute[71113]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)
Jul 31 10:01:31 user nova-compute[71113]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f (non-flash)
Jul 31 10:01:31 user nova-compute[71113]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 (non-flash)
Jul 31 10:01:31 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:01:31 user nova-compute[71113]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)
Jul 31 10:01:31 user nova-compute[71113]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f (non-flash)
Jul 31 10:01:31 user nova-compute[71113]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 (non-flash)
Jul 31 10:01:31 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f78f07ad000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f'): ({'sdc'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Removing single pathed devices sdc {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b257dc-1fb0-4fe8-8070-c416ac2a0fe5]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77f58f0-fd9c-40c5-ab97-576f057a6600]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Flushing IO for device /dev/sdc {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7040c041-fa45-4bc6-bff2-d1796c714fda]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.059s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[50aec5ae-f5c0-41ee-8492-ebc9a50ac598]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] SCSI volumes sdc have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf9b51e-f542-4e96-8eed-31a64ae1e85a]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a5aec9-39e6-4a58-9a43-f2548be1c19b]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f, portal: 172.16.0.220,3260]
Jul 31 10:01:31 user nova-compute[71113]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f, portal: 172.16.0.220,3260] successful.
Jul 31 10:01:31 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a5fd00-52f3-4a4d-98d1-2d144be68f4a]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] <== disconnect_volume: return (309ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 10:01:31 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Deleting instance files /opt/stack/data/nova/instances/9b01d025-2fe7-4ed9-827d-0546134b08a7_del
Jul 31 10:01:31 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Deletion of /opt/stack/data/nova/instances/9b01d025-2fe7-4ed9-827d-0546134b08a7_del complete
Jul 31 10:01:31 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 9b01d025-2fe7-4ed9-827d-0546134b08a7 could not be found.
Jul 31 10:01:31 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kSRbiupj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:01:31 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 31 10:01:31 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3977184-9f94-496f-bf15-d0841605f698]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d779df-47d8-49f8-a906-da969fde52ee]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:01:31 user nova-compute[71113]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)
Jul 31 10:01:31 user nova-compute[71113]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 (non-flash)
Jul 31 10:01:31 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:01:31 user nova-compute[71113]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)
Jul 31 10:01:31 user nova-compute[71113]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 (non-flash)
Jul 31 10:01:31 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f78f0792830>, {}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Disconnecting from: [] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.046s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] <== disconnect_volume: return (47ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:01:31 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 10:01:32 user nova-compute[71113]: DEBUG nova.compute.manager [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Preparing to wait for external event volume-reimaged-4fa00a07-19dc-4a82-b9a0-6625e649403f {{(pid=71113) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Jul 31 10:01:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Acquiring lock "9b01d025-2fe7-4ed9-827d-0546134b08a7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:01:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lock "9b01d025-2fe7-4ed9-827d-0546134b08a7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:01:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lock "9b01d025-2fe7-4ed9-827d-0546134b08a7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:01:32 user nova-compute[71113]: DEBUG nova.compute.manager [req-6d7094d4-169a-4134-9d0f-6b1dd583e6b9 req-88560a3b-f307-43ee-93ea-c5dbf54eae35 service nova] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Received event network-vif-plugged-cc8f812f-2fff-475e-a41e-abf390366863 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:01:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-6d7094d4-169a-4134-9d0f-6b1dd583e6b9 req-88560a3b-f307-43ee-93ea-c5dbf54eae35 service nova] Acquiring lock "9b01d025-2fe7-4ed9-827d-0546134b08a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:01:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-6d7094d4-169a-4134-9d0f-6b1dd583e6b9 req-88560a3b-f307-43ee-93ea-c5dbf54eae35 service nova] Lock "9b01d025-2fe7-4ed9-827d-0546134b08a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:01:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-6d7094d4-169a-4134-9d0f-6b1dd583e6b9 req-88560a3b-f307-43ee-93ea-c5dbf54eae35 service nova] Lock "9b01d025-2fe7-4ed9-827d-0546134b08a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:01:32 user nova-compute[71113]: DEBUG nova.compute.manager [req-6d7094d4-169a-4134-9d0f-6b1dd583e6b9 req-88560a3b-f307-43ee-93ea-c5dbf54eae35 service nova] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] No event matching network-vif-plugged-cc8f812f-2fff-475e-a41e-abf390366863 in dict_keys([('volume-reimaged', '4fa00a07-19dc-4a82-b9a0-6625e649403f')]) {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:325}}
Jul 31 10:01:32 user nova-compute[71113]: WARNING nova.compute.manager [req-6d7094d4-169a-4134-9d0f-6b1dd583e6b9 req-88560a3b-f307-43ee-93ea-c5dbf54eae35 service nova] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Received unexpected event network-vif-plugged-cc8f812f-2fff-475e-a41e-abf390366863 for instance with vm_state active and task_state rebuilding.
Jul 31 10:01:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Acquiring lock "5ffa30ea-7458-4914-a6f4-9d8310ca977c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:01:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Lock "5ffa30ea-7458-4914-a6f4-9d8310ca977c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:01:39 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Starting instance... {{(pid=71113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 10:01:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:01:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:01:39 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 10:01:39 user nova-compute[71113]: INFO nova.compute.claims [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Claim successful on node user
Jul 31 10:01:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:40 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:01:40 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:01:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.476s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:01:40 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Start building networks asynchronously for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 10:01:40 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Allocating IP information in the background. {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 10:01:40 user nova-compute[71113]: DEBUG nova.network.neutron [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] allocate_for_instance() {{(pid=71113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 10:01:40 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 10:01:40 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Start building block device mappings for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 10:01:40 user nova-compute[71113]: INFO nova.virt.block_device [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Booting with volume 561d8e35-12d8-4f9f-878d-dd377eb2394d at /dev/vda
Jul 31 10:01:40 user nova-compute[71113]: DEBUG nova.policy [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '31f12483848e44098cbb078851c5f8d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c17b9322f9049d390ad212ad8ce7905', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71113) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 10:01:40 user nova-compute[71113]: DEBUG os_brick.utils [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:01:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:40 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8130699-0d16-4124-97e6-755f276a0fb1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:01:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:40 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0d9e65-2cee-44e3-b90b-349cca4cb959]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:01:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:40 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b52ab02-3fcf-4953-8d69-24b9e5208be9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:01:40 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32fc660-1cda-459a-818b-16503c411083]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:01:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 10:01:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 10:01:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 10:01:40 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 10:01:40 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a7fcba-47ba-4528-b1ef-0404fc9c068c]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:01:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 10:01:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 10:01:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 10:01:40 user nova-compute[71113]: DEBUG os_brick.utils [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:01:40 user nova-compute[71113]: DEBUG nova.virt.block_device [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Updating existing volume attachment record: 8c35f29e-a54e-4134-a8ff-678ee0bb90c2 {{(pid=71113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 10:01:41 user nova-compute[71113]: DEBUG nova.network.neutron [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Successfully created port: 8a38b464-522f-48bd-90b6-4447f9a6eb21 {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 10:01:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:42 user nova-compute[71113]: DEBUG nova.network.neutron [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Successfully updated port: 8a38b464-522f-48bd-90b6-4447f9a6eb21 {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 10:01:42 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Acquiring lock "refresh_cache-5ffa30ea-7458-4914-a6f4-9d8310ca977c" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:01:42 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Acquired lock "refresh_cache-5ffa30ea-7458-4914-a6f4-9d8310ca977c" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:01:42 user nova-compute[71113]: DEBUG nova.network.neutron [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 10:01:42 user nova-compute[71113]: DEBUG nova.compute.manager [req-022c697d-aa50-45d6-9e3b-9b5cbf11fd94 req-4bf4bec5-59a5-45cf-a5e3-d1c95670a8fa service nova] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Received event network-changed-8a38b464-522f-48bd-90b6-4447f9a6eb21 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:01:42 user nova-compute[71113]: DEBUG nova.compute.manager [req-022c697d-aa50-45d6-9e3b-9b5cbf11fd94 req-4bf4bec5-59a5-45cf-a5e3-d1c95670a8fa service nova] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Refreshing instance network info cache due to event network-changed-8a38b464-522f-48bd-90b6-4447f9a6eb21. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 10:01:42 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-022c697d-aa50-45d6-9e3b-9b5cbf11fd94 req-4bf4bec5-59a5-45cf-a5e3-d1c95670a8fa service nova] Acquiring lock "refresh_cache-5ffa30ea-7458-4914-a6f4-9d8310ca977c" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:01:42 user nova-compute[71113]: DEBUG nova.network.neutron [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 10:01:42 user nova-compute[71113]: DEBUG nova.network.neutron [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Updating instance_info_cache with network_info: [{"id": "8a38b464-522f-48bd-90b6-4447f9a6eb21", "address": "fa:16:3e:8f:24:b1", "network": {"id": "a88a6414-c6fd-4581-bbb5-7250ebcb1345", "bridge": "br-int", "label": "tempest-TestShelveInstance-1094508903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c17b9322f9049d390ad212ad8ce7905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a38b464-52", "ovs_interfaceid": "8a38b464-522f-48bd-90b6-4447f9a6eb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:01:42 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Releasing lock "refresh_cache-5ffa30ea-7458-4914-a6f4-9d8310ca977c" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:01:42 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Instance network_info: |[{"id": "8a38b464-522f-48bd-90b6-4447f9a6eb21", "address": "fa:16:3e:8f:24:b1", "network": {"id": "a88a6414-c6fd-4581-bbb5-7250ebcb1345", "bridge": "br-int", "label": "tempest-TestShelveInstance-1094508903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c17b9322f9049d390ad212ad8ce7905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a38b464-52", "ovs_interfaceid": "8a38b464-522f-48bd-90b6-4447f9a6eb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 10:01:42 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-022c697d-aa50-45d6-9e3b-9b5cbf11fd94 req-4bf4bec5-59a5-45cf-a5e3-d1c95670a8fa service nova] Acquired lock "refresh_cache-5ffa30ea-7458-4914-a6f4-9d8310ca977c" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:01:42 user nova-compute[71113]: DEBUG nova.network.neutron [req-022c697d-aa50-45d6-9e3b-9b5cbf11fd94 req-4bf4bec5-59a5-45cf-a5e3-d1c95670a8fa service nova] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Refreshing network info cache for port 8a38b464-522f-48bd-90b6-4447f9a6eb21 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 10:01:42 user nova-compute[71113]: DEBUG nova.network.neutron [req-022c697d-aa50-45d6-9e3b-9b5cbf11fd94 req-4bf4bec5-59a5-45cf-a5e3-d1c95670a8fa service nova] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Updated VIF entry in instance network info cache for port 8a38b464-522f-48bd-90b6-4447f9a6eb21. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 10:01:42 user nova-compute[71113]: DEBUG nova.network.neutron [req-022c697d-aa50-45d6-9e3b-9b5cbf11fd94 req-4bf4bec5-59a5-45cf-a5e3-d1c95670a8fa service nova] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Updating instance_info_cache with network_info: [{"id": "8a38b464-522f-48bd-90b6-4447f9a6eb21", "address": "fa:16:3e:8f:24:b1", "network": {"id": "a88a6414-c6fd-4581-bbb5-7250ebcb1345", "bridge": "br-int", "label": "tempest-TestShelveInstance-1094508903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c17b9322f9049d390ad212ad8ce7905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a38b464-52", "ovs_interfaceid": "8a38b464-522f-48bd-90b6-4447f9a6eb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:01:42 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-022c697d-aa50-45d6-9e3b-9b5cbf11fd94 req-4bf4bec5-59a5-45cf-a5e3-d1c95670a8fa service nova] Releasing lock "refresh_cache-5ffa30ea-7458-4914-a6f4-9d8310ca977c" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:01:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:46 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690797691.2667205, 9b01d025-2fe7-4ed9-827d-0546134b08a7 => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:01:46 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] VM Stopped (Lifecycle Event)
Jul 31 10:01:46 user nova-compute[71113]: DEBUG nova.compute.manager [None req-7b35a013-903a-4003-b27f-3c146af9555c None None] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:01:46 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG nova.compute.manager [req-5350720d-b11a-4646-8db3-b954e7238d9d req-a8daa337-7568-4e00-8035-928dec3bfba5 service nova] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Received event volume-reimaged-4fa00a07-19dc-4a82-b9a0-6625e649403f {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-5350720d-b11a-4646-8db3-b954e7238d9d req-a8daa337-7568-4e00-8035-928dec3bfba5 service nova] Acquiring lock "9b01d025-2fe7-4ed9-827d-0546134b08a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-5350720d-b11a-4646-8db3-b954e7238d9d req-a8daa337-7568-4e00-8035-928dec3bfba5 service nova] Lock "9b01d025-2fe7-4ed9-827d-0546134b08a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-5350720d-b11a-4646-8db3-b954e7238d9d req-a8daa337-7568-4e00-8035-928dec3bfba5 service nova] Lock "9b01d025-2fe7-4ed9-827d-0546134b08a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG nova.compute.manager [req-5350720d-b11a-4646-8db3-b954e7238d9d req-a8daa337-7568-4e00-8035-928dec3bfba5 service nova] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Processing event volume-reimaged-4fa00a07-19dc-4a82-b9a0-6625e649403f {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG nova.compute.manager [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Instance event wait completed in 16 seconds for volume-reimaged {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 10:01:49 user nova-compute[71113]: INFO nova.virt.block_device [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Booting with volume 4fa00a07-19dc-4a82-b9a0-6625e649403f at /dev/vda
Jul 31 10:01:49 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Start spawning the instance on the hypervisor. {{(pid=71113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 10:01:49 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Creating image(s)
Jul 31 10:01:49 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Did not create local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Ensure instance console log exists: /opt/stack/data/nova/instances/5ffa30ea-7458-4914-a6f4-9d8310ca977c/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Start _get_guest_xml network_info=[{"id": "8a38b464-522f-48bd-90b6-4447f9a6eb21", "address": "fa:16:3e:8f:24:b1", "network": {"id": "a88a6414-c6fd-4581-bbb5-7250ebcb1345", "bridge": "br-int", "label": "tempest-TestShelveInstance-1094508903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c17b9322f9049d390ad212ad8ce7905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a38b464-52", "ovs_interfaceid": "8a38b464-522f-48bd-90b6-4447f9a6eb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '8c35f29e-a54e-4134-a8ff-678ee0bb90c2', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'egBnzlMD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5ffa30ea-7458-4914-a6f4-9d8310ca977c', 'attached_at': '', 'detached_at': '', 'volume_id': '561d8e35-12d8-4f9f-878d-dd377eb2394d', 'serial': '561d8e35-12d8-4f9f-878d-dd377eb2394d'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 10:01:49 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:01:49 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:01:49 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'egBnzlMD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:01:49 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:01:49 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:01:49 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:01:49 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:01:49 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 10:01:49 user nova-compute[71113]: DEBUG os_brick.utils [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a40eb12-a78b-41b9-b982-afac941dbfe7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 10:01:49 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2555b4-a13b-42fd-bd02-b0e6e5a31cae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f787f98e-53cd-4c95-98b8-0e76bfc4843c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d] added
Jul 31 10:01:49 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2c90ae-bc06-4a2b-b126-546cdd7d2399]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[42409f4e-6415-4179-b154-59b24451c323]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da43501-0f7c-48bc-9cf9-17aa7ffc4f79]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af7cdeb-3e82-47ec-b0f1-969f943c4dad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc3eb37-1651-42da-9733-509213f03b62]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v egBnzlMD {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 10:01:49 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 10:01:49 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f1b8eb-40af-4a93-9c77-8c07c46ec87b]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG os_brick.utils [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG nova.virt.block_device [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Updating existing volume attachment record: 3c299a7d-bada-4033-a451-41e6bf23a827 {{(pid=71113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v egBnzlMD" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[15839509-37f0-401f-bb6d-1fe90d367d18]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'egBnzlMD'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[24183557-9653-46b0-a8ca-b6a3997942b6]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b95e599-3326-4833-83c2-8716917d60e8]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:01:49 user nova-compute[71113]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)
Jul 31 10:01:49 user nova-compute[71113]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 (non-flash)
Jul 31 10:01:49 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:01:49 user nova-compute[71113]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)
Jul 31 10:01:49 user nova-compute[71113]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 (non-flash)
Jul 31 10:01:49 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af2ad3f-940a-43f1-8c7a-f86750478e86]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d, portal: 172.16.0.220,3260]
Jul 31 10:01:49 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d, portal: 172.16.0.220,3260] successful.
Jul 31 10:01:49 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[88248786-ece0-4d52-b9d0-65d1d38d23f1]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c613a43e-d14c-43bc-a34b-6698b1cb5ac9]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:01:49 user nova-compute[71113]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)
Jul 31 10:01:49 user nova-compute[71113]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 (non-flash)
Jul 31 10:01:49 user nova-compute[71113]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d (non-flash)
Jul 31 10:01:49 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:01:49 user nova-compute[71113]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)
Jul 31 10:01:49 user nova-compute[71113]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 (non-flash)
Jul 31 10:01:49 user nova-compute[71113]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d (non-flash)
Jul 31 10:01:49 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.371s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[563f8999-4dc0-4370-a396-095dc422acef]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'egBnzlMD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 10:01:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:50 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.406s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:01:50 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] <== connect_volume: return (1408ms) {'type': 'block', 'scsi_wwn': '23134643538353035', 'path': '/dev/sdc'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:01:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134643538353035', 'path': '/dev/sdc'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 10:01:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:01:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1588137860',display_name='tempest-TestShelveInstance-server-1588137860',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1588137860',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbaQKqzXS+iGAdyU+IEYcpzfIkkhUCBcV/jtcllq2kAmrkSuKN+HhjRpB+JHeg80k59esL5yAramhhM5R6CSY2dBC3P+p41xS0uXt2ByFPfGSwj17CP/Ai/tBqcEiPsRA==',key_name='tempest-TestShelveInstance-735724819',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c17b9322f9049d390ad212ad8ce7905',ramdisk_id='',reservation_id='r-mtlq72k6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1763207303',owner_user_name='tempest-TestShelveInstance-1763207303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T10:01:40Z,user_data=None,user_id='31f12483848e44098cbb078851c5f8d7',uuid=5ffa30ea-7458-4914-a6f4-9d8310ca977c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a38b464-522f-48bd-90b6-4447f9a6eb21", "address": "fa:16:3e:8f:24:b1", "network": {"id": "a88a6414-c6fd-4581-bbb5-7250ebcb1345", "bridge": "br-int", "label": "tempest-TestShelveInstance-1094508903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c17b9322f9049d390ad212ad8ce7905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a38b464-52", "ovs_interfaceid": "8a38b464-522f-48bd-90b6-4447f9a6eb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 10:01:50 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Converting VIF {"id": "8a38b464-522f-48bd-90b6-4447f9a6eb21", "address": "fa:16:3e:8f:24:b1", "network": {"id": "a88a6414-c6fd-4581-bbb5-7250ebcb1345", "bridge": "br-int", "label": "tempest-TestShelveInstance-1094508903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c17b9322f9049d390ad212ad8ce7905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a38b464-52", "ovs_interfaceid": "8a38b464-522f-48bd-90b6-4447f9a6eb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:01:50 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:24:b1,bridge_name='br-int',has_traffic_filtering=True,id=8a38b464-522f-48bd-90b6-4447f9a6eb21,network=Network(a88a6414-c6fd-4581-bbb5-7250ebcb1345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a38b464-52') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:01:50 user nova-compute[71113]: DEBUG nova.objects.instance [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Lazy-loading 'pci_devices' on Instance uuid 5ffa30ea-7458-4914-a6f4-9d8310ca977c {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:01:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] End _get_guest_xml xml=<domain type="kvm">
Jul 31 10:01:50 user nova-compute[71113]:   <uuid>5ffa30ea-7458-4914-a6f4-9d8310ca977c</uuid>
Jul 31 10:01:50 user nova-compute[71113]:   <name>instance-00000021</name>
Jul 31 10:01:50 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 10:01:50 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 10:01:50 user nova-compute[71113]:   <metadata>
Jul 31 10:01:50 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 10:01:50 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 10:01:50 user nova-compute[71113]:       <nova:name>tempest-TestShelveInstance-server-1588137860</nova:name>
Jul 31 10:01:50 user nova-compute[71113]:       <nova:creationTime>2023-07-31 10:01:49</nova:creationTime>
Jul 31 10:01:50 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 10:01:50 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 10:01:50 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 10:01:50 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 10:01:50 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 10:01:50 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 10:01:50 user nova-compute[71113]:       </nova:flavor>
Jul 31 10:01:50 user nova-compute[71113]:       <nova:owner>
Jul 31 10:01:50 user nova-compute[71113]:         <nova:user uuid="31f12483848e44098cbb078851c5f8d7">tempest-TestShelveInstance-1763207303-project-member</nova:user>
Jul 31 10:01:50 user nova-compute[71113]:         <nova:project uuid="9c17b9322f9049d390ad212ad8ce7905">tempest-TestShelveInstance-1763207303</nova:project>
Jul 31 10:01:50 user nova-compute[71113]:       </nova:owner>
Jul 31 10:01:50 user nova-compute[71113]:       <nova:ports>
Jul 31 10:01:50 user nova-compute[71113]:         <nova:port uuid="8a38b464-522f-48bd-90b6-4447f9a6eb21">
Jul 31 10:01:50 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 31 10:01:50 user nova-compute[71113]:         </nova:port>
Jul 31 10:01:50 user nova-compute[71113]:       </nova:ports>
Jul 31 10:01:50 user nova-compute[71113]:     </nova:instance>
Jul 31 10:01:50 user nova-compute[71113]:   </metadata>
Jul 31 10:01:50 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 10:01:50 user nova-compute[71113]:     <system>
Jul 31 10:01:50 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 10:01:50 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 10:01:50 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 10:01:50 user nova-compute[71113]:       <entry name="serial">5ffa30ea-7458-4914-a6f4-9d8310ca977c</entry>
Jul 31 10:01:50 user nova-compute[71113]:       <entry name="uuid">5ffa30ea-7458-4914-a6f4-9d8310ca977c</entry>
Jul 31 10:01:50 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 10:01:50 user nova-compute[71113]:     </system>
Jul 31 10:01:50 user nova-compute[71113]:   </sysinfo>
Jul 31 10:01:50 user nova-compute[71113]:   <os>
Jul 31 10:01:50 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 10:01:50 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 10:01:50 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 10:01:50 user nova-compute[71113]:   </os>
Jul 31 10:01:50 user nova-compute[71113]:   <features>
Jul 31 10:01:50 user nova-compute[71113]:     <acpi/>
Jul 31 10:01:50 user nova-compute[71113]:     <apic/>
Jul 31 10:01:50 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 10:01:50 user nova-compute[71113]:   </features>
Jul 31 10:01:50 user nova-compute[71113]:   <clock offset="utc">
Jul 31 10:01:50 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 10:01:50 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 10:01:50 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 10:01:50 user nova-compute[71113]:   </clock>
Jul 31 10:01:50 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 10:01:50 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 10:01:50 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 10:01:50 user nova-compute[71113]:   </cpu>
Jul 31 10:01:50 user nova-compute[71113]:   <devices>
Jul 31 10:01:50 user nova-compute[71113]:     <disk type="block" device="disk">
Jul 31 10:01:50 user nova-compute[71113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:01:50 user nova-compute[71113]:       <source dev="/dev/sdc"/>
Jul 31 10:01:50 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 10:01:50 user nova-compute[71113]:       <serial>561d8e35-12d8-4f9f-878d-dd377eb2394d</serial>
Jul 31 10:01:50 user nova-compute[71113]:     </disk>
Jul 31 10:01:50 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 10:01:50 user nova-compute[71113]:       <mac address="fa:16:3e:8f:24:b1"/>
Jul 31 10:01:50 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:01:50 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 10:01:50 user nova-compute[71113]:       <target dev="tap8a38b464-52"/>
Jul 31 10:01:50 user nova-compute[71113]:     </interface>
Jul 31 10:01:50 user nova-compute[71113]:     <serial type="pty">
Jul 31 10:01:50 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/5ffa30ea-7458-4914-a6f4-9d8310ca977c/console.log" append="off"/>
Jul 31 10:01:50 user nova-compute[71113]:     </serial>
Jul 31 10:01:50 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 10:01:50 user nova-compute[71113]:     <video>
Jul 31 10:01:50 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:01:50 user nova-compute[71113]:     </video>
Jul 31 10:01:50 user nova-compute[71113]:     <rng model="virtio">
Jul 31 10:01:50 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 10:01:50 user nova-compute[71113]:     </rng>
Jul 31 10:01:50 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 10:01:50 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 10:01:50 user nova-compute[71113]:       <stats period="10"/>
Jul 31 10:01:50 user nova-compute[71113]:     </memballoon>
Jul 31 10:01:50 user nova-compute[71113]:   </devices>
Jul 31 10:01:50 user nova-compute[71113]: </domain>
Jul 31 10:01:50 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 10:01:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:01:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1588137860',display_name='tempest-TestShelveInstance-server-1588137860',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1588137860',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbaQKqzXS+iGAdyU+IEYcpzfIkkhUCBcV/jtcllq2kAmrkSuKN+HhjRpB+JHeg80k59esL5yAramhhM5R6CSY2dBC3P+p41xS0uXt2ByFPfGSwj17CP/Ai/tBqcEiPsRA==',key_name='tempest-TestShelveInstance-735724819',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c17b9322f9049d390ad212ad8ce7905',ramdisk_id='',reservation_id='r-mtlq72k6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1763207303',owner_user_name='tempest-TestShelveInstance-1763207303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T10:01:40Z,user_data=None,user_id='31f12483848e44098cbb078851c5f8d7',uuid=5ffa30ea-7458-4914-a6f4-9d8310ca977c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a38b464-522f-48bd-90b6-4447f9a6eb21", "address": "fa:16:3e:8f:24:b1", "network": {"id": "a88a6414-c6fd-4581-bbb5-7250ebcb1345", "bridge": "br-int", "label": "tempest-TestShelveInstance-1094508903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c17b9322f9049d390ad212ad8ce7905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a38b464-52", "ovs_interfaceid": "8a38b464-522f-48bd-90b6-4447f9a6eb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 10:01:50 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Converting VIF {"id": "8a38b464-522f-48bd-90b6-4447f9a6eb21", "address": "fa:16:3e:8f:24:b1", "network": {"id": "a88a6414-c6fd-4581-bbb5-7250ebcb1345", "bridge": "br-int", "label": "tempest-TestShelveInstance-1094508903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c17b9322f9049d390ad212ad8ce7905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a38b464-52", "ovs_interfaceid": "8a38b464-522f-48bd-90b6-4447f9a6eb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:01:50 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:24:b1,bridge_name='br-int',has_traffic_filtering=True,id=8a38b464-522f-48bd-90b6-4447f9a6eb21,network=Network(a88a6414-c6fd-4581-bbb5-7250ebcb1345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a38b464-52') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:01:50 user nova-compute[71113]: DEBUG os_vif [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:24:b1,bridge_name='br-int',has_traffic_filtering=True,id=8a38b464-522f-48bd-90b6-4447f9a6eb21,network=Network(a88a6414-c6fd-4581-bbb5-7250ebcb1345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a38b464-52') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 10:01:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:01:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 10:01:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a38b464-52, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:01:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8a38b464-52, col_values=(('external_ids', {'iface-id': '8a38b464-522f-48bd-90b6-4447f9a6eb21', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:24:b1', 'vm-uuid': '5ffa30ea-7458-4914-a6f4-9d8310ca977c'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:01:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:01:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:50 user nova-compute[71113]: INFO os_vif [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:24:b1,bridge_name='br-int',has_traffic_filtering=True,id=8a38b464-522f-48bd-90b6-4447f9a6eb21,network=Network(a88a6414-c6fd-4581-bbb5-7250ebcb1345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a38b464-52')
Jul 31 10:01:51 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:01:51 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] No VIF found with MAC fa:16:3e:8f:24:b1, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 10:01:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:52 user nova-compute[71113]: DEBUG nova.compute.manager [req-ef964555-251e-4dc2-8d15-34e6e1154550 req-f2e7061d-4662-474d-9f24-5118d77aa287 service nova] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Received event network-vif-plugged-8a38b464-522f-48bd-90b6-4447f9a6eb21 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:01:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ef964555-251e-4dc2-8d15-34e6e1154550 req-f2e7061d-4662-474d-9f24-5118d77aa287 service nova] Acquiring lock "5ffa30ea-7458-4914-a6f4-9d8310ca977c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:01:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ef964555-251e-4dc2-8d15-34e6e1154550 req-f2e7061d-4662-474d-9f24-5118d77aa287 service nova] Lock "5ffa30ea-7458-4914-a6f4-9d8310ca977c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:01:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ef964555-251e-4dc2-8d15-34e6e1154550 req-f2e7061d-4662-474d-9f24-5118d77aa287 service nova] Lock "5ffa30ea-7458-4914-a6f4-9d8310ca977c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:01:52 user nova-compute[71113]: DEBUG nova.compute.manager [req-ef964555-251e-4dc2-8d15-34e6e1154550 req-f2e7061d-4662-474d-9f24-5118d77aa287 service nova] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] No waiting events found dispatching network-vif-plugged-8a38b464-522f-48bd-90b6-4447f9a6eb21 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:01:52 user nova-compute[71113]: WARNING nova.compute.manager [req-ef964555-251e-4dc2-8d15-34e6e1154550 req-f2e7061d-4662-474d-9f24-5118d77aa287 service nova] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Received unexpected event network-vif-plugged-8a38b464-522f-48bd-90b6-4447f9a6eb21 for instance with vm_state building and task_state spawning.
Jul 31 10:01:53 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:53 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:53 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:53 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b86b0525-16c1-4357-b007-49841321bfdb tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Acquiring lock "a950d710-4596-4355-ac31-568c7728335a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:01:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b86b0525-16c1-4357-b007-49841321bfdb tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "a950d710-4596-4355-ac31-568c7728335a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:01:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b86b0525-16c1-4357-b007-49841321bfdb tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Acquiring lock "a950d710-4596-4355-ac31-568c7728335a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:01:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b86b0525-16c1-4357-b007-49841321bfdb tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "a950d710-4596-4355-ac31-568c7728335a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:01:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b86b0525-16c1-4357-b007-49841321bfdb tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "a950d710-4596-4355-ac31-568c7728335a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:01:53 user nova-compute[71113]: INFO nova.compute.manager [None req-b86b0525-16c1-4357-b007-49841321bfdb tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Terminating instance
Jul 31 10:01:53 user nova-compute[71113]: DEBUG nova.compute.manager [None req-b86b0525-16c1-4357-b007-49841321bfdb tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Start destroying the instance on the hypervisor. {{(pid=71113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 10:01:53 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG nova.compute.manager [req-e65fe683-d852-4de8-a913-dbb937d3c873 req-c767c312-3c90-4e7f-b1bf-b5803ca4fc9b service nova] [instance: a950d710-4596-4355-ac31-568c7728335a] Received event network-vif-unplugged-469843c1-3548-4bae-90bb-7fd1f5ac0052 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e65fe683-d852-4de8-a913-dbb937d3c873 req-c767c312-3c90-4e7f-b1bf-b5803ca4fc9b service nova] Acquiring lock "a950d710-4596-4355-ac31-568c7728335a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e65fe683-d852-4de8-a913-dbb937d3c873 req-c767c312-3c90-4e7f-b1bf-b5803ca4fc9b service nova] Lock "a950d710-4596-4355-ac31-568c7728335a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e65fe683-d852-4de8-a913-dbb937d3c873 req-c767c312-3c90-4e7f-b1bf-b5803ca4fc9b service nova] Lock "a950d710-4596-4355-ac31-568c7728335a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG nova.compute.manager [req-e65fe683-d852-4de8-a913-dbb937d3c873 req-c767c312-3c90-4e7f-b1bf-b5803ca4fc9b service nova] [instance: a950d710-4596-4355-ac31-568c7728335a] No waiting events found dispatching network-vif-unplugged-469843c1-3548-4bae-90bb-7fd1f5ac0052 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG nova.compute.manager [req-e65fe683-d852-4de8-a913-dbb937d3c873 req-c767c312-3c90-4e7f-b1bf-b5803ca4fc9b service nova] [instance: a950d710-4596-4355-ac31-568c7728335a] Received event network-vif-unplugged-469843c1-3548-4bae-90bb-7fd1f5ac0052 for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797714.5509455, 5ffa30ea-7458-4914-a6f4-9d8310ca977c => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:01:54 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] VM Resumed (Lifecycle Event)
Jul 31 10:01:54 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:01:54 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Instance spawned successfully.
Jul 31 10:01:54 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Found default for hw_cdrom_bus of ide {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Found default for hw_disk_bus of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Found default for hw_input_bus of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Found default for hw_pointer_model of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Found default for hw_video_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Found default for hw_vif_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:01:54 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 10:01:54 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797714.5511947, 5ffa30ea-7458-4914-a6f4-9d8310ca977c => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:01:54 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] VM Started (Lifecycle Event)
Jul 31 10:01:54 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:01:54 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 10:01:54 user nova-compute[71113]: INFO nova.compute.manager [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Took 5.30 seconds to spawn the instance on the hypervisor.
Jul 31 10:01:54 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:01:54 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: a950d710-4596-4355-ac31-568c7728335a] Instance destroyed successfully.
Jul 31 10:01:54 user nova-compute[71113]: DEBUG nova.objects.instance [None req-b86b0525-16c1-4357-b007-49841321bfdb tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lazy-loading 'resources' on Instance uuid a950d710-4596-4355-ac31-568c7728335a {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-b86b0525-16c1-4357-b007-49841321bfdb tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:55:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-834893459',display_name='tempest-ServerActionsTestOtherA-server-834893459',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-834893459',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5EE1xUvLRoodLjDMpmYpiUOpJ4L9wfbpJsZ+HUVFxXJGKbpzcG8jQIKPQ0cQElq3F/Fhyr7R6+c9C8jzz21FzCpd/o9T+iI7W2nanWOzhB0iUhT1vp4Ko8/FdZGlABXg==',key_name='tempest-keypair-58057469',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:57:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f7a5479fd014325b8790a80b2405d1d',ramdisk_id='',reservation_id='r-l0unkf5n',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2065923437',owner_user_name='tempest-ServerActionsTestOtherA-2065923437-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:59:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7029dd8d775d4c14bb349b72b1171d5f',uuid=a950d710-4596-4355-ac31-568c7728335a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "469843c1-3548-4bae-90bb-7fd1f5ac0052", "address": "fa:16:3e:08:cb:ac", "network": {"id": "cc84435f-b983-425d-bad0-36039e592e25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1662840158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f7a5479fd014325b8790a80b2405d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469843c1-35", "ovs_interfaceid": "469843c1-3548-4bae-90bb-7fd1f5ac0052", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-b86b0525-16c1-4357-b007-49841321bfdb tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Converting VIF {"id": "469843c1-3548-4bae-90bb-7fd1f5ac0052", "address": "fa:16:3e:08:cb:ac", "network": {"id": "cc84435f-b983-425d-bad0-36039e592e25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1662840158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f7a5479fd014325b8790a80b2405d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap469843c1-35", "ovs_interfaceid": "469843c1-3548-4bae-90bb-7fd1f5ac0052", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-b86b0525-16c1-4357-b007-49841321bfdb tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:cb:ac,bridge_name='br-int',has_traffic_filtering=True,id=469843c1-3548-4bae-90bb-7fd1f5ac0052,network=Network(cc84435f-b983-425d-bad0-36039e592e25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469843c1-35') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG os_vif [None req-b86b0525-16c1-4357-b007-49841321bfdb tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:cb:ac,bridge_name='br-int',has_traffic_filtering=True,id=469843c1-3548-4bae-90bb-7fd1f5ac0052,network=Network(cc84435f-b983-425d-bad0-36039e592e25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469843c1-35') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap469843c1-35, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:01:54 user nova-compute[71113]: INFO os_vif [None req-b86b0525-16c1-4357-b007-49841321bfdb tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:cb:ac,bridge_name='br-int',has_traffic_filtering=True,id=469843c1-3548-4bae-90bb-7fd1f5ac0052,network=Network(cc84435f-b983-425d-bad0-36039e592e25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap469843c1-35')
Jul 31 10:01:54 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b86b0525-16c1-4357-b007-49841321bfdb tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b86b0525-16c1-4357-b007-49841321bfdb tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vwYotCOs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:01:54 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-b86b0525-16c1-4357-b007-49841321bfdb tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:01:54 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-b86b0525-16c1-4357-b007-49841321bfdb tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-b86b0525-16c1-4357-b007-49841321bfdb tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b86b0525-16c1-4357-b007-49841321bfdb tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:54 user nova-compute[71113]: INFO nova.compute.manager [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Took 15.07 seconds to build instance.
Jul 31 10:01:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dda148c-5a8b-4b12-8dba-956d24f6b0ac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ab1c15ad-ab15-4171-98da-8c883d46acf0 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Lock "5ffa30ea-7458-4914-a6f4-9d8310ca977c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.183s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d973599-3083-4b62-9585-eacfc8c2854a]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b86b0525-16c1-4357-b007-49841321bfdb tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:01:54 user nova-compute[71113]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)
Jul 31 10:01:54 user nova-compute[71113]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 (non-flash)
Jul 31 10:01:54 user nova-compute[71113]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d (non-flash)
Jul 31 10:01:54 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b86b0525-16c1-4357-b007-49841321bfdb tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:01:54 user nova-compute[71113]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 (non-flash)
Jul 31 10:01:54 user nova-compute[71113]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 (non-flash)
Jul 31 10:01:54 user nova-compute[71113]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d (non-flash)
Jul 31 10:01:54 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b86b0525-16c1-4357-b007-49841321bfdb tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f78f07aee60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38'): ({'sdb'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-b86b0525-16c1-4357-b007-49841321bfdb tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Removing single pathed devices sdb {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG nova.compute.manager [req-bccc74c8-46f6-4762-bdd1-3e434dbb1ce9 req-6b4f19eb-d051-4402-aab9-b3f35325049b service nova] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Received event network-vif-plugged-8a38b464-522f-48bd-90b6-4447f9a6eb21 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-bccc74c8-46f6-4762-bdd1-3e434dbb1ce9 req-6b4f19eb-d051-4402-aab9-b3f35325049b service nova] Acquiring lock "5ffa30ea-7458-4914-a6f4-9d8310ca977c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-bccc74c8-46f6-4762-bdd1-3e434dbb1ce9 req-6b4f19eb-d051-4402-aab9-b3f35325049b service nova] Lock "5ffa30ea-7458-4914-a6f4-9d8310ca977c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-bccc74c8-46f6-4762-bdd1-3e434dbb1ce9 req-6b4f19eb-d051-4402-aab9-b3f35325049b service nova] Lock "5ffa30ea-7458-4914-a6f4-9d8310ca977c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG nova.compute.manager [req-bccc74c8-46f6-4762-bdd1-3e434dbb1ce9 req-6b4f19eb-d051-4402-aab9-b3f35325049b service nova] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] No waiting events found dispatching network-vif-plugged-8a38b464-522f-48bd-90b6-4447f9a6eb21 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:01:54 user nova-compute[71113]: WARNING nova.compute.manager [req-bccc74c8-46f6-4762-bdd1-3e434dbb1ce9 req-6b4f19eb-d051-4402-aab9-b3f35325049b service nova] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Received unexpected event network-vif-plugged-8a38b464-522f-48bd-90b6-4447f9a6eb21 for instance with vm_state active and task_state None.
Jul 31 10:01:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d7e9f1-6f77-4acc-9fbd-e68a6199d7ed]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7036d5f5-74de-4090-8d63-40c96daaef59]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-b86b0525-16c1-4357-b007-49841321bfdb tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Flushing IO for device /dev/sdb {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[873d9e0a-6fca-433f-bf16-e4dfac9e2fb4]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-b86b0525-16c1-4357-b007-49841321bfdb tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 10:01:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:55 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:55 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b218e8-e43a-4a5b-bdeb-12f91253481e]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:01:55 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-b86b0525-16c1-4357-b007-49841321bfdb tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 10:01:55 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-b86b0525-16c1-4357-b007-49841321bfdb tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] SCSI volumes sdb have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 10:01:55 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b86b0525-16c1-4357-b007-49841321bfdb tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 10:01:55 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:55 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.045s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:55 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62a49e0-32f9-46f3-83f7-d3aedd86a622]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:01:55 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b86b0525-16c1-4357-b007-49841321bfdb tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:01:55 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:55 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:55 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e17f0f-21fa-48c2-830f-7d33efa2ba16]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:01:55 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b86b0525-16c1-4357-b007-49841321bfdb tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38, portal: 172.16.0.220,3260]
Jul 31 10:01:55 user nova-compute[71113]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38, portal: 172.16.0.220,3260] successful.
Jul 31 10:01:55 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:01:55 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:55 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78ea4913-8d79-4c9a-9324-c2d9f86c6d38 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:55 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eebb16a-1cb6-4476-8582-dbbdf4cbd520]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:01:55 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b86b0525-16c1-4357-b007-49841321bfdb tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:01:55 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-b86b0525-16c1-4357-b007-49841321bfdb tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.407s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:01:55 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b86b0525-16c1-4357-b007-49841321bfdb tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] <== disconnect_volume: return (408ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:01:55 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b86b0525-16c1-4357-b007-49841321bfdb tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 10:01:55 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-b86b0525-16c1-4357-b007-49841321bfdb tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Deleting instance files /opt/stack/data/nova/instances/a950d710-4596-4355-ac31-568c7728335a_del
Jul 31 10:01:55 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-b86b0525-16c1-4357-b007-49841321bfdb tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Deletion of /opt/stack/data/nova/instances/a950d710-4596-4355-ac31-568c7728335a_del complete
Jul 31 10:01:55 user nova-compute[71113]: INFO nova.compute.manager [None req-b86b0525-16c1-4357-b007-49841321bfdb tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Took 1.40 seconds to destroy the instance on the hypervisor.
Jul 31 10:01:55 user nova-compute[71113]: DEBUG oslo.service.loopingcall [None req-b86b0525-16c1-4357-b007-49841321bfdb tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71113) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 10:01:55 user nova-compute[71113]: DEBUG nova.compute.manager [-] [instance: a950d710-4596-4355-ac31-568c7728335a] Deallocating network for instance {{(pid=71113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 10:01:55 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: a950d710-4596-4355-ac31-568c7728335a] deallocate_for_instance() {{(pid=71113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 10:01:56 user nova-compute[71113]: DEBUG nova.compute.manager [req-8984ebb7-5e31-4c8c-87a4-984562218330 req-c13c2e49-f5c6-4ce8-8173-987f3250fa3a service nova] [instance: a950d710-4596-4355-ac31-568c7728335a] Received event network-vif-plugged-469843c1-3548-4bae-90bb-7fd1f5ac0052 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:01:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8984ebb7-5e31-4c8c-87a4-984562218330 req-c13c2e49-f5c6-4ce8-8173-987f3250fa3a service nova] Acquiring lock "a950d710-4596-4355-ac31-568c7728335a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:01:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8984ebb7-5e31-4c8c-87a4-984562218330 req-c13c2e49-f5c6-4ce8-8173-987f3250fa3a service nova] Lock "a950d710-4596-4355-ac31-568c7728335a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:01:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8984ebb7-5e31-4c8c-87a4-984562218330 req-c13c2e49-f5c6-4ce8-8173-987f3250fa3a service nova] Lock "a950d710-4596-4355-ac31-568c7728335a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:01:56 user nova-compute[71113]: DEBUG nova.compute.manager [req-8984ebb7-5e31-4c8c-87a4-984562218330 req-c13c2e49-f5c6-4ce8-8173-987f3250fa3a service nova] [instance: a950d710-4596-4355-ac31-568c7728335a] No waiting events found dispatching network-vif-plugged-469843c1-3548-4bae-90bb-7fd1f5ac0052 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:01:56 user nova-compute[71113]: WARNING nova.compute.manager [req-8984ebb7-5e31-4c8c-87a4-984562218330 req-c13c2e49-f5c6-4ce8-8173-987f3250fa3a service nova] [instance: a950d710-4596-4355-ac31-568c7728335a] Received unexpected event network-vif-plugged-469843c1-3548-4bae-90bb-7fd1f5ac0052 for instance with vm_state active and task_state deleting.
Jul 31 10:01:56 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: a950d710-4596-4355-ac31-568c7728335a] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:01:56 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: a950d710-4596-4355-ac31-568c7728335a] Took 1.47 seconds to deallocate network for instance.
Jul 31 10:01:57 user nova-compute[71113]: DEBUG nova.compute.manager [req-4e80ddec-73dd-4415-bdcd-f01fb05f5101 req-54e05788-b612-4214-86e7-158e2f3d177a service nova] [instance: a950d710-4596-4355-ac31-568c7728335a] Received event network-vif-deleted-469843c1-3548-4bae-90bb-7fd1f5ac0052 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:01:57 user nova-compute[71113]: INFO nova.compute.manager [None req-b86b0525-16c1-4357-b007-49841321bfdb tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Took 0.98 seconds to detach 1 volumes for instance.
Jul 31 10:01:57 user nova-compute[71113]: DEBUG nova.compute.manager [None req-b86b0525-16c1-4357-b007-49841321bfdb tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: a950d710-4596-4355-ac31-568c7728335a] Deleting volume: 78ea4913-8d79-4c9a-9324-c2d9f86c6d38 {{(pid=71113) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 31 10:01:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b86b0525-16c1-4357-b007-49841321bfdb tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:01:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b86b0525-16c1-4357-b007-49841321bfdb tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:01:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 10:01:58 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Creating image(s)
Jul 31 10:01:58 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Did not create local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Ensure instance console log exists: /opt/stack/data/nova/instances/9b01d025-2fe7-4ed9-827d-0546134b08a7/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Start _get_guest_xml network_info=[{"id": "cc8f812f-2fff-475e-a41e-abf390366863", "address": "fa:16:3e:61:8f:df", "network": {"id": "5f333808-4342-4014-9221-7ccd394eff66", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-42408734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4b02badf8ea4f32a5e259c25120eac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc8f812f-2f", "ovs_interfaceid": "cc8f812f-2fff-475e-a41e-abf390366863", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '3c299a7d-bada-4033-a451-41e6bf23a827', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kSRbiupj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9b01d025-2fe7-4ed9-827d-0546134b08a7', 'attached_at': '', 'detached_at': '', 'volume_id': '4fa00a07-19dc-4a82-b9a0-6625e649403f', 'serial': '4fa00a07-19dc-4a82-b9a0-6625e649403f'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 10:01:58 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 31 10:01:58 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 31 10:01:58 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG nova.objects.instance [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9b01d025-2fe7-4ed9-827d-0546134b08a7 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-b86b0525-16c1-4357-b007-49841321bfdb tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kSRbiupj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:01:58 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 31 10:01:58 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:01:58 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 31 10:01:58 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:01:58 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 10:01:58 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-b86b0525-16c1-4357-b007-49841321bfdb tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c854243-1d48-4200-8058-83af2cf53c2f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 10:01:58 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b86b0525-16c1-4357-b007-49841321bfdb tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.485s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae57d09-f0fd-4564-a67f-e0bbb1767cfd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f] added
Jul 31 10:01:58 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:58 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-b86b0525-16c1-4357-b007-49841321bfdb tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Deleted allocations for instance a950d710-4596-4355-ac31-568c7728335a
Jul 31 10:01:58 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c606aeaf-08d4-4363-89db-e706e06d6768]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f38b12e-32ff-4824-b53a-c13f5c4f39bc]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kSRbiupj {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kSRbiupj" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3bead6-7428-4ed2-b9bd-572eb29ec410]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kSRbiupj'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b9abd6-7487-452c-a408-878be05bf5c5]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b86b0525-16c1-4357-b007-49841321bfdb tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "a950d710-4596-4355-ac31-568c7728335a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.646s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1426a56-e5cb-4589-ba9d-35697e642292]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:01:58 user nova-compute[71113]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 (non-flash)
Jul 31 10:01:58 user nova-compute[71113]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d (non-flash)
Jul 31 10:01:58 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:01:58 user nova-compute[71113]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 (non-flash)
Jul 31 10:01:58 user nova-compute[71113]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d (non-flash)
Jul 31 10:01:58 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3e19a8-9a2a-4cb5-94ce-dd8c348f3a41]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f, portal: 172.16.0.220,3260]
Jul 31 10:01:58 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f, portal: 172.16.0.220,3260] successful.
Jul 31 10:01:58 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a609a7eb-9aad-41c0-99f2-12d8969902dc]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[236499ba-fddf-4ab5-96c4-00c0b7d30491]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:01:58 user nova-compute[71113]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 (non-flash)
Jul 31 10:01:58 user nova-compute[71113]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d (non-flash)
Jul 31 10:01:58 user nova-compute[71113]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f (non-flash)
Jul 31 10:01:58 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:01:58 user nova-compute[71113]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 (non-flash)
Jul 31 10:01:58 user nova-compute[71113]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d (non-flash)
Jul 31 10:01:58 user nova-compute[71113]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f (non-flash)
Jul 31 10:01:58 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fbc73d8-310e-4709-9257-1841796dd7ed]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 10:01:58 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kSRbiupj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 10:01:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:01:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '23730616262336538', 'path': '/dev/sdb'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:01:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730616262336538', 'path': '/dev/sdb'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 10:01:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T09:59:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-53810513',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-972438511',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMN/Rb0UqXjD4v1BBxetpe4UPNYObazNnGN7FxKdXTvz2iyzNZUZD6rIfXejF9ItEE9BSDAPgEkcwdmUFy1RLvhZdWlT7mUS0xbJEpPYT/4mz1Vn4Dur4VHq0XzU1g9+4Q==',key_name='tempest-keypair-1593349916',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:59:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e4b02badf8ea4f32a5e259c25120eac7',ramdisk_id='',reservation_id='r-6qeaa7mv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1497143588',owner_user_name='tempest-ServerActionsV293TestJSON-1497143588-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T10:01:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba2fd55dd96b4c49bb0c1c98c0a724d4',uuid=9b01d025-2fe7-4ed9-827d-0546134b08a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc8f812f-2fff-475e-a41e-abf390366863", "address": "fa:16:3e:61:8f:df", "network": {"id": "5f333808-4342-4014-9221-7ccd394eff66", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-42408734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4b02badf8ea4f32a5e259c25120eac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc8f812f-2f", "ovs_interfaceid": "cc8f812f-2fff-475e-a41e-abf390366863", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 10:01:59 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Converting VIF {"id": "cc8f812f-2fff-475e-a41e-abf390366863", "address": "fa:16:3e:61:8f:df", "network": {"id": "5f333808-4342-4014-9221-7ccd394eff66", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-42408734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4b02badf8ea4f32a5e259c25120eac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc8f812f-2f", "ovs_interfaceid": "cc8f812f-2fff-475e-a41e-abf390366863", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:01:59 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:8f:df,bridge_name='br-int',has_traffic_filtering=True,id=cc8f812f-2fff-475e-a41e-abf390366863,network=Network(5f333808-4342-4014-9221-7ccd394eff66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc8f812f-2f') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:01:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] End _get_guest_xml xml=<domain type="kvm">
Jul 31 10:01:59 user nova-compute[71113]:   <uuid>9b01d025-2fe7-4ed9-827d-0546134b08a7</uuid>
Jul 31 10:01:59 user nova-compute[71113]:   <name>instance-0000001f</name>
Jul 31 10:01:59 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 10:01:59 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 10:01:59 user nova-compute[71113]:   <metadata>
Jul 31 10:01:59 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 10:01:59 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 10:01:59 user nova-compute[71113]:       <nova:name>tempest-ServerActionsV293TestJSON-server-53810513</nova:name>
Jul 31 10:01:59 user nova-compute[71113]:       <nova:creationTime>2023-07-31 10:01:58</nova:creationTime>
Jul 31 10:01:59 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 10:01:59 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 10:01:59 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 10:01:59 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 10:01:59 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 10:01:59 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 10:01:59 user nova-compute[71113]:       </nova:flavor>
Jul 31 10:01:59 user nova-compute[71113]:       <nova:owner>
Jul 31 10:01:59 user nova-compute[71113]:         <nova:user uuid="ba2fd55dd96b4c49bb0c1c98c0a724d4">tempest-ServerActionsV293TestJSON-1497143588-project-member</nova:user>
Jul 31 10:01:59 user nova-compute[71113]:         <nova:project uuid="e4b02badf8ea4f32a5e259c25120eac7">tempest-ServerActionsV293TestJSON-1497143588</nova:project>
Jul 31 10:01:59 user nova-compute[71113]:       </nova:owner>
Jul 31 10:01:59 user nova-compute[71113]:       <nova:ports>
Jul 31 10:01:59 user nova-compute[71113]:         <nova:port uuid="cc8f812f-2fff-475e-a41e-abf390366863">
Jul 31 10:01:59 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 31 10:01:59 user nova-compute[71113]:         </nova:port>
Jul 31 10:01:59 user nova-compute[71113]:       </nova:ports>
Jul 31 10:01:59 user nova-compute[71113]:     </nova:instance>
Jul 31 10:01:59 user nova-compute[71113]:   </metadata>
Jul 31 10:01:59 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 10:01:59 user nova-compute[71113]:     <system>
Jul 31 10:01:59 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 10:01:59 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 10:01:59 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 10:01:59 user nova-compute[71113]:       <entry name="serial">9b01d025-2fe7-4ed9-827d-0546134b08a7</entry>
Jul 31 10:01:59 user nova-compute[71113]:       <entry name="uuid">9b01d025-2fe7-4ed9-827d-0546134b08a7</entry>
Jul 31 10:01:59 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 10:01:59 user nova-compute[71113]:     </system>
Jul 31 10:01:59 user nova-compute[71113]:   </sysinfo>
Jul 31 10:01:59 user nova-compute[71113]:   <os>
Jul 31 10:01:59 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 10:01:59 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 10:01:59 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 10:01:59 user nova-compute[71113]:   </os>
Jul 31 10:01:59 user nova-compute[71113]:   <features>
Jul 31 10:01:59 user nova-compute[71113]:     <acpi/>
Jul 31 10:01:59 user nova-compute[71113]:     <apic/>
Jul 31 10:01:59 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 10:01:59 user nova-compute[71113]:   </features>
Jul 31 10:01:59 user nova-compute[71113]:   <clock offset="utc">
Jul 31 10:01:59 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 10:01:59 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 10:01:59 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 10:01:59 user nova-compute[71113]:   </clock>
Jul 31 10:01:59 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 10:01:59 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 10:01:59 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 10:01:59 user nova-compute[71113]:   </cpu>
Jul 31 10:01:59 user nova-compute[71113]:   <devices>
Jul 31 10:01:59 user nova-compute[71113]:     <disk type="block" device="disk">
Jul 31 10:01:59 user nova-compute[71113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:01:59 user nova-compute[71113]:       <source dev="/dev/sdb"/>
Jul 31 10:01:59 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 10:01:59 user nova-compute[71113]:       <serial>4fa00a07-19dc-4a82-b9a0-6625e649403f</serial>
Jul 31 10:01:59 user nova-compute[71113]:     </disk>
Jul 31 10:01:59 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 10:01:59 user nova-compute[71113]:       <mac address="fa:16:3e:61:8f:df"/>
Jul 31 10:01:59 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:01:59 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 10:01:59 user nova-compute[71113]:       <target dev="tapcc8f812f-2f"/>
Jul 31 10:01:59 user nova-compute[71113]:     </interface>
Jul 31 10:01:59 user nova-compute[71113]:     <serial type="pty">
Jul 31 10:01:59 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/9b01d025-2fe7-4ed9-827d-0546134b08a7/console.log" append="off"/>
Jul 31 10:01:59 user nova-compute[71113]:     </serial>
Jul 31 10:01:59 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 10:01:59 user nova-compute[71113]:     <video>
Jul 31 10:01:59 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:01:59 user nova-compute[71113]:     </video>
Jul 31 10:01:59 user nova-compute[71113]:     <rng model="virtio">
Jul 31 10:01:59 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 10:01:59 user nova-compute[71113]:     </rng>
Jul 31 10:01:59 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 10:01:59 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 10:01:59 user nova-compute[71113]:       <stats period="10"/>
Jul 31 10:01:59 user nova-compute[71113]:     </memballoon>
Jul 31 10:01:59 user nova-compute[71113]:   </devices>
Jul 31 10:01:59 user nova-compute[71113]: </domain>
Jul 31 10:01:59 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 10:01:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T09:59:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-53810513',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-972438511',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMN/Rb0UqXjD4v1BBxetpe4UPNYObazNnGN7FxKdXTvz2iyzNZUZD6rIfXejF9ItEE9BSDAPgEkcwdmUFy1RLvhZdWlT7mUS0xbJEpPYT/4mz1Vn4Dur4VHq0XzU1g9+4Q==',key_name='tempest-keypair-1593349916',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:59:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e4b02badf8ea4f32a5e259c25120eac7',ramdisk_id='',reservation_id='r-6qeaa7mv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1497143588',owner_user_name='tempest-ServerActionsV293TestJSON-1497143588-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T10:01:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba2fd55dd96b4c49bb0c1c98c0a724d4',uuid=9b01d025-2fe7-4ed9-827d-0546134b08a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc8f812f-2fff-475e-a41e-abf390366863", "address": "fa:16:3e:61:8f:df", "network": {"id": "5f333808-4342-4014-9221-7ccd394eff66", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-42408734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4b02badf8ea4f32a5e259c25120eac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc8f812f-2f", "ovs_interfaceid": "cc8f812f-2fff-475e-a41e-abf390366863", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 10:01:59 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Converting VIF {"id": "cc8f812f-2fff-475e-a41e-abf390366863", "address": "fa:16:3e:61:8f:df", "network": {"id": "5f333808-4342-4014-9221-7ccd394eff66", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-42408734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4b02badf8ea4f32a5e259c25120eac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc8f812f-2f", "ovs_interfaceid": "cc8f812f-2fff-475e-a41e-abf390366863", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:01:59 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:8f:df,bridge_name='br-int',has_traffic_filtering=True,id=cc8f812f-2fff-475e-a41e-abf390366863,network=Network(5f333808-4342-4014-9221-7ccd394eff66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc8f812f-2f') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:01:59 user nova-compute[71113]: DEBUG os_vif [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:8f:df,bridge_name='br-int',has_traffic_filtering=True,id=cc8f812f-2fff-475e-a41e-abf390366863,network=Network(5f333808-4342-4014-9221-7ccd394eff66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc8f812f-2f') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 10:01:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:01:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 10:01:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc8f812f-2f, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:01:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcc8f812f-2f, col_values=(('external_ids', {'iface-id': 'cc8f812f-2fff-475e-a41e-abf390366863', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:8f:df', 'vm-uuid': '9b01d025-2fe7-4ed9-827d-0546134b08a7'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:01:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:01:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:01:59 user nova-compute[71113]: INFO os_vif [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:8f:df,bridge_name='br-int',has_traffic_filtering=True,id=cc8f812f-2fff-475e-a41e-abf390366863,network=Network(5f333808-4342-4014-9221-7ccd394eff66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc8f812f-2f')
Jul 31 10:01:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:01:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] No VIF found with MAC fa:16:3e:61:8f:df, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 10:01:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:02:00 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:02:01 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:02:01 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:02:01 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:02:01 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:02:01 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:02:01 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:02:01 user nova-compute[71113]: DEBUG nova.compute.manager [req-cc3e911d-cc91-4588-9e5a-0cc2334fc0ea req-cd248c8e-ce18-4ec0-87ca-3830a4de2df4 service nova] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Received event network-vif-plugged-cc8f812f-2fff-475e-a41e-abf390366863 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:02:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-cc3e911d-cc91-4588-9e5a-0cc2334fc0ea req-cd248c8e-ce18-4ec0-87ca-3830a4de2df4 service nova] Acquiring lock "9b01d025-2fe7-4ed9-827d-0546134b08a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:02:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-cc3e911d-cc91-4588-9e5a-0cc2334fc0ea req-cd248c8e-ce18-4ec0-87ca-3830a4de2df4 service nova] Lock "9b01d025-2fe7-4ed9-827d-0546134b08a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:02:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-cc3e911d-cc91-4588-9e5a-0cc2334fc0ea req-cd248c8e-ce18-4ec0-87ca-3830a4de2df4 service nova] Lock "9b01d025-2fe7-4ed9-827d-0546134b08a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:02:01 user nova-compute[71113]: DEBUG nova.compute.manager [req-cc3e911d-cc91-4588-9e5a-0cc2334fc0ea req-cd248c8e-ce18-4ec0-87ca-3830a4de2df4 service nova] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] No waiting events found dispatching network-vif-plugged-cc8f812f-2fff-475e-a41e-abf390366863 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:02:01 user nova-compute[71113]: WARNING nova.compute.manager [req-cc3e911d-cc91-4588-9e5a-0cc2334fc0ea req-cd248c8e-ce18-4ec0-87ca-3830a4de2df4 service nova] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Received unexpected event network-vif-plugged-cc8f812f-2fff-475e-a41e-abf390366863 for instance with vm_state active and task_state rebuild_spawning.
Jul 31 10:02:03 user nova-compute[71113]: DEBUG nova.compute.manager [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 10:02:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 10:02:03 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797723.5027378, 9b01d025-2fe7-4ed9-827d-0546134b08a7 => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:02:03 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] VM Resumed (Lifecycle Event)
Jul 31 10:02:03 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Instance spawned successfully.
Jul 31 10:02:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 10:02:03 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:02:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Found default for hw_cdrom_bus of ide {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:02:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Found default for hw_disk_bus of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:02:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Found default for hw_input_bus of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:02:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Found default for hw_pointer_model of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:02:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Found default for hw_video_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:02:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Found default for hw_vif_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:02:03 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:02:03 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 31 10:02:03 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797723.5029132, 9b01d025-2fe7-4ed9-827d-0546134b08a7 => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:02:03 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] VM Started (Lifecycle Event)
Jul 31 10:02:03 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:02:03 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:02:03 user nova-compute[71113]: DEBUG nova.compute.manager [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:02:03 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 31 10:02:03 user nova-compute[71113]: DEBUG nova.compute.manager [req-4f9659f7-a5d3-4205-9af2-cf5be5f80050 req-c3f12f86-7809-4e05-a041-cefbbbc1f998 service nova] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Received event network-vif-plugged-cc8f812f-2fff-475e-a41e-abf390366863 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:02:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-4f9659f7-a5d3-4205-9af2-cf5be5f80050 req-c3f12f86-7809-4e05-a041-cefbbbc1f998 service nova] Acquiring lock "9b01d025-2fe7-4ed9-827d-0546134b08a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:02:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-4f9659f7-a5d3-4205-9af2-cf5be5f80050 req-c3f12f86-7809-4e05-a041-cefbbbc1f998 service nova] Lock "9b01d025-2fe7-4ed9-827d-0546134b08a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:02:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-4f9659f7-a5d3-4205-9af2-cf5be5f80050 req-c3f12f86-7809-4e05-a041-cefbbbc1f998 service nova] Lock "9b01d025-2fe7-4ed9-827d-0546134b08a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:02:03 user nova-compute[71113]: DEBUG nova.compute.manager [req-4f9659f7-a5d3-4205-9af2-cf5be5f80050 req-c3f12f86-7809-4e05-a041-cefbbbc1f998 service nova] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] No waiting events found dispatching network-vif-plugged-cc8f812f-2fff-475e-a41e-abf390366863 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:02:03 user nova-compute[71113]: WARNING nova.compute.manager [req-4f9659f7-a5d3-4205-9af2-cf5be5f80050 req-c3f12f86-7809-4e05-a041-cefbbbc1f998 service nova] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Received unexpected event network-vif-plugged-cc8f812f-2fff-475e-a41e-abf390366863 for instance with vm_state active and task_state rebuild_spawning.
Jul 31 10:02:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:02:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:02:03 user nova-compute[71113]: DEBUG nova.objects.instance [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71113) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Jul 31 10:02:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5350720d-b11a-4646-8db3-b954e7238d9d tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.083s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:02:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:02:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:02:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:02:07 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:02:09 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690797714.7531118, a950d710-4596-4355-ac31-568c7728335a => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:02:09 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: a950d710-4596-4355-ac31-568c7728335a] VM Stopped (Lifecycle Event)
Jul 31 10:02:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:02:09 user nova-compute[71113]: DEBUG nova.compute.manager [None req-a8c581cc-0979-4823-ab42-b1fbd3925b27 None None] [instance: a950d710-4596-4355-ac31-568c7728335a] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:02:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:02:10 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:02:10 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:02:11 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:02:11 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:02:12 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:02:12 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:02:12 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:02:12 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:02:12 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:02:12 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:02:12 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:02:12 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:02:12 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 10:02:12 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 10:02:12 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 10:02:12 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/208130bc-5ece-4683-aa83-505ee89a8ba5/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:02:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/208130bc-5ece-4683-aa83-505ee89a8ba5/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:02:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/208130bc-5ece-4683-aa83-505ee89a8ba5/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:02:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/208130bc-5ece-4683-aa83-505ee89a8ba5/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:02:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b88201-04dc-4da9-b213-c50cdf274f4e/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:02:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b88201-04dc-4da9-b213-c50cdf274f4e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:02:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b88201-04dc-4da9-b213-c50cdf274f4e/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:02:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b88201-04dc-4da9-b213-c50cdf274f4e/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:02:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f020f166-07b6-4cf5-9f17-2ab108b55c30/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:02:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f020f166-07b6-4cf5-9f17-2ab108b55c30/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:02:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f020f166-07b6-4cf5-9f17-2ab108b55c30/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:02:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f020f166-07b6-4cf5-9f17-2ab108b55c30/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:02:13 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 10:02:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:02:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:02:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:02:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:02:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:02:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:02:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:02:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:02:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:02:14 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:02:14 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:02:14 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=7817MB free_disk=25.243431091308594GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:02:14 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:02:14 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:02:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:02:15 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 0ea0401b-26c2-4655-956b-1bc000debd53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:02:15 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 3157a7a6-b8a9-4e2d-a157-360bce4c625d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:02:15 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 92d25a03-98ce-4bde-a3cc-20313ae77d41 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:02:15 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance c4b88201-04dc-4da9-b213-c50cdf274f4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:02:15 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance f020f166-07b6-4cf5-9f17-2ab108b55c30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:02:15 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 9b01d025-2fe7-4ed9-827d-0546134b08a7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:02:15 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 208130bc-5ece-4683-aa83-505ee89a8ba5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:02:15 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance fc41eb59-d988-461c-941e-551ceb174ba1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:02:15 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 5ffa30ea-7458-4914-a6f4-9d8310ca977c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:02:15 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:02:15 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:02:15 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Refreshing inventories for resource provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 31 10:02:15 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Updating ProviderTree inventory for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 31 10:02:15 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Updating inventory in ProviderTree for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 31 10:02:15 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Refreshing aggregate associations for resource provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05, aggregates: None {{(pid=71113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 31 10:02:15 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Refreshing trait associations for resource provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE2,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS {{(pid=71113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 31 10:02:15 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:02:15 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:02:15 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:02:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.690s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:02:18 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:02:18 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:02:18 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:02:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "refresh_cache-c4b88201-04dc-4da9-b213-c50cdf274f4e" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:02:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquired lock "refresh_cache-c4b88201-04dc-4da9-b213-c50cdf274f4e" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:02:18 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Forcefully refreshing network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 10:02:19 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Updating instance_info_cache with network_info: [{"id": "b9c0f910-2e85-41e6-903c-4b678d4fbe5e", "address": "fa:16:3e:1b:88:27", "network": {"id": "5f333808-4342-4014-9221-7ccd394eff66", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-42408734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4b02badf8ea4f32a5e259c25120eac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9c0f910-2e", "ovs_interfaceid": "b9c0f910-2e85-41e6-903c-4b678d4fbe5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:02:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Releasing lock "refresh_cache-c4b88201-04dc-4da9-b213-c50cdf274f4e" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:02:19 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Updated the network info_cache for instance {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 10:02:19 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:02:19 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Cleaning up deleted instances {{(pid=71113) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 31 10:02:19 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] There are 0 instances to clean {{(pid=71113) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 31 10:02:19 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:02:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:02:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:02:21 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:02:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:02:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:02:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f7f41305-d002-4258-b0bf-2f14e075f37b tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Acquiring lock "208130bc-5ece-4683-aa83-505ee89a8ba5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:02:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f7f41305-d002-4258-b0bf-2f14e075f37b tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "208130bc-5ece-4683-aa83-505ee89a8ba5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:02:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f7f41305-d002-4258-b0bf-2f14e075f37b tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Acquiring lock "208130bc-5ece-4683-aa83-505ee89a8ba5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:02:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f7f41305-d002-4258-b0bf-2f14e075f37b tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "208130bc-5ece-4683-aa83-505ee89a8ba5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:02:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f7f41305-d002-4258-b0bf-2f14e075f37b tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "208130bc-5ece-4683-aa83-505ee89a8ba5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:02:25 user nova-compute[71113]: INFO nova.compute.manager [None req-f7f41305-d002-4258-b0bf-2f14e075f37b tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Terminating instance
Jul 31 10:02:25 user nova-compute[71113]: DEBUG nova.compute.manager [None req-f7f41305-d002-4258-b0bf-2f14e075f37b tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Start destroying the instance on the hypervisor. {{(pid=71113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 10:02:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:02:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:02:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:02:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:02:25 user nova-compute[71113]: DEBUG nova.compute.manager [req-3d6cfca8-adcd-45a2-b4f7-9487854eb7de req-9f71276a-4069-4b76-9084-240ce9c29acd service nova] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Received event network-vif-unplugged-d8cb465d-1593-4491-b337-8528c1bcfb3e {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:02:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3d6cfca8-adcd-45a2-b4f7-9487854eb7de req-9f71276a-4069-4b76-9084-240ce9c29acd service nova] Acquiring lock "208130bc-5ece-4683-aa83-505ee89a8ba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:02:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3d6cfca8-adcd-45a2-b4f7-9487854eb7de req-9f71276a-4069-4b76-9084-240ce9c29acd service nova] Lock "208130bc-5ece-4683-aa83-505ee89a8ba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:02:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3d6cfca8-adcd-45a2-b4f7-9487854eb7de req-9f71276a-4069-4b76-9084-240ce9c29acd service nova] Lock "208130bc-5ece-4683-aa83-505ee89a8ba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:02:25 user nova-compute[71113]: DEBUG nova.compute.manager [req-3d6cfca8-adcd-45a2-b4f7-9487854eb7de req-9f71276a-4069-4b76-9084-240ce9c29acd service nova] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] No waiting events found dispatching network-vif-unplugged-d8cb465d-1593-4491-b337-8528c1bcfb3e {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:02:25 user nova-compute[71113]: DEBUG nova.compute.manager [req-3d6cfca8-adcd-45a2-b4f7-9487854eb7de req-9f71276a-4069-4b76-9084-240ce9c29acd service nova] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Received event network-vif-unplugged-d8cb465d-1593-4491-b337-8528c1bcfb3e for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 10:02:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:02:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:02:25 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Instance destroyed successfully.
Jul 31 10:02:25 user nova-compute[71113]: DEBUG nova.objects.instance [None req-f7f41305-d002-4258-b0bf-2f14e075f37b tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lazy-loading 'resources' on Instance uuid 208130bc-5ece-4683-aa83-505ee89a8ba5 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:02:25 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-f7f41305-d002-4258-b0bf-2f14e075f37b tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T09:56:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-97586711',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-97586711',id=24,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+v3MPsTIfHcpTY6Yc9MWbbovJf56dPzvszMKErbyp/5ES3uvJPZ3C4p1soQ6orjbgw1Ikn6UYVzPxqHqb5fC5p2P+Nz5lCYomH/HxtkCE/snnyG2rynWTcNbrs5qIdaQ==',key_name='tempest-keypair-1581132008',keypairs=<?>,launch_index=0,launched_at=2023-07-31T10:00:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4461b48e5470471d8fe1b61fb8af9c8d',ramdisk_id='',reservation_id='r-q8o5zbgt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-960167684',owner_user_name='tempest-AttachVolumeShelveTestJSON-960167684-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T10:00:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5199c7da0634b6e8111782122adcf70',uuid=208130bc-5ece-4683-aa83-505ee89a8ba5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8cb465d-1593-4491-b337-8528c1bcfb3e", "address": "fa:16:3e:bb:b2:fd", "network": {"id": "e498d93a-703d-4d19-9adf-61469f37d4da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1320431580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4461b48e5470471d8fe1b61fb8af9c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8cb465d-15", "ovs_interfaceid": "d8cb465d-1593-4491-b337-8528c1bcfb3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 10:02:25 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-f7f41305-d002-4258-b0bf-2f14e075f37b tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Converting VIF {"id": "d8cb465d-1593-4491-b337-8528c1bcfb3e", "address": "fa:16:3e:bb:b2:fd", "network": {"id": "e498d93a-703d-4d19-9adf-61469f37d4da", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1320431580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4461b48e5470471d8fe1b61fb8af9c8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8cb465d-15", "ovs_interfaceid": "d8cb465d-1593-4491-b337-8528c1bcfb3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:02:25 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-f7f41305-d002-4258-b0bf-2f14e075f37b tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:b2:fd,bridge_name='br-int',has_traffic_filtering=True,id=d8cb465d-1593-4491-b337-8528c1bcfb3e,network=Network(e498d93a-703d-4d19-9adf-61469f37d4da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8cb465d-15') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:02:25 user nova-compute[71113]: DEBUG os_vif [None req-f7f41305-d002-4258-b0bf-2f14e075f37b tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:b2:fd,bridge_name='br-int',has_traffic_filtering=True,id=d8cb465d-1593-4491-b337-8528c1bcfb3e,network=Network(e498d93a-703d-4d19-9adf-61469f37d4da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8cb465d-15') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 10:02:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:02:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd8cb465d-15, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:02:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:02:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:02:25 user nova-compute[71113]: INFO os_vif [None req-f7f41305-d002-4258-b0bf-2f14e075f37b tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:b2:fd,bridge_name='br-int',has_traffic_filtering=True,id=d8cb465d-1593-4491-b337-8528c1bcfb3e,network=Network(e498d93a-703d-4d19-9adf-61469f37d4da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8cb465d-15')
Jul 31 10:02:25 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-f7f41305-d002-4258-b0bf-2f14e075f37b tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Deleting instance files /opt/stack/data/nova/instances/208130bc-5ece-4683-aa83-505ee89a8ba5_del
Jul 31 10:02:25 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-f7f41305-d002-4258-b0bf-2f14e075f37b tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Deletion of /opt/stack/data/nova/instances/208130bc-5ece-4683-aa83-505ee89a8ba5_del complete
Jul 31 10:02:25 user nova-compute[71113]: INFO nova.compute.manager [None req-f7f41305-d002-4258-b0bf-2f14e075f37b tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Took 0.89 seconds to destroy the instance on the hypervisor.
Jul 31 10:02:25 user nova-compute[71113]: DEBUG oslo.service.loopingcall [None req-f7f41305-d002-4258-b0bf-2f14e075f37b tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71113) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 10:02:25 user nova-compute[71113]: DEBUG nova.compute.manager [-] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Deallocating network for instance {{(pid=71113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 10:02:25 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] deallocate_for_instance() {{(pid=71113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 10:02:26 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:02:26 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Took 0.76 seconds to deallocate network for instance.
Jul 31 10:02:26 user nova-compute[71113]: DEBUG nova.compute.manager [req-2218bafe-f84b-4a2e-b022-c651d1322da4 req-73d41bad-5dd1-408c-bf01-7f0d0e12689f service nova] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Received event network-vif-deleted-d8cb465d-1593-4491-b337-8528c1bcfb3e {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:02:26 user nova-compute[71113]: INFO nova.compute.manager [req-2218bafe-f84b-4a2e-b022-c651d1322da4 req-73d41bad-5dd1-408c-bf01-7f0d0e12689f service nova] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Neutron deleted interface d8cb465d-1593-4491-b337-8528c1bcfb3e; detaching it from the instance and deleting it from the info cache
Jul 31 10:02:26 user nova-compute[71113]: DEBUG nova.network.neutron [req-2218bafe-f84b-4a2e-b022-c651d1322da4 req-73d41bad-5dd1-408c-bf01-7f0d0e12689f service nova] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:02:26 user nova-compute[71113]: DEBUG nova.compute.manager [req-2218bafe-f84b-4a2e-b022-c651d1322da4 req-73d41bad-5dd1-408c-bf01-7f0d0e12689f service nova] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Detach interface failed, port_id=d8cb465d-1593-4491-b337-8528c1bcfb3e, reason: Instance 208130bc-5ece-4683-aa83-505ee89a8ba5 could not be found. {{(pid=71113) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 10:02:26 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f7f41305-d002-4258-b0bf-2f14e075f37b tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:02:26 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f7f41305-d002-4258-b0bf-2f14e075f37b tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:02:27 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-f7f41305-d002-4258-b0bf-2f14e075f37b tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:02:27 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-f7f41305-d002-4258-b0bf-2f14e075f37b tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:02:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f7f41305-d002-4258-b0bf-2f14e075f37b tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.334s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:02:27 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-f7f41305-d002-4258-b0bf-2f14e075f37b tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Deleted allocations for instance 208130bc-5ece-4683-aa83-505ee89a8ba5
Jul 31 10:02:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f7f41305-d002-4258-b0bf-2f14e075f37b tempest-AttachVolumeShelveTestJSON-960167684 tempest-AttachVolumeShelveTestJSON-960167684-project-member] Lock "208130bc-5ece-4683-aa83-505ee89a8ba5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.197s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:02:27 user nova-compute[71113]: DEBUG nova.compute.manager [req-6ed6fba7-2864-441c-b3f4-739f21db9364 req-cb990cbf-4ac6-472a-add0-ffbc25a6d02b service nova] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Received event network-vif-plugged-d8cb465d-1593-4491-b337-8528c1bcfb3e {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:02:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-6ed6fba7-2864-441c-b3f4-739f21db9364 req-cb990cbf-4ac6-472a-add0-ffbc25a6d02b service nova] Acquiring lock "208130bc-5ece-4683-aa83-505ee89a8ba5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:02:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-6ed6fba7-2864-441c-b3f4-739f21db9364 req-cb990cbf-4ac6-472a-add0-ffbc25a6d02b service nova] Lock "208130bc-5ece-4683-aa83-505ee89a8ba5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:02:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-6ed6fba7-2864-441c-b3f4-739f21db9364 req-cb990cbf-4ac6-472a-add0-ffbc25a6d02b service nova] Lock "208130bc-5ece-4683-aa83-505ee89a8ba5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:02:27 user nova-compute[71113]: DEBUG nova.compute.manager [req-6ed6fba7-2864-441c-b3f4-739f21db9364 req-cb990cbf-4ac6-472a-add0-ffbc25a6d02b service nova] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] No waiting events found dispatching network-vif-plugged-d8cb465d-1593-4491-b337-8528c1bcfb3e {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:02:27 user nova-compute[71113]: WARNING nova.compute.manager [req-6ed6fba7-2864-441c-b3f4-739f21db9364 req-cb990cbf-4ac6-472a-add0-ffbc25a6d02b service nova] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Received unexpected event network-vif-plugged-d8cb465d-1593-4491-b337-8528c1bcfb3e for instance with vm_state deleted and task_state None.
Jul 31 10:02:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:02:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:02:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquiring lock "52f1f390-1599-4dda-9418-f12a48ef582c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:02:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "52f1f390-1599-4dda-9418-f12a48ef582c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:02:31 user nova-compute[71113]: DEBUG nova.compute.manager [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Starting instance... {{(pid=71113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 10:02:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:02:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:02:31 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 10:02:31 user nova-compute[71113]: INFO nova.compute.claims [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Claim successful on node user
Jul 31 10:02:31 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:02:31 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:02:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.382s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:02:31 user nova-compute[71113]: DEBUG nova.compute.manager [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Start building networks asynchronously for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 10:02:31 user nova-compute[71113]: DEBUG nova.compute.manager [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Allocating IP information in the background. {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 10:02:31 user nova-compute[71113]: DEBUG nova.network.neutron [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] allocate_for_instance() {{(pid=71113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 10:02:31 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 10:02:31 user nova-compute[71113]: DEBUG nova.compute.manager [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Start building block device mappings for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 10:02:31 user nova-compute[71113]: INFO nova.virt.block_device [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Booting with volume-backed-image 078646fe-b504-41ed-a147-61072e903e51 at /dev/vda
Jul 31 10:02:31 user nova-compute[71113]: DEBUG nova.policy [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f4f505d5eddc4df48ec267f6f69a01f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88bbf2636f6248fcbe644af4eab0c823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71113) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 10:02:32 user nova-compute[71113]: DEBUG nova.network.neutron [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Successfully created port: 6af975ec-2ae8-44fc-8762-90e9a13efbce {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 10:02:33 user nova-compute[71113]: DEBUG nova.network.neutron [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Successfully updated port: 6af975ec-2ae8-44fc-8762-90e9a13efbce {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 10:02:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquiring lock "refresh_cache-52f1f390-1599-4dda-9418-f12a48ef582c" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:02:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquired lock "refresh_cache-52f1f390-1599-4dda-9418-f12a48ef582c" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:02:33 user nova-compute[71113]: DEBUG nova.network.neutron [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 10:02:33 user nova-compute[71113]: DEBUG nova.compute.manager [req-f673680d-a36b-4fed-950a-0c32fe021834 req-db45edb0-8f8f-447b-b88d-5d2e9fdaf0db service nova] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Received event network-changed-6af975ec-2ae8-44fc-8762-90e9a13efbce {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:02:33 user nova-compute[71113]: DEBUG nova.compute.manager [req-f673680d-a36b-4fed-950a-0c32fe021834 req-db45edb0-8f8f-447b-b88d-5d2e9fdaf0db service nova] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Refreshing instance network info cache due to event network-changed-6af975ec-2ae8-44fc-8762-90e9a13efbce. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 10:02:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f673680d-a36b-4fed-950a-0c32fe021834 req-db45edb0-8f8f-447b-b88d-5d2e9fdaf0db service nova] Acquiring lock "refresh_cache-52f1f390-1599-4dda-9418-f12a48ef582c" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:02:33 user nova-compute[71113]: DEBUG nova.network.neutron [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 10:02:33 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:02:33 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71113) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 31 10:02:33 user nova-compute[71113]: DEBUG nova.network.neutron [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Updating instance_info_cache with network_info: [{"id": "6af975ec-2ae8-44fc-8762-90e9a13efbce", "address": "fa:16:3e:b2:53:f2", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af975ec-2a", "ovs_interfaceid": "6af975ec-2ae8-44fc-8762-90e9a13efbce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:02:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Releasing lock "refresh_cache-52f1f390-1599-4dda-9418-f12a48ef582c" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:02:33 user nova-compute[71113]: DEBUG nova.compute.manager [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Instance network_info: |[{"id": "6af975ec-2ae8-44fc-8762-90e9a13efbce", "address": "fa:16:3e:b2:53:f2", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af975ec-2a", "ovs_interfaceid": "6af975ec-2ae8-44fc-8762-90e9a13efbce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 10:02:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f673680d-a36b-4fed-950a-0c32fe021834 req-db45edb0-8f8f-447b-b88d-5d2e9fdaf0db service nova] Acquired lock "refresh_cache-52f1f390-1599-4dda-9418-f12a48ef582c" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:02:33 user nova-compute[71113]: DEBUG nova.network.neutron [req-f673680d-a36b-4fed-950a-0c32fe021834 req-db45edb0-8f8f-447b-b88d-5d2e9fdaf0db service nova] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Refreshing network info cache for port 6af975ec-2ae8-44fc-8762-90e9a13efbce {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 10:02:34 user nova-compute[71113]: DEBUG nova.network.neutron [req-f673680d-a36b-4fed-950a-0c32fe021834 req-db45edb0-8f8f-447b-b88d-5d2e9fdaf0db service nova] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Updated VIF entry in instance network info cache for port 6af975ec-2ae8-44fc-8762-90e9a13efbce. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 10:02:34 user nova-compute[71113]: DEBUG nova.network.neutron [req-f673680d-a36b-4fed-950a-0c32fe021834 req-db45edb0-8f8f-447b-b88d-5d2e9fdaf0db service nova] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Updating instance_info_cache with network_info: [{"id": "6af975ec-2ae8-44fc-8762-90e9a13efbce", "address": "fa:16:3e:b2:53:f2", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af975ec-2a", "ovs_interfaceid": "6af975ec-2ae8-44fc-8762-90e9a13efbce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:02:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f673680d-a36b-4fed-950a-0c32fe021834 req-db45edb0-8f8f-447b-b88d-5d2e9fdaf0db service nova] Releasing lock "refresh_cache-52f1f390-1599-4dda-9418-f12a48ef582c" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:02:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:02:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:02:39 user nova-compute[71113]: DEBUG nova.compute.manager [req-f1cf6e40-8da1-441c-b488-f40fd6cc8234 req-6ca600ff-0ad1-4f36-9d4a-305636c748ce service nova] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Received event network-changed-4d104a96-94cd-48ed-bab3-0f6dd4ecefba {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:02:39 user nova-compute[71113]: DEBUG nova.compute.manager [req-f1cf6e40-8da1-441c-b488-f40fd6cc8234 req-6ca600ff-0ad1-4f36-9d4a-305636c748ce service nova] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Refreshing instance network info cache due to event network-changed-4d104a96-94cd-48ed-bab3-0f6dd4ecefba. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 10:02:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f1cf6e40-8da1-441c-b488-f40fd6cc8234 req-6ca600ff-0ad1-4f36-9d4a-305636c748ce service nova] Acquiring lock "refresh_cache-fc41eb59-d988-461c-941e-551ceb174ba1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:02:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f1cf6e40-8da1-441c-b488-f40fd6cc8234 req-6ca600ff-0ad1-4f36-9d4a-305636c748ce service nova] Acquired lock "refresh_cache-fc41eb59-d988-461c-941e-551ceb174ba1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:02:39 user nova-compute[71113]: DEBUG nova.network.neutron [req-f1cf6e40-8da1-441c-b488-f40fd6cc8234 req-6ca600ff-0ad1-4f36-9d4a-305636c748ce service nova] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Refreshing network info cache for port 4d104a96-94cd-48ed-bab3-0f6dd4ecefba {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 10:02:40 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:02:40 user nova-compute[71113]: DEBUG nova.network.neutron [req-f1cf6e40-8da1-441c-b488-f40fd6cc8234 req-6ca600ff-0ad1-4f36-9d4a-305636c748ce service nova] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Updated VIF entry in instance network info cache for port 4d104a96-94cd-48ed-bab3-0f6dd4ecefba. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 10:02:40 user nova-compute[71113]: DEBUG nova.network.neutron [req-f1cf6e40-8da1-441c-b488-f40fd6cc8234 req-6ca600ff-0ad1-4f36-9d4a-305636c748ce service nova] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Updating instance_info_cache with network_info: [{"id": "4d104a96-94cd-48ed-bab3-0f6dd4ecefba", "address": "fa:16:3e:dc:ea:ab", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d104a96-94", "ovs_interfaceid": "4d104a96-94cd-48ed-bab3-0f6dd4ecefba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:02:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f1cf6e40-8da1-441c-b488-f40fd6cc8234 req-6ca600ff-0ad1-4f36-9d4a-305636c748ce service nova] Releasing lock "refresh_cache-fc41eb59-d988-461c-941e-551ceb174ba1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:02:40 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690797745.8467903, 208130bc-5ece-4683-aa83-505ee89a8ba5 => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:02:40 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] VM Stopped (Lifecycle Event)
Jul 31 10:02:40 user nova-compute[71113]: DEBUG nova.compute.manager [None req-4cf1d920-5c39-44b5-b23b-bf5f0c00f8da None None] [instance: 208130bc-5ece-4683-aa83-505ee89a8ba5] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:02:40 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:02:40 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:02:40 user nova-compute[71113]: WARNING nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] While synchronizing instance power states, found 9 instances in the database and 8 instances on the hypervisor.
Jul 31 10:02:40 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Triggering sync for uuid 0ea0401b-26c2-4655-956b-1bc000debd53 {{(pid=71113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 10:02:40 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Triggering sync for uuid 3157a7a6-b8a9-4e2d-a157-360bce4c625d {{(pid=71113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 10:02:40 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Triggering sync for uuid 92d25a03-98ce-4bde-a3cc-20313ae77d41 {{(pid=71113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 10:02:40 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Triggering sync for uuid c4b88201-04dc-4da9-b213-c50cdf274f4e {{(pid=71113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 10:02:40 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Triggering sync for uuid f020f166-07b6-4cf5-9f17-2ab108b55c30 {{(pid=71113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 10:02:40 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Triggering sync for uuid 9b01d025-2fe7-4ed9-827d-0546134b08a7 {{(pid=71113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 10:02:40 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Triggering sync for uuid fc41eb59-d988-461c-941e-551ceb174ba1 {{(pid=71113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 10:02:40 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Triggering sync for uuid 5ffa30ea-7458-4914-a6f4-9d8310ca977c {{(pid=71113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 10:02:40 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Triggering sync for uuid 52f1f390-1599-4dda-9418-f12a48ef582c {{(pid=71113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 10:02:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "0ea0401b-26c2-4655-956b-1bc000debd53" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:02:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "0ea0401b-26c2-4655-956b-1bc000debd53" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:02:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "3157a7a6-b8a9-4e2d-a157-360bce4c625d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:02:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "3157a7a6-b8a9-4e2d-a157-360bce4c625d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:02:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "92d25a03-98ce-4bde-a3cc-20313ae77d41" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:02:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "92d25a03-98ce-4bde-a3cc-20313ae77d41" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:02:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "c4b88201-04dc-4da9-b213-c50cdf274f4e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:02:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "c4b88201-04dc-4da9-b213-c50cdf274f4e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:02:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "f020f166-07b6-4cf5-9f17-2ab108b55c30" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:02:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "f020f166-07b6-4cf5-9f17-2ab108b55c30" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:02:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "9b01d025-2fe7-4ed9-827d-0546134b08a7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:02:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "9b01d025-2fe7-4ed9-827d-0546134b08a7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:02:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "fc41eb59-d988-461c-941e-551ceb174ba1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:02:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "fc41eb59-d988-461c-941e-551ceb174ba1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:02:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "5ffa30ea-7458-4914-a6f4-9d8310ca977c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:02:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "5ffa30ea-7458-4914-a6f4-9d8310ca977c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:02:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "52f1f390-1599-4dda-9418-f12a48ef582c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:02:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "3157a7a6-b8a9-4e2d-a157-360bce4c625d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:02:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "0ea0401b-26c2-4655-956b-1bc000debd53" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:02:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "92d25a03-98ce-4bde-a3cc-20313ae77d41" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:02:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "c4b88201-04dc-4da9-b213-c50cdf274f4e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:02:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "f020f166-07b6-4cf5-9f17-2ab108b55c30" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:02:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "9b01d025-2fe7-4ed9-827d-0546134b08a7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:02:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "5ffa30ea-7458-4914-a6f4-9d8310ca977c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:02:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "fc41eb59-d988-461c-941e-551ceb174ba1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.087s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:02:42 user nova-compute[71113]: DEBUG os_brick.utils [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:02:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:02:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:02:42 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec7d8ab-0439-4563-bbcc-e69c88452b0b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:02:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:02:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:02:42 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[80237867-9b47-4dd0-a301-563c6dca573c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:02:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:02:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:02:42 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f887343-01eb-499f-8166-1ab17b41482a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:02:42 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4968e81c-fbd3-4503-a4fe-b55b018f1737]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:02:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:02:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 10:02:42 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 10:02:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:02:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 10:02:42 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 10:02:42 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1361d915-7f92-45ad-89d8-2fb9a5b4c2db]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:02:42 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 10:02:42 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 10:02:42 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 10:02:42 user nova-compute[71113]: DEBUG os_brick.utils [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:02:42 user nova-compute[71113]: DEBUG nova.virt.block_device [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Updating existing volume attachment record: fb12baf0-7498-4417-9a23-2ca2e19c4fef {{(pid=71113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 10:02:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:02:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:02:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "b751cc3f-b5b1-438b-b251-c589774c2bcf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:02:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "b751cc3f-b5b1-438b-b251-c589774c2bcf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:02:47 user nova-compute[71113]: DEBUG nova.compute.manager [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Starting instance... {{(pid=71113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 10:02:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:02:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:02:47 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 10:02:47 user nova-compute[71113]: INFO nova.compute.claims [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Claim successful on node user
Jul 31 10:02:48 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:02:48 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:02:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.419s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:02:48 user nova-compute[71113]: DEBUG nova.compute.manager [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Start building networks asynchronously for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 10:02:48 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 10:02:48 user nova-compute[71113]: DEBUG nova.compute.manager [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Allocating IP information in the background. {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 10:02:48 user nova-compute[71113]: DEBUG nova.network.neutron [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] allocate_for_instance() {{(pid=71113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 10:02:48 user nova-compute[71113]: DEBUG nova.compute.manager [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Start building block device mappings for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 10:02:48 user nova-compute[71113]: INFO nova.virt.block_device [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Booting with volume snapshot ef2e6910-c67f-469d-97be-13733b9212ef at /dev/vda
Jul 31 10:02:48 user nova-compute[71113]: DEBUG nova.policy [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a58fe92488ed47b696fc5d6d990b1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa2add2e2a24b9cb8e48042b06931d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71113) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 10:02:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c93b2dac-dca5-43a5-9b7d-a1b97c766e05 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Acquiring lock "0ea0401b-26c2-4655-956b-1bc000debd53" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:02:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c93b2dac-dca5-43a5-9b7d-a1b97c766e05 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "0ea0401b-26c2-4655-956b-1bc000debd53" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:02:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c93b2dac-dca5-43a5-9b7d-a1b97c766e05 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Acquiring lock "0ea0401b-26c2-4655-956b-1bc000debd53-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:02:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c93b2dac-dca5-43a5-9b7d-a1b97c766e05 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "0ea0401b-26c2-4655-956b-1bc000debd53-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:02:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c93b2dac-dca5-43a5-9b7d-a1b97c766e05 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "0ea0401b-26c2-4655-956b-1bc000debd53-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:02:49 user nova-compute[71113]: INFO nova.compute.manager [None req-c93b2dac-dca5-43a5-9b7d-a1b97c766e05 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Terminating instance
Jul 31 10:02:49 user nova-compute[71113]: DEBUG nova.compute.manager [None req-c93b2dac-dca5-43a5-9b7d-a1b97c766e05 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Start destroying the instance on the hypervisor. {{(pid=71113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 10:02:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:02:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:02:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:02:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:02:49 user nova-compute[71113]: DEBUG nova.compute.manager [req-9104d779-dd89-467d-9b94-4dac5a29077e req-5039108e-93ff-4471-ab47-a2484b8eec8e service nova] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Received event network-vif-unplugged-5408a169-bdde-42da-be35-24006f474bc6 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:02:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9104d779-dd89-467d-9b94-4dac5a29077e req-5039108e-93ff-4471-ab47-a2484b8eec8e service nova] Acquiring lock "0ea0401b-26c2-4655-956b-1bc000debd53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:02:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9104d779-dd89-467d-9b94-4dac5a29077e req-5039108e-93ff-4471-ab47-a2484b8eec8e service nova] Lock "0ea0401b-26c2-4655-956b-1bc000debd53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:02:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9104d779-dd89-467d-9b94-4dac5a29077e req-5039108e-93ff-4471-ab47-a2484b8eec8e service nova] Lock "0ea0401b-26c2-4655-956b-1bc000debd53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:02:49 user nova-compute[71113]: DEBUG nova.compute.manager [req-9104d779-dd89-467d-9b94-4dac5a29077e req-5039108e-93ff-4471-ab47-a2484b8eec8e service nova] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] No waiting events found dispatching network-vif-unplugged-5408a169-bdde-42da-be35-24006f474bc6 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:02:49 user nova-compute[71113]: DEBUG nova.compute.manager [req-9104d779-dd89-467d-9b94-4dac5a29077e req-5039108e-93ff-4471-ab47-a2484b8eec8e service nova] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Received event network-vif-unplugged-5408a169-bdde-42da-be35-24006f474bc6 for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 10:02:49 user nova-compute[71113]: DEBUG nova.network.neutron [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Successfully created port: d36845e4-c20a-43b4-803b-529a8823d170 {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 10:02:49 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Instance destroyed successfully.
Jul 31 10:02:49 user nova-compute[71113]: DEBUG nova.objects.instance [None req-c93b2dac-dca5-43a5-9b7d-a1b97c766e05 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lazy-loading 'resources' on Instance uuid 0ea0401b-26c2-4655-956b-1bc000debd53 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:02:49 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-c93b2dac-dca5-43a5-9b7d-a1b97c766e05 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T09:46:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-554499227',display_name='tempest-ServerActionsTestOtherA-server-682149866',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-554499227',id=2,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5EE1xUvLRoodLjDMpmYpiUOpJ4L9wfbpJsZ+HUVFxXJGKbpzcG8jQIKPQ0cQElq3F/Fhyr7R6+c9C8jzz21FzCpd/o9T+iI7W2nanWOzhB0iUhT1vp4Ko8/FdZGlABXg==',key_name='tempest-keypair-58057469',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:50:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f7a5479fd014325b8790a80b2405d1d',ramdisk_id='',reservation_id='r-119yz4q0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2065923437',owner_user_name='tempest-ServerActionsTestOtherA-2065923437-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:50:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7029dd8d775d4c14bb349b72b1171d5f',uuid=0ea0401b-26c2-4655-956b-1bc000debd53,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5408a169-bdde-42da-be35-24006f474bc6", "address": "fa:16:3e:77:a3:62", "network": {"id": "cc84435f-b983-425d-bad0-36039e592e25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1662840158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f7a5479fd014325b8790a80b2405d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5408a169-bd", "ovs_interfaceid": "5408a169-bdde-42da-be35-24006f474bc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 10:02:49 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-c93b2dac-dca5-43a5-9b7d-a1b97c766e05 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Converting VIF {"id": "5408a169-bdde-42da-be35-24006f474bc6", "address": "fa:16:3e:77:a3:62", "network": {"id": "cc84435f-b983-425d-bad0-36039e592e25", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1662840158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f7a5479fd014325b8790a80b2405d1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5408a169-bd", "ovs_interfaceid": "5408a169-bdde-42da-be35-24006f474bc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:02:49 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-c93b2dac-dca5-43a5-9b7d-a1b97c766e05 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:a3:62,bridge_name='br-int',has_traffic_filtering=True,id=5408a169-bdde-42da-be35-24006f474bc6,network=Network(cc84435f-b983-425d-bad0-36039e592e25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5408a169-bd') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:02:49 user nova-compute[71113]: DEBUG os_vif [None req-c93b2dac-dca5-43a5-9b7d-a1b97c766e05 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:a3:62,bridge_name='br-int',has_traffic_filtering=True,id=5408a169-bdde-42da-be35-24006f474bc6,network=Network(cc84435f-b983-425d-bad0-36039e592e25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5408a169-bd') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 10:02:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:02:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5408a169-bd, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:02:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:02:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:02:49 user nova-compute[71113]: INFO os_vif [None req-c93b2dac-dca5-43a5-9b7d-a1b97c766e05 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:a3:62,bridge_name='br-int',has_traffic_filtering=True,id=5408a169-bdde-42da-be35-24006f474bc6,network=Network(cc84435f-b983-425d-bad0-36039e592e25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5408a169-bd')
Jul 31 10:02:49 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-c93b2dac-dca5-43a5-9b7d-a1b97c766e05 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Deleting instance files /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53_del
Jul 31 10:02:49 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-c93b2dac-dca5-43a5-9b7d-a1b97c766e05 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Deletion of /opt/stack/data/nova/instances/0ea0401b-26c2-4655-956b-1bc000debd53_del complete
Jul 31 10:02:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:02:50 user nova-compute[71113]: INFO nova.compute.manager [None req-c93b2dac-dca5-43a5-9b7d-a1b97c766e05 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Took 0.95 seconds to destroy the instance on the hypervisor.
Jul 31 10:02:50 user nova-compute[71113]: DEBUG oslo.service.loopingcall [None req-c93b2dac-dca5-43a5-9b7d-a1b97c766e05 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71113) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG nova.compute.manager [-] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Deallocating network for instance {{(pid=71113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] deallocate_for_instance() {{(pid=71113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG nova.compute.manager [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Start spawning the instance on the hypervisor. {{(pid=71113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 10:02:50 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Creating image(s)
Jul 31 10:02:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Did not create local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Ensure instance console log exists: /opt/stack/data/nova/instances/52f1f390-1599-4dda-9418-f12a48ef582c/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Start _get_guest_xml network_info=[{"id": "6af975ec-2ae8-44fc-8762-90e9a13efbce", "address": "fa:16:3e:b2:53:f2", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af975ec-2a", "ovs_interfaceid": "6af975ec-2ae8-44fc-8762-90e9a13efbce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'fb12baf0-7498-4417-9a23-2ca2e19c4fef', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OCHGdVDP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '52f1f390-1599-4dda-9418-f12a48ef582c', 'attached_at': '', 'detached_at': '', 'volume_id': 'd4041c37-33ce-4873-b87c-b4f145dd6fe7', 'serial': 'd4041c37-33ce-4873-b87c-b4f145dd6fe7'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 10:02:50 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:02:50 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:02:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OCHGdVDP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:02:50 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:02:50 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:02:50 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:02:50 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:02:50 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 10:02:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf583ed-d568-425c-806c-ee40febab934]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 10:02:50 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6f3606-d705-447e-9b77-2d1de6f8edc8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7] added
Jul 31 10:02:50 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dda72a3-5c73-4baa-be39-9295794ef298]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:02:50 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Took 0.69 seconds to deallocate network for instance.
Jul 31 10:02:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9c7b26-fca8-4f0c-b7e1-d6fdf66c1daf]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OCHGdVDP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OCHGdVDP" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f9a6bd-ca7e-4631-9b83-1da3b32fdff1]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OCHGdVDP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2972344a-80b4-475a-94bb-2b92498263a4]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c93b2dac-dca5-43a5-9b7d-a1b97c766e05 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c93b2dac-dca5-43a5-9b7d-a1b97c766e05 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG nova.compute.manager [req-41d28909-fd9d-40fd-9553-54ffcc9f9c8d req-706c0db3-b5b8-47f8-bc83-4a19b141133d service nova] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Received event network-vif-deleted-5408a169-bdde-42da-be35-24006f474bc6 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac507d78-ccae-49c3-ae52-b64c8779aaa9]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:02:50 user nova-compute[71113]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 (non-flash)
Jul 31 10:02:50 user nova-compute[71113]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d (non-flash)
Jul 31 10:02:50 user nova-compute[71113]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f (non-flash)
Jul 31 10:02:50 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:02:50 user nova-compute[71113]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 (non-flash)
Jul 31 10:02:50 user nova-compute[71113]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d (non-flash)
Jul 31 10:02:50 user nova-compute[71113]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f (non-flash)
Jul 31 10:02:50 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[29cacc86-8d5e-424e-9f3d-9f01417d86ae]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7, portal: 172.16.0.220,3260]
Jul 31 10:02:50 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7, portal: 172.16.0.220,3260] successful.
Jul 31 10:02:50 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG nova.network.neutron [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Successfully updated port: d36845e4-c20a-43b4-803b-529a8823d170 {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "refresh_cache-b751cc3f-b5b1-438b-b251-c589774c2bcf" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquired lock "refresh_cache-b751cc3f-b5b1-438b-b251-c589774c2bcf" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG nova.network.neutron [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[214e5434-a9dc-43b9-8a29-a75a157fa772]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8153d6d6-ac5a-4df6-ba15-e549a0a9680f]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:02:50 user nova-compute[71113]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 (non-flash)
Jul 31 10:02:50 user nova-compute[71113]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d (non-flash)
Jul 31 10:02:50 user nova-compute[71113]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f (non-flash)
Jul 31 10:02:50 user nova-compute[71113]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)
Jul 31 10:02:50 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:02:50 user nova-compute[71113]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 (non-flash)
Jul 31 10:02:50 user nova-compute[71113]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d (non-flash)
Jul 31 10:02:50 user nova-compute[71113]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f (non-flash)
Jul 31 10:02:50 user nova-compute[71113]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)
Jul 31 10:02:50 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] HCTL ('37', '-', '-', 0) found on session 41 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 10:02:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:02:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:02:51 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a52b92d-cd42-4106-95bd-710e50811afa]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:02:51 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Searching for a device in session 41 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 10:02:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OCHGdVDP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 10:02:51 user nova-compute[71113]: DEBUG nova.network.neutron [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 10:02:51 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-c93b2dac-dca5-43a5-9b7d-a1b97c766e05 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:02:51 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-c93b2dac-dca5-43a5-9b7d-a1b97c766e05 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:02:51 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c93b2dac-dca5-43a5-9b7d-a1b97c766e05 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.430s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:02:51 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-c93b2dac-dca5-43a5-9b7d-a1b97c766e05 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Deleted allocations for instance 0ea0401b-26c2-4655-956b-1bc000debd53
Jul 31 10:02:51 user nova-compute[71113]: DEBUG nova.network.neutron [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Updating instance_info_cache with network_info: [{"id": "d36845e4-c20a-43b4-803b-529a8823d170", "address": "fa:16:3e:18:05:a4", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd36845e4-c2", "ovs_interfaceid": "d36845e4-c20a-43b4-803b-529a8823d170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:02:51 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Releasing lock "refresh_cache-b751cc3f-b5b1-438b-b251-c589774c2bcf" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:02:51 user nova-compute[71113]: DEBUG nova.compute.manager [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Instance network_info: |[{"id": "d36845e4-c20a-43b4-803b-529a8823d170", "address": "fa:16:3e:18:05:a4", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd36845e4-c2", "ovs_interfaceid": "d36845e4-c20a-43b4-803b-529a8823d170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 10:02:51 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c93b2dac-dca5-43a5-9b7d-a1b97c766e05 tempest-ServerActionsTestOtherA-2065923437 tempest-ServerActionsTestOtherA-2065923437-project-member] Lock "0ea0401b-26c2-4655-956b-1bc000debd53" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.268s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:02:51 user nova-compute[71113]: DEBUG nova.compute.manager [req-7ecba0c1-dbf8-4d4c-be2c-8f68b6a41fe9 req-be661beb-9a2a-4f15-8ffa-8930813d2b92 service nova] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Received event network-vif-plugged-5408a169-bdde-42da-be35-24006f474bc6 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:02:51 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7ecba0c1-dbf8-4d4c-be2c-8f68b6a41fe9 req-be661beb-9a2a-4f15-8ffa-8930813d2b92 service nova] Acquiring lock "0ea0401b-26c2-4655-956b-1bc000debd53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:02:51 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7ecba0c1-dbf8-4d4c-be2c-8f68b6a41fe9 req-be661beb-9a2a-4f15-8ffa-8930813d2b92 service nova] Lock "0ea0401b-26c2-4655-956b-1bc000debd53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:02:51 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7ecba0c1-dbf8-4d4c-be2c-8f68b6a41fe9 req-be661beb-9a2a-4f15-8ffa-8930813d2b92 service nova] Lock "0ea0401b-26c2-4655-956b-1bc000debd53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:02:51 user nova-compute[71113]: DEBUG nova.compute.manager [req-7ecba0c1-dbf8-4d4c-be2c-8f68b6a41fe9 req-be661beb-9a2a-4f15-8ffa-8930813d2b92 service nova] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] No waiting events found dispatching network-vif-plugged-5408a169-bdde-42da-be35-24006f474bc6 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:02:51 user nova-compute[71113]: WARNING nova.compute.manager [req-7ecba0c1-dbf8-4d4c-be2c-8f68b6a41fe9 req-be661beb-9a2a-4f15-8ffa-8930813d2b92 service nova] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Received unexpected event network-vif-plugged-5408a169-bdde-42da-be35-24006f474bc6 for instance with vm_state deleted and task_state None.
Jul 31 10:02:51 user nova-compute[71113]: DEBUG nova.compute.manager [req-7ecba0c1-dbf8-4d4c-be2c-8f68b6a41fe9 req-be661beb-9a2a-4f15-8ffa-8930813d2b92 service nova] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Received event network-changed-d36845e4-c20a-43b4-803b-529a8823d170 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:02:51 user nova-compute[71113]: DEBUG nova.compute.manager [req-7ecba0c1-dbf8-4d4c-be2c-8f68b6a41fe9 req-be661beb-9a2a-4f15-8ffa-8930813d2b92 service nova] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Refreshing instance network info cache due to event network-changed-d36845e4-c20a-43b4-803b-529a8823d170. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 10:02:51 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7ecba0c1-dbf8-4d4c-be2c-8f68b6a41fe9 req-be661beb-9a2a-4f15-8ffa-8930813d2b92 service nova] Acquiring lock "refresh_cache-b751cc3f-b5b1-438b-b251-c589774c2bcf" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:02:51 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7ecba0c1-dbf8-4d4c-be2c-8f68b6a41fe9 req-be661beb-9a2a-4f15-8ffa-8930813d2b92 service nova] Acquired lock "refresh_cache-b751cc3f-b5b1-438b-b251-c589774c2bcf" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:02:51 user nova-compute[71113]: DEBUG nova.network.neutron [req-7ecba0c1-dbf8-4d4c-be2c-8f68b6a41fe9 req-be661beb-9a2a-4f15-8ffa-8930813d2b92 service nova] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Refreshing network info cache for port d36845e4-c20a-43b4-803b-529a8823d170 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 10:02:52 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:02:52 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '23065323163386162', 'path': '/dev/sdf'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:02:52 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065323163386162', 'path': '/dev/sdf'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 10:02:52 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:02:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1367258869',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1367258869',id=34,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88bbf2636f6248fcbe644af4eab0c823',ramdisk_id='',reservation_id='r-zhtgqe4c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1194948978',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T10:02:32Z,user_data=None,user_id='f4f505d5eddc4df48ec267f6f69a01f9',uuid=52f1f390-1599-4dda-9418-f12a48ef582c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6af975ec-2ae8-44fc-8762-90e9a13efbce", "address": "fa:16:3e:b2:53:f2", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af975ec-2a", "ovs_interfaceid": "6af975ec-2ae8-44fc-8762-90e9a13efbce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 10:02:52 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Converting VIF {"id": "6af975ec-2ae8-44fc-8762-90e9a13efbce", "address": "fa:16:3e:b2:53:f2", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af975ec-2a", "ovs_interfaceid": "6af975ec-2ae8-44fc-8762-90e9a13efbce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:02:52 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:53:f2,bridge_name='br-int',has_traffic_filtering=True,id=6af975ec-2ae8-44fc-8762-90e9a13efbce,network=Network(6f88bfaa-d58d-4ac2-b43d-0689d50456ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6af975ec-2a') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:02:52 user nova-compute[71113]: DEBUG nova.objects.instance [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lazy-loading 'pci_devices' on Instance uuid 52f1f390-1599-4dda-9418-f12a48ef582c {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:02:52 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] End _get_guest_xml xml=<domain type="kvm">
Jul 31 10:02:52 user nova-compute[71113]:   <uuid>52f1f390-1599-4dda-9418-f12a48ef582c</uuid>
Jul 31 10:02:52 user nova-compute[71113]:   <name>instance-00000022</name>
Jul 31 10:02:52 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 10:02:52 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 10:02:52 user nova-compute[71113]:   <metadata>
Jul 31 10:02:52 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 10:02:52 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 10:02:52 user nova-compute[71113]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1367258869</nova:name>
Jul 31 10:02:52 user nova-compute[71113]:       <nova:creationTime>2023-07-31 10:02:50</nova:creationTime>
Jul 31 10:02:52 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 10:02:52 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 10:02:52 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 10:02:52 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 10:02:52 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 10:02:52 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 10:02:52 user nova-compute[71113]:       </nova:flavor>
Jul 31 10:02:52 user nova-compute[71113]:       <nova:owner>
Jul 31 10:02:52 user nova-compute[71113]:         <nova:user uuid="f4f505d5eddc4df48ec267f6f69a01f9">tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member</nova:user>
Jul 31 10:02:52 user nova-compute[71113]:         <nova:project uuid="88bbf2636f6248fcbe644af4eab0c823">tempest-ServerBootFromVolumeStableRescueTest-1194948978</nova:project>
Jul 31 10:02:52 user nova-compute[71113]:       </nova:owner>
Jul 31 10:02:52 user nova-compute[71113]:       <nova:root type="image" uuid="078646fe-b504-41ed-a147-61072e903e51"/>
Jul 31 10:02:52 user nova-compute[71113]:       <nova:ports>
Jul 31 10:02:52 user nova-compute[71113]:         <nova:port uuid="6af975ec-2ae8-44fc-8762-90e9a13efbce">
Jul 31 10:02:52 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 31 10:02:52 user nova-compute[71113]:         </nova:port>
Jul 31 10:02:52 user nova-compute[71113]:       </nova:ports>
Jul 31 10:02:52 user nova-compute[71113]:     </nova:instance>
Jul 31 10:02:52 user nova-compute[71113]:   </metadata>
Jul 31 10:02:52 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 10:02:52 user nova-compute[71113]:     <system>
Jul 31 10:02:52 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 10:02:52 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 10:02:52 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 10:02:52 user nova-compute[71113]:       <entry name="serial">52f1f390-1599-4dda-9418-f12a48ef582c</entry>
Jul 31 10:02:52 user nova-compute[71113]:       <entry name="uuid">52f1f390-1599-4dda-9418-f12a48ef582c</entry>
Jul 31 10:02:52 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 10:02:52 user nova-compute[71113]:     </system>
Jul 31 10:02:52 user nova-compute[71113]:   </sysinfo>
Jul 31 10:02:52 user nova-compute[71113]:   <os>
Jul 31 10:02:52 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 10:02:52 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 10:02:52 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 10:02:52 user nova-compute[71113]:   </os>
Jul 31 10:02:52 user nova-compute[71113]:   <features>
Jul 31 10:02:52 user nova-compute[71113]:     <acpi/>
Jul 31 10:02:52 user nova-compute[71113]:     <apic/>
Jul 31 10:02:52 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 10:02:52 user nova-compute[71113]:   </features>
Jul 31 10:02:52 user nova-compute[71113]:   <clock offset="utc">
Jul 31 10:02:52 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 10:02:52 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 10:02:52 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 10:02:52 user nova-compute[71113]:   </clock>
Jul 31 10:02:52 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 10:02:52 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 10:02:52 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 10:02:52 user nova-compute[71113]:   </cpu>
Jul 31 10:02:52 user nova-compute[71113]:   <devices>
Jul 31 10:02:52 user nova-compute[71113]:     <disk type="block" device="disk">
Jul 31 10:02:52 user nova-compute[71113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:02:52 user nova-compute[71113]:       <source dev="/dev/sdf"/>
Jul 31 10:02:52 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 10:02:52 user nova-compute[71113]:       <serial>d4041c37-33ce-4873-b87c-b4f145dd6fe7</serial>
Jul 31 10:02:52 user nova-compute[71113]:     </disk>
Jul 31 10:02:52 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 10:02:52 user nova-compute[71113]:       <mac address="fa:16:3e:b2:53:f2"/>
Jul 31 10:02:52 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:02:52 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 10:02:52 user nova-compute[71113]:       <target dev="tap6af975ec-2a"/>
Jul 31 10:02:52 user nova-compute[71113]:     </interface>
Jul 31 10:02:52 user nova-compute[71113]:     <serial type="pty">
Jul 31 10:02:52 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/52f1f390-1599-4dda-9418-f12a48ef582c/console.log" append="off"/>
Jul 31 10:02:52 user nova-compute[71113]:     </serial>
Jul 31 10:02:52 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 10:02:52 user nova-compute[71113]:     <video>
Jul 31 10:02:52 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:02:52 user nova-compute[71113]:     </video>
Jul 31 10:02:52 user nova-compute[71113]:     <rng model="virtio">
Jul 31 10:02:52 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 10:02:52 user nova-compute[71113]:     </rng>
Jul 31 10:02:52 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 10:02:52 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 10:02:52 user nova-compute[71113]:       <stats period="10"/>
Jul 31 10:02:52 user nova-compute[71113]:     </memballoon>
Jul 31 10:02:52 user nova-compute[71113]:   </devices>
Jul 31 10:02:52 user nova-compute[71113]: </domain>
Jul 31 10:02:52 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 10:02:52 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:02:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1367258869',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1367258869',id=34,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88bbf2636f6248fcbe644af4eab0c823',ramdisk_id='',reservation_id='r-zhtgqe4c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1194948978',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T10:02:32Z,user_data=None,user_id='f4f505d5eddc4df48ec267f6f69a01f9',uuid=52f1f390-1599-4dda-9418-f12a48ef582c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6af975ec-2ae8-44fc-8762-90e9a13efbce", "address": "fa:16:3e:b2:53:f2", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af975ec-2a", "ovs_interfaceid": "6af975ec-2ae8-44fc-8762-90e9a13efbce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 10:02:52 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Converting VIF {"id": "6af975ec-2ae8-44fc-8762-90e9a13efbce", "address": "fa:16:3e:b2:53:f2", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af975ec-2a", "ovs_interfaceid": "6af975ec-2ae8-44fc-8762-90e9a13efbce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:02:52 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:53:f2,bridge_name='br-int',has_traffic_filtering=True,id=6af975ec-2ae8-44fc-8762-90e9a13efbce,network=Network(6f88bfaa-d58d-4ac2-b43d-0689d50456ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6af975ec-2a') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:02:52 user nova-compute[71113]: DEBUG os_vif [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:53:f2,bridge_name='br-int',has_traffic_filtering=True,id=6af975ec-2ae8-44fc-8762-90e9a13efbce,network=Network(6f88bfaa-d58d-4ac2-b43d-0689d50456ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6af975ec-2a') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 10:02:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:02:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:02:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 10:02:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:02:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6af975ec-2a, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:02:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6af975ec-2a, col_values=(('external_ids', {'iface-id': '6af975ec-2ae8-44fc-8762-90e9a13efbce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:53:f2', 'vm-uuid': '52f1f390-1599-4dda-9418-f12a48ef582c'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:02:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:02:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:02:52 user nova-compute[71113]: INFO os_vif [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:53:f2,bridge_name='br-int',has_traffic_filtering=True,id=6af975ec-2ae8-44fc-8762-90e9a13efbce,network=Network(6f88bfaa-d58d-4ac2-b43d-0689d50456ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6af975ec-2a')
Jul 31 10:02:52 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:02:52 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] No VIF found with MAC fa:16:3e:b2:53:f2, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 10:02:52 user nova-compute[71113]: DEBUG nova.network.neutron [req-7ecba0c1-dbf8-4d4c-be2c-8f68b6a41fe9 req-be661beb-9a2a-4f15-8ffa-8930813d2b92 service nova] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Updated VIF entry in instance network info cache for port d36845e4-c20a-43b4-803b-529a8823d170. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 10:02:52 user nova-compute[71113]: DEBUG nova.network.neutron [req-7ecba0c1-dbf8-4d4c-be2c-8f68b6a41fe9 req-be661beb-9a2a-4f15-8ffa-8930813d2b92 service nova] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Updating instance_info_cache with network_info: [{"id": "d36845e4-c20a-43b4-803b-529a8823d170", "address": "fa:16:3e:18:05:a4", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd36845e4-c2", "ovs_interfaceid": "d36845e4-c20a-43b4-803b-529a8823d170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:02:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7ecba0c1-dbf8-4d4c-be2c-8f68b6a41fe9 req-be661beb-9a2a-4f15-8ffa-8930813d2b92 service nova] Releasing lock "refresh_cache-b751cc3f-b5b1-438b-b251-c589774c2bcf" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:02:53 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:02:53 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:02:53 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:02:53 user nova-compute[71113]: DEBUG nova.compute.manager [req-8447fc94-8df7-4fd5-89f7-a8a4ec5df35c req-bc960491-bac6-47e6-90e6-15e3673177c1 service nova] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Received event network-vif-plugged-6af975ec-2ae8-44fc-8762-90e9a13efbce {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:02:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8447fc94-8df7-4fd5-89f7-a8a4ec5df35c req-bc960491-bac6-47e6-90e6-15e3673177c1 service nova] Acquiring lock "52f1f390-1599-4dda-9418-f12a48ef582c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:02:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8447fc94-8df7-4fd5-89f7-a8a4ec5df35c req-bc960491-bac6-47e6-90e6-15e3673177c1 service nova] Lock "52f1f390-1599-4dda-9418-f12a48ef582c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:02:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8447fc94-8df7-4fd5-89f7-a8a4ec5df35c req-bc960491-bac6-47e6-90e6-15e3673177c1 service nova] Lock "52f1f390-1599-4dda-9418-f12a48ef582c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:02:53 user nova-compute[71113]: DEBUG nova.compute.manager [req-8447fc94-8df7-4fd5-89f7-a8a4ec5df35c req-bc960491-bac6-47e6-90e6-15e3673177c1 service nova] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] No waiting events found dispatching network-vif-plugged-6af975ec-2ae8-44fc-8762-90e9a13efbce {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:02:53 user nova-compute[71113]: WARNING nova.compute.manager [req-8447fc94-8df7-4fd5-89f7-a8a4ec5df35c req-bc960491-bac6-47e6-90e6-15e3673177c1 service nova] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Received unexpected event network-vif-plugged-6af975ec-2ae8-44fc-8762-90e9a13efbce for instance with vm_state building and task_state spawning.
Jul 31 10:02:53 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:02:53 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:02:53 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:02:54 user nova-compute[71113]: DEBUG os_brick.utils [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:02:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:02:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:02:54 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[57729fa2-69f8-42eb-a882-fa286820e5a8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:02:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:02:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:02:54 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da5cd53-cd81-4335-9e47-3c7d380fcefb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:02:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:02:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:02:54 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec73150-f3be-4c87-ad8e-5ee093ec9f19]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:02:54 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[95163501-1239-4e6f-8fd3-78da9ad917ff]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:02:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:02:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 10:02:54 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 10:02:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:02:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 10:02:54 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 10:02:54 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3474703-2931-4638-8fa1-4b04cad436d8]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:02:54 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 10:02:54 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 10:02:54 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 10:02:54 user nova-compute[71113]: DEBUG os_brick.utils [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:02:54 user nova-compute[71113]: DEBUG nova.virt.block_device [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Updating existing volume attachment record: dac96234-9c22-448c-9721-a6d4cbddc982 {{(pid=71113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 10:02:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:02:55 user nova-compute[71113]: DEBUG nova.compute.manager [req-afa9c205-58fd-4ad5-9442-325d58628eb2 req-4a00f0b7-fda3-4742-8cfc-03c1e74cf7f4 service nova] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Received event network-vif-plugged-6af975ec-2ae8-44fc-8762-90e9a13efbce {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:02:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-afa9c205-58fd-4ad5-9442-325d58628eb2 req-4a00f0b7-fda3-4742-8cfc-03c1e74cf7f4 service nova] Acquiring lock "52f1f390-1599-4dda-9418-f12a48ef582c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:02:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-afa9c205-58fd-4ad5-9442-325d58628eb2 req-4a00f0b7-fda3-4742-8cfc-03c1e74cf7f4 service nova] Lock "52f1f390-1599-4dda-9418-f12a48ef582c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:02:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-afa9c205-58fd-4ad5-9442-325d58628eb2 req-4a00f0b7-fda3-4742-8cfc-03c1e74cf7f4 service nova] Lock "52f1f390-1599-4dda-9418-f12a48ef582c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:02:55 user nova-compute[71113]: DEBUG nova.compute.manager [req-afa9c205-58fd-4ad5-9442-325d58628eb2 req-4a00f0b7-fda3-4742-8cfc-03c1e74cf7f4 service nova] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] No waiting events found dispatching network-vif-plugged-6af975ec-2ae8-44fc-8762-90e9a13efbce {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:02:55 user nova-compute[71113]: WARNING nova.compute.manager [req-afa9c205-58fd-4ad5-9442-325d58628eb2 req-4a00f0b7-fda3-4742-8cfc-03c1e74cf7f4 service nova] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Received unexpected event network-vif-plugged-6af975ec-2ae8-44fc-8762-90e9a13efbce for instance with vm_state building and task_state spawning.
Jul 31 10:02:55 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797775.6868498, 52f1f390-1599-4dda-9418-f12a48ef582c => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:02:55 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] VM Resumed (Lifecycle Event)
Jul 31 10:02:55 user nova-compute[71113]: DEBUG nova.compute.manager [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 10:02:55 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 10:02:55 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Instance spawned successfully.
Jul 31 10:02:55 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 10:02:55 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:02:55 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Found default for hw_cdrom_bus of ide {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:02:55 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Found default for hw_disk_bus of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:02:55 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Found default for hw_input_bus of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:02:55 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Found default for hw_pointer_model of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:02:55 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Found default for hw_video_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:02:55 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Found default for hw_vif_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:02:55 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:02:55 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 10:02:55 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797775.6871128, 52f1f390-1599-4dda-9418-f12a48ef582c => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:02:55 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] VM Started (Lifecycle Event)
Jul 31 10:02:55 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:02:55 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:02:55 user nova-compute[71113]: INFO nova.compute.manager [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Took 5.25 seconds to spawn the instance on the hypervisor.
Jul 31 10:02:55 user nova-compute[71113]: DEBUG nova.compute.manager [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:02:55 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 10:02:55 user nova-compute[71113]: INFO nova.compute.manager [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Took 24.75 seconds to build instance.
Jul 31 10:02:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-705786df-ad04-46b4-ac8c-0ba0c64e1db3 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "52f1f390-1599-4dda-9418-f12a48ef582c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.847s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:02:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "52f1f390-1599-4dda-9418-f12a48ef582c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 15.016s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:02:55 user nova-compute[71113]: INFO nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Jul 31 10:02:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "52f1f390-1599-4dda-9418-f12a48ef582c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:02:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG nova.compute.manager [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Start spawning the instance on the hypervisor. {{(pid=71113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 10:03:02 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Creating image(s)
Jul 31 10:03:02 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Did not create local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Ensure instance console log exists: /opt/stack/data/nova/instances/b751cc3f-b5b1-438b-b251-c589774c2bcf/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Start _get_guest_xml network_info=[{"id": "d36845e4-c20a-43b4-803b-529a8823d170", "address": "fa:16:3e:18:05:a4", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd36845e4-c2", "ovs_interfaceid": "d36845e4-c20a-43b4-803b-529a8823d170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-07-31T10:02:41Z,direct_url=<?>,disk_format='qcow2',id=ca65a28b-1891-4dc6-acb5-601505c22b15,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1051131313',owner='3aa2add2e2a24b9cb8e48042b06931d3',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-07-31T10:02:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'dac96234-9c22-448c-9721-a6d4cbddc982', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mFpgjPzA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b751cc3f-b5b1-438b-b251-c589774c2bcf', 'attached_at': '', 'detached_at': '', 'volume_id': '186010c9-30be-4722-bb2e-0f48c4b0bc8c', 'serial': '186010c9-30be-4722-bb2e-0f48c4b0bc8c'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 10:03:02 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:03:02 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:03:02 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-07-31T10:02:41Z,direct_url=<?>,disk_format='qcow2',id=ca65a28b-1891-4dc6-acb5-601505c22b15,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1051131313',owner='3aa2add2e2a24b9cb8e48042b06931d3',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-07-31T10:02:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mFpgjPzA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:03:02 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:03:02 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:03:02 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:03:02 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:03:02 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 10:03:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d11ee3-b285-4630-8114-bf356a2a0f87]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 10:03:02 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[309a85a4-d5c0-4adb-b736-d44624a20fd3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c] added
Jul 31 10:03:02 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36e6dd6-a2dd-4c34-bb5b-d7b5a7b23cbe]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0438bf4-e32e-4b15-b200-e1a253b8d757]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mFpgjPzA {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mFpgjPzA" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc73c74-d4c2-42c9-bd34-50933cec7335]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mFpgjPzA'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53d560b-4ad3-4a44-8520-147f5adf018e]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5196e783-0c0e-4e14-aa82-ba7cab452cc2]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:03:02 user nova-compute[71113]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 (non-flash)
Jul 31 10:03:02 user nova-compute[71113]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d (non-flash)
Jul 31 10:03:02 user nova-compute[71113]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f (non-flash)
Jul 31 10:03:02 user nova-compute[71113]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)
Jul 31 10:03:02 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:03:02 user nova-compute[71113]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 (non-flash)
Jul 31 10:03:02 user nova-compute[71113]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d (non-flash)
Jul 31 10:03:02 user nova-compute[71113]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f (non-flash)
Jul 31 10:03:02 user nova-compute[71113]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)
Jul 31 10:03:02 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ab17f9-9bf8-47b8-8bfa-e9d968d6dbc4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c, portal: 172.16.0.220,3260]
Jul 31 10:03:02 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c, portal: 172.16.0.220,3260] successful.
Jul 31 10:03:02 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc6270c-674e-4fb0-a6ab-1235af41361d]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bbc107-e6e3-4ba7-9557-584caebf34b2]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:03:02 user nova-compute[71113]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 (non-flash)
Jul 31 10:03:02 user nova-compute[71113]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d (non-flash)
Jul 31 10:03:02 user nova-compute[71113]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f (non-flash)
Jul 31 10:03:02 user nova-compute[71113]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)
Jul 31 10:03:02 user nova-compute[71113]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c (non-flash)
Jul 31 10:03:02 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:03:02 user nova-compute[71113]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 (non-flash)
Jul 31 10:03:02 user nova-compute[71113]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d (non-flash)
Jul 31 10:03:02 user nova-compute[71113]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f (non-flash)
Jul 31 10:03:02 user nova-compute[71113]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)
Jul 31 10:03:02 user nova-compute[71113]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c (non-flash)
Jul 31 10:03:02 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] HCTL ('38', '-', '-', 0) found on session 42 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.029s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd77d6d-f312-4c94-8a9c-bda58d01f821]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Searching for a device in session 42 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 10:03:02 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mFpgjPzA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 10:03:03 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:03:03 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '26638353164366231', 'path': '/dev/sdg'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:03:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638353164366231', 'path': '/dev/sdg'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 10:03:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:02:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1943543533',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1943543533',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1943543533',id=35,image_ref='ca65a28b-1891-4dc6-acb5-601505c22b15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB2eqPqjpfda73MYODnqXl+e1YE2deD1IwnXje4zqwMYGpvHz0HR4sU3EoQUGDqnWCTGb60YLXWhIxm4LlP/L0vWRvQUYk7EiBfmrNQbkELoIEQ1Kfb3mHe0tPwceNgEsg==',key_name='tempest-keypair-1719870748',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3aa2add2e2a24b9cb8e48042b06931d3',ramdisk_id='',reservation_id='r-ljiv5quq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1754399827',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1754399827-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1754399827',owner_user_name='tempest-TestVolumeBootPattern-1754399827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T10:02:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a58fe92488ed47b696fc5d6d990b1acd',uuid=b751cc3f-b5b1-438b-b251-c589774c2bcf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d36845e4-c20a-43b4-803b-529a8823d170", "address": "fa:16:3e:18:05:a4", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd36845e4-c2", "ovs_interfaceid": "d36845e4-c20a-43b4-803b-529a8823d170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 10:03:03 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Converting VIF {"id": "d36845e4-c20a-43b4-803b-529a8823d170", "address": "fa:16:3e:18:05:a4", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd36845e4-c2", "ovs_interfaceid": "d36845e4-c20a-43b4-803b-529a8823d170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:03:03 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:05:a4,bridge_name='br-int',has_traffic_filtering=True,id=d36845e4-c20a-43b4-803b-529a8823d170,network=Network(fa792d7a-ddf6-4a2d-acb9-802f8daf87ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd36845e4-c2') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:03:03 user nova-compute[71113]: DEBUG nova.objects.instance [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lazy-loading 'pci_devices' on Instance uuid b751cc3f-b5b1-438b-b251-c589774c2bcf {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:03:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] End _get_guest_xml xml=<domain type="kvm">
Jul 31 10:03:03 user nova-compute[71113]:   <uuid>b751cc3f-b5b1-438b-b251-c589774c2bcf</uuid>
Jul 31 10:03:03 user nova-compute[71113]:   <name>instance-00000023</name>
Jul 31 10:03:03 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 10:03:03 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 10:03:03 user nova-compute[71113]:   <metadata>
Jul 31 10:03:03 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 10:03:03 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 10:03:03 user nova-compute[71113]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1943543533</nova:name>
Jul 31 10:03:03 user nova-compute[71113]:       <nova:creationTime>2023-07-31 10:03:02</nova:creationTime>
Jul 31 10:03:03 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 10:03:03 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 10:03:03 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 10:03:03 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 10:03:03 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 10:03:03 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 10:03:03 user nova-compute[71113]:       </nova:flavor>
Jul 31 10:03:03 user nova-compute[71113]:       <nova:owner>
Jul 31 10:03:03 user nova-compute[71113]:         <nova:user uuid="a58fe92488ed47b696fc5d6d990b1acd">tempest-TestVolumeBootPattern-1754399827-project-member</nova:user>
Jul 31 10:03:03 user nova-compute[71113]:         <nova:project uuid="3aa2add2e2a24b9cb8e48042b06931d3">tempest-TestVolumeBootPattern-1754399827</nova:project>
Jul 31 10:03:03 user nova-compute[71113]:       </nova:owner>
Jul 31 10:03:03 user nova-compute[71113]:       <nova:root type="image" uuid="ca65a28b-1891-4dc6-acb5-601505c22b15"/>
Jul 31 10:03:03 user nova-compute[71113]:       <nova:ports>
Jul 31 10:03:03 user nova-compute[71113]:         <nova:port uuid="d36845e4-c20a-43b4-803b-529a8823d170">
Jul 31 10:03:03 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 31 10:03:03 user nova-compute[71113]:         </nova:port>
Jul 31 10:03:03 user nova-compute[71113]:       </nova:ports>
Jul 31 10:03:03 user nova-compute[71113]:     </nova:instance>
Jul 31 10:03:03 user nova-compute[71113]:   </metadata>
Jul 31 10:03:03 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 10:03:03 user nova-compute[71113]:     <system>
Jul 31 10:03:03 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 10:03:03 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 10:03:03 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 10:03:03 user nova-compute[71113]:       <entry name="serial">b751cc3f-b5b1-438b-b251-c589774c2bcf</entry>
Jul 31 10:03:03 user nova-compute[71113]:       <entry name="uuid">b751cc3f-b5b1-438b-b251-c589774c2bcf</entry>
Jul 31 10:03:03 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 10:03:03 user nova-compute[71113]:     </system>
Jul 31 10:03:03 user nova-compute[71113]:   </sysinfo>
Jul 31 10:03:03 user nova-compute[71113]:   <os>
Jul 31 10:03:03 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 10:03:03 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 10:03:03 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 10:03:03 user nova-compute[71113]:   </os>
Jul 31 10:03:03 user nova-compute[71113]:   <features>
Jul 31 10:03:03 user nova-compute[71113]:     <acpi/>
Jul 31 10:03:03 user nova-compute[71113]:     <apic/>
Jul 31 10:03:03 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 10:03:03 user nova-compute[71113]:   </features>
Jul 31 10:03:03 user nova-compute[71113]:   <clock offset="utc">
Jul 31 10:03:03 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 10:03:03 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 10:03:03 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 10:03:03 user nova-compute[71113]:   </clock>
Jul 31 10:03:03 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 10:03:03 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 10:03:03 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 10:03:03 user nova-compute[71113]:   </cpu>
Jul 31 10:03:03 user nova-compute[71113]:   <devices>
Jul 31 10:03:03 user nova-compute[71113]:     <disk type="block" device="disk">
Jul 31 10:03:03 user nova-compute[71113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:03:03 user nova-compute[71113]:       <source dev="/dev/sdg"/>
Jul 31 10:03:03 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 10:03:03 user nova-compute[71113]:       <serial>186010c9-30be-4722-bb2e-0f48c4b0bc8c</serial>
Jul 31 10:03:03 user nova-compute[71113]:     </disk>
Jul 31 10:03:03 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 10:03:03 user nova-compute[71113]:       <mac address="fa:16:3e:18:05:a4"/>
Jul 31 10:03:03 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:03:03 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 10:03:03 user nova-compute[71113]:       <target dev="tapd36845e4-c2"/>
Jul 31 10:03:03 user nova-compute[71113]:     </interface>
Jul 31 10:03:03 user nova-compute[71113]:     <serial type="pty">
Jul 31 10:03:03 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/b751cc3f-b5b1-438b-b251-c589774c2bcf/console.log" append="off"/>
Jul 31 10:03:03 user nova-compute[71113]:     </serial>
Jul 31 10:03:03 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 10:03:03 user nova-compute[71113]:     <video>
Jul 31 10:03:03 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:03:03 user nova-compute[71113]:     </video>
Jul 31 10:03:03 user nova-compute[71113]:     <rng model="virtio">
Jul 31 10:03:03 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 10:03:03 user nova-compute[71113]:     </rng>
Jul 31 10:03:03 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 10:03:03 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 10:03:03 user nova-compute[71113]:       <stats period="10"/>
Jul 31 10:03:03 user nova-compute[71113]:     </memballoon>
Jul 31 10:03:03 user nova-compute[71113]:   </devices>
Jul 31 10:03:03 user nova-compute[71113]: </domain>
Jul 31 10:03:03 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 10:03:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:02:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1943543533',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1943543533',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1943543533',id=35,image_ref='ca65a28b-1891-4dc6-acb5-601505c22b15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB2eqPqjpfda73MYODnqXl+e1YE2deD1IwnXje4zqwMYGpvHz0HR4sU3EoQUGDqnWCTGb60YLXWhIxm4LlP/L0vWRvQUYk7EiBfmrNQbkELoIEQ1Kfb3mHe0tPwceNgEsg==',key_name='tempest-keypair-1719870748',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3aa2add2e2a24b9cb8e48042b06931d3',ramdisk_id='',reservation_id='r-ljiv5quq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1754399827',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1754399827-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1754399827',owner_user_name='tempest-TestVolumeBootPattern-1754399827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T10:02:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a58fe92488ed47b696fc5d6d990b1acd',uuid=b751cc3f-b5b1-438b-b251-c589774c2bcf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d36845e4-c20a-43b4-803b-529a8823d170", "address": "fa:16:3e:18:05:a4", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd36845e4-c2", "ovs_interfaceid": "d36845e4-c20a-43b4-803b-529a8823d170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 10:03:03 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Converting VIF {"id": "d36845e4-c20a-43b4-803b-529a8823d170", "address": "fa:16:3e:18:05:a4", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd36845e4-c2", "ovs_interfaceid": "d36845e4-c20a-43b4-803b-529a8823d170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:03:03 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:05:a4,bridge_name='br-int',has_traffic_filtering=True,id=d36845e4-c20a-43b4-803b-529a8823d170,network=Network(fa792d7a-ddf6-4a2d-acb9-802f8daf87ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd36845e4-c2') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:03:03 user nova-compute[71113]: DEBUG os_vif [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:05:a4,bridge_name='br-int',has_traffic_filtering=True,id=d36845e4-c20a-43b4-803b-529a8823d170,network=Network(fa792d7a-ddf6-4a2d-acb9-802f8daf87ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd36845e4-c2') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 10:03:03 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:03:03 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:03:03 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 10:03:03 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:03:03 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd36845e4-c2, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:03:03 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd36845e4-c2, col_values=(('external_ids', {'iface-id': 'd36845e4-c20a-43b4-803b-529a8823d170', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:05:a4', 'vm-uuid': 'b751cc3f-b5b1-438b-b251-c589774c2bcf'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:03:03 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:03:03 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:03:03 user nova-compute[71113]: INFO os_vif [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:05:a4,bridge_name='br-int',has_traffic_filtering=True,id=d36845e4-c20a-43b4-803b-529a8823d170,network=Network(fa792d7a-ddf6-4a2d-acb9-802f8daf87ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd36845e4-c2')
Jul 31 10:03:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:03:03 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] No VIF found with MAC fa:16:3e:18:05:a4, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 10:03:04 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690797769.9340026, 0ea0401b-26c2-4655-956b-1bc000debd53 => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:03:04 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] VM Stopped (Lifecycle Event)
Jul 31 10:03:04 user nova-compute[71113]: DEBUG nova.compute.manager [None req-3e941515-d16a-4e5a-bb7e-97ba9ead0462 None None] [instance: 0ea0401b-26c2-4655-956b-1bc000debd53] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:03:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:03:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:03:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:03:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:03:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:03:05 user nova-compute[71113]: DEBUG nova.compute.manager [req-fc887b6f-74f5-47ad-b7f6-a1c46d646ec9 req-2213f5c6-eab1-4074-8d8b-455d75f58d06 service nova] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Received event network-vif-plugged-d36845e4-c20a-43b4-803b-529a8823d170 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:03:05 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-fc887b6f-74f5-47ad-b7f6-a1c46d646ec9 req-2213f5c6-eab1-4074-8d8b-455d75f58d06 service nova] Acquiring lock "b751cc3f-b5b1-438b-b251-c589774c2bcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:03:05 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-fc887b6f-74f5-47ad-b7f6-a1c46d646ec9 req-2213f5c6-eab1-4074-8d8b-455d75f58d06 service nova] Lock "b751cc3f-b5b1-438b-b251-c589774c2bcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:03:05 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-fc887b6f-74f5-47ad-b7f6-a1c46d646ec9 req-2213f5c6-eab1-4074-8d8b-455d75f58d06 service nova] Lock "b751cc3f-b5b1-438b-b251-c589774c2bcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:03:05 user nova-compute[71113]: DEBUG nova.compute.manager [req-fc887b6f-74f5-47ad-b7f6-a1c46d646ec9 req-2213f5c6-eab1-4074-8d8b-455d75f58d06 service nova] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] No waiting events found dispatching network-vif-plugged-d36845e4-c20a-43b4-803b-529a8823d170 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:03:05 user nova-compute[71113]: WARNING nova.compute.manager [req-fc887b6f-74f5-47ad-b7f6-a1c46d646ec9 req-2213f5c6-eab1-4074-8d8b-455d75f58d06 service nova] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Received unexpected event network-vif-plugged-d36845e4-c20a-43b4-803b-529a8823d170 for instance with vm_state building and task_state spawning.
Jul 31 10:03:07 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797787.1896508, b751cc3f-b5b1-438b-b251-c589774c2bcf => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:03:07 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] VM Resumed (Lifecycle Event)
Jul 31 10:03:07 user nova-compute[71113]: DEBUG nova.compute.manager [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 10:03:07 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 10:03:07 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Instance spawned successfully.
Jul 31 10:03:07 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 10:03:07 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Found default for hw_input_bus of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:03:07 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Found default for hw_pointer_model of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:03:07 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:03:07 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:03:07 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 10:03:07 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797787.1942573, b751cc3f-b5b1-438b-b251-c589774c2bcf => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:03:07 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] VM Started (Lifecycle Event)
Jul 31 10:03:07 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:03:07 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:03:07 user nova-compute[71113]: INFO nova.compute.manager [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Took 4.96 seconds to spawn the instance on the hypervisor.
Jul 31 10:03:07 user nova-compute[71113]: DEBUG nova.compute.manager [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:03:07 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 10:03:07 user nova-compute[71113]: INFO nova.compute.manager [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Took 19.44 seconds to build instance.
Jul 31 10:03:07 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-6b566db5-4d0b-4212-ae86-d64f449ea036 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "b751cc3f-b5b1-438b-b251-c589774c2bcf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.627s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:03:07 user nova-compute[71113]: DEBUG nova.compute.manager [req-b503b1c5-4691-4a3a-9c51-09e8b51f327f req-4ba2cb7e-2806-43d4-9fa8-79ebacaa482e service nova] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Received event network-vif-plugged-d36845e4-c20a-43b4-803b-529a8823d170 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:03:07 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-b503b1c5-4691-4a3a-9c51-09e8b51f327f req-4ba2cb7e-2806-43d4-9fa8-79ebacaa482e service nova] Acquiring lock "b751cc3f-b5b1-438b-b251-c589774c2bcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:03:07 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-b503b1c5-4691-4a3a-9c51-09e8b51f327f req-4ba2cb7e-2806-43d4-9fa8-79ebacaa482e service nova] Lock "b751cc3f-b5b1-438b-b251-c589774c2bcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:03:07 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-b503b1c5-4691-4a3a-9c51-09e8b51f327f req-4ba2cb7e-2806-43d4-9fa8-79ebacaa482e service nova] Lock "b751cc3f-b5b1-438b-b251-c589774c2bcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:03:07 user nova-compute[71113]: DEBUG nova.compute.manager [req-b503b1c5-4691-4a3a-9c51-09e8b51f327f req-4ba2cb7e-2806-43d4-9fa8-79ebacaa482e service nova] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] No waiting events found dispatching network-vif-plugged-d36845e4-c20a-43b4-803b-529a8823d170 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:03:07 user nova-compute[71113]: WARNING nova.compute.manager [req-b503b1c5-4691-4a3a-9c51-09e8b51f327f req-4ba2cb7e-2806-43d4-9fa8-79ebacaa482e service nova] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Received unexpected event network-vif-plugged-d36845e4-c20a-43b4-803b-529a8823d170 for instance with vm_state active and task_state None.
Jul 31 10:03:08 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:03:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:03:10 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:03:12 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:03:12 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:03:12 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:03:13 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:03:13 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:03:13 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:03:13 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:03:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:03:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:03:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:03:13 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:03:13 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:03:13 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 10:03:13 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 10:03:13 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 10:03:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b88201-04dc-4da9-b213-c50cdf274f4e/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:03:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b88201-04dc-4da9-b213-c50cdf274f4e/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:03:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b88201-04dc-4da9-b213-c50cdf274f4e/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:03:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4b88201-04dc-4da9-b213-c50cdf274f4e/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:03:14 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 10:03:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f020f166-07b6-4cf5-9f17-2ab108b55c30/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:03:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f020f166-07b6-4cf5-9f17-2ab108b55c30/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:03:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f020f166-07b6-4cf5-9f17-2ab108b55c30/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:03:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f020f166-07b6-4cf5-9f17-2ab108b55c30/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:03:14 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 10:03:14 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 10:03:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:03:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:03:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:03:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:03:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:03:15 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:03:15 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:03:15 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=7853MB free_disk=25.294692993164062GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:03:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:03:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:03:15 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 3157a7a6-b8a9-4e2d-a157-360bce4c625d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:03:15 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 92d25a03-98ce-4bde-a3cc-20313ae77d41 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:03:15 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance c4b88201-04dc-4da9-b213-c50cdf274f4e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:03:15 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance f020f166-07b6-4cf5-9f17-2ab108b55c30 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:03:15 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 9b01d025-2fe7-4ed9-827d-0546134b08a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:03:15 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance fc41eb59-d988-461c-941e-551ceb174ba1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:03:15 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 5ffa30ea-7458-4914-a6f4-9d8310ca977c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:03:15 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 52f1f390-1599-4dda-9418-f12a48ef582c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:03:15 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance b751cc3f-b5b1-438b-b251-c589774c2bcf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:03:15 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:03:15 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:03:15 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:03:15 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:03:15 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:03:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.463s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:03:17 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:03:17 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:03:17 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Didn't find any instances for network info cache update. {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 10:03:18 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:03:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:03:20 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:03:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-556e1ee0-5117-42e0-bc48-6c43adfd8611 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Acquiring lock "9b01d025-2fe7-4ed9-827d-0546134b08a7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:03:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-556e1ee0-5117-42e0-bc48-6c43adfd8611 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lock "9b01d025-2fe7-4ed9-827d-0546134b08a7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:03:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-556e1ee0-5117-42e0-bc48-6c43adfd8611 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Acquiring lock "9b01d025-2fe7-4ed9-827d-0546134b08a7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:03:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-556e1ee0-5117-42e0-bc48-6c43adfd8611 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lock "9b01d025-2fe7-4ed9-827d-0546134b08a7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:03:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-556e1ee0-5117-42e0-bc48-6c43adfd8611 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lock "9b01d025-2fe7-4ed9-827d-0546134b08a7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:03:21 user nova-compute[71113]: INFO nova.compute.manager [None req-556e1ee0-5117-42e0-bc48-6c43adfd8611 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Terminating instance
Jul 31 10:03:21 user nova-compute[71113]: DEBUG nova.compute.manager [None req-556e1ee0-5117-42e0-bc48-6c43adfd8611 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Start destroying the instance on the hypervisor. {{(pid=71113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 10:03:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:03:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG nova.compute.manager [req-fca05be4-ac5f-4394-b423-18d8e9d55da9 req-1e2a7d5d-0046-488c-986f-73ed4d72bd73 service nova] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Received event network-vif-unplugged-cc8f812f-2fff-475e-a41e-abf390366863 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-fca05be4-ac5f-4394-b423-18d8e9d55da9 req-1e2a7d5d-0046-488c-986f-73ed4d72bd73 service nova] Acquiring lock "9b01d025-2fe7-4ed9-827d-0546134b08a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-fca05be4-ac5f-4394-b423-18d8e9d55da9 req-1e2a7d5d-0046-488c-986f-73ed4d72bd73 service nova] Lock "9b01d025-2fe7-4ed9-827d-0546134b08a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-fca05be4-ac5f-4394-b423-18d8e9d55da9 req-1e2a7d5d-0046-488c-986f-73ed4d72bd73 service nova] Lock "9b01d025-2fe7-4ed9-827d-0546134b08a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG nova.compute.manager [req-fca05be4-ac5f-4394-b423-18d8e9d55da9 req-1e2a7d5d-0046-488c-986f-73ed4d72bd73 service nova] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] No waiting events found dispatching network-vif-unplugged-cc8f812f-2fff-475e-a41e-abf390366863 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG nova.compute.manager [req-fca05be4-ac5f-4394-b423-18d8e9d55da9 req-1e2a7d5d-0046-488c-986f-73ed4d72bd73 service nova] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Received event network-vif-unplugged-cc8f812f-2fff-475e-a41e-abf390366863 for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:03:22 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Instance destroyed successfully.
Jul 31 10:03:22 user nova-compute[71113]: DEBUG nova.objects.instance [None req-556e1ee0-5117-42e0-bc48-6c43adfd8611 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lazy-loading 'resources' on Instance uuid 9b01d025-2fe7-4ed9-827d-0546134b08a7 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-556e1ee0-5117-42e0-bc48-6c43adfd8611 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T09:59:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-53810513',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-972438511',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMN/Rb0UqXjD4v1BBxetpe4UPNYObazNnGN7FxKdXTvz2iyzNZUZD6rIfXejF9ItEE9BSDAPgEkcwdmUFy1RLvhZdWlT7mUS0xbJEpPYT/4mz1Vn4Dur4VHq0XzU1g9+4Q==',key_name='tempest-keypair-1593349916',keypairs=<?>,launch_index=0,launched_at=2023-07-31T10:02:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e4b02badf8ea4f32a5e259c25120eac7',ramdisk_id='',reservation_id='r-6qeaa7mv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1497143588',owner_user_name='tempest-ServerActionsV293TestJSON-1497143588-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T10:02:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba2fd55dd96b4c49bb0c1c98c0a724d4',uuid=9b01d025-2fe7-4ed9-827d-0546134b08a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc8f812f-2fff-475e-a41e-abf390366863", "address": "fa:16:3e:61:8f:df", "network": {"id": "5f333808-4342-4014-9221-7ccd394eff66", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-42408734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4b02badf8ea4f32a5e259c25120eac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc8f812f-2f", "ovs_interfaceid": "cc8f812f-2fff-475e-a41e-abf390366863", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-556e1ee0-5117-42e0-bc48-6c43adfd8611 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Converting VIF {"id": "cc8f812f-2fff-475e-a41e-abf390366863", "address": "fa:16:3e:61:8f:df", "network": {"id": "5f333808-4342-4014-9221-7ccd394eff66", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-42408734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4b02badf8ea4f32a5e259c25120eac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc8f812f-2f", "ovs_interfaceid": "cc8f812f-2fff-475e-a41e-abf390366863", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-556e1ee0-5117-42e0-bc48-6c43adfd8611 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:8f:df,bridge_name='br-int',has_traffic_filtering=True,id=cc8f812f-2fff-475e-a41e-abf390366863,network=Network(5f333808-4342-4014-9221-7ccd394eff66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc8f812f-2f') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG os_vif [None req-556e1ee0-5117-42e0-bc48-6c43adfd8611 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:8f:df,bridge_name='br-int',has_traffic_filtering=True,id=cc8f812f-2fff-475e-a41e-abf390366863,network=Network(5f333808-4342-4014-9221-7ccd394eff66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc8f812f-2f') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc8f812f-2f, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:03:22 user nova-compute[71113]: INFO os_vif [None req-556e1ee0-5117-42e0-bc48-6c43adfd8611 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:8f:df,bridge_name='br-int',has_traffic_filtering=True,id=cc8f812f-2fff-475e-a41e-abf390366863,network=Network(5f333808-4342-4014-9221-7ccd394eff66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc8f812f-2f')
Jul 31 10:03:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-556e1ee0-5117-42e0-bc48-6c43adfd8611 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-556e1ee0-5117-42e0-bc48-6c43adfd8611 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kSRbiupj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:03:22 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-556e1ee0-5117-42e0-bc48-6c43adfd8611 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:03:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-556e1ee0-5117-42e0-bc48-6c43adfd8611 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-556e1ee0-5117-42e0-bc48-6c43adfd8611 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-556e1ee0-5117-42e0-bc48-6c43adfd8611 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a76b45-131f-49c7-ab29-d5f1114e9816]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f607ae-8e12-40b6-80f9-b703daafb13d]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-556e1ee0-5117-42e0-bc48-6c43adfd8611 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:03:22 user nova-compute[71113]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 (non-flash)
Jul 31 10:03:22 user nova-compute[71113]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d (non-flash)
Jul 31 10:03:22 user nova-compute[71113]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f (non-flash)
Jul 31 10:03:22 user nova-compute[71113]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)
Jul 31 10:03:22 user nova-compute[71113]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c (non-flash)
Jul 31 10:03:22 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-556e1ee0-5117-42e0-bc48-6c43adfd8611 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:03:22 user nova-compute[71113]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 (non-flash)
Jul 31 10:03:22 user nova-compute[71113]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d (non-flash)
Jul 31 10:03:22 user nova-compute[71113]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f (non-flash)
Jul 31 10:03:22 user nova-compute[71113]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)
Jul 31 10:03:22 user nova-compute[71113]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c (non-flash)
Jul 31 10:03:22 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-556e1ee0-5117-42e0-bc48-6c43adfd8611 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f78f07905e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f'): ({'sdb'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-556e1ee0-5117-42e0-bc48-6c43adfd8611 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Removing single pathed devices sdb {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e42926a-29f1-4f41-b7ef-94704e954d45]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaca4b62-d182-4345-ad45-7272192c8314]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-556e1ee0-5117-42e0-bc48-6c43adfd8611 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Flushing IO for device /dev/sdb {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c902506-cb4e-4c2f-9cf9-c6b60f5abd61]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-556e1ee0-5117-42e0-bc48-6c43adfd8611 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6681c0ab-0d8e-42f9-b488-09b666f019d5]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-556e1ee0-5117-42e0-bc48-6c43adfd8611 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-556e1ee0-5117-42e0-bc48-6c43adfd8611 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] SCSI volumes sdb have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23730616262336538', '/dev/disk/by-id/scsi-1SCST_BIO2e66d65-70abb3e8ded83fb3', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_2e66d65') {{(pid=81983) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[da54202f-85ba-4eeb-90a7-83587dcb1704]: (4, None) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-556e1ee0-5117-42e0-bc48-6c43adfd8611 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[89462b8e-50dc-4d08-a910-ed07c3ff6a2e]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-556e1ee0-5117-42e0-bc48-6c43adfd8611 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[442d5da1-25ca-43fd-831e-be9cee925c96]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-556e1ee0-5117-42e0-bc48-6c43adfd8611 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f, portal: 172.16.0.220,3260]
Jul 31 10:03:22 user nova-compute[71113]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f, portal: 172.16.0.220,3260] successful.
Jul 31 10:03:22 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fa00a07-19dc-4a82-b9a0-6625e649403f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4f9993-1f5f-484a-98cf-e6730a1d8464]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-556e1ee0-5117-42e0-bc48-6c43adfd8611 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-556e1ee0-5117-42e0-bc48-6c43adfd8611 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-556e1ee0-5117-42e0-bc48-6c43adfd8611 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] <== disconnect_volume: return (324ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:03:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-556e1ee0-5117-42e0-bc48-6c43adfd8611 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 10:03:22 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-556e1ee0-5117-42e0-bc48-6c43adfd8611 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Deleting instance files /opt/stack/data/nova/instances/9b01d025-2fe7-4ed9-827d-0546134b08a7_del
Jul 31 10:03:22 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-556e1ee0-5117-42e0-bc48-6c43adfd8611 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Deletion of /opt/stack/data/nova/instances/9b01d025-2fe7-4ed9-827d-0546134b08a7_del complete
Jul 31 10:03:23 user nova-compute[71113]: INFO nova.compute.manager [None req-556e1ee0-5117-42e0-bc48-6c43adfd8611 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Took 1.17 seconds to destroy the instance on the hypervisor.
Jul 31 10:03:23 user nova-compute[71113]: DEBUG oslo.service.loopingcall [None req-556e1ee0-5117-42e0-bc48-6c43adfd8611 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71113) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 10:03:23 user nova-compute[71113]: DEBUG nova.compute.manager [-] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Deallocating network for instance {{(pid=71113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 10:03:23 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] deallocate_for_instance() {{(pid=71113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 10:03:23 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:03:23 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Took 0.92 seconds to deallocate network for instance.
Jul 31 10:03:24 user nova-compute[71113]: DEBUG nova.compute.manager [req-d33488c7-794f-45aa-a0b6-04872c9e2bd1 req-17dbcb45-c68d-40fa-a0ea-e831082ea282 service nova] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Received event network-vif-plugged-cc8f812f-2fff-475e-a41e-abf390366863 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:03:24 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-d33488c7-794f-45aa-a0b6-04872c9e2bd1 req-17dbcb45-c68d-40fa-a0ea-e831082ea282 service nova] Acquiring lock "9b01d025-2fe7-4ed9-827d-0546134b08a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:03:24 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-d33488c7-794f-45aa-a0b6-04872c9e2bd1 req-17dbcb45-c68d-40fa-a0ea-e831082ea282 service nova] Lock "9b01d025-2fe7-4ed9-827d-0546134b08a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:03:24 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-d33488c7-794f-45aa-a0b6-04872c9e2bd1 req-17dbcb45-c68d-40fa-a0ea-e831082ea282 service nova] Lock "9b01d025-2fe7-4ed9-827d-0546134b08a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:03:24 user nova-compute[71113]: DEBUG nova.compute.manager [req-d33488c7-794f-45aa-a0b6-04872c9e2bd1 req-17dbcb45-c68d-40fa-a0ea-e831082ea282 service nova] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] No waiting events found dispatching network-vif-plugged-cc8f812f-2fff-475e-a41e-abf390366863 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:03:24 user nova-compute[71113]: WARNING nova.compute.manager [req-d33488c7-794f-45aa-a0b6-04872c9e2bd1 req-17dbcb45-c68d-40fa-a0ea-e831082ea282 service nova] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Received unexpected event network-vif-plugged-cc8f812f-2fff-475e-a41e-abf390366863 for instance with vm_state active and task_state deleting.
Jul 31 10:03:24 user nova-compute[71113]: DEBUG nova.compute.manager [req-d33488c7-794f-45aa-a0b6-04872c9e2bd1 req-17dbcb45-c68d-40fa-a0ea-e831082ea282 service nova] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Received event network-vif-deleted-cc8f812f-2fff-475e-a41e-abf390366863 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:03:24 user nova-compute[71113]: INFO nova.compute.manager [None req-556e1ee0-5117-42e0-bc48-6c43adfd8611 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Took 0.73 seconds to detach 1 volumes for instance.
Jul 31 10:03:24 user nova-compute[71113]: DEBUG nova.compute.manager [None req-556e1ee0-5117-42e0-bc48-6c43adfd8611 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Deleting volume: 4fa00a07-19dc-4a82-b9a0-6625e649403f {{(pid=71113) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 31 10:03:24 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-556e1ee0-5117-42e0-bc48-6c43adfd8611 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:03:24 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-556e1ee0-5117-42e0-bc48-6c43adfd8611 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:03:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:03:25 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-556e1ee0-5117-42e0-bc48-6c43adfd8611 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:03:25 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-556e1ee0-5117-42e0-bc48-6c43adfd8611 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:03:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-556e1ee0-5117-42e0-bc48-6c43adfd8611 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.288s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:03:25 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-556e1ee0-5117-42e0-bc48-6c43adfd8611 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Deleted allocations for instance 9b01d025-2fe7-4ed9-827d-0546134b08a7
Jul 31 10:03:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-556e1ee0-5117-42e0-bc48-6c43adfd8611 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lock "9b01d025-2fe7-4ed9-827d-0546134b08a7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.433s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:03:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:03:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:03:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:03:32 user nova-compute[71113]: DEBUG nova.compute.manager [req-1dc3b116-965f-4470-8893-1d1d7bcfd8bb req-88684628-381a-4732-9796-23b320600005 service nova] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Received event network-changed-8a38b464-522f-48bd-90b6-4447f9a6eb21 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:03:32 user nova-compute[71113]: DEBUG nova.compute.manager [req-1dc3b116-965f-4470-8893-1d1d7bcfd8bb req-88684628-381a-4732-9796-23b320600005 service nova] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Refreshing instance network info cache due to event network-changed-8a38b464-522f-48bd-90b6-4447f9a6eb21. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 10:03:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1dc3b116-965f-4470-8893-1d1d7bcfd8bb req-88684628-381a-4732-9796-23b320600005 service nova] Acquiring lock "refresh_cache-5ffa30ea-7458-4914-a6f4-9d8310ca977c" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:03:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1dc3b116-965f-4470-8893-1d1d7bcfd8bb req-88684628-381a-4732-9796-23b320600005 service nova] Acquired lock "refresh_cache-5ffa30ea-7458-4914-a6f4-9d8310ca977c" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:03:32 user nova-compute[71113]: DEBUG nova.network.neutron [req-1dc3b116-965f-4470-8893-1d1d7bcfd8bb req-88684628-381a-4732-9796-23b320600005 service nova] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Refreshing network info cache for port 8a38b464-522f-48bd-90b6-4447f9a6eb21 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 10:03:32 user nova-compute[71113]: DEBUG nova.network.neutron [req-1dc3b116-965f-4470-8893-1d1d7bcfd8bb req-88684628-381a-4732-9796-23b320600005 service nova] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Updated VIF entry in instance network info cache for port 8a38b464-522f-48bd-90b6-4447f9a6eb21. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 10:03:32 user nova-compute[71113]: DEBUG nova.network.neutron [req-1dc3b116-965f-4470-8893-1d1d7bcfd8bb req-88684628-381a-4732-9796-23b320600005 service nova] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Updating instance_info_cache with network_info: [{"id": "8a38b464-522f-48bd-90b6-4447f9a6eb21", "address": "fa:16:3e:8f:24:b1", "network": {"id": "a88a6414-c6fd-4581-bbb5-7250ebcb1345", "bridge": "br-int", "label": "tempest-TestShelveInstance-1094508903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c17b9322f9049d390ad212ad8ce7905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a38b464-52", "ovs_interfaceid": "8a38b464-522f-48bd-90b6-4447f9a6eb21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:03:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1dc3b116-965f-4470-8893-1d1d7bcfd8bb req-88684628-381a-4732-9796-23b320600005 service nova] Releasing lock "refresh_cache-5ffa30ea-7458-4914-a6f4-9d8310ca977c" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:03:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:03:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ada463bb-b556-4e18-9f93-24efb12264c2 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Acquiring lock "5ffa30ea-7458-4914-a6f4-9d8310ca977c" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:03:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ada463bb-b556-4e18-9f93-24efb12264c2 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Lock "5ffa30ea-7458-4914-a6f4-9d8310ca977c" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:03:33 user nova-compute[71113]: INFO nova.compute.manager [None req-ada463bb-b556-4e18-9f93-24efb12264c2 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Shelve offloading
Jul 31 10:03:33 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:03:33 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:03:33 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:03:33 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:03:34 user nova-compute[71113]: DEBUG nova.compute.manager [req-35af8aa4-1e14-45a2-9ca6-43153dccd986 req-e93ccb7d-b7af-47cd-a6a5-ff0b499db20a service nova] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Received event network-vif-unplugged-8a38b464-522f-48bd-90b6-4447f9a6eb21 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:03:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-35af8aa4-1e14-45a2-9ca6-43153dccd986 req-e93ccb7d-b7af-47cd-a6a5-ff0b499db20a service nova] Acquiring lock "5ffa30ea-7458-4914-a6f4-9d8310ca977c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:03:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-35af8aa4-1e14-45a2-9ca6-43153dccd986 req-e93ccb7d-b7af-47cd-a6a5-ff0b499db20a service nova] Lock "5ffa30ea-7458-4914-a6f4-9d8310ca977c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:03:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-35af8aa4-1e14-45a2-9ca6-43153dccd986 req-e93ccb7d-b7af-47cd-a6a5-ff0b499db20a service nova] Lock "5ffa30ea-7458-4914-a6f4-9d8310ca977c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:03:34 user nova-compute[71113]: DEBUG nova.compute.manager [req-35af8aa4-1e14-45a2-9ca6-43153dccd986 req-e93ccb7d-b7af-47cd-a6a5-ff0b499db20a service nova] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] No waiting events found dispatching network-vif-unplugged-8a38b464-522f-48bd-90b6-4447f9a6eb21 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:03:34 user nova-compute[71113]: WARNING nova.compute.manager [req-35af8aa4-1e14-45a2-9ca6-43153dccd986 req-e93ccb7d-b7af-47cd-a6a5-ff0b499db20a service nova] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Received unexpected event network-vif-unplugged-8a38b464-522f-48bd-90b6-4447f9a6eb21 for instance with vm_state active and task_state shelving.
Jul 31 10:03:34 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Instance destroyed successfully.
Jul 31 10:03:34 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ada463bb-b556-4e18-9f93-24efb12264c2 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:03:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ada463bb-b556-4e18-9f93-24efb12264c2 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Acquiring lock "refresh_cache-5ffa30ea-7458-4914-a6f4-9d8310ca977c" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:03:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ada463bb-b556-4e18-9f93-24efb12264c2 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Acquired lock "refresh_cache-5ffa30ea-7458-4914-a6f4-9d8310ca977c" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:03:34 user nova-compute[71113]: DEBUG nova.network.neutron [None req-ada463bb-b556-4e18-9f93-24efb12264c2 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 10:03:34 user nova-compute[71113]: DEBUG nova.network.neutron [None req-ada463bb-b556-4e18-9f93-24efb12264c2 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Updating instance_info_cache with network_info: [{"id": "8a38b464-522f-48bd-90b6-4447f9a6eb21", "address": "fa:16:3e:8f:24:b1", "network": {"id": "a88a6414-c6fd-4581-bbb5-7250ebcb1345", "bridge": "br-int", "label": "tempest-TestShelveInstance-1094508903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c17b9322f9049d390ad212ad8ce7905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a38b464-52", "ovs_interfaceid": "8a38b464-522f-48bd-90b6-4447f9a6eb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:03:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ada463bb-b556-4e18-9f93-24efb12264c2 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Releasing lock "refresh_cache-5ffa30ea-7458-4914-a6f4-9d8310ca977c" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:03:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:03:35 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Instance destroyed successfully.
Jul 31 10:03:35 user nova-compute[71113]: DEBUG nova.objects.instance [None req-ada463bb-b556-4e18-9f93-24efb12264c2 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Lazy-loading 'resources' on Instance uuid 5ffa30ea-7458-4914-a6f4-9d8310ca977c {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:03:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-ada463bb-b556-4e18-9f93-24efb12264c2 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:01:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1588137860',display_name='tempest-TestShelveInstance-server-1588137860',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1588137860',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbaQKqzXS+iGAdyU+IEYcpzfIkkhUCBcV/jtcllq2kAmrkSuKN+HhjRpB+JHeg80k59esL5yAramhhM5R6CSY2dBC3P+p41xS0uXt2ByFPfGSwj17CP/Ai/tBqcEiPsRA==',key_name='tempest-TestShelveInstance-735724819',keypairs=<?>,launch_index=0,launched_at=2023-07-31T10:01:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9c17b9322f9049d390ad212ad8ce7905',ramdisk_id='',reservation_id='r-mtlq72k6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1763207303',owner_user_name='tempest-TestShelveInstance-1763207303-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T10:01:55Z,user_data=None,user_id='31f12483848e44098cbb078851c5f8d7',uuid=5ffa30ea-7458-4914-a6f4-9d8310ca977c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a38b464-522f-48bd-90b6-4447f9a6eb21", "address": "fa:16:3e:8f:24:b1", "network": {"id": "a88a6414-c6fd-4581-bbb5-7250ebcb1345", "bridge": "br-int", "label": "tempest-TestShelveInstance-1094508903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c17b9322f9049d390ad212ad8ce7905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a38b464-52", "ovs_interfaceid": "8a38b464-522f-48bd-90b6-4447f9a6eb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 10:03:35 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-ada463bb-b556-4e18-9f93-24efb12264c2 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Converting VIF {"id": "8a38b464-522f-48bd-90b6-4447f9a6eb21", "address": "fa:16:3e:8f:24:b1", "network": {"id": "a88a6414-c6fd-4581-bbb5-7250ebcb1345", "bridge": "br-int", "label": "tempest-TestShelveInstance-1094508903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c17b9322f9049d390ad212ad8ce7905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a38b464-52", "ovs_interfaceid": "8a38b464-522f-48bd-90b6-4447f9a6eb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:03:35 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-ada463bb-b556-4e18-9f93-24efb12264c2 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:24:b1,bridge_name='br-int',has_traffic_filtering=True,id=8a38b464-522f-48bd-90b6-4447f9a6eb21,network=Network(a88a6414-c6fd-4581-bbb5-7250ebcb1345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a38b464-52') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:03:35 user nova-compute[71113]: DEBUG os_vif [None req-ada463bb-b556-4e18-9f93-24efb12264c2 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:24:b1,bridge_name='br-int',has_traffic_filtering=True,id=8a38b464-522f-48bd-90b6-4447f9a6eb21,network=Network(a88a6414-c6fd-4581-bbb5-7250ebcb1345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a38b464-52') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 10:03:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:03:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a38b464-52, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:03:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:03:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:03:35 user nova-compute[71113]: INFO os_vif [None req-ada463bb-b556-4e18-9f93-24efb12264c2 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:24:b1,bridge_name='br-int',has_traffic_filtering=True,id=8a38b464-522f-48bd-90b6-4447f9a6eb21,network=Network(a88a6414-c6fd-4581-bbb5-7250ebcb1345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a38b464-52')
Jul 31 10:03:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ada463bb-b556-4e18-9f93-24efb12264c2 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 10:03:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada463bb-b556-4e18-9f93-24efb12264c2 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'egBnzlMD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:03:35 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-ada463bb-b556-4e18-9f93-24efb12264c2 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:03:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-ada463bb-b556-4e18-9f93-24efb12264c2 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:03:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-ada463bb-b556-4e18-9f93-24efb12264c2 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:03:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada463bb-b556-4e18-9f93-24efb12264c2 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 10:03:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:03:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:03:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[15fbd0ab-335c-423a-bdfe-3cd70f511ef0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:03:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:03:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:03:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2a3797-1c64-4972-969c-73214c4ce37e]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:03:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada463bb-b556-4e18-9f93-24efb12264c2 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:03:35 user nova-compute[71113]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 (non-flash)
Jul 31 10:03:35 user nova-compute[71113]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d (non-flash)
Jul 31 10:03:35 user nova-compute[71113]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)
Jul 31 10:03:35 user nova-compute[71113]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c (non-flash)
Jul 31 10:03:35 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:03:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada463bb-b556-4e18-9f93-24efb12264c2 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:03:35 user nova-compute[71113]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 (non-flash)
Jul 31 10:03:35 user nova-compute[71113]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d (non-flash)
Jul 31 10:03:35 user nova-compute[71113]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)
Jul 31 10:03:35 user nova-compute[71113]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c (non-flash)
Jul 31 10:03:35 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:03:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada463bb-b556-4e18-9f93-24efb12264c2 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f78cc72c3a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d'): ({'sdc'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 10:03:35 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-ada463bb-b556-4e18-9f93-24efb12264c2 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Removing single pathed devices sdc {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 10:03:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:03:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:03:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3ce018-1860-48a6-b000-df61d68d112c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:03:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:03:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:03:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb96c245-3323-4d2e-930b-d3d591bd48af]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:03:35 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-ada463bb-b556-4e18-9f93-24efb12264c2 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Flushing IO for device /dev/sdc {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 10:03:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:03:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:03:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4dbbd5-8204-4aba-9cc1-cc5d70c55b51]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:03:35 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-ada463bb-b556-4e18-9f93-24efb12264c2 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 10:03:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:03:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.059s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:03:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b9e2b5-8a78-4dce-9164-f5c4119d25a7]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:03:35 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-ada463bb-b556-4e18-9f93-24efb12264c2 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 10:03:35 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-ada463bb-b556-4e18-9f93-24efb12264c2 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] SCSI volumes sdc have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 10:03:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada463bb-b556-4e18-9f93-24efb12264c2 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 10:03:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:03:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:03:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37b8bfb-12ef-4ff2-b765-e0febd81a3d2]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:03:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada463bb-b556-4e18-9f93-24efb12264c2 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:03:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:03:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:03:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6014e8a5-49ba-4c50-9bc0-5b917c2b909a]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:03:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada463bb-b556-4e18-9f93-24efb12264c2 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d, portal: 172.16.0.220,3260]
Jul 31 10:03:35 user nova-compute[71113]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d, portal: 172.16.0.220,3260] successful.
Jul 31 10:03:35 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:03:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:03:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:03:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ca4dc6-9dd6-4239-bb19-e48ef9912391]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:03:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada463bb-b556-4e18-9f93-24efb12264c2 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:03:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-ada463bb-b556-4e18-9f93-24efb12264c2 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:03:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada463bb-b556-4e18-9f93-24efb12264c2 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] <== disconnect_volume: return (302ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:03:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ada463bb-b556-4e18-9f93-24efb12264c2 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 10:03:35 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-ada463bb-b556-4e18-9f93-24efb12264c2 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Deleting instance files /opt/stack/data/nova/instances/5ffa30ea-7458-4914-a6f4-9d8310ca977c_del
Jul 31 10:03:35 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-ada463bb-b556-4e18-9f93-24efb12264c2 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Deletion of /opt/stack/data/nova/instances/5ffa30ea-7458-4914-a6f4-9d8310ca977c_del complete
Jul 31 10:03:36 user nova-compute[71113]: DEBUG nova.compute.manager [req-4514c408-0db4-4c84-bde7-d0ff4c71275a req-75fc3d7e-305c-4f42-b590-dea3decf4f13 service nova] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Received event network-vif-plugged-8a38b464-522f-48bd-90b6-4447f9a6eb21 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:03:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-4514c408-0db4-4c84-bde7-d0ff4c71275a req-75fc3d7e-305c-4f42-b590-dea3decf4f13 service nova] Acquiring lock "5ffa30ea-7458-4914-a6f4-9d8310ca977c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:03:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-4514c408-0db4-4c84-bde7-d0ff4c71275a req-75fc3d7e-305c-4f42-b590-dea3decf4f13 service nova] Lock "5ffa30ea-7458-4914-a6f4-9d8310ca977c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:03:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-4514c408-0db4-4c84-bde7-d0ff4c71275a req-75fc3d7e-305c-4f42-b590-dea3decf4f13 service nova] Lock "5ffa30ea-7458-4914-a6f4-9d8310ca977c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:03:36 user nova-compute[71113]: DEBUG nova.compute.manager [req-4514c408-0db4-4c84-bde7-d0ff4c71275a req-75fc3d7e-305c-4f42-b590-dea3decf4f13 service nova] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] No waiting events found dispatching network-vif-plugged-8a38b464-522f-48bd-90b6-4447f9a6eb21 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:03:36 user nova-compute[71113]: WARNING nova.compute.manager [req-4514c408-0db4-4c84-bde7-d0ff4c71275a req-75fc3d7e-305c-4f42-b590-dea3decf4f13 service nova] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Received unexpected event network-vif-plugged-8a38b464-522f-48bd-90b6-4447f9a6eb21 for instance with vm_state active and task_state shelving.
Jul 31 10:03:36 user nova-compute[71113]: DEBUG nova.compute.manager [req-4514c408-0db4-4c84-bde7-d0ff4c71275a req-75fc3d7e-305c-4f42-b590-dea3decf4f13 service nova] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Received event network-changed-8a38b464-522f-48bd-90b6-4447f9a6eb21 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:03:36 user nova-compute[71113]: DEBUG nova.compute.manager [req-4514c408-0db4-4c84-bde7-d0ff4c71275a req-75fc3d7e-305c-4f42-b590-dea3decf4f13 service nova] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Refreshing instance network info cache due to event network-changed-8a38b464-522f-48bd-90b6-4447f9a6eb21. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 10:03:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-4514c408-0db4-4c84-bde7-d0ff4c71275a req-75fc3d7e-305c-4f42-b590-dea3decf4f13 service nova] Acquiring lock "refresh_cache-5ffa30ea-7458-4914-a6f4-9d8310ca977c" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:03:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-4514c408-0db4-4c84-bde7-d0ff4c71275a req-75fc3d7e-305c-4f42-b590-dea3decf4f13 service nova] Acquired lock "refresh_cache-5ffa30ea-7458-4914-a6f4-9d8310ca977c" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:03:36 user nova-compute[71113]: DEBUG nova.network.neutron [req-4514c408-0db4-4c84-bde7-d0ff4c71275a req-75fc3d7e-305c-4f42-b590-dea3decf4f13 service nova] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Refreshing network info cache for port 8a38b464-522f-48bd-90b6-4447f9a6eb21 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 10:03:36 user nova-compute[71113]: DEBUG nova.network.neutron [req-4514c408-0db4-4c84-bde7-d0ff4c71275a req-75fc3d7e-305c-4f42-b590-dea3decf4f13 service nova] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Updated VIF entry in instance network info cache for port 8a38b464-522f-48bd-90b6-4447f9a6eb21. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 10:03:36 user nova-compute[71113]: DEBUG nova.network.neutron [req-4514c408-0db4-4c84-bde7-d0ff4c71275a req-75fc3d7e-305c-4f42-b590-dea3decf4f13 service nova] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Updating instance_info_cache with network_info: [{"id": "8a38b464-522f-48bd-90b6-4447f9a6eb21", "address": "fa:16:3e:8f:24:b1", "network": {"id": "a88a6414-c6fd-4581-bbb5-7250ebcb1345", "bridge": null, "label": "tempest-TestShelveInstance-1094508903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c17b9322f9049d390ad212ad8ce7905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap8a38b464-52", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:03:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-4514c408-0db4-4c84-bde7-d0ff4c71275a req-75fc3d7e-305c-4f42-b590-dea3decf4f13 service nova] Releasing lock "refresh_cache-5ffa30ea-7458-4914-a6f4-9d8310ca977c" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:03:37 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-ada463bb-b556-4e18-9f93-24efb12264c2 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Deleted allocations for instance 5ffa30ea-7458-4914-a6f4-9d8310ca977c
Jul 31 10:03:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ada463bb-b556-4e18-9f93-24efb12264c2 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:03:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ada463bb-b556-4e18-9f93-24efb12264c2 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:03:37 user nova-compute[71113]: DEBUG nova.objects.instance [None req-ada463bb-b556-4e18-9f93-24efb12264c2 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Lazy-loading 'numa_topology' on Instance uuid 5ffa30ea-7458-4914-a6f4-9d8310ca977c {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:03:37 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-ada463bb-b556-4e18-9f93-24efb12264c2 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:03:37 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-ada463bb-b556-4e18-9f93-24efb12264c2 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:03:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ada463bb-b556-4e18-9f93-24efb12264c2 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.258s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:03:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ada463bb-b556-4e18-9f93-24efb12264c2 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Lock "5ffa30ea-7458-4914-a6f4-9d8310ca977c" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.932s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:03:37 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690797802.613574, 9b01d025-2fe7-4ed9-827d-0546134b08a7 => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:03:37 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] VM Stopped (Lifecycle Event)
Jul 31 10:03:37 user nova-compute[71113]: DEBUG nova.compute.manager [None req-f5785786-f0b5-457a-b218-3eb979b4af4c None None] [instance: 9b01d025-2fe7-4ed9-827d-0546134b08a7] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:03:40 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:03:40 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:03:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:03:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:03:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:03:49 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690797814.3937185, 5ffa30ea-7458-4914-a6f4-9d8310ca977c => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:03:49 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] VM Stopped (Lifecycle Event)
Jul 31 10:03:49 user nova-compute[71113]: DEBUG nova.compute.manager [None req-053ff620-c067-4051-b442-d7999238e5ac None None] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:03:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:03:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:03:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:03:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:03:53 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:03:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:03:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Acquiring lock "95a84d3c-7aa2-4294-a419-995926a2782f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:03:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Lock "95a84d3c-7aa2-4294-a419-995926a2782f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:03:55 user nova-compute[71113]: DEBUG nova.compute.manager [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Starting instance... {{(pid=71113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 10:03:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:03:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:03:55 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 10:03:55 user nova-compute[71113]: INFO nova.compute.claims [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Claim successful on node user
Jul 31 10:03:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:03:55 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:03:56 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:03:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.604s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:03:56 user nova-compute[71113]: DEBUG nova.compute.manager [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Start building networks asynchronously for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 10:03:56 user nova-compute[71113]: DEBUG nova.compute.manager [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Allocating IP information in the background. {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 10:03:56 user nova-compute[71113]: DEBUG nova.network.neutron [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] allocate_for_instance() {{(pid=71113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 10:03:56 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 10:03:56 user nova-compute[71113]: DEBUG nova.compute.manager [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Start building block device mappings for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 10:03:56 user nova-compute[71113]: DEBUG nova.policy [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c4c2f8d82f494a5d8255984f4bd3806b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f8d203e3c534371b05a2ec4c6c07a61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71113) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 10:03:56 user nova-compute[71113]: DEBUG nova.compute.manager [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Start spawning the instance on the hypervisor. {{(pid=71113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 10:03:56 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 10:03:56 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Creating image(s)
Jul 31 10:03:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Acquiring lock "/opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:03:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Lock "/opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:03:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Lock "/opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:03:56 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:03:56 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.139s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:03:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Acquiring lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:03:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:03:56 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:03:56 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.145s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:03:56 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk 1073741824 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:03:56 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk 1073741824" returned: 0 in 0.054s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:03:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:03:56 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:03:56 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.152s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:03:56 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Checking if we can resize image /opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk. size=1073741824 {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 10:03:56 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:03:56 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:03:56 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Cannot resize image /opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk to a smaller size. {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 10:03:56 user nova-compute[71113]: DEBUG nova.objects.instance [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Lazy-loading 'migration_context' on Instance uuid 95a84d3c-7aa2-4294-a419-995926a2782f {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:03:56 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Created local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 10:03:56 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Ensure instance console log exists: /opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 10:03:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:03:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:03:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:03:57 user nova-compute[71113]: DEBUG nova.network.neutron [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Successfully created port: a856eb89-910c-456e-bc0e-a9f92ce20248 {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 10:03:58 user nova-compute[71113]: DEBUG nova.network.neutron [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Successfully updated port: a856eb89-910c-456e-bc0e-a9f92ce20248 {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 10:03:58 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Acquiring lock "refresh_cache-95a84d3c-7aa2-4294-a419-995926a2782f" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:03:58 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Acquired lock "refresh_cache-95a84d3c-7aa2-4294-a419-995926a2782f" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:03:58 user nova-compute[71113]: DEBUG nova.network.neutron [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 10:03:58 user nova-compute[71113]: DEBUG nova.compute.manager [req-9af0d4d1-9776-4bc4-ba93-c8edf03dd8dc req-aae846f6-c301-413a-b833-ddf2055b085e service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Received event network-changed-a856eb89-910c-456e-bc0e-a9f92ce20248 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:03:58 user nova-compute[71113]: DEBUG nova.compute.manager [req-9af0d4d1-9776-4bc4-ba93-c8edf03dd8dc req-aae846f6-c301-413a-b833-ddf2055b085e service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Refreshing instance network info cache due to event network-changed-a856eb89-910c-456e-bc0e-a9f92ce20248. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 10:03:58 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9af0d4d1-9776-4bc4-ba93-c8edf03dd8dc req-aae846f6-c301-413a-b833-ddf2055b085e service nova] Acquiring lock "refresh_cache-95a84d3c-7aa2-4294-a419-995926a2782f" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:03:58 user nova-compute[71113]: DEBUG nova.network.neutron [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 10:03:59 user nova-compute[71113]: DEBUG nova.network.neutron [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Updating instance_info_cache with network_info: [{"id": "a856eb89-910c-456e-bc0e-a9f92ce20248", "address": "fa:16:3e:d0:99:09", "network": {"id": "67fc40ba-b2c8-43f9-a714-46ef13acf5ed", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1597196996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f8d203e3c534371b05a2ec4c6c07a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa856eb89-91", "ovs_interfaceid": "a856eb89-910c-456e-bc0e-a9f92ce20248", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:03:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Releasing lock "refresh_cache-95a84d3c-7aa2-4294-a419-995926a2782f" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:03:59 user nova-compute[71113]: DEBUG nova.compute.manager [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Instance network_info: |[{"id": "a856eb89-910c-456e-bc0e-a9f92ce20248", "address": "fa:16:3e:d0:99:09", "network": {"id": "67fc40ba-b2c8-43f9-a714-46ef13acf5ed", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1597196996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f8d203e3c534371b05a2ec4c6c07a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa856eb89-91", "ovs_interfaceid": "a856eb89-910c-456e-bc0e-a9f92ce20248", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 10:03:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9af0d4d1-9776-4bc4-ba93-c8edf03dd8dc req-aae846f6-c301-413a-b833-ddf2055b085e service nova] Acquired lock "refresh_cache-95a84d3c-7aa2-4294-a419-995926a2782f" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:03:59 user nova-compute[71113]: DEBUG nova.network.neutron [req-9af0d4d1-9776-4bc4-ba93-c8edf03dd8dc req-aae846f6-c301-413a-b833-ddf2055b085e service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Refreshing network info cache for port a856eb89-910c-456e-bc0e-a9f92ce20248 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 10:03:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Start _get_guest_xml network_info=[{"id": "a856eb89-910c-456e-bc0e-a9f92ce20248", "address": "fa:16:3e:d0:99:09", "network": {"id": "67fc40ba-b2c8-43f9-a714-46ef13acf5ed", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1597196996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f8d203e3c534371b05a2ec4c6c07a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa856eb89-91", "ovs_interfaceid": "a856eb89-910c-456e-bc0e-a9f92ce20248", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'image_id': '078646fe-b504-41ed-a147-61072e903e51'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 10:03:59 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:03:59 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:03:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 10:03:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 10:03:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 10:03:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 10:03:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 10:03:59 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 10:03:59 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 10:03:59 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 10:03:59 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 10:03:59 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 10:03:59 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 10:03:59 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 10:03:59 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 10:03:59 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 10:03:59 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 10:03:59 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 10:03:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:03:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2103964806',display_name='tempest-ServerStableDeviceRescueTest-server-2103964806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2103964806',id=36,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdl8SX645/Muc/9M6HuPzDTOvIdM6KrFE61+dTZHqyrZ0zWuC0IOgJE5YL7IjPgvGTYTgBzjZJL8AHFSZVMP6dsDsN1FtFI6gizkdDAM6HYW8d03e+SFHeZYZOyP/3S4w==',key_name='tempest-keypair-1251481522',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f8d203e3c534371b05a2ec4c6c07a61',ramdisk_id='',reservation_id='r-fanuve5b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1277436113',owner_user_name='tempest-ServerStableDeviceRescueTest-1277436113-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T10:03:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4c2f8d82f494a5d8255984f4bd3806b',uuid=95a84d3c-7aa2-4294-a419-995926a2782f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a856eb89-910c-456e-bc0e-a9f92ce20248", "address": "fa:16:3e:d0:99:09", "network": {"id": "67fc40ba-b2c8-43f9-a714-46ef13acf5ed", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1597196996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f8d203e3c534371b05a2ec4c6c07a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa856eb89-91", "ovs_interfaceid": "a856eb89-910c-456e-bc0e-a9f92ce20248", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 10:03:59 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Converting VIF {"id": "a856eb89-910c-456e-bc0e-a9f92ce20248", "address": "fa:16:3e:d0:99:09", "network": {"id": "67fc40ba-b2c8-43f9-a714-46ef13acf5ed", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1597196996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f8d203e3c534371b05a2ec4c6c07a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa856eb89-91", "ovs_interfaceid": "a856eb89-910c-456e-bc0e-a9f92ce20248", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:03:59 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:99:09,bridge_name='br-int',has_traffic_filtering=True,id=a856eb89-910c-456e-bc0e-a9f92ce20248,network=Network(67fc40ba-b2c8-43f9-a714-46ef13acf5ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa856eb89-91') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:03:59 user nova-compute[71113]: DEBUG nova.objects.instance [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Lazy-loading 'pci_devices' on Instance uuid 95a84d3c-7aa2-4294-a419-995926a2782f {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:03:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] End _get_guest_xml xml=<domain type="kvm">
Jul 31 10:03:59 user nova-compute[71113]:   <uuid>95a84d3c-7aa2-4294-a419-995926a2782f</uuid>
Jul 31 10:03:59 user nova-compute[71113]:   <name>instance-00000024</name>
Jul 31 10:03:59 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 10:03:59 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 10:03:59 user nova-compute[71113]:   <metadata>
Jul 31 10:03:59 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 10:03:59 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 10:03:59 user nova-compute[71113]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-2103964806</nova:name>
Jul 31 10:03:59 user nova-compute[71113]:       <nova:creationTime>2023-07-31 10:03:59</nova:creationTime>
Jul 31 10:03:59 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 10:03:59 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 10:03:59 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 10:03:59 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 10:03:59 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 10:03:59 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 10:03:59 user nova-compute[71113]:       </nova:flavor>
Jul 31 10:03:59 user nova-compute[71113]:       <nova:owner>
Jul 31 10:03:59 user nova-compute[71113]:         <nova:user uuid="c4c2f8d82f494a5d8255984f4bd3806b">tempest-ServerStableDeviceRescueTest-1277436113-project-member</nova:user>
Jul 31 10:03:59 user nova-compute[71113]:         <nova:project uuid="6f8d203e3c534371b05a2ec4c6c07a61">tempest-ServerStableDeviceRescueTest-1277436113</nova:project>
Jul 31 10:03:59 user nova-compute[71113]:       </nova:owner>
Jul 31 10:03:59 user nova-compute[71113]:       <nova:root type="image" uuid="078646fe-b504-41ed-a147-61072e903e51"/>
Jul 31 10:03:59 user nova-compute[71113]:       <nova:ports>
Jul 31 10:03:59 user nova-compute[71113]:         <nova:port uuid="a856eb89-910c-456e-bc0e-a9f92ce20248">
Jul 31 10:03:59 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 31 10:03:59 user nova-compute[71113]:         </nova:port>
Jul 31 10:03:59 user nova-compute[71113]:       </nova:ports>
Jul 31 10:03:59 user nova-compute[71113]:     </nova:instance>
Jul 31 10:03:59 user nova-compute[71113]:   </metadata>
Jul 31 10:03:59 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 10:03:59 user nova-compute[71113]:     <system>
Jul 31 10:03:59 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 10:03:59 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 10:03:59 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 10:03:59 user nova-compute[71113]:       <entry name="serial">95a84d3c-7aa2-4294-a419-995926a2782f</entry>
Jul 31 10:03:59 user nova-compute[71113]:       <entry name="uuid">95a84d3c-7aa2-4294-a419-995926a2782f</entry>
Jul 31 10:03:59 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 10:03:59 user nova-compute[71113]:     </system>
Jul 31 10:03:59 user nova-compute[71113]:   </sysinfo>
Jul 31 10:03:59 user nova-compute[71113]:   <os>
Jul 31 10:03:59 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 10:03:59 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 10:03:59 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 10:03:59 user nova-compute[71113]:   </os>
Jul 31 10:03:59 user nova-compute[71113]:   <features>
Jul 31 10:03:59 user nova-compute[71113]:     <acpi/>
Jul 31 10:03:59 user nova-compute[71113]:     <apic/>
Jul 31 10:03:59 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 10:03:59 user nova-compute[71113]:   </features>
Jul 31 10:03:59 user nova-compute[71113]:   <clock offset="utc">
Jul 31 10:03:59 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 10:03:59 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 10:03:59 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 10:03:59 user nova-compute[71113]:   </clock>
Jul 31 10:03:59 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 10:03:59 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 10:03:59 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 10:03:59 user nova-compute[71113]:   </cpu>
Jul 31 10:03:59 user nova-compute[71113]:   <devices>
Jul 31 10:03:59 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 10:03:59 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 10:03:59 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk"/>
Jul 31 10:03:59 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 10:03:59 user nova-compute[71113]:     </disk>
Jul 31 10:03:59 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 10:03:59 user nova-compute[71113]:       <mac address="fa:16:3e:d0:99:09"/>
Jul 31 10:03:59 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:03:59 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 10:03:59 user nova-compute[71113]:       <target dev="tapa856eb89-91"/>
Jul 31 10:03:59 user nova-compute[71113]:     </interface>
Jul 31 10:03:59 user nova-compute[71113]:     <serial type="pty">
Jul 31 10:03:59 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/console.log" append="off"/>
Jul 31 10:03:59 user nova-compute[71113]:     </serial>
Jul 31 10:03:59 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 10:03:59 user nova-compute[71113]:     <video>
Jul 31 10:03:59 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:03:59 user nova-compute[71113]:     </video>
Jul 31 10:03:59 user nova-compute[71113]:     <rng model="virtio">
Jul 31 10:03:59 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 10:03:59 user nova-compute[71113]:     </rng>
Jul 31 10:03:59 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 10:03:59 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 10:03:59 user nova-compute[71113]:       <stats period="10"/>
Jul 31 10:03:59 user nova-compute[71113]:     </memballoon>
Jul 31 10:03:59 user nova-compute[71113]:   </devices>
Jul 31 10:03:59 user nova-compute[71113]: </domain>
Jul 31 10:03:59 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 10:03:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:03:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2103964806',display_name='tempest-ServerStableDeviceRescueTest-server-2103964806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2103964806',id=36,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdl8SX645/Muc/9M6HuPzDTOvIdM6KrFE61+dTZHqyrZ0zWuC0IOgJE5YL7IjPgvGTYTgBzjZJL8AHFSZVMP6dsDsN1FtFI6gizkdDAM6HYW8d03e+SFHeZYZOyP/3S4w==',key_name='tempest-keypair-1251481522',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f8d203e3c534371b05a2ec4c6c07a61',ramdisk_id='',reservation_id='r-fanuve5b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1277436113',owner_user_name='tempest-ServerStableDeviceRescueTest-1277436113-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T10:03:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4c2f8d82f494a5d8255984f4bd3806b',uuid=95a84d3c-7aa2-4294-a419-995926a2782f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a856eb89-910c-456e-bc0e-a9f92ce20248", "address": "fa:16:3e:d0:99:09", "network": {"id": "67fc40ba-b2c8-43f9-a714-46ef13acf5ed", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1597196996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f8d203e3c534371b05a2ec4c6c07a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa856eb89-91", "ovs_interfaceid": "a856eb89-910c-456e-bc0e-a9f92ce20248", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 10:03:59 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Converting VIF {"id": "a856eb89-910c-456e-bc0e-a9f92ce20248", "address": "fa:16:3e:d0:99:09", "network": {"id": "67fc40ba-b2c8-43f9-a714-46ef13acf5ed", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1597196996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f8d203e3c534371b05a2ec4c6c07a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa856eb89-91", "ovs_interfaceid": "a856eb89-910c-456e-bc0e-a9f92ce20248", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:03:59 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:99:09,bridge_name='br-int',has_traffic_filtering=True,id=a856eb89-910c-456e-bc0e-a9f92ce20248,network=Network(67fc40ba-b2c8-43f9-a714-46ef13acf5ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa856eb89-91') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:03:59 user nova-compute[71113]: DEBUG os_vif [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:99:09,bridge_name='br-int',has_traffic_filtering=True,id=a856eb89-910c-456e-bc0e-a9f92ce20248,network=Network(67fc40ba-b2c8-43f9-a714-46ef13acf5ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa856eb89-91') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 10:03:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:03:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:03:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 10:03:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:03:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa856eb89-91, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:03:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa856eb89-91, col_values=(('external_ids', {'iface-id': 'a856eb89-910c-456e-bc0e-a9f92ce20248', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:99:09', 'vm-uuid': '95a84d3c-7aa2-4294-a419-995926a2782f'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:03:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:03:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:03:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:03:59 user nova-compute[71113]: INFO os_vif [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:99:09,bridge_name='br-int',has_traffic_filtering=True,id=a856eb89-910c-456e-bc0e-a9f92ce20248,network=Network(67fc40ba-b2c8-43f9-a714-46ef13acf5ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa856eb89-91')
Jul 31 10:03:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:03:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] No VIF found with MAC fa:16:3e:d0:99:09, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 10:03:59 user nova-compute[71113]: DEBUG nova.network.neutron [req-9af0d4d1-9776-4bc4-ba93-c8edf03dd8dc req-aae846f6-c301-413a-b833-ddf2055b085e service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Updated VIF entry in instance network info cache for port a856eb89-910c-456e-bc0e-a9f92ce20248. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 10:03:59 user nova-compute[71113]: DEBUG nova.network.neutron [req-9af0d4d1-9776-4bc4-ba93-c8edf03dd8dc req-aae846f6-c301-413a-b833-ddf2055b085e service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Updating instance_info_cache with network_info: [{"id": "a856eb89-910c-456e-bc0e-a9f92ce20248", "address": "fa:16:3e:d0:99:09", "network": {"id": "67fc40ba-b2c8-43f9-a714-46ef13acf5ed", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1597196996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f8d203e3c534371b05a2ec4c6c07a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa856eb89-91", "ovs_interfaceid": "a856eb89-910c-456e-bc0e-a9f92ce20248", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:03:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9af0d4d1-9776-4bc4-ba93-c8edf03dd8dc req-aae846f6-c301-413a-b833-ddf2055b085e service nova] Releasing lock "refresh_cache-95a84d3c-7aa2-4294-a419-995926a2782f" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:04:00 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:04:00 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:04:00 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:04:00 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:04:00 user nova-compute[71113]: DEBUG nova.compute.manager [req-2f5a1996-44be-49c9-8bd9-57caa74be92d req-e75df861-8617-4e89-8ae3-69550029406d service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Received event network-vif-plugged-a856eb89-910c-456e-bc0e-a9f92ce20248 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:04:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-2f5a1996-44be-49c9-8bd9-57caa74be92d req-e75df861-8617-4e89-8ae3-69550029406d service nova] Acquiring lock "95a84d3c-7aa2-4294-a419-995926a2782f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:04:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-2f5a1996-44be-49c9-8bd9-57caa74be92d req-e75df861-8617-4e89-8ae3-69550029406d service nova] Lock "95a84d3c-7aa2-4294-a419-995926a2782f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:04:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-2f5a1996-44be-49c9-8bd9-57caa74be92d req-e75df861-8617-4e89-8ae3-69550029406d service nova] Lock "95a84d3c-7aa2-4294-a419-995926a2782f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:04:00 user nova-compute[71113]: DEBUG nova.compute.manager [req-2f5a1996-44be-49c9-8bd9-57caa74be92d req-e75df861-8617-4e89-8ae3-69550029406d service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] No waiting events found dispatching network-vif-plugged-a856eb89-910c-456e-bc0e-a9f92ce20248 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:04:00 user nova-compute[71113]: WARNING nova.compute.manager [req-2f5a1996-44be-49c9-8bd9-57caa74be92d req-e75df861-8617-4e89-8ae3-69550029406d service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Received unexpected event network-vif-plugged-a856eb89-910c-456e-bc0e-a9f92ce20248 for instance with vm_state building and task_state spawning.
Jul 31 10:04:01 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:04:01 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:04:01 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:04:01 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:04:02 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797842.7494779, 95a84d3c-7aa2-4294-a419-995926a2782f => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:04:02 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] VM Resumed (Lifecycle Event)
Jul 31 10:04:02 user nova-compute[71113]: DEBUG nova.compute.manager [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 10:04:02 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 10:04:02 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Instance spawned successfully.
Jul 31 10:04:02 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 10:04:02 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:04:02 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:04:02 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Found default for hw_cdrom_bus of ide {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:04:02 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Found default for hw_disk_bus of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:04:02 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Found default for hw_input_bus of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:04:02 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Found default for hw_pointer_model of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:04:02 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Found default for hw_video_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:04:02 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Found default for hw_vif_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:04:02 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 10:04:02 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797842.7526712, 95a84d3c-7aa2-4294-a419-995926a2782f => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:04:02 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] VM Started (Lifecycle Event)
Jul 31 10:04:02 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:04:02 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:04:02 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 10:04:02 user nova-compute[71113]: INFO nova.compute.manager [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Took 6.59 seconds to spawn the instance on the hypervisor.
Jul 31 10:04:02 user nova-compute[71113]: DEBUG nova.compute.manager [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:04:02 user nova-compute[71113]: INFO nova.compute.manager [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Took 7.53 seconds to build instance.
Jul 31 10:04:02 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5331e490-69a9-4970-a73d-e6014cace1f4 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Lock "95a84d3c-7aa2-4294-a419-995926a2782f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.659s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:04:02 user nova-compute[71113]: DEBUG nova.compute.manager [req-7c5e444a-9bf5-4e6e-93d8-4a3a6e77b0d3 req-25475172-a036-4ff3-80f3-02b63bbd0dc1 service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Received event network-vif-plugged-a856eb89-910c-456e-bc0e-a9f92ce20248 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:04:02 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7c5e444a-9bf5-4e6e-93d8-4a3a6e77b0d3 req-25475172-a036-4ff3-80f3-02b63bbd0dc1 service nova] Acquiring lock "95a84d3c-7aa2-4294-a419-995926a2782f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:04:02 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7c5e444a-9bf5-4e6e-93d8-4a3a6e77b0d3 req-25475172-a036-4ff3-80f3-02b63bbd0dc1 service nova] Lock "95a84d3c-7aa2-4294-a419-995926a2782f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:04:02 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7c5e444a-9bf5-4e6e-93d8-4a3a6e77b0d3 req-25475172-a036-4ff3-80f3-02b63bbd0dc1 service nova] Lock "95a84d3c-7aa2-4294-a419-995926a2782f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:04:02 user nova-compute[71113]: DEBUG nova.compute.manager [req-7c5e444a-9bf5-4e6e-93d8-4a3a6e77b0d3 req-25475172-a036-4ff3-80f3-02b63bbd0dc1 service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] No waiting events found dispatching network-vif-plugged-a856eb89-910c-456e-bc0e-a9f92ce20248 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:04:02 user nova-compute[71113]: WARNING nova.compute.manager [req-7c5e444a-9bf5-4e6e-93d8-4a3a6e77b0d3 req-25475172-a036-4ff3-80f3-02b63bbd0dc1 service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Received unexpected event network-vif-plugged-a856eb89-910c-456e-bc0e-a9f92ce20248 for instance with vm_state active and task_state None.
Jul 31 10:04:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:04:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:04:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:04:10 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:04:12 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:04:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7980e644-72e1-4270-b484-0c6bb9616e57 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Acquiring lock "c4b88201-04dc-4da9-b213-c50cdf274f4e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:04:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7980e644-72e1-4270-b484-0c6bb9616e57 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lock "c4b88201-04dc-4da9-b213-c50cdf274f4e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:04:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7980e644-72e1-4270-b484-0c6bb9616e57 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Acquiring lock "c4b88201-04dc-4da9-b213-c50cdf274f4e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:04:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7980e644-72e1-4270-b484-0c6bb9616e57 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lock "c4b88201-04dc-4da9-b213-c50cdf274f4e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:04:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7980e644-72e1-4270-b484-0c6bb9616e57 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lock "c4b88201-04dc-4da9-b213-c50cdf274f4e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:04:13 user nova-compute[71113]: INFO nova.compute.manager [None req-7980e644-72e1-4270-b484-0c6bb9616e57 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Terminating instance
Jul 31 10:04:13 user nova-compute[71113]: DEBUG nova.compute.manager [None req-7980e644-72e1-4270-b484-0c6bb9616e57 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Start destroying the instance on the hypervisor. {{(pid=71113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 10:04:13 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:04:13 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:04:13 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:04:13 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:04:13 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:04:13 user nova-compute[71113]: DEBUG nova.compute.manager [req-9f62bce4-1c4c-4f98-b762-9cc86cd982bf req-d5110ffd-ed46-4a64-ad45-2600685c9f03 service nova] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Received event network-vif-unplugged-b9c0f910-2e85-41e6-903c-4b678d4fbe5e {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:04:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9f62bce4-1c4c-4f98-b762-9cc86cd982bf req-d5110ffd-ed46-4a64-ad45-2600685c9f03 service nova] Acquiring lock "c4b88201-04dc-4da9-b213-c50cdf274f4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:04:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9f62bce4-1c4c-4f98-b762-9cc86cd982bf req-d5110ffd-ed46-4a64-ad45-2600685c9f03 service nova] Lock "c4b88201-04dc-4da9-b213-c50cdf274f4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:04:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9f62bce4-1c4c-4f98-b762-9cc86cd982bf req-d5110ffd-ed46-4a64-ad45-2600685c9f03 service nova] Lock "c4b88201-04dc-4da9-b213-c50cdf274f4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:04:13 user nova-compute[71113]: DEBUG nova.compute.manager [req-9f62bce4-1c4c-4f98-b762-9cc86cd982bf req-d5110ffd-ed46-4a64-ad45-2600685c9f03 service nova] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] No waiting events found dispatching network-vif-unplugged-b9c0f910-2e85-41e6-903c-4b678d4fbe5e {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:04:13 user nova-compute[71113]: DEBUG nova.compute.manager [req-9f62bce4-1c4c-4f98-b762-9cc86cd982bf req-d5110ffd-ed46-4a64-ad45-2600685c9f03 service nova] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Received event network-vif-unplugged-b9c0f910-2e85-41e6-903c-4b678d4fbe5e for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 10:04:13 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:04:13 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:04:13 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:04:13 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:04:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:04:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.004s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:04:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:04:13 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:04:13 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Instance destroyed successfully.
Jul 31 10:04:13 user nova-compute[71113]: DEBUG nova.objects.instance [None req-7980e644-72e1-4270-b484-0c6bb9616e57 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lazy-loading 'resources' on Instance uuid c4b88201-04dc-4da9-b213-c50cdf274f4e {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:04:14 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-7980e644-72e1-4270-b484-0c6bb9616e57 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:57:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-272327487',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-272327487',id=28,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQSFRbgG8fn20fSbYTtr/mryCM3cS66xKkFgDl4Atxq0gS6Iyk/4ZDiDclIbL4yIv6KMdHi13hHC1nM1eapV8B93tENKeE5RNaQPY6ACbEOrENq7vJJh7Cmwq1mUx9W+g==',key_name='tempest-keypair-1850268314',keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:57:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e4b02badf8ea4f32a5e259c25120eac7',ramdisk_id='',reservation_id='r-4m2ef3pd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1497143588',owner_user_name='tempest-ServerActionsV293TestJSON-1497143588-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:57:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba2fd55dd96b4c49bb0c1c98c0a724d4',uuid=c4b88201-04dc-4da9-b213-c50cdf274f4e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b9c0f910-2e85-41e6-903c-4b678d4fbe5e", "address": "fa:16:3e:1b:88:27", "network": {"id": "5f333808-4342-4014-9221-7ccd394eff66", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-42408734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4b02badf8ea4f32a5e259c25120eac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9c0f910-2e", "ovs_interfaceid": "b9c0f910-2e85-41e6-903c-4b678d4fbe5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 10:04:14 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-7980e644-72e1-4270-b484-0c6bb9616e57 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Converting VIF {"id": "b9c0f910-2e85-41e6-903c-4b678d4fbe5e", "address": "fa:16:3e:1b:88:27", "network": {"id": "5f333808-4342-4014-9221-7ccd394eff66", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-42408734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4b02badf8ea4f32a5e259c25120eac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9c0f910-2e", "ovs_interfaceid": "b9c0f910-2e85-41e6-903c-4b678d4fbe5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:04:14 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-7980e644-72e1-4270-b484-0c6bb9616e57 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:88:27,bridge_name='br-int',has_traffic_filtering=True,id=b9c0f910-2e85-41e6-903c-4b678d4fbe5e,network=Network(5f333808-4342-4014-9221-7ccd394eff66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9c0f910-2e') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:04:14 user nova-compute[71113]: DEBUG os_vif [None req-7980e644-72e1-4270-b484-0c6bb9616e57 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:88:27,bridge_name='br-int',has_traffic_filtering=True,id=b9c0f910-2e85-41e6-903c-4b678d4fbe5e,network=Network(5f333808-4342-4014-9221-7ccd394eff66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9c0f910-2e') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 10:04:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:04:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb9c0f910-2e, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:04:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:04:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:04:14 user nova-compute[71113]: INFO os_vif [None req-7980e644-72e1-4270-b484-0c6bb9616e57 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:88:27,bridge_name='br-int',has_traffic_filtering=True,id=b9c0f910-2e85-41e6-903c-4b678d4fbe5e,network=Network(5f333808-4342-4014-9221-7ccd394eff66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9c0f910-2e')
Jul 31 10:04:14 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-7980e644-72e1-4270-b484-0c6bb9616e57 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Deleting instance files /opt/stack/data/nova/instances/c4b88201-04dc-4da9-b213-c50cdf274f4e_del
Jul 31 10:04:14 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-7980e644-72e1-4270-b484-0c6bb9616e57 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Deletion of /opt/stack/data/nova/instances/c4b88201-04dc-4da9-b213-c50cdf274f4e_del complete
Jul 31 10:04:14 user nova-compute[71113]: INFO nova.compute.manager [None req-7980e644-72e1-4270-b484-0c6bb9616e57 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Took 1.01 seconds to destroy the instance on the hypervisor.
Jul 31 10:04:14 user nova-compute[71113]: DEBUG oslo.service.loopingcall [None req-7980e644-72e1-4270-b484-0c6bb9616e57 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71113) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 10:04:14 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 10:04:14 user nova-compute[71113]: DEBUG nova.compute.manager [-] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Deallocating network for instance {{(pid=71113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 10:04:14 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] deallocate_for_instance() {{(pid=71113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 10:04:14 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 10:04:14 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Error from libvirt while getting description of instance-0000001c: [Error Code 42] Domain not found: no domain with matching uuid 'c4b88201-04dc-4da9-b213-c50cdf274f4e' (instance-0000001c): libvirt.libvirtError: Domain not found: no domain with matching uuid 'c4b88201-04dc-4da9-b213-c50cdf274f4e' (instance-0000001c)
Jul 31 10:04:14 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 10:04:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f020f166-07b6-4cf5-9f17-2ab108b55c30/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:04:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f020f166-07b6-4cf5-9f17-2ab108b55c30/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:04:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f020f166-07b6-4cf5-9f17-2ab108b55c30/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:04:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f020f166-07b6-4cf5-9f17-2ab108b55c30/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:04:14 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 10:04:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:04:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:04:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:04:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:04:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:04:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:04:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:04:15 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:04:15 user nova-compute[71113]: DEBUG nova.compute.manager [req-35325607-4a3e-431f-9bfa-05a8dbd99440 req-3e25e1af-ed56-4170-b7a5-c05c33abd5e3 service nova] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Received event network-vif-deleted-b9c0f910-2e85-41e6-903c-4b678d4fbe5e {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:04:15 user nova-compute[71113]: INFO nova.compute.manager [req-35325607-4a3e-431f-9bfa-05a8dbd99440 req-3e25e1af-ed56-4170-b7a5-c05c33abd5e3 service nova] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Neutron deleted interface b9c0f910-2e85-41e6-903c-4b678d4fbe5e; detaching it from the instance and deleting it from the info cache
Jul 31 10:04:15 user nova-compute[71113]: DEBUG nova.network.neutron [req-35325607-4a3e-431f-9bfa-05a8dbd99440 req-3e25e1af-ed56-4170-b7a5-c05c33abd5e3 service nova] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:04:15 user nova-compute[71113]: DEBUG nova.compute.manager [req-9e2d9638-7316-4646-ad08-fb6db1bc4e79 req-90270439-a604-4d32-b1ca-08d3d3d22c4e service nova] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Received event network-vif-plugged-b9c0f910-2e85-41e6-903c-4b678d4fbe5e {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:04:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9e2d9638-7316-4646-ad08-fb6db1bc4e79 req-90270439-a604-4d32-b1ca-08d3d3d22c4e service nova] Acquiring lock "c4b88201-04dc-4da9-b213-c50cdf274f4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:04:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9e2d9638-7316-4646-ad08-fb6db1bc4e79 req-90270439-a604-4d32-b1ca-08d3d3d22c4e service nova] Lock "c4b88201-04dc-4da9-b213-c50cdf274f4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:04:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9e2d9638-7316-4646-ad08-fb6db1bc4e79 req-90270439-a604-4d32-b1ca-08d3d3d22c4e service nova] Lock "c4b88201-04dc-4da9-b213-c50cdf274f4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:04:15 user nova-compute[71113]: DEBUG nova.compute.manager [req-9e2d9638-7316-4646-ad08-fb6db1bc4e79 req-90270439-a604-4d32-b1ca-08d3d3d22c4e service nova] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] No waiting events found dispatching network-vif-plugged-b9c0f910-2e85-41e6-903c-4b678d4fbe5e {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:04:15 user nova-compute[71113]: WARNING nova.compute.manager [req-9e2d9638-7316-4646-ad08-fb6db1bc4e79 req-90270439-a604-4d32-b1ca-08d3d3d22c4e service nova] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Received unexpected event network-vif-plugged-b9c0f910-2e85-41e6-903c-4b678d4fbe5e for instance with vm_state active and task_state deleting.
Jul 31 10:04:15 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:04:15 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:04:15 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=8037MB free_disk=25.26613998413086GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:04:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:04:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:04:15 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:04:15 user nova-compute[71113]: DEBUG nova.compute.manager [req-35325607-4a3e-431f-9bfa-05a8dbd99440 req-3e25e1af-ed56-4170-b7a5-c05c33abd5e3 service nova] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Detach interface failed, port_id=b9c0f910-2e85-41e6-903c-4b678d4fbe5e, reason: Instance c4b88201-04dc-4da9-b213-c50cdf274f4e could not be found. {{(pid=71113) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 10:04:15 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Took 1.44 seconds to deallocate network for instance.
Jul 31 10:04:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7980e644-72e1-4270-b484-0c6bb9616e57 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:04:15 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 3157a7a6-b8a9-4e2d-a157-360bce4c625d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:04:15 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 92d25a03-98ce-4bde-a3cc-20313ae77d41 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:04:15 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance c4b88201-04dc-4da9-b213-c50cdf274f4e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:04:15 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance f020f166-07b6-4cf5-9f17-2ab108b55c30 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:04:15 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance fc41eb59-d988-461c-941e-551ceb174ba1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:04:15 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 52f1f390-1599-4dda-9418-f12a48ef582c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:04:15 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance b751cc3f-b5b1-438b-b251-c589774c2bcf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:04:15 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 95a84d3c-7aa2-4294-a419-995926a2782f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:04:15 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:04:15 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:04:15 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:04:15 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:04:16 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:04:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.429s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:04:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7980e644-72e1-4270-b484-0c6bb9616e57 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.336s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:04:16 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-7980e644-72e1-4270-b484-0c6bb9616e57 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:04:16 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-7980e644-72e1-4270-b484-0c6bb9616e57 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:04:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7980e644-72e1-4270-b484-0c6bb9616e57 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.264s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:04:16 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-7980e644-72e1-4270-b484-0c6bb9616e57 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Deleted allocations for instance c4b88201-04dc-4da9-b213-c50cdf274f4e
Jul 31 10:04:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7980e644-72e1-4270-b484-0c6bb9616e57 tempest-ServerActionsV293TestJSON-1497143588 tempest-ServerActionsV293TestJSON-1497143588-project-member] Lock "c4b88201-04dc-4da9-b213-c50cdf274f4e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.237s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:04:17 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:04:17 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:04:17 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:04:17 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:04:17 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Rebuilding the list of instances to heal {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 10:04:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "refresh_cache-3157a7a6-b8a9-4e2d-a157-360bce4c625d" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:04:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquired lock "refresh_cache-3157a7a6-b8a9-4e2d-a157-360bce4c625d" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:04:17 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Forcefully refreshing network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 10:04:17 user nova-compute[71113]: DEBUG nova.objects.instance [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lazy-loading 'info_cache' on Instance uuid 3157a7a6-b8a9-4e2d-a157-360bce4c625d {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:04:18 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Updating instance_info_cache with network_info: [{"id": "179480f5-30b9-4a11-9771-95d88f21574f", "address": "fa:16:3e:42:ea:05", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap179480f5-30", "ovs_interfaceid": "179480f5-30b9-4a11-9771-95d88f21574f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:04:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Releasing lock "refresh_cache-3157a7a6-b8a9-4e2d-a157-360bce4c625d" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:04:18 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Updated the network info_cache for instance {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 10:04:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:04:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:04:21 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:04:21 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:04:22 user nova-compute[71113]: INFO nova.compute.manager [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Rescuing
Jul 31 10:04:22 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquiring lock "refresh_cache-52f1f390-1599-4dda-9418-f12a48ef582c" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:04:22 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquired lock "refresh_cache-52f1f390-1599-4dda-9418-f12a48ef582c" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:04:22 user nova-compute[71113]: DEBUG nova.network.neutron [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 10:04:22 user nova-compute[71113]: DEBUG nova.network.neutron [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Updating instance_info_cache with network_info: [{"id": "6af975ec-2ae8-44fc-8762-90e9a13efbce", "address": "fa:16:3e:b2:53:f2", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af975ec-2a", "ovs_interfaceid": "6af975ec-2ae8-44fc-8762-90e9a13efbce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:04:22 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Releasing lock "refresh_cache-52f1f390-1599-4dda-9418-f12a48ef582c" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:04:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:04:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:04:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:04:22 user nova-compute[71113]: DEBUG nova.compute.manager [req-7fc0b602-c110-40d1-9090-8c708d87ff4d req-263996a4-4a3b-4f0e-ab84-6bcf4fb12659 service nova] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Received event network-vif-unplugged-6af975ec-2ae8-44fc-8762-90e9a13efbce {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:04:22 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7fc0b602-c110-40d1-9090-8c708d87ff4d req-263996a4-4a3b-4f0e-ab84-6bcf4fb12659 service nova] Acquiring lock "52f1f390-1599-4dda-9418-f12a48ef582c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:04:22 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7fc0b602-c110-40d1-9090-8c708d87ff4d req-263996a4-4a3b-4f0e-ab84-6bcf4fb12659 service nova] Lock "52f1f390-1599-4dda-9418-f12a48ef582c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:04:22 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7fc0b602-c110-40d1-9090-8c708d87ff4d req-263996a4-4a3b-4f0e-ab84-6bcf4fb12659 service nova] Lock "52f1f390-1599-4dda-9418-f12a48ef582c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:04:22 user nova-compute[71113]: DEBUG nova.compute.manager [req-7fc0b602-c110-40d1-9090-8c708d87ff4d req-263996a4-4a3b-4f0e-ab84-6bcf4fb12659 service nova] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] No waiting events found dispatching network-vif-unplugged-6af975ec-2ae8-44fc-8762-90e9a13efbce {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:04:22 user nova-compute[71113]: WARNING nova.compute.manager [req-7fc0b602-c110-40d1-9090-8c708d87ff4d req-263996a4-4a3b-4f0e-ab84-6bcf4fb12659 service nova] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Received unexpected event network-vif-unplugged-6af975ec-2ae8-44fc-8762-90e9a13efbce for instance with vm_state active and task_state rescuing.
Jul 31 10:04:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:04:23 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Instance destroyed successfully.
Jul 31 10:04:23 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Attempting a stable device rescue
Jul 31 10:04:23 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71113) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 31 10:04:23 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Instance directory exists: not creating {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 31 10:04:23 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Creating image(s)
Jul 31 10:04:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquiring lock "/opt/stack/data/nova/instances/52f1f390-1599-4dda-9418-f12a48ef582c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:04:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "/opt/stack/data/nova/instances/52f1f390-1599-4dda-9418-f12a48ef582c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:04:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "/opt/stack/data/nova/instances/52f1f390-1599-4dda-9418-f12a48ef582c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:04:23 user nova-compute[71113]: DEBUG nova.objects.instance [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lazy-loading 'trusted_certs' on Instance uuid 52f1f390-1599-4dda-9418-f12a48ef582c {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:04:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquiring lock "6716e364bf45231893438011268d06f09ad151fc" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:04:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "6716e364bf45231893438011268d06f09ad151fc" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:04:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6716e364bf45231893438011268d06f09ad151fc.part --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:04:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:04:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6716e364bf45231893438011268d06f09ad151fc.part --force-share --output=json" returned: 0 in 0.142s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:04:24 user nova-compute[71113]: DEBUG nova.virt.images [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] f3b33d35-d968-459a-98d4-20f0d7682543 was qcow2, converting to raw {{(pid=71113) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 31 10:04:24 user nova-compute[71113]: DEBUG nova.privsep.utils [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71113) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 10:04:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6716e364bf45231893438011268d06f09ad151fc.part /opt/stack/data/nova/instances/_base/6716e364bf45231893438011268d06f09ad151fc.converted {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:04:25 user nova-compute[71113]: DEBUG nova.compute.manager [req-9ef90d33-f158-4633-96fc-e80a92b59951 req-7e95c2c0-8dba-4f99-ad46-1cc2246a521a service nova] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Received event network-vif-plugged-6af975ec-2ae8-44fc-8762-90e9a13efbce {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:04:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9ef90d33-f158-4633-96fc-e80a92b59951 req-7e95c2c0-8dba-4f99-ad46-1cc2246a521a service nova] Acquiring lock "52f1f390-1599-4dda-9418-f12a48ef582c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:04:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9ef90d33-f158-4633-96fc-e80a92b59951 req-7e95c2c0-8dba-4f99-ad46-1cc2246a521a service nova] Lock "52f1f390-1599-4dda-9418-f12a48ef582c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:04:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9ef90d33-f158-4633-96fc-e80a92b59951 req-7e95c2c0-8dba-4f99-ad46-1cc2246a521a service nova] Lock "52f1f390-1599-4dda-9418-f12a48ef582c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:04:25 user nova-compute[71113]: DEBUG nova.compute.manager [req-9ef90d33-f158-4633-96fc-e80a92b59951 req-7e95c2c0-8dba-4f99-ad46-1cc2246a521a service nova] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] No waiting events found dispatching network-vif-plugged-6af975ec-2ae8-44fc-8762-90e9a13efbce {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:04:25 user nova-compute[71113]: WARNING nova.compute.manager [req-9ef90d33-f158-4633-96fc-e80a92b59951 req-7e95c2c0-8dba-4f99-ad46-1cc2246a521a service nova] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Received unexpected event network-vif-plugged-6af975ec-2ae8-44fc-8762-90e9a13efbce for instance with vm_state active and task_state rescuing.
Jul 31 10:04:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:04:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6716e364bf45231893438011268d06f09ad151fc.part /opt/stack/data/nova/instances/_base/6716e364bf45231893438011268d06f09ad151fc.converted" returned: 0 in 0.632s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:04:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6716e364bf45231893438011268d06f09ad151fc.converted --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:04:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6716e364bf45231893438011268d06f09ad151fc.converted --force-share --output=json" returned: 0 in 0.154s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:04:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "6716e364bf45231893438011268d06f09ad151fc" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.258s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:04:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquiring lock "6716e364bf45231893438011268d06f09ad151fc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:04:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "6716e364bf45231893438011268d06f09ad151fc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:04:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6716e364bf45231893438011268d06f09ad151fc --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:04:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6716e364bf45231893438011268d06f09ad151fc --force-share --output=json" returned: 0 in 0.139s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:04:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6716e364bf45231893438011268d06f09ad151fc,backing_fmt=raw /opt/stack/data/nova/instances/52f1f390-1599-4dda-9418-f12a48ef582c/disk.rescue {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:04:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6716e364bf45231893438011268d06f09ad151fc,backing_fmt=raw /opt/stack/data/nova/instances/52f1f390-1599-4dda-9418-f12a48ef582c/disk.rescue" returned: 0 in 0.049s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:04:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "6716e364bf45231893438011268d06f09ad151fc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:04:25 user nova-compute[71113]: DEBUG nova.objects.instance [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lazy-loading 'migration_context' on Instance uuid 52f1f390-1599-4dda-9418-f12a48ef582c {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:04:25 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Created local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 10:04:25 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Start _get_guest_xml network_info=[{"id": "6af975ec-2ae8-44fc-8762-90e9a13efbce", "address": "fa:16:3e:b2:53:f2", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "vif_mac": "fa:16:3e:b2:53:f2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af975ec-2a", "ovs_interfaceid": "6af975ec-2ae8-44fc-8762-90e9a13efbce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f3b33d35-d968-459a-98d4-20f0d7682543', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'fb12baf0-7498-4417-9a23-2ca2e19c4fef', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OCHGdVDP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '52f1f390-1599-4dda-9418-f12a48ef582c', 'attached_at': '', 'detached_at': '', 'volume_id': 'd4041c37-33ce-4873-b87c-b4f145dd6fe7', 'serial': 'd4041c37-33ce-4873-b87c-b4f145dd6fe7'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 10:04:25 user nova-compute[71113]: DEBUG nova.objects.instance [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lazy-loading 'resources' on Instance uuid 52f1f390-1599-4dda-9418-f12a48ef582c {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:04:25 user nova-compute[71113]: DEBUG nova.objects.instance [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lazy-loading 'numa_topology' on Instance uuid 52f1f390-1599-4dda-9418-f12a48ef582c {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:04:25 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:04:25 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:04:25 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 10:04:25 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 10:04:25 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 10:04:25 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 10:04:25 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 10:04:25 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 10:04:25 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 10:04:25 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 10:04:25 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 10:04:25 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 10:04:25 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 10:04:25 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 10:04:25 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 10:04:25 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 10:04:25 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 10:04:25 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 10:04:25 user nova-compute[71113]: DEBUG nova.objects.instance [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lazy-loading 'vcpu_model' on Instance uuid 52f1f390-1599-4dda-9418-f12a48ef582c {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:04:26 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 10:04:26 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OCHGdVDP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:04:26 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:04:26 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:04:26 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:04:26 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:04:26 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:04:26 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:04:26 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 10:04:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:04:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:04:26 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f954c2f-256e-42ad-a69d-2baa0e711a61]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = OCHGdVDP\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:04:26 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 31 10:04:26 user nova-compute[71113]: node.name = iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7
Jul 31 10:04:26 user nova-compute[71113]: node.tpgt = -1
Jul 31 10:04:26 user nova-compute[71113]: node.startup = automatic
Jul 31 10:04:26 user nova-compute[71113]: node.leading_login = No
Jul 31 10:04:26 user nova-compute[71113]: iface.iscsi_ifacename = default
Jul 31 10:04:26 user nova-compute[71113]: iface.net_ifacename = <empty>
Jul 31 10:04:26 user nova-compute[71113]: iface.ipaddress = <empty>
Jul 31 10:04:26 user nova-compute[71113]: iface.prefix_len = 0
Jul 31 10:04:26 user nova-compute[71113]: iface.hwaddress = <empty>
Jul 31 10:04:26 user nova-compute[71113]: iface.transport_name = tcp
Jul 31 10:04:26 user nova-compute[71113]: iface.initiatorname = <empty>
Jul 31 10:04:26 user nova-compute[71113]: iface.state = <empty>
Jul 31 10:04:26 user nova-compute[71113]: iface.vlan_id = 0
Jul 31 10:04:26 user nova-compute[71113]: iface.vlan_priority = 0
Jul 31 10:04:26 user nova-compute[71113]: iface.vlan_state = <empty>
Jul 31 10:04:26 user nova-compute[71113]: iface.iface_num = 0
Jul 31 10:04:26 user nova-compute[71113]: iface.mtu = 0
Jul 31 10:04:26 user nova-compute[71113]: iface.port = 0
Jul 31 10:04:26 user nova-compute[71113]: iface.bootproto = <empty>
Jul 31 10:04:26 user nova-compute[71113]: iface.subnet_mask = <empty>
Jul 31 10:04:26 user nova-compute[71113]: iface.gateway = <empty>
Jul 31 10:04:26 user nova-compute[71113]: iface.dhcp_alt_client_id_state = <empty>
Jul 31 10:04:26 user nova-compute[71113]: iface.dhcp_alt_client_id = <empty>
Jul 31 10:04:26 user nova-compute[71113]: iface.dhcp_dns = <empty>
Jul 31 10:04:26 user nova-compute[71113]: iface.dhcp_learn_iqn = <empty>
Jul 31 10:04:26 user nova-compute[71113]: iface.dhcp_req_vendor_id_state = <empty>
Jul 31 10:04:26 user nova-compute[71113]: iface.dhcp_vendor_id_state = <empty>
Jul 31 10:04:26 user nova-compute[71113]: iface.dhcp_vendor_id = <empty>
Jul 31 10:04:26 user nova-compute[71113]: iface.dhcp_slp_da = <empty>
Jul 31 10:04:26 user nova-compute[71113]: iface.fragmentation = <empty>
Jul 31 10:04:26 user nova-compute[71113]: iface.gratuitous_arp = <empty>
Jul 31 10:04:26 user nova-compute[71113]: iface.incoming_forwarding = <empty>
Jul 31 10:04:26 user nova-compute[71113]: iface.tos_state = <empty>
Jul 31 10:04:26 user nova-compute[71113]: iface.tos = 0
Jul 31 10:04:26 user nova-compute[71113]: iface.ttl = 0
Jul 31 10:04:26 user nova-compute[71113]: iface.delayed_ack = <empty>
Jul 31 10:04:26 user nova-compute[71113]: iface.tcp_nagle = <empty>
Jul 31 10:04:26 user nova-compute[71113]: iface.tcp_wsf_state = <empty>
Jul 31 10:04:26 user nova-compute[71113]: iface.tcp_wsf = 0
Jul 31 10:04:26 user nova-compute[71113]: iface.tcp_timer_scale = 0
Jul 31 10:04:26 user nova-compute[71113]: iface.tcp_timestamp = <empty>
Jul 31 10:04:26 user nova-compute[71113]: iface.redirect = <empty>
Jul 31 10:04:26 user nova-compute[71113]: iface.def_task_mgmt_timeout = 0
Jul 31 10:04:26 user nova-compute[71113]: iface.header_digest = <empty>
Jul 31 10:04:26 user nova-compute[71113]: iface.data_digest = <empty>
Jul 31 10:04:26 user nova-compute[71113]: iface.immediate_data = <empty>
Jul 31 10:04:26 user nova-compute[71113]: iface.initial_r2t = <empty>
Jul 31 10:04:26 user nova-compute[71113]: iface.data_seq_inorder = <empty>
Jul 31 10:04:26 user nova-compute[71113]: iface.data_pdu_inorder = <empty>
Jul 31 10:04:26 user nova-compute[71113]: iface.erl = 0
Jul 31 10:04:26 user nova-compute[71113]: iface.max_receive_data_len = 0
Jul 31 10:04:26 user nova-compute[71113]: iface.first_burst_len = 0
Jul 31 10:04:26 user nova-compute[71113]: iface.max_outstanding_r2t = 0
Jul 31 10:04:26 user nova-compute[71113]: iface.max_burst_len = 0
Jul 31 10:04:26 user nova-compute[71113]: iface.chap_auth = <empty>
Jul 31 10:04:26 user nova-compute[71113]: iface.bidi_chap = <empty>
Jul 31 10:04:26 user nova-compute[71113]: iface.strict_login_compliance = <empty>
Jul 31 10:04:26 user nova-compute[71113]: iface.discovery_auth = <empty>
Jul 31 10:04:26 user nova-compute[71113]: iface.discovery_logout = <empty>
Jul 31 10:04:26 user nova-compute[71113]: node.discovery_address = <empty>
Jul 31 10:04:26 user nova-compute[71113]: node.discovery_port = 0
Jul 31 10:04:26 user nova-compute[71113]: node.discovery_type = static
Jul 31 10:04:26 user nova-compute[71113]: node.session.initial_cmdsn = 0
Jul 31 10:04:26 user nova-compute[71113]: node.session.initial_login_retry_max = 8
Jul 31 10:04:26 user nova-compute[71113]: node.session.xmit_thread_priority = -20
Jul 31 10:04:26 user nova-compute[71113]: node.session.cmds_max = 128
Jul 31 10:04:26 user nova-compute[71113]: node.session.queue_depth = 32
Jul 31 10:04:26 user nova-compute[71113]: node.session.nr_sessions = 1
Jul 31 10:04:26 user nova-compute[71113]: node.session.auth.authmethod = CHAP
Jul 31 10:04:26 user nova-compute[71113]: node.session.auth.username = OCHGdVDP
Jul 31 10:04:26 user nova-compute[71113]: node.session.auth.password = ***
Jul 31 10:04:26 user nova-compute[71113]: node.session.auth.username_in = <empty>
Jul 31 10:04:26 user nova-compute[71113]: node.session.auth.password_in = <empty>
Jul 31 10:04:26 user nova-compute[71113]: node.session.auth.chap_algs = MD5
Jul 31 10:04:26 user nova-compute[71113]: node.session.timeo.replacement_timeout = 120
Jul 31 10:04:26 user nova-compute[71113]: node.session.err_timeo.abort_timeout = 15
Jul 31 10:04:26 user nova-compute[71113]: node.session.err_timeo.lu_reset_timeout = 30
Jul 31 10:04:26 user nova-compute[71113]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 31 10:04:26 user nova-compute[71113]: node.session.err_timeo.host_reset_timeout = 60
Jul 31 10:04:26 user nova-compute[71113]: node.session.iscsi.FastAbort = Yes
Jul 31 10:04:26 user nova-compute[71113]: node.session.iscsi.InitialR2T = No
Jul 31 10:04:26 user nova-compute[71113]: node.session.iscsi.ImmediateData = Yes
Jul 31 10:04:26 user nova-compute[71113]: node.session.iscsi.FirstBurstLength = 262144
Jul 31 10:04:26 user nova-compute[71113]: node.session.iscsi.MaxBurstLength = 16776192
Jul 31 10:04:26 user nova-compute[71113]: node.session.iscsi.DefaultTime2Retain = 0
Jul 31 10:04:26 user nova-compute[71113]: node.session.iscsi.DefaultTime2Wait = 2
Jul 31 10:04:26 user nova-compute[71113]: node.session.iscsi.MaxConnections = 1
Jul 31 10:04:26 user nova-compute[71113]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 31 10:04:26 user nova-compute[71113]: node.session.iscsi.ERL = 0
Jul 31 10:04:26 user nova-compute[71113]: node.session.scan = manual
Jul 31 10:04:26 user nova-compute[71113]: node.session.reopen_max = 0
Jul 31 10:04:26 user nova-compute[71113]: node.conn[0].address = 172.16.0.220
Jul 31 10:04:26 user nova-compute[71113]: node.conn[0].port = 3260
Jul 31 10:04:26 user nova-compute[71113]: node.conn[0].startup = manual
Jul 31 10:04:26 user nova-compute[71113]: node.conn[0].tcp.window_size = 524288
Jul 31 10:04:26 user nova-compute[71113]: node.conn[0].tcp.type_of_service = 0
Jul 31 10:04:26 user nova-compute[71113]: node.conn[0].timeo.logout_timeout = 15
Jul 31 10:04:26 user nova-compute[71113]: node.conn[0].timeo.login_timeout = 15
Jul 31 10:04:26 user nova-compute[71113]: node.conn[0].timeo.auth_timeout = 45
Jul 31 10:04:26 user nova-compute[71113]: node.conn[0].timeo.noop_out_interval = 5
Jul 31 10:04:26 user nova-compute[71113]: node.conn[0].timeo.noop_out_timeout = 5
Jul 31 10:04:26 user nova-compute[71113]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 31 10:04:26 user nova-compute[71113]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 31 10:04:26 user nova-compute[71113]: node.conn[0].iscsi.HeaderDigest = None
Jul 31 10:04:26 user nova-compute[71113]: node.conn[0].iscsi.DataDigest = None
Jul 31 10:04:26 user nova-compute[71113]: node.conn[0].iscsi.IFMarker = No
Jul 31 10:04:26 user nova-compute[71113]: node.conn[0].iscsi.OFMarker = No
Jul 31 10:04:26 user nova-compute[71113]: # END RECORD
Jul 31 10:04:26 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:04:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:04:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:04:26 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[33709c9e-722d-4db3-b709-0ae44af2aac1]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:04:26 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:04:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:04:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:04:26 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1befe28b-2213-4924-8a3b-a6e59114263b]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:04:26 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:04:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OCHGdVDP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:04:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OCHGdVDP" returned: 0 in 0.029s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:04:26 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[93521804-a413-4aa4-b01b-3e589fd24828]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:04:26 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OCHGdVDP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:04:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:04:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:04:26 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cca5237-1159-4932-bf04-456d490f1cc4]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:04:26 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:04:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:04:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:04:26 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[55520341-eb6f-43a4-8954-804cf1f27b25]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:04:26 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:04:26 user nova-compute[71113]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 (non-flash)
Jul 31 10:04:26 user nova-compute[71113]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)
Jul 31 10:04:26 user nova-compute[71113]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c (non-flash)
Jul 31 10:04:26 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:04:26 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:04:26 user nova-compute[71113]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 (non-flash)
Jul 31 10:04:26 user nova-compute[71113]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)
Jul 31 10:04:26 user nova-compute[71113]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c (non-flash)
Jul 31 10:04:26 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:04:26 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.168s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:04:26 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 10:04:26 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] HCTL ('37', '0', '0', 0) found on session 41 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 10:04:26 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 10:04:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:04:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.014s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:04:26 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d95b286-f6ca-4ddf-a8ba-6d3ef67cfe25]: (4, ('0 0 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:04:26 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Searching for a device in session 41 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 10:04:26 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OCHGdVDP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 10:04:26 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.194s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:04:26 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] <== connect_volume: return (195ms) {'type': 'block', 'scsi_wwn': '23065323163386162', 'path': '/dev/sdf'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:04:26 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065323163386162', 'path': '/dev/sdf'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 10:04:26 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:02:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1367258869',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1367258869',id=34,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T10:02:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88bbf2636f6248fcbe644af4eab0c823',ramdisk_id='',reservation_id='r-zhtgqe4c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1194948978',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T10:02:56Z,user_data=None,user_id='f4f505d5eddc4df48ec267f6f69a01f9',uuid=52f1f390-1599-4dda-9418-f12a48ef582c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6af975ec-2ae8-44fc-8762-90e9a13efbce", "address": "fa:16:3e:b2:53:f2", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "vif_mac": "fa:16:3e:b2:53:f2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af975ec-2a", "ovs_interfaceid": "6af975ec-2ae8-44fc-8762-90e9a13efbce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 10:04:26 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Converting VIF {"id": "6af975ec-2ae8-44fc-8762-90e9a13efbce", "address": "fa:16:3e:b2:53:f2", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "vif_mac": "fa:16:3e:b2:53:f2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af975ec-2a", "ovs_interfaceid": "6af975ec-2ae8-44fc-8762-90e9a13efbce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:04:26 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:53:f2,bridge_name='br-int',has_traffic_filtering=True,id=6af975ec-2ae8-44fc-8762-90e9a13efbce,network=Network(6f88bfaa-d58d-4ac2-b43d-0689d50456ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6af975ec-2a') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:04:26 user nova-compute[71113]: DEBUG nova.objects.instance [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lazy-loading 'pci_devices' on Instance uuid 52f1f390-1599-4dda-9418-f12a48ef582c {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:04:26 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] End _get_guest_xml xml=<domain type="kvm">
Jul 31 10:04:26 user nova-compute[71113]:   <uuid>52f1f390-1599-4dda-9418-f12a48ef582c</uuid>
Jul 31 10:04:26 user nova-compute[71113]:   <name>instance-00000022</name>
Jul 31 10:04:26 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 10:04:26 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 10:04:26 user nova-compute[71113]:   <metadata>
Jul 31 10:04:26 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 10:04:26 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 10:04:26 user nova-compute[71113]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1367258869</nova:name>
Jul 31 10:04:26 user nova-compute[71113]:       <nova:creationTime>2023-07-31 10:04:25</nova:creationTime>
Jul 31 10:04:26 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 10:04:26 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 10:04:26 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 10:04:26 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 10:04:26 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 10:04:26 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 10:04:26 user nova-compute[71113]:       </nova:flavor>
Jul 31 10:04:26 user nova-compute[71113]:       <nova:owner>
Jul 31 10:04:26 user nova-compute[71113]:         <nova:user uuid="f4f505d5eddc4df48ec267f6f69a01f9">tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member</nova:user>
Jul 31 10:04:26 user nova-compute[71113]:         <nova:project uuid="88bbf2636f6248fcbe644af4eab0c823">tempest-ServerBootFromVolumeStableRescueTest-1194948978</nova:project>
Jul 31 10:04:26 user nova-compute[71113]:       </nova:owner>
Jul 31 10:04:26 user nova-compute[71113]:       <nova:root type="image" uuid="078646fe-b504-41ed-a147-61072e903e51"/>
Jul 31 10:04:26 user nova-compute[71113]:       <nova:ports>
Jul 31 10:04:26 user nova-compute[71113]:         <nova:port uuid="6af975ec-2ae8-44fc-8762-90e9a13efbce">
Jul 31 10:04:26 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 31 10:04:26 user nova-compute[71113]:         </nova:port>
Jul 31 10:04:26 user nova-compute[71113]:       </nova:ports>
Jul 31 10:04:26 user nova-compute[71113]:     </nova:instance>
Jul 31 10:04:26 user nova-compute[71113]:   </metadata>
Jul 31 10:04:26 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 10:04:26 user nova-compute[71113]:     <system>
Jul 31 10:04:26 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 10:04:26 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 10:04:26 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 10:04:26 user nova-compute[71113]:       <entry name="serial">52f1f390-1599-4dda-9418-f12a48ef582c</entry>
Jul 31 10:04:26 user nova-compute[71113]:       <entry name="uuid">52f1f390-1599-4dda-9418-f12a48ef582c</entry>
Jul 31 10:04:26 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 10:04:26 user nova-compute[71113]:     </system>
Jul 31 10:04:26 user nova-compute[71113]:   </sysinfo>
Jul 31 10:04:26 user nova-compute[71113]:   <os>
Jul 31 10:04:26 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 10:04:26 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 10:04:26 user nova-compute[71113]:   </os>
Jul 31 10:04:26 user nova-compute[71113]:   <features>
Jul 31 10:04:26 user nova-compute[71113]:     <acpi/>
Jul 31 10:04:26 user nova-compute[71113]:     <apic/>
Jul 31 10:04:26 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 10:04:26 user nova-compute[71113]:   </features>
Jul 31 10:04:26 user nova-compute[71113]:   <clock offset="utc">
Jul 31 10:04:26 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 10:04:26 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 10:04:26 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 10:04:26 user nova-compute[71113]:   </clock>
Jul 31 10:04:26 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 10:04:26 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 10:04:26 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 10:04:26 user nova-compute[71113]:   </cpu>
Jul 31 10:04:26 user nova-compute[71113]:   <devices>
Jul 31 10:04:26 user nova-compute[71113]:     <disk type="block" device="disk">
Jul 31 10:04:26 user nova-compute[71113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:04:26 user nova-compute[71113]:       <source dev="/dev/sdf"/>
Jul 31 10:04:26 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 10:04:26 user nova-compute[71113]:       <serial>d4041c37-33ce-4873-b87c-b4f145dd6fe7</serial>
Jul 31 10:04:26 user nova-compute[71113]:     </disk>
Jul 31 10:04:26 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 10:04:26 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 10:04:26 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/52f1f390-1599-4dda-9418-f12a48ef582c/disk.rescue"/>
Jul 31 10:04:26 user nova-compute[71113]:       <target dev="vdb" bus="virtio"/>
Jul 31 10:04:26 user nova-compute[71113]:       <boot order="1"/>
Jul 31 10:04:26 user nova-compute[71113]:     </disk>
Jul 31 10:04:26 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 10:04:26 user nova-compute[71113]:       <mac address="fa:16:3e:b2:53:f2"/>
Jul 31 10:04:26 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:04:26 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 10:04:26 user nova-compute[71113]:       <target dev="tap6af975ec-2a"/>
Jul 31 10:04:26 user nova-compute[71113]:     </interface>
Jul 31 10:04:26 user nova-compute[71113]:     <serial type="pty">
Jul 31 10:04:26 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/52f1f390-1599-4dda-9418-f12a48ef582c/console.log" append="off"/>
Jul 31 10:04:26 user nova-compute[71113]:     </serial>
Jul 31 10:04:26 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 10:04:26 user nova-compute[71113]:     <video>
Jul 31 10:04:26 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:04:26 user nova-compute[71113]:     </video>
Jul 31 10:04:26 user nova-compute[71113]:     <rng model="virtio">
Jul 31 10:04:26 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 10:04:26 user nova-compute[71113]:     </rng>
Jul 31 10:04:26 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 10:04:26 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 10:04:26 user nova-compute[71113]:       <stats period="10"/>
Jul 31 10:04:26 user nova-compute[71113]:     </memballoon>
Jul 31 10:04:26 user nova-compute[71113]:   </devices>
Jul 31 10:04:26 user nova-compute[71113]: </domain>
Jul 31 10:04:26 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 10:04:26 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Instance destroyed successfully.
Jul 31 10:04:26 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:04:26 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:04:26 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] No VIF found with MAC fa:16:3e:b2:53:f2, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 10:04:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:04:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:04:27 user nova-compute[71113]: DEBUG nova.compute.manager [req-05257156-47cd-4759-971f-6e783d84fcc7 req-3a37ac1f-c6ea-453a-b7d8-602dca6d7753 service nova] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Received event network-vif-plugged-6af975ec-2ae8-44fc-8762-90e9a13efbce {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:04:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-05257156-47cd-4759-971f-6e783d84fcc7 req-3a37ac1f-c6ea-453a-b7d8-602dca6d7753 service nova] Acquiring lock "52f1f390-1599-4dda-9418-f12a48ef582c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:04:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-05257156-47cd-4759-971f-6e783d84fcc7 req-3a37ac1f-c6ea-453a-b7d8-602dca6d7753 service nova] Lock "52f1f390-1599-4dda-9418-f12a48ef582c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:04:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-05257156-47cd-4759-971f-6e783d84fcc7 req-3a37ac1f-c6ea-453a-b7d8-602dca6d7753 service nova] Lock "52f1f390-1599-4dda-9418-f12a48ef582c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:04:27 user nova-compute[71113]: DEBUG nova.compute.manager [req-05257156-47cd-4759-971f-6e783d84fcc7 req-3a37ac1f-c6ea-453a-b7d8-602dca6d7753 service nova] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] No waiting events found dispatching network-vif-plugged-6af975ec-2ae8-44fc-8762-90e9a13efbce {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:04:27 user nova-compute[71113]: WARNING nova.compute.manager [req-05257156-47cd-4759-971f-6e783d84fcc7 req-3a37ac1f-c6ea-453a-b7d8-602dca6d7753 service nova] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Received unexpected event network-vif-plugged-6af975ec-2ae8-44fc-8762-90e9a13efbce for instance with vm_state active and task_state rescuing.
Jul 31 10:04:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:04:28 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690797853.9875734, c4b88201-04dc-4da9-b213-c50cdf274f4e => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:04:28 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] VM Stopped (Lifecycle Event)
Jul 31 10:04:29 user nova-compute[71113]: DEBUG nova.compute.manager [None req-e78e8b09-a5a0-486f-b65f-85da7e18697a None None] [instance: c4b88201-04dc-4da9-b213-c50cdf274f4e] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:04:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:04:29 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Removed pending event for 52f1f390-1599-4dda-9418-f12a48ef582c due to event {{(pid=71113) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 31 10:04:29 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797869.8862069, 52f1f390-1599-4dda-9418-f12a48ef582c => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:04:29 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] VM Resumed (Lifecycle Event)
Jul 31 10:04:29 user nova-compute[71113]: DEBUG nova.compute.manager [None req-4b9c5330-f473-4502-b1f9-64674c65c1ea tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:04:29 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:04:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:04:30 user nova-compute[71113]: DEBUG nova.compute.manager [req-53d3ad05-6e47-4c18-9011-182eb214ea5b req-12be4158-9ed8-4dde-86f5-58b9df529b16 service nova] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Received event network-vif-plugged-6af975ec-2ae8-44fc-8762-90e9a13efbce {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:04:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-53d3ad05-6e47-4c18-9011-182eb214ea5b req-12be4158-9ed8-4dde-86f5-58b9df529b16 service nova] Acquiring lock "52f1f390-1599-4dda-9418-f12a48ef582c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:04:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-53d3ad05-6e47-4c18-9011-182eb214ea5b req-12be4158-9ed8-4dde-86f5-58b9df529b16 service nova] Lock "52f1f390-1599-4dda-9418-f12a48ef582c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:04:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-53d3ad05-6e47-4c18-9011-182eb214ea5b req-12be4158-9ed8-4dde-86f5-58b9df529b16 service nova] Lock "52f1f390-1599-4dda-9418-f12a48ef582c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:04:30 user nova-compute[71113]: DEBUG nova.compute.manager [req-53d3ad05-6e47-4c18-9011-182eb214ea5b req-12be4158-9ed8-4dde-86f5-58b9df529b16 service nova] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] No waiting events found dispatching network-vif-plugged-6af975ec-2ae8-44fc-8762-90e9a13efbce {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:04:30 user nova-compute[71113]: WARNING nova.compute.manager [req-53d3ad05-6e47-4c18-9011-182eb214ea5b req-12be4158-9ed8-4dde-86f5-58b9df529b16 service nova] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Received unexpected event network-vif-plugged-6af975ec-2ae8-44fc-8762-90e9a13efbce for instance with vm_state active and task_state rescuing.
Jul 31 10:04:30 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:04:30 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797869.8890898, 52f1f390-1599-4dda-9418-f12a48ef582c => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:04:30 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] VM Started (Lifecycle Event)
Jul 31 10:04:30 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:04:30 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:04:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:04:38 user nova-compute[71113]: DEBUG nova.compute.manager [req-1b55cab6-fee5-4de2-9ae9-ad78c2c27ff6 req-935f41bc-473c-4a36-90b0-1ae87613ffc5 service nova] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Received event network-changed-d36845e4-c20a-43b4-803b-529a8823d170 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:04:38 user nova-compute[71113]: DEBUG nova.compute.manager [req-1b55cab6-fee5-4de2-9ae9-ad78c2c27ff6 req-935f41bc-473c-4a36-90b0-1ae87613ffc5 service nova] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Refreshing instance network info cache due to event network-changed-d36845e4-c20a-43b4-803b-529a8823d170. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 10:04:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1b55cab6-fee5-4de2-9ae9-ad78c2c27ff6 req-935f41bc-473c-4a36-90b0-1ae87613ffc5 service nova] Acquiring lock "refresh_cache-b751cc3f-b5b1-438b-b251-c589774c2bcf" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:04:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1b55cab6-fee5-4de2-9ae9-ad78c2c27ff6 req-935f41bc-473c-4a36-90b0-1ae87613ffc5 service nova] Acquired lock "refresh_cache-b751cc3f-b5b1-438b-b251-c589774c2bcf" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:04:38 user nova-compute[71113]: DEBUG nova.network.neutron [req-1b55cab6-fee5-4de2-9ae9-ad78c2c27ff6 req-935f41bc-473c-4a36-90b0-1ae87613ffc5 service nova] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Refreshing network info cache for port d36845e4-c20a-43b4-803b-529a8823d170 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 10:04:39 user nova-compute[71113]: DEBUG nova.network.neutron [req-1b55cab6-fee5-4de2-9ae9-ad78c2c27ff6 req-935f41bc-473c-4a36-90b0-1ae87613ffc5 service nova] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Updated VIF entry in instance network info cache for port d36845e4-c20a-43b4-803b-529a8823d170. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 10:04:39 user nova-compute[71113]: DEBUG nova.network.neutron [req-1b55cab6-fee5-4de2-9ae9-ad78c2c27ff6 req-935f41bc-473c-4a36-90b0-1ae87613ffc5 service nova] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Updating instance_info_cache with network_info: [{"id": "d36845e4-c20a-43b4-803b-529a8823d170", "address": "fa:16:3e:18:05:a4", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd36845e4-c2", "ovs_interfaceid": "d36845e4-c20a-43b4-803b-529a8823d170", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:04:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1b55cab6-fee5-4de2-9ae9-ad78c2c27ff6 req-935f41bc-473c-4a36-90b0-1ae87613ffc5 service nova] Releasing lock "refresh_cache-b751cc3f-b5b1-438b-b251-c589774c2bcf" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:04:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-214064b1-dfe0-4e03-ba6a-60ea9f608aef tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "b751cc3f-b5b1-438b-b251-c589774c2bcf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:04:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-214064b1-dfe0-4e03-ba6a-60ea9f608aef tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "b751cc3f-b5b1-438b-b251-c589774c2bcf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:04:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-214064b1-dfe0-4e03-ba6a-60ea9f608aef tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "b751cc3f-b5b1-438b-b251-c589774c2bcf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:04:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-214064b1-dfe0-4e03-ba6a-60ea9f608aef tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "b751cc3f-b5b1-438b-b251-c589774c2bcf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:04:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-214064b1-dfe0-4e03-ba6a-60ea9f608aef tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "b751cc3f-b5b1-438b-b251-c589774c2bcf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:04:39 user nova-compute[71113]: INFO nova.compute.manager [None req-214064b1-dfe0-4e03-ba6a-60ea9f608aef tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Terminating instance
Jul 31 10:04:39 user nova-compute[71113]: DEBUG nova.compute.manager [None req-214064b1-dfe0-4e03-ba6a-60ea9f608aef tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Start destroying the instance on the hypervisor. {{(pid=71113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 10:04:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:04:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:04:39 user nova-compute[71113]: DEBUG nova.compute.manager [req-266082f7-5e9f-48f5-97bd-8e3e841bb7c4 req-60a96962-23f2-4d99-ae14-c217e1068d3a service nova] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Received event network-vif-unplugged-d36845e4-c20a-43b4-803b-529a8823d170 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:04:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-266082f7-5e9f-48f5-97bd-8e3e841bb7c4 req-60a96962-23f2-4d99-ae14-c217e1068d3a service nova] Acquiring lock "b751cc3f-b5b1-438b-b251-c589774c2bcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:04:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-266082f7-5e9f-48f5-97bd-8e3e841bb7c4 req-60a96962-23f2-4d99-ae14-c217e1068d3a service nova] Lock "b751cc3f-b5b1-438b-b251-c589774c2bcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:04:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-266082f7-5e9f-48f5-97bd-8e3e841bb7c4 req-60a96962-23f2-4d99-ae14-c217e1068d3a service nova] Lock "b751cc3f-b5b1-438b-b251-c589774c2bcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:04:39 user nova-compute[71113]: DEBUG nova.compute.manager [req-266082f7-5e9f-48f5-97bd-8e3e841bb7c4 req-60a96962-23f2-4d99-ae14-c217e1068d3a service nova] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] No waiting events found dispatching network-vif-unplugged-d36845e4-c20a-43b4-803b-529a8823d170 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:04:39 user nova-compute[71113]: DEBUG nova.compute.manager [req-266082f7-5e9f-48f5-97bd-8e3e841bb7c4 req-60a96962-23f2-4d99-ae14-c217e1068d3a service nova] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Received event network-vif-unplugged-d36845e4-c20a-43b4-803b-529a8823d170 for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 10:04:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:04:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:04:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:04:40 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Instance destroyed successfully.
Jul 31 10:04:40 user nova-compute[71113]: DEBUG nova.objects.instance [None req-214064b1-dfe0-4e03-ba6a-60ea9f608aef tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lazy-loading 'resources' on Instance uuid b751cc3f-b5b1-438b-b251-c589774c2bcf {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-214064b1-dfe0-4e03-ba6a-60ea9f608aef tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:02:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1943543533',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1943543533',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1943543533',id=35,image_ref='ca65a28b-1891-4dc6-acb5-601505c22b15',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB2eqPqjpfda73MYODnqXl+e1YE2deD1IwnXje4zqwMYGpvHz0HR4sU3EoQUGDqnWCTGb60YLXWhIxm4LlP/L0vWRvQUYk7EiBfmrNQbkELoIEQ1Kfb3mHe0tPwceNgEsg==',key_name='tempest-keypair-1719870748',keypairs=<?>,launch_index=0,launched_at=2023-07-31T10:03:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3aa2add2e2a24b9cb8e48042b06931d3',ramdisk_id='',reservation_id='r-ljiv5quq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1754399827',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1754399827-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1754399827',owner_user_name='tempest-TestVolumeBootPattern-1754399827-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T10:03:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a58fe92488ed47b696fc5d6d990b1acd',uuid=b751cc3f-b5b1-438b-b251-c589774c2bcf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d36845e4-c20a-43b4-803b-529a8823d170", "address": "fa:16:3e:18:05:a4", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd36845e4-c2", "ovs_interfaceid": "d36845e4-c20a-43b4-803b-529a8823d170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-214064b1-dfe0-4e03-ba6a-60ea9f608aef tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Converting VIF {"id": "d36845e4-c20a-43b4-803b-529a8823d170", "address": "fa:16:3e:18:05:a4", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd36845e4-c2", "ovs_interfaceid": "d36845e4-c20a-43b4-803b-529a8823d170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-214064b1-dfe0-4e03-ba6a-60ea9f608aef tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:05:a4,bridge_name='br-int',has_traffic_filtering=True,id=d36845e4-c20a-43b4-803b-529a8823d170,network=Network(fa792d7a-ddf6-4a2d-acb9-802f8daf87ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd36845e4-c2') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG os_vif [None req-214064b1-dfe0-4e03-ba6a-60ea9f608aef tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:05:a4,bridge_name='br-int',has_traffic_filtering=True,id=d36845e4-c20a-43b4-803b-529a8823d170,network=Network(fa792d7a-ddf6-4a2d-acb9-802f8daf87ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd36845e4-c2') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd36845e4-c2, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:04:40 user nova-compute[71113]: INFO os_vif [None req-214064b1-dfe0-4e03-ba6a-60ea9f608aef tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:05:a4,bridge_name='br-int',has_traffic_filtering=True,id=d36845e4-c20a-43b4-803b-529a8823d170,network=Network(fa792d7a-ddf6-4a2d-acb9-802f8daf87ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd36845e4-c2')
Jul 31 10:04:40 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-214064b1-dfe0-4e03-ba6a-60ea9f608aef tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-214064b1-dfe0-4e03-ba6a-60ea9f608aef tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mFpgjPzA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:04:40 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-214064b1-dfe0-4e03-ba6a-60ea9f608aef tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:04:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-214064b1-dfe0-4e03-ba6a-60ea9f608aef tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-214064b1-dfe0-4e03-ba6a-60ea9f608aef tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-214064b1-dfe0-4e03-ba6a-60ea9f608aef tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[58014efd-48f5-49b6-9a4c-00f936fbb7d2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b75bdd2-0642-4423-9809-449b46802c93]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-214064b1-dfe0-4e03-ba6a-60ea9f608aef tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:04:40 user nova-compute[71113]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 (non-flash)
Jul 31 10:04:40 user nova-compute[71113]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)
Jul 31 10:04:40 user nova-compute[71113]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c (non-flash)
Jul 31 10:04:40 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-214064b1-dfe0-4e03-ba6a-60ea9f608aef tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:04:40 user nova-compute[71113]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 (non-flash)
Jul 31 10:04:40 user nova-compute[71113]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)
Jul 31 10:04:40 user nova-compute[71113]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c (non-flash)
Jul 31 10:04:40 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-214064b1-dfe0-4e03-ba6a-60ea9f608aef tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f78f05ac550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c'): ({'sdg'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-214064b1-dfe0-4e03-ba6a-60ea9f608aef tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Removing single pathed devices sdg {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc519bd-e8ee-4aa4-9214-be170569760b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13c0158-a1af-4fb1-a505-370ea05b82d8]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-214064b1-dfe0-4e03-ba6a-60ea9f608aef tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Flushing IO for device /dev/sdg {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af116e0-096a-46f6-8675-6badb0fd5101]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-214064b1-dfe0-4e03-ba6a-60ea9f608aef tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.034s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e606bdaf-dec1-407a-bb8b-6d947989b273]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-214064b1-dfe0-4e03-ba6a-60ea9f608aef tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-214064b1-dfe0-4e03-ba6a-60ea9f608aef tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] SCSI volumes sdg have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_fd2f7fc5', '/dev/disk/by-id/scsi-26638353164366231', '/dev/disk/by-id/scsi-1SCST_BIOfd2f7fc5-f851d6b1d6a9d61e') {{(pid=81983) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[22369f60-c004-4325-b7e0-e4a0cf52086e]: (4, None) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-214064b1-dfe0-4e03-ba6a-60ea9f608aef tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d3128e-286a-486e-a6d7-0e42d5b23e52]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-214064b1-dfe0-4e03-ba6a-60ea9f608aef tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e7ed56-3bec-4870-acf0-55d9c7f06403]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-214064b1-dfe0-4e03-ba6a-60ea9f608aef tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c, portal: 172.16.0.220,3260]
Jul 31 10:04:40 user nova-compute[71113]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c, portal: 172.16.0.220,3260] successful.
Jul 31 10:04:40 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:186010c9-30be-4722-bb2e-0f48c4b0bc8c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d06a98-1418-4388-a416-5b3b944e2153]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-214064b1-dfe0-4e03-ba6a-60ea9f608aef tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-214064b1-dfe0-4e03-ba6a-60ea9f608aef tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-214064b1-dfe0-4e03-ba6a-60ea9f608aef tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] <== disconnect_volume: return (347ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-214064b1-dfe0-4e03-ba6a-60ea9f608aef tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 10:04:40 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-214064b1-dfe0-4e03-ba6a-60ea9f608aef tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Deleting instance files /opt/stack/data/nova/instances/b751cc3f-b5b1-438b-b251-c589774c2bcf_del
Jul 31 10:04:40 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-214064b1-dfe0-4e03-ba6a-60ea9f608aef tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Deletion of /opt/stack/data/nova/instances/b751cc3f-b5b1-438b-b251-c589774c2bcf_del complete
Jul 31 10:04:40 user nova-compute[71113]: INFO nova.compute.manager [None req-214064b1-dfe0-4e03-ba6a-60ea9f608aef tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Took 1.23 seconds to destroy the instance on the hypervisor.
Jul 31 10:04:40 user nova-compute[71113]: DEBUG oslo.service.loopingcall [None req-214064b1-dfe0-4e03-ba6a-60ea9f608aef tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71113) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG nova.compute.manager [-] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Deallocating network for instance {{(pid=71113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] deallocate_for_instance() {{(pid=71113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:04:40 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:04:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:04:41 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:04:41 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Took 0.98 seconds to deallocate network for instance.
Jul 31 10:04:41 user nova-compute[71113]: DEBUG nova.compute.manager [req-5e3524f2-b874-497d-ab25-886196d6b0b1 req-d3b2f946-af00-4e18-9f21-8c8a59f911d6 service nova] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Received event network-vif-deleted-d36845e4-c20a-43b4-803b-529a8823d170 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:04:41 user nova-compute[71113]: INFO nova.compute.manager [req-5e3524f2-b874-497d-ab25-886196d6b0b1 req-d3b2f946-af00-4e18-9f21-8c8a59f911d6 service nova] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Neutron deleted interface d36845e4-c20a-43b4-803b-529a8823d170; detaching it from the instance and deleting it from the info cache
Jul 31 10:04:41 user nova-compute[71113]: DEBUG nova.network.neutron [req-5e3524f2-b874-497d-ab25-886196d6b0b1 req-d3b2f946-af00-4e18-9f21-8c8a59f911d6 service nova] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:04:41 user nova-compute[71113]: DEBUG nova.compute.manager [req-5e3524f2-b874-497d-ab25-886196d6b0b1 req-d3b2f946-af00-4e18-9f21-8c8a59f911d6 service nova] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Detach interface failed, port_id=d36845e4-c20a-43b4-803b-529a8823d170, reason: Instance b751cc3f-b5b1-438b-b251-c589774c2bcf could not be found. {{(pid=71113) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 10:04:41 user nova-compute[71113]: DEBUG nova.compute.manager [req-ff1bb879-c834-45fe-ba2c-bcea41b68c9a req-7d83c8d6-7f4e-4b25-b960-bc6fa1ae3d97 service nova] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Received event network-vif-plugged-d36845e4-c20a-43b4-803b-529a8823d170 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:04:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ff1bb879-c834-45fe-ba2c-bcea41b68c9a req-7d83c8d6-7f4e-4b25-b960-bc6fa1ae3d97 service nova] Acquiring lock "b751cc3f-b5b1-438b-b251-c589774c2bcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:04:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ff1bb879-c834-45fe-ba2c-bcea41b68c9a req-7d83c8d6-7f4e-4b25-b960-bc6fa1ae3d97 service nova] Lock "b751cc3f-b5b1-438b-b251-c589774c2bcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:04:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ff1bb879-c834-45fe-ba2c-bcea41b68c9a req-7d83c8d6-7f4e-4b25-b960-bc6fa1ae3d97 service nova] Lock "b751cc3f-b5b1-438b-b251-c589774c2bcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:04:41 user nova-compute[71113]: DEBUG nova.compute.manager [req-ff1bb879-c834-45fe-ba2c-bcea41b68c9a req-7d83c8d6-7f4e-4b25-b960-bc6fa1ae3d97 service nova] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] No waiting events found dispatching network-vif-plugged-d36845e4-c20a-43b4-803b-529a8823d170 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:04:41 user nova-compute[71113]: WARNING nova.compute.manager [req-ff1bb879-c834-45fe-ba2c-bcea41b68c9a req-7d83c8d6-7f4e-4b25-b960-bc6fa1ae3d97 service nova] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Received unexpected event network-vif-plugged-d36845e4-c20a-43b4-803b-529a8823d170 for instance with vm_state active and task_state deleting.
Jul 31 10:04:41 user nova-compute[71113]: DEBUG nova.compute.manager [req-ff1bb879-c834-45fe-ba2c-bcea41b68c9a req-7d83c8d6-7f4e-4b25-b960-bc6fa1ae3d97 service nova] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Received event network-vif-plugged-d36845e4-c20a-43b4-803b-529a8823d170 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:04:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ff1bb879-c834-45fe-ba2c-bcea41b68c9a req-7d83c8d6-7f4e-4b25-b960-bc6fa1ae3d97 service nova] Acquiring lock "b751cc3f-b5b1-438b-b251-c589774c2bcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:04:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ff1bb879-c834-45fe-ba2c-bcea41b68c9a req-7d83c8d6-7f4e-4b25-b960-bc6fa1ae3d97 service nova] Lock "b751cc3f-b5b1-438b-b251-c589774c2bcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:04:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ff1bb879-c834-45fe-ba2c-bcea41b68c9a req-7d83c8d6-7f4e-4b25-b960-bc6fa1ae3d97 service nova] Lock "b751cc3f-b5b1-438b-b251-c589774c2bcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:04:41 user nova-compute[71113]: DEBUG nova.compute.manager [req-ff1bb879-c834-45fe-ba2c-bcea41b68c9a req-7d83c8d6-7f4e-4b25-b960-bc6fa1ae3d97 service nova] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] No waiting events found dispatching network-vif-plugged-d36845e4-c20a-43b4-803b-529a8823d170 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:04:41 user nova-compute[71113]: WARNING nova.compute.manager [req-ff1bb879-c834-45fe-ba2c-bcea41b68c9a req-7d83c8d6-7f4e-4b25-b960-bc6fa1ae3d97 service nova] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Received unexpected event network-vif-plugged-d36845e4-c20a-43b4-803b-529a8823d170 for instance with vm_state active and task_state deleting.
Jul 31 10:04:41 user nova-compute[71113]: DEBUG nova.compute.manager [req-ff1bb879-c834-45fe-ba2c-bcea41b68c9a req-7d83c8d6-7f4e-4b25-b960-bc6fa1ae3d97 service nova] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Received event network-vif-plugged-d36845e4-c20a-43b4-803b-529a8823d170 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:04:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ff1bb879-c834-45fe-ba2c-bcea41b68c9a req-7d83c8d6-7f4e-4b25-b960-bc6fa1ae3d97 service nova] Acquiring lock "b751cc3f-b5b1-438b-b251-c589774c2bcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:04:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ff1bb879-c834-45fe-ba2c-bcea41b68c9a req-7d83c8d6-7f4e-4b25-b960-bc6fa1ae3d97 service nova] Lock "b751cc3f-b5b1-438b-b251-c589774c2bcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:04:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ff1bb879-c834-45fe-ba2c-bcea41b68c9a req-7d83c8d6-7f4e-4b25-b960-bc6fa1ae3d97 service nova] Lock "b751cc3f-b5b1-438b-b251-c589774c2bcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:04:41 user nova-compute[71113]: DEBUG nova.compute.manager [req-ff1bb879-c834-45fe-ba2c-bcea41b68c9a req-7d83c8d6-7f4e-4b25-b960-bc6fa1ae3d97 service nova] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] No waiting events found dispatching network-vif-plugged-d36845e4-c20a-43b4-803b-529a8823d170 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:04:41 user nova-compute[71113]: WARNING nova.compute.manager [req-ff1bb879-c834-45fe-ba2c-bcea41b68c9a req-7d83c8d6-7f4e-4b25-b960-bc6fa1ae3d97 service nova] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Received unexpected event network-vif-plugged-d36845e4-c20a-43b4-803b-529a8823d170 for instance with vm_state active and task_state deleting.
Jul 31 10:04:41 user nova-compute[71113]: DEBUG nova.compute.manager [req-ff1bb879-c834-45fe-ba2c-bcea41b68c9a req-7d83c8d6-7f4e-4b25-b960-bc6fa1ae3d97 service nova] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Received event network-vif-unplugged-d36845e4-c20a-43b4-803b-529a8823d170 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:04:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ff1bb879-c834-45fe-ba2c-bcea41b68c9a req-7d83c8d6-7f4e-4b25-b960-bc6fa1ae3d97 service nova] Acquiring lock "b751cc3f-b5b1-438b-b251-c589774c2bcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:04:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ff1bb879-c834-45fe-ba2c-bcea41b68c9a req-7d83c8d6-7f4e-4b25-b960-bc6fa1ae3d97 service nova] Lock "b751cc3f-b5b1-438b-b251-c589774c2bcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:04:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ff1bb879-c834-45fe-ba2c-bcea41b68c9a req-7d83c8d6-7f4e-4b25-b960-bc6fa1ae3d97 service nova] Lock "b751cc3f-b5b1-438b-b251-c589774c2bcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:04:41 user nova-compute[71113]: DEBUG nova.compute.manager [req-ff1bb879-c834-45fe-ba2c-bcea41b68c9a req-7d83c8d6-7f4e-4b25-b960-bc6fa1ae3d97 service nova] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] No waiting events found dispatching network-vif-unplugged-d36845e4-c20a-43b4-803b-529a8823d170 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:04:41 user nova-compute[71113]: DEBUG nova.compute.manager [req-ff1bb879-c834-45fe-ba2c-bcea41b68c9a req-7d83c8d6-7f4e-4b25-b960-bc6fa1ae3d97 service nova] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Received event network-vif-unplugged-d36845e4-c20a-43b4-803b-529a8823d170 for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 10:04:41 user nova-compute[71113]: DEBUG nova.compute.manager [req-ff1bb879-c834-45fe-ba2c-bcea41b68c9a req-7d83c8d6-7f4e-4b25-b960-bc6fa1ae3d97 service nova] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Received event network-vif-plugged-d36845e4-c20a-43b4-803b-529a8823d170 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:04:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ff1bb879-c834-45fe-ba2c-bcea41b68c9a req-7d83c8d6-7f4e-4b25-b960-bc6fa1ae3d97 service nova] Acquiring lock "b751cc3f-b5b1-438b-b251-c589774c2bcf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:04:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ff1bb879-c834-45fe-ba2c-bcea41b68c9a req-7d83c8d6-7f4e-4b25-b960-bc6fa1ae3d97 service nova] Lock "b751cc3f-b5b1-438b-b251-c589774c2bcf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:04:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ff1bb879-c834-45fe-ba2c-bcea41b68c9a req-7d83c8d6-7f4e-4b25-b960-bc6fa1ae3d97 service nova] Lock "b751cc3f-b5b1-438b-b251-c589774c2bcf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:04:41 user nova-compute[71113]: DEBUG nova.compute.manager [req-ff1bb879-c834-45fe-ba2c-bcea41b68c9a req-7d83c8d6-7f4e-4b25-b960-bc6fa1ae3d97 service nova] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] No waiting events found dispatching network-vif-plugged-d36845e4-c20a-43b4-803b-529a8823d170 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:04:41 user nova-compute[71113]: WARNING nova.compute.manager [req-ff1bb879-c834-45fe-ba2c-bcea41b68c9a req-7d83c8d6-7f4e-4b25-b960-bc6fa1ae3d97 service nova] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Received unexpected event network-vif-plugged-d36845e4-c20a-43b4-803b-529a8823d170 for instance with vm_state active and task_state deleting.
Jul 31 10:04:42 user nova-compute[71113]: INFO nova.compute.manager [None req-214064b1-dfe0-4e03-ba6a-60ea9f608aef tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Took 0.83 seconds to detach 1 volumes for instance.
Jul 31 10:04:42 user nova-compute[71113]: DEBUG nova.compute.manager [None req-214064b1-dfe0-4e03-ba6a-60ea9f608aef tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Deleting volume: 186010c9-30be-4722-bb2e-0f48c4b0bc8c {{(pid=71113) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 31 10:04:42 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-214064b1-dfe0-4e03-ba6a-60ea9f608aef tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:04:42 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-214064b1-dfe0-4e03-ba6a-60ea9f608aef tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:04:42 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-214064b1-dfe0-4e03-ba6a-60ea9f608aef tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:04:42 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-214064b1-dfe0-4e03-ba6a-60ea9f608aef tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:04:42 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-214064b1-dfe0-4e03-ba6a-60ea9f608aef tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.257s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:04:42 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-214064b1-dfe0-4e03-ba6a-60ea9f608aef tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Deleted allocations for instance b751cc3f-b5b1-438b-b251-c589774c2bcf
Jul 31 10:04:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-214064b1-dfe0-4e03-ba6a-60ea9f608aef tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "b751cc3f-b5b1-438b-b251-c589774c2bcf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.567s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:04:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:04:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:04:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:04:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:04:55 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690797880.242795, b751cc3f-b5b1-438b-b251-c589774c2bcf => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:04:55 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] VM Stopped (Lifecycle Event)
Jul 31 10:04:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:04:55 user nova-compute[71113]: DEBUG nova.compute.manager [None req-7958a7f7-d1a5-464a-9bf2-ec77c0238452 None None] [instance: b751cc3f-b5b1-438b-b251-c589774c2bcf] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:04:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:05:00 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:05:00 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:05:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:05:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:05:07 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:05:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:05:11 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:05:12 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:05:13 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:05:13 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:05:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:05:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:05:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:05:13 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:05:13 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 10:05:13 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 10:05:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f020f166-07b6-4cf5-9f17-2ab108b55c30/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:05:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f020f166-07b6-4cf5-9f17-2ab108b55c30/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:05:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f020f166-07b6-4cf5-9f17-2ab108b55c30/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:05:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f020f166-07b6-4cf5-9f17-2ab108b55c30/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:05:14 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 10:05:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52f1f390-1599-4dda-9418-f12a48ef582c/disk.rescue --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:05:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52f1f390-1599-4dda-9418-f12a48ef582c/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:05:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52f1f390-1599-4dda-9418-f12a48ef582c/disk.rescue --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:05:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52f1f390-1599-4dda-9418-f12a48ef582c/disk.rescue --force-share --output=json" returned: 0 in 0.153s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:05:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:05:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:05:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:05:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:05:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:05:15 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:05:15 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:05:15 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:05:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:05:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:05:15 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:05:15 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:05:15 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=8163MB free_disk=25.166519165039062GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:05:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:05:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:05:15 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 3157a7a6-b8a9-4e2d-a157-360bce4c625d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:05:15 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 92d25a03-98ce-4bde-a3cc-20313ae77d41 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:05:15 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance f020f166-07b6-4cf5-9f17-2ab108b55c30 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:05:15 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance fc41eb59-d988-461c-941e-551ceb174ba1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:05:15 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 52f1f390-1599-4dda-9418-f12a48ef582c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:05:15 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 95a84d3c-7aa2-4294-a419-995926a2782f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:05:15 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:05:15 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:05:15 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:05:15 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:05:16 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:05:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.367s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:05:18 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:05:18 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:05:18 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:05:18 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:05:18 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:05:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquiring lock "2c7bd88d-2991-4660-928e-298c0a0b2e18" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:05:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "2c7bd88d-2991-4660-928e-298c0a0b2e18" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:05:18 user nova-compute[71113]: DEBUG nova.compute.manager [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Starting instance... {{(pid=71113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 10:05:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:05:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:05:18 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 10:05:18 user nova-compute[71113]: INFO nova.compute.claims [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Claim successful on node user
Jul 31 10:05:18 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:05:18 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:05:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.383s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:05:18 user nova-compute[71113]: DEBUG nova.compute.manager [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Start building networks asynchronously for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 10:05:19 user nova-compute[71113]: DEBUG nova.compute.manager [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Allocating IP information in the background. {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 10:05:19 user nova-compute[71113]: DEBUG nova.network.neutron [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] allocate_for_instance() {{(pid=71113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 10:05:19 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 10:05:19 user nova-compute[71113]: DEBUG nova.compute.manager [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Start building block device mappings for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 10:05:19 user nova-compute[71113]: DEBUG nova.policy [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd9883a5677fb4852ae031137736a9ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7000d6a2a6b147ddbc38208b316574cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71113) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 10:05:19 user nova-compute[71113]: DEBUG nova.compute.manager [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Start spawning the instance on the hypervisor. {{(pid=71113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 10:05:19 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 10:05:19 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Creating image(s)
Jul 31 10:05:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquiring lock "/opt/stack/data/nova/instances/2c7bd88d-2991-4660-928e-298c0a0b2e18/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:05:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "/opt/stack/data/nova/instances/2c7bd88d-2991-4660-928e-298c0a0b2e18/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:05:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "/opt/stack/data/nova/instances/2c7bd88d-2991-4660-928e-298c0a0b2e18/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:05:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:05:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.142s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:05:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquiring lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:05:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:05:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:05:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.145s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:05:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/2c7bd88d-2991-4660-928e-298c0a0b2e18/disk 1073741824 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:05:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/2c7bd88d-2991-4660-928e-298c0a0b2e18/disk 1073741824" returned: 0 in 0.059s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:05:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:05:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:05:19 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:05:19 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:05:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.156s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:05:19 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2c7bd88d-2991-4660-928e-298c0a0b2e18/disk. size=1073741824 {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 10:05:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c7bd88d-2991-4660-928e-298c0a0b2e18/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:05:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "refresh_cache-92d25a03-98ce-4bde-a3cc-20313ae77d41" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:05:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquired lock "refresh_cache-92d25a03-98ce-4bde-a3cc-20313ae77d41" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:05:19 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Forcefully refreshing network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 10:05:19 user nova-compute[71113]: DEBUG nova.network.neutron [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Successfully created port: 3a203223-ccaa-4246-960c-686b0f431f07 {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 10:05:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c7bd88d-2991-4660-928e-298c0a0b2e18/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:05:19 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Cannot resize image /opt/stack/data/nova/instances/2c7bd88d-2991-4660-928e-298c0a0b2e18/disk to a smaller size. {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 10:05:19 user nova-compute[71113]: DEBUG nova.objects.instance [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lazy-loading 'migration_context' on Instance uuid 2c7bd88d-2991-4660-928e-298c0a0b2e18 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:05:19 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Created local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 10:05:19 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Ensure instance console log exists: /opt/stack/data/nova/instances/2c7bd88d-2991-4660-928e-298c0a0b2e18/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 10:05:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:05:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:05:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:05:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:05:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:05:20 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Updating instance_info_cache with network_info: [{"id": "e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d", "address": "fa:16:3e:2c:5b:c3", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape82fc7e2-25", "ovs_interfaceid": "e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:05:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Releasing lock "refresh_cache-92d25a03-98ce-4bde-a3cc-20313ae77d41" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:05:20 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Updated the network info_cache for instance {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 10:05:20 user nova-compute[71113]: DEBUG nova.network.neutron [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Successfully updated port: 3a203223-ccaa-4246-960c-686b0f431f07 {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 10:05:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquiring lock "refresh_cache-2c7bd88d-2991-4660-928e-298c0a0b2e18" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:05:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquired lock "refresh_cache-2c7bd88d-2991-4660-928e-298c0a0b2e18" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:05:20 user nova-compute[71113]: DEBUG nova.network.neutron [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 10:05:20 user nova-compute[71113]: DEBUG nova.compute.manager [req-5baf80fe-35f4-4509-87fe-1f925266d3f4 req-bc63ae46-58c7-4d21-b275-148a3263c246 service nova] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Received event network-changed-3a203223-ccaa-4246-960c-686b0f431f07 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:05:20 user nova-compute[71113]: DEBUG nova.compute.manager [req-5baf80fe-35f4-4509-87fe-1f925266d3f4 req-bc63ae46-58c7-4d21-b275-148a3263c246 service nova] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Refreshing instance network info cache due to event network-changed-3a203223-ccaa-4246-960c-686b0f431f07. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 10:05:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-5baf80fe-35f4-4509-87fe-1f925266d3f4 req-bc63ae46-58c7-4d21-b275-148a3263c246 service nova] Acquiring lock "refresh_cache-2c7bd88d-2991-4660-928e-298c0a0b2e18" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:05:20 user nova-compute[71113]: DEBUG nova.network.neutron [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 10:05:21 user nova-compute[71113]: DEBUG nova.network.neutron [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Updating instance_info_cache with network_info: [{"id": "3a203223-ccaa-4246-960c-686b0f431f07", "address": "fa:16:3e:a1:ae:09", "network": {"id": "4b030626-e3f1-4617-89c2-f6389226652f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441335951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7000d6a2a6b147ddbc38208b316574cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a203223-cc", "ovs_interfaceid": "3a203223-ccaa-4246-960c-686b0f431f07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:05:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Releasing lock "refresh_cache-2c7bd88d-2991-4660-928e-298c0a0b2e18" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:05:21 user nova-compute[71113]: DEBUG nova.compute.manager [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Instance network_info: |[{"id": "3a203223-ccaa-4246-960c-686b0f431f07", "address": "fa:16:3e:a1:ae:09", "network": {"id": "4b030626-e3f1-4617-89c2-f6389226652f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441335951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7000d6a2a6b147ddbc38208b316574cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a203223-cc", "ovs_interfaceid": "3a203223-ccaa-4246-960c-686b0f431f07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 10:05:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-5baf80fe-35f4-4509-87fe-1f925266d3f4 req-bc63ae46-58c7-4d21-b275-148a3263c246 service nova] Acquired lock "refresh_cache-2c7bd88d-2991-4660-928e-298c0a0b2e18" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:05:21 user nova-compute[71113]: DEBUG nova.network.neutron [req-5baf80fe-35f4-4509-87fe-1f925266d3f4 req-bc63ae46-58c7-4d21-b275-148a3263c246 service nova] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Refreshing network info cache for port 3a203223-ccaa-4246-960c-686b0f431f07 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 10:05:21 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Start _get_guest_xml network_info=[{"id": "3a203223-ccaa-4246-960c-686b0f431f07", "address": "fa:16:3e:a1:ae:09", "network": {"id": "4b030626-e3f1-4617-89c2-f6389226652f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441335951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7000d6a2a6b147ddbc38208b316574cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a203223-cc", "ovs_interfaceid": "3a203223-ccaa-4246-960c-686b0f431f07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'image_id': '078646fe-b504-41ed-a147-61072e903e51'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 10:05:21 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:05:21 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:05:21 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 10:05:21 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 10:05:21 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 10:05:21 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 10:05:21 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 10:05:21 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 10:05:21 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 10:05:21 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 10:05:21 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 10:05:21 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 10:05:21 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 10:05:21 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 10:05:21 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 10:05:21 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 10:05:21 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 10:05:21 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 10:05:21 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:05:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-640721173',display_name='tempest-AttachVolumeNegativeTest-server-640721173',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-640721173',id=37,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmXiItTwuYYSVLtzin7xW3g5ye4crVlybmaPNMULubChk/s5W/MiImHjmXoTQ2j1Q+CMssyy/c5yNqvpzYG6IhkXve232ryGExiwqKEybw3erRtzojQmciWVQVuGUv2/A==',key_name='tempest-keypair-668613639',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7000d6a2a6b147ddbc38208b316574cd',ramdisk_id='',reservation_id='r-g82x0ruj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2110881646',owner_user_name='tempest-AttachVolumeNegativeTest-2110881646-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T10:05:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9883a5677fb4852ae031137736a9ee4',uuid=2c7bd88d-2991-4660-928e-298c0a0b2e18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a203223-ccaa-4246-960c-686b0f431f07", "address": "fa:16:3e:a1:ae:09", "network": {"id": "4b030626-e3f1-4617-89c2-f6389226652f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441335951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7000d6a2a6b147ddbc38208b316574cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a203223-cc", "ovs_interfaceid": "3a203223-ccaa-4246-960c-686b0f431f07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 10:05:21 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Converting VIF {"id": "3a203223-ccaa-4246-960c-686b0f431f07", "address": "fa:16:3e:a1:ae:09", "network": {"id": "4b030626-e3f1-4617-89c2-f6389226652f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441335951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7000d6a2a6b147ddbc38208b316574cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a203223-cc", "ovs_interfaceid": "3a203223-ccaa-4246-960c-686b0f431f07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:05:21 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:ae:09,bridge_name='br-int',has_traffic_filtering=True,id=3a203223-ccaa-4246-960c-686b0f431f07,network=Network(4b030626-e3f1-4617-89c2-f6389226652f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a203223-cc') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:05:21 user nova-compute[71113]: DEBUG nova.objects.instance [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lazy-loading 'pci_devices' on Instance uuid 2c7bd88d-2991-4660-928e-298c0a0b2e18 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:05:21 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] End _get_guest_xml xml=<domain type="kvm">
Jul 31 10:05:21 user nova-compute[71113]:   <uuid>2c7bd88d-2991-4660-928e-298c0a0b2e18</uuid>
Jul 31 10:05:21 user nova-compute[71113]:   <name>instance-00000025</name>
Jul 31 10:05:21 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 10:05:21 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 10:05:21 user nova-compute[71113]:   <metadata>
Jul 31 10:05:21 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 10:05:21 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 10:05:21 user nova-compute[71113]:       <nova:name>tempest-AttachVolumeNegativeTest-server-640721173</nova:name>
Jul 31 10:05:21 user nova-compute[71113]:       <nova:creationTime>2023-07-31 10:05:21</nova:creationTime>
Jul 31 10:05:21 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 10:05:21 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 10:05:21 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 10:05:21 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 10:05:21 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 10:05:21 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 10:05:21 user nova-compute[71113]:       </nova:flavor>
Jul 31 10:05:21 user nova-compute[71113]:       <nova:owner>
Jul 31 10:05:21 user nova-compute[71113]:         <nova:user uuid="d9883a5677fb4852ae031137736a9ee4">tempest-AttachVolumeNegativeTest-2110881646-project-member</nova:user>
Jul 31 10:05:21 user nova-compute[71113]:         <nova:project uuid="7000d6a2a6b147ddbc38208b316574cd">tempest-AttachVolumeNegativeTest-2110881646</nova:project>
Jul 31 10:05:21 user nova-compute[71113]:       </nova:owner>
Jul 31 10:05:21 user nova-compute[71113]:       <nova:root type="image" uuid="078646fe-b504-41ed-a147-61072e903e51"/>
Jul 31 10:05:21 user nova-compute[71113]:       <nova:ports>
Jul 31 10:05:21 user nova-compute[71113]:         <nova:port uuid="3a203223-ccaa-4246-960c-686b0f431f07">
Jul 31 10:05:21 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 31 10:05:21 user nova-compute[71113]:         </nova:port>
Jul 31 10:05:21 user nova-compute[71113]:       </nova:ports>
Jul 31 10:05:21 user nova-compute[71113]:     </nova:instance>
Jul 31 10:05:21 user nova-compute[71113]:   </metadata>
Jul 31 10:05:21 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 10:05:21 user nova-compute[71113]:     <system>
Jul 31 10:05:21 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 10:05:21 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 10:05:21 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 10:05:21 user nova-compute[71113]:       <entry name="serial">2c7bd88d-2991-4660-928e-298c0a0b2e18</entry>
Jul 31 10:05:21 user nova-compute[71113]:       <entry name="uuid">2c7bd88d-2991-4660-928e-298c0a0b2e18</entry>
Jul 31 10:05:21 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 10:05:21 user nova-compute[71113]:     </system>
Jul 31 10:05:21 user nova-compute[71113]:   </sysinfo>
Jul 31 10:05:21 user nova-compute[71113]:   <os>
Jul 31 10:05:21 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 10:05:21 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 10:05:21 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 10:05:21 user nova-compute[71113]:   </os>
Jul 31 10:05:21 user nova-compute[71113]:   <features>
Jul 31 10:05:21 user nova-compute[71113]:     <acpi/>
Jul 31 10:05:21 user nova-compute[71113]:     <apic/>
Jul 31 10:05:21 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 10:05:21 user nova-compute[71113]:   </features>
Jul 31 10:05:21 user nova-compute[71113]:   <clock offset="utc">
Jul 31 10:05:21 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 10:05:21 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 10:05:21 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 10:05:21 user nova-compute[71113]:   </clock>
Jul 31 10:05:21 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 10:05:21 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 10:05:21 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 10:05:21 user nova-compute[71113]:   </cpu>
Jul 31 10:05:21 user nova-compute[71113]:   <devices>
Jul 31 10:05:21 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 10:05:21 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 10:05:21 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/2c7bd88d-2991-4660-928e-298c0a0b2e18/disk"/>
Jul 31 10:05:21 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 10:05:21 user nova-compute[71113]:     </disk>
Jul 31 10:05:21 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 10:05:21 user nova-compute[71113]:       <mac address="fa:16:3e:a1:ae:09"/>
Jul 31 10:05:21 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:05:21 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 10:05:21 user nova-compute[71113]:       <target dev="tap3a203223-cc"/>
Jul 31 10:05:21 user nova-compute[71113]:     </interface>
Jul 31 10:05:21 user nova-compute[71113]:     <serial type="pty">
Jul 31 10:05:21 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/2c7bd88d-2991-4660-928e-298c0a0b2e18/console.log" append="off"/>
Jul 31 10:05:21 user nova-compute[71113]:     </serial>
Jul 31 10:05:21 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 10:05:21 user nova-compute[71113]:     <video>
Jul 31 10:05:21 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:05:21 user nova-compute[71113]:     </video>
Jul 31 10:05:21 user nova-compute[71113]:     <rng model="virtio">
Jul 31 10:05:21 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 10:05:21 user nova-compute[71113]:     </rng>
Jul 31 10:05:21 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 10:05:21 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 10:05:21 user nova-compute[71113]:       <stats period="10"/>
Jul 31 10:05:21 user nova-compute[71113]:     </memballoon>
Jul 31 10:05:21 user nova-compute[71113]:   </devices>
Jul 31 10:05:21 user nova-compute[71113]: </domain>
Jul 31 10:05:21 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 10:05:21 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:05:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-640721173',display_name='tempest-AttachVolumeNegativeTest-server-640721173',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-640721173',id=37,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmXiItTwuYYSVLtzin7xW3g5ye4crVlybmaPNMULubChk/s5W/MiImHjmXoTQ2j1Q+CMssyy/c5yNqvpzYG6IhkXve232ryGExiwqKEybw3erRtzojQmciWVQVuGUv2/A==',key_name='tempest-keypair-668613639',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7000d6a2a6b147ddbc38208b316574cd',ramdisk_id='',reservation_id='r-g82x0ruj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2110881646',owner_user_name='tempest-AttachVolumeNegativeTest-2110881646-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T10:05:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9883a5677fb4852ae031137736a9ee4',uuid=2c7bd88d-2991-4660-928e-298c0a0b2e18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a203223-ccaa-4246-960c-686b0f431f07", "address": "fa:16:3e:a1:ae:09", "network": {"id": "4b030626-e3f1-4617-89c2-f6389226652f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441335951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7000d6a2a6b147ddbc38208b316574cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a203223-cc", "ovs_interfaceid": "3a203223-ccaa-4246-960c-686b0f431f07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 10:05:21 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Converting VIF {"id": "3a203223-ccaa-4246-960c-686b0f431f07", "address": "fa:16:3e:a1:ae:09", "network": {"id": "4b030626-e3f1-4617-89c2-f6389226652f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441335951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7000d6a2a6b147ddbc38208b316574cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a203223-cc", "ovs_interfaceid": "3a203223-ccaa-4246-960c-686b0f431f07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:05:21 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:ae:09,bridge_name='br-int',has_traffic_filtering=True,id=3a203223-ccaa-4246-960c-686b0f431f07,network=Network(4b030626-e3f1-4617-89c2-f6389226652f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a203223-cc') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:05:21 user nova-compute[71113]: DEBUG os_vif [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:ae:09,bridge_name='br-int',has_traffic_filtering=True,id=3a203223-ccaa-4246-960c-686b0f431f07,network=Network(4b030626-e3f1-4617-89c2-f6389226652f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a203223-cc') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 10:05:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:05:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:05:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 10:05:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:05:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a203223-cc, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:05:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3a203223-cc, col_values=(('external_ids', {'iface-id': '3a203223-ccaa-4246-960c-686b0f431f07', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:ae:09', 'vm-uuid': '2c7bd88d-2991-4660-928e-298c0a0b2e18'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:05:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:05:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:05:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:05:21 user nova-compute[71113]: INFO os_vif [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:ae:09,bridge_name='br-int',has_traffic_filtering=True,id=3a203223-ccaa-4246-960c-686b0f431f07,network=Network(4b030626-e3f1-4617-89c2-f6389226652f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a203223-cc')
Jul 31 10:05:21 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:05:21 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] No VIF found with MAC fa:16:3e:a1:ae:09, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 10:05:21 user nova-compute[71113]: DEBUG nova.network.neutron [req-5baf80fe-35f4-4509-87fe-1f925266d3f4 req-bc63ae46-58c7-4d21-b275-148a3263c246 service nova] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Updated VIF entry in instance network info cache for port 3a203223-ccaa-4246-960c-686b0f431f07. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 10:05:21 user nova-compute[71113]: DEBUG nova.network.neutron [req-5baf80fe-35f4-4509-87fe-1f925266d3f4 req-bc63ae46-58c7-4d21-b275-148a3263c246 service nova] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Updating instance_info_cache with network_info: [{"id": "3a203223-ccaa-4246-960c-686b0f431f07", "address": "fa:16:3e:a1:ae:09", "network": {"id": "4b030626-e3f1-4617-89c2-f6389226652f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441335951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7000d6a2a6b147ddbc38208b316574cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a203223-cc", "ovs_interfaceid": "3a203223-ccaa-4246-960c-686b0f431f07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:05:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-5baf80fe-35f4-4509-87fe-1f925266d3f4 req-bc63ae46-58c7-4d21-b275-148a3263c246 service nova] Releasing lock "refresh_cache-2c7bd88d-2991-4660-928e-298c0a0b2e18" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:05:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:05:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:05:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:05:22 user nova-compute[71113]: DEBUG nova.compute.manager [req-b8aff1e8-bb75-4ac3-b1de-92df0e707745 req-785e385a-d515-49f3-bcae-79bca8534401 service nova] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Received event network-vif-plugged-3a203223-ccaa-4246-960c-686b0f431f07 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:05:22 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-b8aff1e8-bb75-4ac3-b1de-92df0e707745 req-785e385a-d515-49f3-bcae-79bca8534401 service nova] Acquiring lock "2c7bd88d-2991-4660-928e-298c0a0b2e18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:05:22 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-b8aff1e8-bb75-4ac3-b1de-92df0e707745 req-785e385a-d515-49f3-bcae-79bca8534401 service nova] Lock "2c7bd88d-2991-4660-928e-298c0a0b2e18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:05:22 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-b8aff1e8-bb75-4ac3-b1de-92df0e707745 req-785e385a-d515-49f3-bcae-79bca8534401 service nova] Lock "2c7bd88d-2991-4660-928e-298c0a0b2e18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:05:22 user nova-compute[71113]: DEBUG nova.compute.manager [req-b8aff1e8-bb75-4ac3-b1de-92df0e707745 req-785e385a-d515-49f3-bcae-79bca8534401 service nova] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] No waiting events found dispatching network-vif-plugged-3a203223-ccaa-4246-960c-686b0f431f07 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:05:22 user nova-compute[71113]: WARNING nova.compute.manager [req-b8aff1e8-bb75-4ac3-b1de-92df0e707745 req-785e385a-d515-49f3-bcae-79bca8534401 service nova] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Received unexpected event network-vif-plugged-3a203223-ccaa-4246-960c-686b0f431f07 for instance with vm_state building and task_state spawning.
Jul 31 10:05:23 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:05:23 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:05:23 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:05:23 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:05:23 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:05:24 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797924.9456503, 2c7bd88d-2991-4660-928e-298c0a0b2e18 => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:05:24 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] VM Resumed (Lifecycle Event)
Jul 31 10:05:24 user nova-compute[71113]: DEBUG nova.compute.manager [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 10:05:24 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 10:05:24 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Instance spawned successfully.
Jul 31 10:05:24 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 10:05:24 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:05:24 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:05:24 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Found default for hw_cdrom_bus of ide {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:05:24 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Found default for hw_disk_bus of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:05:24 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Found default for hw_input_bus of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:05:24 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Found default for hw_pointer_model of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:05:24 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Found default for hw_video_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:05:24 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Found default for hw_vif_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:05:24 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 10:05:24 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797924.9491105, 2c7bd88d-2991-4660-928e-298c0a0b2e18 => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:05:24 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] VM Started (Lifecycle Event)
Jul 31 10:05:25 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:05:25 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:05:25 user nova-compute[71113]: DEBUG nova.compute.manager [req-cc251f77-7a95-45bb-ba12-6bd350d55bfc req-6fc4805e-0f66-4601-8202-31c9cf86fd1e service nova] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Received event network-vif-plugged-3a203223-ccaa-4246-960c-686b0f431f07 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:05:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-cc251f77-7a95-45bb-ba12-6bd350d55bfc req-6fc4805e-0f66-4601-8202-31c9cf86fd1e service nova] Acquiring lock "2c7bd88d-2991-4660-928e-298c0a0b2e18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:05:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-cc251f77-7a95-45bb-ba12-6bd350d55bfc req-6fc4805e-0f66-4601-8202-31c9cf86fd1e service nova] Lock "2c7bd88d-2991-4660-928e-298c0a0b2e18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:05:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-cc251f77-7a95-45bb-ba12-6bd350d55bfc req-6fc4805e-0f66-4601-8202-31c9cf86fd1e service nova] Lock "2c7bd88d-2991-4660-928e-298c0a0b2e18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:05:25 user nova-compute[71113]: DEBUG nova.compute.manager [req-cc251f77-7a95-45bb-ba12-6bd350d55bfc req-6fc4805e-0f66-4601-8202-31c9cf86fd1e service nova] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] No waiting events found dispatching network-vif-plugged-3a203223-ccaa-4246-960c-686b0f431f07 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:05:25 user nova-compute[71113]: WARNING nova.compute.manager [req-cc251f77-7a95-45bb-ba12-6bd350d55bfc req-6fc4805e-0f66-4601-8202-31c9cf86fd1e service nova] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Received unexpected event network-vif-plugged-3a203223-ccaa-4246-960c-686b0f431f07 for instance with vm_state building and task_state spawning.
Jul 31 10:05:25 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 10:05:25 user nova-compute[71113]: INFO nova.compute.manager [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Took 5.87 seconds to spawn the instance on the hypervisor.
Jul 31 10:05:25 user nova-compute[71113]: DEBUG nova.compute.manager [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:05:25 user nova-compute[71113]: INFO nova.compute.manager [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Took 6.62 seconds to build instance.
Jul 31 10:05:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-10c7b902-848d-4c37-b1bb-9ae58e10b2e0 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "2c7bd88d-2991-4660-928e-298c0a0b2e18" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.723s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:05:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:05:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Acquiring lock "5ffa30ea-7458-4914-a6f4-9d8310ca977c" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:05:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Lock "5ffa30ea-7458-4914-a6f4-9d8310ca977c" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:05:25 user nova-compute[71113]: INFO nova.compute.manager [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Unshelving
Jul 31 10:05:25 user nova-compute[71113]: INFO nova.virt.block_device [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Booting with volume 561d8e35-12d8-4f9f-878d-dd377eb2394d at /dev/vda
Jul 31 10:05:25 user nova-compute[71113]: DEBUG os_brick.utils [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:05:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:05:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:05:25 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d98c86-69b7-4465-a9e5-ffe8ae194349]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:05:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:05:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:05:25 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12788ff-c998-4ddf-900a-1b26ad9cf429]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:05:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:05:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:05:25 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c696ab2-1561-4383-abb0-96cad9577e51]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:05:25 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[727eab21-a6e7-4e65-ba0d-70762ca21a05]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:05:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:05:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 10:05:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 10:05:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:05:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 10:05:25 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 10:05:25 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc804d7-f8b6-4aa9-bdef-4a4a251e7e09]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:05:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 10:05:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 10:05:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 10:05:25 user nova-compute[71113]: DEBUG os_brick.utils [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:05:25 user nova-compute[71113]: DEBUG nova.virt.block_device [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Updating existing volume attachment record: d8e5ac6c-59ab-4d5a-99ed-ff6cd9124d2f {{(pid=71113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 10:05:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:05:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:05:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:05:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:05:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:05:33 user nova-compute[71113]: DEBUG nova.objects.instance [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Lazy-loading 'pci_requests' on Instance uuid 5ffa30ea-7458-4914-a6f4-9d8310ca977c {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:05:33 user nova-compute[71113]: DEBUG nova.objects.instance [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Lazy-loading 'numa_topology' on Instance uuid 5ffa30ea-7458-4914-a6f4-9d8310ca977c {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:05:33 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 10:05:33 user nova-compute[71113]: INFO nova.compute.claims [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Claim successful on node user
Jul 31 10:05:33 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:05:33 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:05:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.498s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:05:33 user nova-compute[71113]: INFO nova.network.neutron [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Updating port 8a38b464-522f-48bd-90b6-4447f9a6eb21 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Jul 31 10:05:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-759a966a-2a43-4fb2-9bbe-1ee00d87241b tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "fc41eb59-d988-461c-941e-551ceb174ba1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:05:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-759a966a-2a43-4fb2-9bbe-1ee00d87241b tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "fc41eb59-d988-461c-941e-551ceb174ba1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:05:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-759a966a-2a43-4fb2-9bbe-1ee00d87241b tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "fc41eb59-d988-461c-941e-551ceb174ba1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:05:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-759a966a-2a43-4fb2-9bbe-1ee00d87241b tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "fc41eb59-d988-461c-941e-551ceb174ba1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:05:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-759a966a-2a43-4fb2-9bbe-1ee00d87241b tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "fc41eb59-d988-461c-941e-551ceb174ba1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:05:34 user nova-compute[71113]: INFO nova.compute.manager [None req-759a966a-2a43-4fb2-9bbe-1ee00d87241b tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Terminating instance
Jul 31 10:05:34 user nova-compute[71113]: DEBUG nova.compute.manager [None req-759a966a-2a43-4fb2-9bbe-1ee00d87241b tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Start destroying the instance on the hypervisor. {{(pid=71113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 10:05:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:05:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:05:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:05:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:05:34 user nova-compute[71113]: DEBUG nova.compute.manager [req-48b6253d-2e52-4156-b0e1-19968bbeafe3 req-8e57ac45-9eaf-4cc3-b80a-cbb2d8471c18 service nova] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Received event network-vif-unplugged-4d104a96-94cd-48ed-bab3-0f6dd4ecefba {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:05:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-48b6253d-2e52-4156-b0e1-19968bbeafe3 req-8e57ac45-9eaf-4cc3-b80a-cbb2d8471c18 service nova] Acquiring lock "fc41eb59-d988-461c-941e-551ceb174ba1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:05:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-48b6253d-2e52-4156-b0e1-19968bbeafe3 req-8e57ac45-9eaf-4cc3-b80a-cbb2d8471c18 service nova] Lock "fc41eb59-d988-461c-941e-551ceb174ba1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:05:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-48b6253d-2e52-4156-b0e1-19968bbeafe3 req-8e57ac45-9eaf-4cc3-b80a-cbb2d8471c18 service nova] Lock "fc41eb59-d988-461c-941e-551ceb174ba1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:05:34 user nova-compute[71113]: DEBUG nova.compute.manager [req-48b6253d-2e52-4156-b0e1-19968bbeafe3 req-8e57ac45-9eaf-4cc3-b80a-cbb2d8471c18 service nova] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] No waiting events found dispatching network-vif-unplugged-4d104a96-94cd-48ed-bab3-0f6dd4ecefba {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:05:34 user nova-compute[71113]: DEBUG nova.compute.manager [req-48b6253d-2e52-4156-b0e1-19968bbeafe3 req-8e57ac45-9eaf-4cc3-b80a-cbb2d8471c18 service nova] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Received event network-vif-unplugged-4d104a96-94cd-48ed-bab3-0f6dd4ecefba for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 10:05:34 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Instance destroyed successfully.
Jul 31 10:05:34 user nova-compute[71113]: DEBUG nova.objects.instance [None req-759a966a-2a43-4fb2-9bbe-1ee00d87241b tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lazy-loading 'resources' on Instance uuid fc41eb59-d988-461c-941e-551ceb174ba1 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:05:34 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-759a966a-2a43-4fb2-9bbe-1ee00d87241b tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:00:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-828587170',display_name='tempest-TestVolumeBootPattern-volume-backed-server-828587170',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-828587170',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLhTIbqoaq8DvckwA1CLo1IxIbsIRYDKIRUzLU3okDrvx1mOchmqHcrnDofr+nCkdZ/QXp4Us2t+n/RpZ1Djg3NBjXF2gSLWtp8cT9PACuyPgxM6s4H0Cpbmc1kivd2RBA==',key_name='tempest-keypair-639827778',keypairs=<?>,launch_index=0,launched_at=2023-07-31T10:01:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3aa2add2e2a24b9cb8e48042b06931d3',ramdisk_id='',reservation_id='r-iex4d838',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1754399827',owner_user_name='tempest-TestVolumeBootPattern-1754399827-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T10:01:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a58fe92488ed47b696fc5d6d990b1acd',uuid=fc41eb59-d988-461c-941e-551ceb174ba1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d104a96-94cd-48ed-bab3-0f6dd4ecefba", "address": "fa:16:3e:dc:ea:ab", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d104a96-94", "ovs_interfaceid": "4d104a96-94cd-48ed-bab3-0f6dd4ecefba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 10:05:34 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-759a966a-2a43-4fb2-9bbe-1ee00d87241b tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Converting VIF {"id": "4d104a96-94cd-48ed-bab3-0f6dd4ecefba", "address": "fa:16:3e:dc:ea:ab", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d104a96-94", "ovs_interfaceid": "4d104a96-94cd-48ed-bab3-0f6dd4ecefba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:05:34 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-759a966a-2a43-4fb2-9bbe-1ee00d87241b tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dc:ea:ab,bridge_name='br-int',has_traffic_filtering=True,id=4d104a96-94cd-48ed-bab3-0f6dd4ecefba,network=Network(fa792d7a-ddf6-4a2d-acb9-802f8daf87ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d104a96-94') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:05:34 user nova-compute[71113]: DEBUG os_vif [None req-759a966a-2a43-4fb2-9bbe-1ee00d87241b tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:ea:ab,bridge_name='br-int',has_traffic_filtering=True,id=4d104a96-94cd-48ed-bab3-0f6dd4ecefba,network=Network(fa792d7a-ddf6-4a2d-acb9-802f8daf87ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d104a96-94') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 10:05:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:05:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d104a96-94, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:05:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:05:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:05:34 user nova-compute[71113]: INFO os_vif [None req-759a966a-2a43-4fb2-9bbe-1ee00d87241b tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:ea:ab,bridge_name='br-int',has_traffic_filtering=True,id=4d104a96-94cd-48ed-bab3-0f6dd4ecefba,network=Network(fa792d7a-ddf6-4a2d-acb9-802f8daf87ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d104a96-94')
Jul 31 10:05:34 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-759a966a-2a43-4fb2-9bbe-1ee00d87241b tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 10:05:34 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-759a966a-2a43-4fb2-9bbe-1ee00d87241b tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eWryYgdK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:05:34 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-759a966a-2a43-4fb2-9bbe-1ee00d87241b tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:05:34 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-759a966a-2a43-4fb2-9bbe-1ee00d87241b tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:05:34 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-759a966a-2a43-4fb2-9bbe-1ee00d87241b tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:05:34 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-759a966a-2a43-4fb2-9bbe-1ee00d87241b tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 10:05:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:05:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Acquiring lock "refresh_cache-5ffa30ea-7458-4914-a6f4-9d8310ca977c" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:05:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Acquired lock "refresh_cache-5ffa30ea-7458-4914-a6f4-9d8310ca977c" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:05:34 user nova-compute[71113]: DEBUG nova.network.neutron [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd89ead-0bbc-4aeb-8195-0c08b06c8007]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG nova.compute.manager [req-fe6d4017-68ba-47a6-886e-64645a774432 req-b847d670-02b6-43e4-8c17-e0b1e29a4eb2 service nova] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Received event network-changed-8a38b464-522f-48bd-90b6-4447f9a6eb21 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG nova.compute.manager [req-fe6d4017-68ba-47a6-886e-64645a774432 req-b847d670-02b6-43e4-8c17-e0b1e29a4eb2 service nova] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Refreshing instance network info cache due to event network-changed-8a38b464-522f-48bd-90b6-4447f9a6eb21. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-fe6d4017-68ba-47a6-886e-64645a774432 req-b847d670-02b6-43e4-8c17-e0b1e29a4eb2 service nova] Acquiring lock "refresh_cache-5ffa30ea-7458-4914-a6f4-9d8310ca977c" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1cee676-99f4-451d-ae6c-4b8a185a3803]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-759a966a-2a43-4fb2-9bbe-1ee00d87241b tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:05:35 user nova-compute[71113]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 (non-flash)
Jul 31 10:05:35 user nova-compute[71113]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)
Jul 31 10:05:35 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-759a966a-2a43-4fb2-9bbe-1ee00d87241b tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:05:35 user nova-compute[71113]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 (non-flash)
Jul 31 10:05:35 user nova-compute[71113]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)
Jul 31 10:05:35 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-759a966a-2a43-4fb2-9bbe-1ee00d87241b tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f78f05af250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2'): ({'sdd'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-759a966a-2a43-4fb2-9bbe-1ee00d87241b tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Removing single pathed devices sdd {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e33cd0-b42e-4ed5-87c5-7e29bbb7c5ef]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c5d170-8996-4df3-adb3-132542ec6509]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-759a966a-2a43-4fb2-9bbe-1ee00d87241b tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Flushing IO for device /dev/sdd {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb4f772-bfde-452a-a426-4186f656f90d]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-759a966a-2a43-4fb2-9bbe-1ee00d87241b tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.065s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3483eaab-184f-4e4a-9e82-981aa996da03]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-759a966a-2a43-4fb2-9bbe-1ee00d87241b tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-759a966a-2a43-4fb2-9bbe-1ee00d87241b tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] SCSI volumes sdd have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO53b9e148-53ef1fdda147a6f1', '/dev/disk/by-id/scsi-23533656631666464', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_53b9e148') {{(pid=81983) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 31 10:05:35 user nova-compute[71113]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO53b9e148-53ef1fdda147a6f1
Jul 31 10:05:35 user nova-compute[71113]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23533656631666464
Jul 31 10:05:35 user nova-compute[71113]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_53b9e148
Jul 31 10:05:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4b8860-19b1-4276-888e-6792e2322c6c]: (4, None) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-759a966a-2a43-4fb2-9bbe-1ee00d87241b tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[41eccb93-4e80-432a-8685-927eebe313af]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-759a966a-2a43-4fb2-9bbe-1ee00d87241b tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2820a659-983f-43d0-b8a7-62602bab8ccd]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-759a966a-2a43-4fb2-9bbe-1ee00d87241b tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2, portal: 172.16.0.220,3260]
Jul 31 10:05:35 user nova-compute[71113]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2, portal: 172.16.0.220,3260] successful.
Jul 31 10:05:35 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:167f63f2-13e2-4db5-89ef-ecffce1425e2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1181b36b-25ba-4798-ac50-c1ab7300a203]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-759a966a-2a43-4fb2-9bbe-1ee00d87241b tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-759a966a-2a43-4fb2-9bbe-1ee00d87241b tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.412s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-759a966a-2a43-4fb2-9bbe-1ee00d87241b tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] <== disconnect_volume: return (415ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-759a966a-2a43-4fb2-9bbe-1ee00d87241b tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 10:05:35 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-759a966a-2a43-4fb2-9bbe-1ee00d87241b tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Deleting instance files /opt/stack/data/nova/instances/fc41eb59-d988-461c-941e-551ceb174ba1_del
Jul 31 10:05:35 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-759a966a-2a43-4fb2-9bbe-1ee00d87241b tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Deletion of /opt/stack/data/nova/instances/fc41eb59-d988-461c-941e-551ceb174ba1_del complete
Jul 31 10:05:35 user nova-compute[71113]: INFO nova.compute.manager [None req-759a966a-2a43-4fb2-9bbe-1ee00d87241b tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Took 1.34 seconds to destroy the instance on the hypervisor.
Jul 31 10:05:35 user nova-compute[71113]: DEBUG oslo.service.loopingcall [None req-759a966a-2a43-4fb2-9bbe-1ee00d87241b tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71113) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG nova.compute.manager [-] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Deallocating network for instance {{(pid=71113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] deallocate_for_instance() {{(pid=71113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG nova.network.neutron [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Updating instance_info_cache with network_info: [{"id": "8a38b464-522f-48bd-90b6-4447f9a6eb21", "address": "fa:16:3e:8f:24:b1", "network": {"id": "a88a6414-c6fd-4581-bbb5-7250ebcb1345", "bridge": "br-int", "label": "tempest-TestShelveInstance-1094508903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c17b9322f9049d390ad212ad8ce7905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a38b464-52", "ovs_interfaceid": "8a38b464-522f-48bd-90b6-4447f9a6eb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Releasing lock "refresh_cache-5ffa30ea-7458-4914-a6f4-9d8310ca977c" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 10:05:35 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Creating image(s)
Jul 31 10:05:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Did not create local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Ensure instance console log exists: /opt/stack/data/nova/instances/5ffa30ea-7458-4914-a6f4-9d8310ca977c/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Start _get_guest_xml network_info=[{"id": "8a38b464-522f-48bd-90b6-4447f9a6eb21", "address": "fa:16:3e:8f:24:b1", "network": {"id": "a88a6414-c6fd-4581-bbb5-7250ebcb1345", "bridge": "br-int", "label": "tempest-TestShelveInstance-1094508903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c17b9322f9049d390ad212ad8ce7905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a38b464-52", "ovs_interfaceid": "8a38b464-522f-48bd-90b6-4447f9a6eb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd8e5ac6c-59ab-4d5a-99ed-ff6cd9124d2f', 'mount_device': '/dev/vda', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'egBnzlMD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5ffa30ea-7458-4914-a6f4-9d8310ca977c', 'attached_at': '', 'detached_at': '', 'volume_id': '561d8e35-12d8-4f9f-878d-dd377eb2394d', 'serial': '561d8e35-12d8-4f9f-878d-dd377eb2394d'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-fe6d4017-68ba-47a6-886e-64645a774432 req-b847d670-02b6-43e4-8c17-e0b1e29a4eb2 service nova] Acquired lock "refresh_cache-5ffa30ea-7458-4914-a6f4-9d8310ca977c" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG nova.network.neutron [req-fe6d4017-68ba-47a6-886e-64645a774432 req-b847d670-02b6-43e4-8c17-e0b1e29a4eb2 service nova] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Refreshing network info cache for port 8a38b464-522f-48bd-90b6-4447f9a6eb21 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 10:05:35 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:05:35 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:05:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG nova.objects.instance [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5ffa30ea-7458-4914-a6f4-9d8310ca977c {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'egBnzlMD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:05:35 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:05:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:05:35 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:05:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:05:35 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 10:05:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[969862e8-7ada-4bd8-b25a-803c6e06a210]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 10:05:35 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae78c167-6650-4cc4-a1ba-aa5ca3901c73]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d] added
Jul 31 10:05:35 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2ac09d-a0ae-4252-a2af-6ddb030d4cdb]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e53bdf-cae1-48f5-89cf-8fb031ec6560]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v egBnzlMD {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v egBnzlMD" returned: 0 in 0.025s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e34b11-ff85-4da7-aa38-0e2b2341aeb4]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'egBnzlMD'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd12e90-9379-4f32-895a-a6f5a26227e5]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f592d91-bf8a-45c6-82e8-b994c1f4ed37]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:05:35 user nova-compute[71113]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)
Jul 31 10:05:35 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:05:35 user nova-compute[71113]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)
Jul 31 10:05:35 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:05:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:05:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:05:36 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2d67cd-5036-46fc-8c5a-aa200d8fb697]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:05:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d, portal: 172.16.0.220,3260]
Jul 31 10:05:36 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d, portal: 172.16.0.220,3260] successful.
Jul 31 10:05:36 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:05:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:05:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:05:36 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f2c043-48d1-4aa7-a3ed-18aeb478add9]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:05:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:05:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:05:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:05:36 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5f6244-dc36-4ad5-afcd-37394e58637f]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:05:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:05:36 user nova-compute[71113]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)
Jul 31 10:05:36 user nova-compute[71113]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d (non-flash)
Jul 31 10:05:36 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:05:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:05:36 user nova-compute[71113]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)
Jul 31 10:05:36 user nova-compute[71113]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d (non-flash)
Jul 31 10:05:36 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:05:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:05:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 10:05:36 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 10:05:36 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 10:05:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:05:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:05:36 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[206cce96-9554-48c5-9886-14e72b8594f0]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:05:36 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 10:05:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'egBnzlMD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 10:05:36 user nova-compute[71113]: DEBUG nova.network.neutron [req-fe6d4017-68ba-47a6-886e-64645a774432 req-b847d670-02b6-43e4-8c17-e0b1e29a4eb2 service nova] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Updated VIF entry in instance network info cache for port 8a38b464-522f-48bd-90b6-4447f9a6eb21. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 10:05:36 user nova-compute[71113]: DEBUG nova.network.neutron [req-fe6d4017-68ba-47a6-886e-64645a774432 req-b847d670-02b6-43e4-8c17-e0b1e29a4eb2 service nova] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Updating instance_info_cache with network_info: [{"id": "8a38b464-522f-48bd-90b6-4447f9a6eb21", "address": "fa:16:3e:8f:24:b1", "network": {"id": "a88a6414-c6fd-4581-bbb5-7250ebcb1345", "bridge": "br-int", "label": "tempest-TestShelveInstance-1094508903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c17b9322f9049d390ad212ad8ce7905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a38b464-52", "ovs_interfaceid": "8a38b464-522f-48bd-90b6-4447f9a6eb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:05:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-fe6d4017-68ba-47a6-886e-64645a774432 req-b847d670-02b6-43e4-8c17-e0b1e29a4eb2 service nova] Releasing lock "refresh_cache-5ffa30ea-7458-4914-a6f4-9d8310ca977c" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:05:36 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:05:36 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Took 0.95 seconds to deallocate network for instance.
Jul 31 10:05:36 user nova-compute[71113]: DEBUG nova.compute.manager [req-acd2ce03-aae3-46f7-b34f-31567a665beb req-efc282cf-9d4c-47bf-a974-263ef052fef7 service nova] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Received event network-vif-deleted-4d104a96-94cd-48ed-bab3-0f6dd4ecefba {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:05:36 user nova-compute[71113]: INFO nova.compute.manager [req-acd2ce03-aae3-46f7-b34f-31567a665beb req-efc282cf-9d4c-47bf-a974-263ef052fef7 service nova] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Neutron deleted interface 4d104a96-94cd-48ed-bab3-0f6dd4ecefba; detaching it from the instance and deleting it from the info cache
Jul 31 10:05:36 user nova-compute[71113]: DEBUG nova.network.neutron [req-acd2ce03-aae3-46f7-b34f-31567a665beb req-efc282cf-9d4c-47bf-a974-263ef052fef7 service nova] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:05:36 user nova-compute[71113]: DEBUG nova.compute.manager [req-acd2ce03-aae3-46f7-b34f-31567a665beb req-efc282cf-9d4c-47bf-a974-263ef052fef7 service nova] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Detach interface failed, port_id=4d104a96-94cd-48ed-bab3-0f6dd4ecefba, reason: Instance fc41eb59-d988-461c-941e-551ceb174ba1 could not be found. {{(pid=71113) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 10:05:36 user nova-compute[71113]: DEBUG nova.compute.manager [req-7da19136-1173-4255-8ab6-f8713c06cf25 req-ef878a03-d74d-4f90-8dc5-934e014c75c7 service nova] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Received event network-vif-plugged-4d104a96-94cd-48ed-bab3-0f6dd4ecefba {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:05:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7da19136-1173-4255-8ab6-f8713c06cf25 req-ef878a03-d74d-4f90-8dc5-934e014c75c7 service nova] Acquiring lock "fc41eb59-d988-461c-941e-551ceb174ba1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:05:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7da19136-1173-4255-8ab6-f8713c06cf25 req-ef878a03-d74d-4f90-8dc5-934e014c75c7 service nova] Lock "fc41eb59-d988-461c-941e-551ceb174ba1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:05:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7da19136-1173-4255-8ab6-f8713c06cf25 req-ef878a03-d74d-4f90-8dc5-934e014c75c7 service nova] Lock "fc41eb59-d988-461c-941e-551ceb174ba1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:05:36 user nova-compute[71113]: DEBUG nova.compute.manager [req-7da19136-1173-4255-8ab6-f8713c06cf25 req-ef878a03-d74d-4f90-8dc5-934e014c75c7 service nova] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] No waiting events found dispatching network-vif-plugged-4d104a96-94cd-48ed-bab3-0f6dd4ecefba {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:05:36 user nova-compute[71113]: WARNING nova.compute.manager [req-7da19136-1173-4255-8ab6-f8713c06cf25 req-ef878a03-d74d-4f90-8dc5-934e014c75c7 service nova] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Received unexpected event network-vif-plugged-4d104a96-94cd-48ed-bab3-0f6dd4ecefba for instance with vm_state active and task_state deleting.
Jul 31 10:05:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:05:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '23134643538353035', 'path': '/dev/sdb'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:05:37 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134643538353035', 'path': '/dev/sdb'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 10:05:37 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T10:01:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1588137860',display_name='tempest-TestShelveInstance-server-1588137860',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1588137860',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-735724819',keypairs=<?>,launch_index=0,launched_at=2023-07-31T10:01:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9c17b9322f9049d390ad212ad8ce7905',ramdisk_id='',reservation_id='r-mtlq72k6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1763207303',owner_user_name='tempest-TestShelveInstance-1763207303-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T10:05:26Z,user_data=None,user_id='31f12483848e44098cbb078851c5f8d7',uuid=5ffa30ea-7458-4914-a6f4-9d8310ca977c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8a38b464-522f-48bd-90b6-4447f9a6eb21", "address": "fa:16:3e:8f:24:b1", "network": {"id": "a88a6414-c6fd-4581-bbb5-7250ebcb1345", "bridge": "br-int", "label": "tempest-TestShelveInstance-1094508903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c17b9322f9049d390ad212ad8ce7905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a38b464-52", "ovs_interfaceid": "8a38b464-522f-48bd-90b6-4447f9a6eb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 10:05:37 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Converting VIF {"id": "8a38b464-522f-48bd-90b6-4447f9a6eb21", "address": "fa:16:3e:8f:24:b1", "network": {"id": "a88a6414-c6fd-4581-bbb5-7250ebcb1345", "bridge": "br-int", "label": "tempest-TestShelveInstance-1094508903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c17b9322f9049d390ad212ad8ce7905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a38b464-52", "ovs_interfaceid": "8a38b464-522f-48bd-90b6-4447f9a6eb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:05:37 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:24:b1,bridge_name='br-int',has_traffic_filtering=True,id=8a38b464-522f-48bd-90b6-4447f9a6eb21,network=Network(a88a6414-c6fd-4581-bbb5-7250ebcb1345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a38b464-52') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:05:37 user nova-compute[71113]: DEBUG nova.objects.instance [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Lazy-loading 'pci_devices' on Instance uuid 5ffa30ea-7458-4914-a6f4-9d8310ca977c {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:05:37 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] End _get_guest_xml xml=<domain type="kvm">
Jul 31 10:05:37 user nova-compute[71113]:   <uuid>5ffa30ea-7458-4914-a6f4-9d8310ca977c</uuid>
Jul 31 10:05:37 user nova-compute[71113]:   <name>instance-00000021</name>
Jul 31 10:05:37 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 10:05:37 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 10:05:37 user nova-compute[71113]:   <metadata>
Jul 31 10:05:37 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 10:05:37 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 10:05:37 user nova-compute[71113]:       <nova:name>tempest-TestShelveInstance-server-1588137860</nova:name>
Jul 31 10:05:37 user nova-compute[71113]:       <nova:creationTime>2023-07-31 10:05:35</nova:creationTime>
Jul 31 10:05:37 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 10:05:37 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 10:05:37 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 10:05:37 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 10:05:37 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 10:05:37 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 10:05:37 user nova-compute[71113]:       </nova:flavor>
Jul 31 10:05:37 user nova-compute[71113]:       <nova:owner>
Jul 31 10:05:37 user nova-compute[71113]:         <nova:user uuid="31f12483848e44098cbb078851c5f8d7">tempest-TestShelveInstance-1763207303-project-member</nova:user>
Jul 31 10:05:37 user nova-compute[71113]:         <nova:project uuid="9c17b9322f9049d390ad212ad8ce7905">tempest-TestShelveInstance-1763207303</nova:project>
Jul 31 10:05:37 user nova-compute[71113]:       </nova:owner>
Jul 31 10:05:37 user nova-compute[71113]:       <nova:ports>
Jul 31 10:05:37 user nova-compute[71113]:         <nova:port uuid="8a38b464-522f-48bd-90b6-4447f9a6eb21">
Jul 31 10:05:37 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 31 10:05:37 user nova-compute[71113]:         </nova:port>
Jul 31 10:05:37 user nova-compute[71113]:       </nova:ports>
Jul 31 10:05:37 user nova-compute[71113]:     </nova:instance>
Jul 31 10:05:37 user nova-compute[71113]:   </metadata>
Jul 31 10:05:37 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 10:05:37 user nova-compute[71113]:     <system>
Jul 31 10:05:37 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 10:05:37 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 10:05:37 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 10:05:37 user nova-compute[71113]:       <entry name="serial">5ffa30ea-7458-4914-a6f4-9d8310ca977c</entry>
Jul 31 10:05:37 user nova-compute[71113]:       <entry name="uuid">5ffa30ea-7458-4914-a6f4-9d8310ca977c</entry>
Jul 31 10:05:37 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 10:05:37 user nova-compute[71113]:     </system>
Jul 31 10:05:37 user nova-compute[71113]:   </sysinfo>
Jul 31 10:05:37 user nova-compute[71113]:   <os>
Jul 31 10:05:37 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 10:05:37 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 10:05:37 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 10:05:37 user nova-compute[71113]:   </os>
Jul 31 10:05:37 user nova-compute[71113]:   <features>
Jul 31 10:05:37 user nova-compute[71113]:     <acpi/>
Jul 31 10:05:37 user nova-compute[71113]:     <apic/>
Jul 31 10:05:37 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 10:05:37 user nova-compute[71113]:   </features>
Jul 31 10:05:37 user nova-compute[71113]:   <clock offset="utc">
Jul 31 10:05:37 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 10:05:37 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 10:05:37 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 10:05:37 user nova-compute[71113]:   </clock>
Jul 31 10:05:37 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 10:05:37 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 10:05:37 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 10:05:37 user nova-compute[71113]:   </cpu>
Jul 31 10:05:37 user nova-compute[71113]:   <devices>
Jul 31 10:05:37 user nova-compute[71113]:     <disk type="block" device="disk">
Jul 31 10:05:37 user nova-compute[71113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:05:37 user nova-compute[71113]:       <source dev="/dev/sdb"/>
Jul 31 10:05:37 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 10:05:37 user nova-compute[71113]:       <serial>561d8e35-12d8-4f9f-878d-dd377eb2394d</serial>
Jul 31 10:05:37 user nova-compute[71113]:     </disk>
Jul 31 10:05:37 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 10:05:37 user nova-compute[71113]:       <mac address="fa:16:3e:8f:24:b1"/>
Jul 31 10:05:37 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:05:37 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 10:05:37 user nova-compute[71113]:       <target dev="tap8a38b464-52"/>
Jul 31 10:05:37 user nova-compute[71113]:     </interface>
Jul 31 10:05:37 user nova-compute[71113]:     <serial type="pty">
Jul 31 10:05:37 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/5ffa30ea-7458-4914-a6f4-9d8310ca977c/console.log" append="off"/>
Jul 31 10:05:37 user nova-compute[71113]:     </serial>
Jul 31 10:05:37 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 10:05:37 user nova-compute[71113]:     <video>
Jul 31 10:05:37 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:05:37 user nova-compute[71113]:     </video>
Jul 31 10:05:37 user nova-compute[71113]:     <rng model="virtio">
Jul 31 10:05:37 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 10:05:37 user nova-compute[71113]:     </rng>
Jul 31 10:05:37 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 10:05:37 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 10:05:37 user nova-compute[71113]:       <stats period="10"/>
Jul 31 10:05:37 user nova-compute[71113]:     </memballoon>
Jul 31 10:05:37 user nova-compute[71113]:   </devices>
Jul 31 10:05:37 user nova-compute[71113]: </domain>
Jul 31 10:05:37 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 10:05:37 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T10:01:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1588137860',display_name='tempest-TestShelveInstance-server-1588137860',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1588137860',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-735724819',keypairs=<?>,launch_index=0,launched_at=2023-07-31T10:01:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9c17b9322f9049d390ad212ad8ce7905',ramdisk_id='',reservation_id='r-mtlq72k6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1763207303',owner_user_name='tempest-TestShelveInstance-1763207303-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T10:05:26Z,user_data=None,user_id='31f12483848e44098cbb078851c5f8d7',uuid=5ffa30ea-7458-4914-a6f4-9d8310ca977c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8a38b464-522f-48bd-90b6-4447f9a6eb21", "address": "fa:16:3e:8f:24:b1", "network": {"id": "a88a6414-c6fd-4581-bbb5-7250ebcb1345", "bridge": "br-int", "label": "tempest-TestShelveInstance-1094508903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c17b9322f9049d390ad212ad8ce7905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a38b464-52", "ovs_interfaceid": "8a38b464-522f-48bd-90b6-4447f9a6eb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 10:05:37 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Converting VIF {"id": "8a38b464-522f-48bd-90b6-4447f9a6eb21", "address": "fa:16:3e:8f:24:b1", "network": {"id": "a88a6414-c6fd-4581-bbb5-7250ebcb1345", "bridge": "br-int", "label": "tempest-TestShelveInstance-1094508903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c17b9322f9049d390ad212ad8ce7905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a38b464-52", "ovs_interfaceid": "8a38b464-522f-48bd-90b6-4447f9a6eb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:05:37 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:24:b1,bridge_name='br-int',has_traffic_filtering=True,id=8a38b464-522f-48bd-90b6-4447f9a6eb21,network=Network(a88a6414-c6fd-4581-bbb5-7250ebcb1345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a38b464-52') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:05:37 user nova-compute[71113]: DEBUG os_vif [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:24:b1,bridge_name='br-int',has_traffic_filtering=True,id=8a38b464-522f-48bd-90b6-4447f9a6eb21,network=Network(a88a6414-c6fd-4581-bbb5-7250ebcb1345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a38b464-52') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 10:05:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:05:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:05:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 10:05:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:05:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a38b464-52, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:05:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8a38b464-52, col_values=(('external_ids', {'iface-id': '8a38b464-522f-48bd-90b6-4447f9a6eb21', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:24:b1', 'vm-uuid': '5ffa30ea-7458-4914-a6f4-9d8310ca977c'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:05:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:05:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:05:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:05:37 user nova-compute[71113]: INFO os_vif [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:24:b1,bridge_name='br-int',has_traffic_filtering=True,id=8a38b464-522f-48bd-90b6-4447f9a6eb21,network=Network(a88a6414-c6fd-4581-bbb5-7250ebcb1345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a38b464-52')
Jul 31 10:05:37 user nova-compute[71113]: INFO nova.compute.manager [None req-759a966a-2a43-4fb2-9bbe-1ee00d87241b tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Took 0.84 seconds to detach 1 volumes for instance.
Jul 31 10:05:37 user nova-compute[71113]: DEBUG nova.compute.manager [None req-759a966a-2a43-4fb2-9bbe-1ee00d87241b tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Deleting volume: 167f63f2-13e2-4db5-89ef-ecffce1425e2 {{(pid=71113) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 31 10:05:37 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:05:37 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] No VIF found with MAC fa:16:3e:8f:24:b1, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 10:05:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-759a966a-2a43-4fb2-9bbe-1ee00d87241b tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:05:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-759a966a-2a43-4fb2-9bbe-1ee00d87241b tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:05:37 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-759a966a-2a43-4fb2-9bbe-1ee00d87241b tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:05:37 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-759a966a-2a43-4fb2-9bbe-1ee00d87241b tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:05:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-759a966a-2a43-4fb2-9bbe-1ee00d87241b tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.371s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:05:37 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-759a966a-2a43-4fb2-9bbe-1ee00d87241b tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Deleted allocations for instance fc41eb59-d988-461c-941e-551ceb174ba1
Jul 31 10:05:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-759a966a-2a43-4fb2-9bbe-1ee00d87241b tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "fc41eb59-d988-461c-941e-551ceb174ba1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.791s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:05:38 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:05:38 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:05:39 user nova-compute[71113]: DEBUG nova.compute.manager [req-615994e8-a4d5-4127-aef3-968a55f17fb1 req-ae786ef3-d787-4272-882a-fbb2eb956e60 service nova] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Received event network-vif-plugged-8a38b464-522f-48bd-90b6-4447f9a6eb21 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:05:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-615994e8-a4d5-4127-aef3-968a55f17fb1 req-ae786ef3-d787-4272-882a-fbb2eb956e60 service nova] Acquiring lock "5ffa30ea-7458-4914-a6f4-9d8310ca977c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:05:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-615994e8-a4d5-4127-aef3-968a55f17fb1 req-ae786ef3-d787-4272-882a-fbb2eb956e60 service nova] Lock "5ffa30ea-7458-4914-a6f4-9d8310ca977c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:05:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-615994e8-a4d5-4127-aef3-968a55f17fb1 req-ae786ef3-d787-4272-882a-fbb2eb956e60 service nova] Lock "5ffa30ea-7458-4914-a6f4-9d8310ca977c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:05:39 user nova-compute[71113]: DEBUG nova.compute.manager [req-615994e8-a4d5-4127-aef3-968a55f17fb1 req-ae786ef3-d787-4272-882a-fbb2eb956e60 service nova] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] No waiting events found dispatching network-vif-plugged-8a38b464-522f-48bd-90b6-4447f9a6eb21 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:05:39 user nova-compute[71113]: WARNING nova.compute.manager [req-615994e8-a4d5-4127-aef3-968a55f17fb1 req-ae786ef3-d787-4272-882a-fbb2eb956e60 service nova] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Received unexpected event network-vif-plugged-8a38b464-522f-48bd-90b6-4447f9a6eb21 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 31 10:05:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:05:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:05:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:05:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:05:40 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:05:41 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797941.087519, 5ffa30ea-7458-4914-a6f4-9d8310ca977c => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:05:41 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] VM Resumed (Lifecycle Event)
Jul 31 10:05:41 user nova-compute[71113]: DEBUG nova.compute.manager [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 10:05:41 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 10:05:41 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Instance spawned successfully.
Jul 31 10:05:41 user nova-compute[71113]: DEBUG nova.compute.manager [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:05:41 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:05:41 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:05:41 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 10:05:41 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797941.090449, 5ffa30ea-7458-4914-a6f4-9d8310ca977c => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:05:41 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] VM Started (Lifecycle Event)
Jul 31 10:05:41 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:05:41 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:05:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-d3123498-9161-4f5c-88f9-997ed3ce6cb3 tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Lock "5ffa30ea-7458-4914-a6f4-9d8310ca977c" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 15.684s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:05:41 user nova-compute[71113]: DEBUG nova.compute.manager [req-56a30bfd-5c80-4ab7-b5fa-aaf23f53b50a req-da49dbc6-c758-4d39-92c6-d8e539665af8 service nova] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Received event network-vif-plugged-8a38b464-522f-48bd-90b6-4447f9a6eb21 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:05:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-56a30bfd-5c80-4ab7-b5fa-aaf23f53b50a req-da49dbc6-c758-4d39-92c6-d8e539665af8 service nova] Acquiring lock "5ffa30ea-7458-4914-a6f4-9d8310ca977c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:05:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-56a30bfd-5c80-4ab7-b5fa-aaf23f53b50a req-da49dbc6-c758-4d39-92c6-d8e539665af8 service nova] Lock "5ffa30ea-7458-4914-a6f4-9d8310ca977c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:05:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-56a30bfd-5c80-4ab7-b5fa-aaf23f53b50a req-da49dbc6-c758-4d39-92c6-d8e539665af8 service nova] Lock "5ffa30ea-7458-4914-a6f4-9d8310ca977c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:05:41 user nova-compute[71113]: DEBUG nova.compute.manager [req-56a30bfd-5c80-4ab7-b5fa-aaf23f53b50a req-da49dbc6-c758-4d39-92c6-d8e539665af8 service nova] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] No waiting events found dispatching network-vif-plugged-8a38b464-522f-48bd-90b6-4447f9a6eb21 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:05:41 user nova-compute[71113]: WARNING nova.compute.manager [req-56a30bfd-5c80-4ab7-b5fa-aaf23f53b50a req-da49dbc6-c758-4d39-92c6-d8e539665af8 service nova] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Received unexpected event network-vif-plugged-8a38b464-522f-48bd-90b6-4447f9a6eb21 for instance with vm_state active and task_state None.
Jul 31 10:05:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:05:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:05:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:05:46 user nova-compute[71113]: DEBUG nova.compute.manager [req-1ea3dad8-2097-43f8-b931-b632e16b7634 req-70942bdd-2dd4-40f5-9713-5c7e49568216 service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Received event network-changed-a856eb89-910c-456e-bc0e-a9f92ce20248 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:05:46 user nova-compute[71113]: DEBUG nova.compute.manager [req-1ea3dad8-2097-43f8-b931-b632e16b7634 req-70942bdd-2dd4-40f5-9713-5c7e49568216 service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Refreshing instance network info cache due to event network-changed-a856eb89-910c-456e-bc0e-a9f92ce20248. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 10:05:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1ea3dad8-2097-43f8-b931-b632e16b7634 req-70942bdd-2dd4-40f5-9713-5c7e49568216 service nova] Acquiring lock "refresh_cache-95a84d3c-7aa2-4294-a419-995926a2782f" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:05:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1ea3dad8-2097-43f8-b931-b632e16b7634 req-70942bdd-2dd4-40f5-9713-5c7e49568216 service nova] Acquired lock "refresh_cache-95a84d3c-7aa2-4294-a419-995926a2782f" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:05:46 user nova-compute[71113]: DEBUG nova.network.neutron [req-1ea3dad8-2097-43f8-b931-b632e16b7634 req-70942bdd-2dd4-40f5-9713-5c7e49568216 service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Refreshing network info cache for port a856eb89-910c-456e-bc0e-a9f92ce20248 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 10:05:46 user nova-compute[71113]: DEBUG nova.network.neutron [req-1ea3dad8-2097-43f8-b931-b632e16b7634 req-70942bdd-2dd4-40f5-9713-5c7e49568216 service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Updated VIF entry in instance network info cache for port a856eb89-910c-456e-bc0e-a9f92ce20248. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 10:05:46 user nova-compute[71113]: DEBUG nova.network.neutron [req-1ea3dad8-2097-43f8-b931-b632e16b7634 req-70942bdd-2dd4-40f5-9713-5c7e49568216 service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Updating instance_info_cache with network_info: [{"id": "a856eb89-910c-456e-bc0e-a9f92ce20248", "address": "fa:16:3e:d0:99:09", "network": {"id": "67fc40ba-b2c8-43f9-a714-46ef13acf5ed", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1597196996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f8d203e3c534371b05a2ec4c6c07a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa856eb89-91", "ovs_interfaceid": "a856eb89-910c-456e-bc0e-a9f92ce20248", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:05:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1ea3dad8-2097-43f8-b931-b632e16b7634 req-70942bdd-2dd4-40f5-9713-5c7e49568216 service nova] Releasing lock "refresh_cache-95a84d3c-7aa2-4294-a419-995926a2782f" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:05:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:05:48 user nova-compute[71113]: DEBUG nova.compute.manager [None req-c674974a-c6c8-4609-9993-8b867e2b96e7 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:05:48 user nova-compute[71113]: INFO nova.compute.manager [None req-c674974a-c6c8-4609-9993-8b867e2b96e7 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] instance snapshotting
Jul 31 10:05:48 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-c674974a-c6c8-4609-9993-8b867e2b96e7 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Beginning live snapshot process
Jul 31 10:05:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-c674974a-c6c8-4609-9993-8b867e2b96e7 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk --force-share --output=json -f qcow2 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:05:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-c674974a-c6c8-4609-9993-8b867e2b96e7 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk --force-share --output=json -f qcow2" returned: 0 in 0.153s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:05:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-c674974a-c6c8-4609-9993-8b867e2b96e7 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk --force-share --output=json -f qcow2 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:05:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-c674974a-c6c8-4609-9993-8b867e2b96e7 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk --force-share --output=json -f qcow2" returned: 0 in 0.144s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:05:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-c674974a-c6c8-4609-9993-8b867e2b96e7 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:05:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-c674974a-c6c8-4609-9993-8b867e2b96e7 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.136s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:05:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-c674974a-c6c8-4609-9993-8b867e2b96e7 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmplcq8lfip/3d123cb75dc843c0a5be9d3b57bf7262.delta 1073741824 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:05:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-c674974a-c6c8-4609-9993-8b867e2b96e7 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmplcq8lfip/3d123cb75dc843c0a5be9d3b57bf7262.delta 1073741824" returned: 0 in 0.049s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:05:49 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-c674974a-c6c8-4609-9993-8b867e2b96e7 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 31 10:05:49 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690797934.9297576, fc41eb59-d988-461c-941e-551ceb174ba1 => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:05:49 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] VM Stopped (Lifecycle Event)
Jul 31 10:05:49 user nova-compute[71113]: DEBUG nova.compute.manager [None req-2ae8ab70-4052-4ece-88f6-3fb401b55661 None None] [instance: fc41eb59-d988-461c-941e-551ceb174ba1] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:05:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-c674974a-c6c8-4609-9993-8b867e2b96e7 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=71113) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 10:05:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:05:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-c674974a-c6c8-4609-9993-8b867e2b96e7 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] COPY block job progress, current cursor: 75366400 final cursor: 75497472 {{(pid=71113) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 10:05:51 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-c674974a-c6c8-4609-9993-8b867e2b96e7 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=71113) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 10:05:51 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-c674974a-c6c8-4609-9993-8b867e2b96e7 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 31 10:05:51 user nova-compute[71113]: DEBUG nova.privsep.utils [None req-c674974a-c6c8-4609-9993-8b867e2b96e7 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71113) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 10:05:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-c674974a-c6c8-4609-9993-8b867e2b96e7 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmplcq8lfip/3d123cb75dc843c0a5be9d3b57bf7262.delta /opt/stack/data/nova/instances/snapshots/tmplcq8lfip/3d123cb75dc843c0a5be9d3b57bf7262 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:05:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-c674974a-c6c8-4609-9993-8b867e2b96e7 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmplcq8lfip/3d123cb75dc843c0a5be9d3b57bf7262.delta /opt/stack/data/nova/instances/snapshots/tmplcq8lfip/3d123cb75dc843c0a5be9d3b57bf7262" returned: 0 in 0.653s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:05:52 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-c674974a-c6c8-4609-9993-8b867e2b96e7 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Snapshot extracted, beginning image upload
Jul 31 10:05:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:05:54 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-c674974a-c6c8-4609-9993-8b867e2b96e7 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Snapshot image upload complete
Jul 31 10:05:54 user nova-compute[71113]: INFO nova.compute.manager [None req-c674974a-c6c8-4609-9993-8b867e2b96e7 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Took 5.91 seconds to snapshot the instance on the hypervisor.
Jul 31 10:05:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:05:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:06:00 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:06:02 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:06:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:06:07 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:06:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:06:11 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:06:12 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:06:12 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:06:12 user nova-compute[71113]: INFO nova.compute.manager [None req-a5cefca1-ae22-41fb-aebd-99c711d46a15 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Unrescuing
Jul 31 10:06:12 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-a5cefca1-ae22-41fb-aebd-99c711d46a15 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquiring lock "refresh_cache-52f1f390-1599-4dda-9418-f12a48ef582c" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:06:12 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-a5cefca1-ae22-41fb-aebd-99c711d46a15 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquired lock "refresh_cache-52f1f390-1599-4dda-9418-f12a48ef582c" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:06:12 user nova-compute[71113]: DEBUG nova.network.neutron [None req-a5cefca1-ae22-41fb-aebd-99c711d46a15 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 10:06:13 user nova-compute[71113]: DEBUG nova.network.neutron [None req-a5cefca1-ae22-41fb-aebd-99c711d46a15 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Updating instance_info_cache with network_info: [{"id": "6af975ec-2ae8-44fc-8762-90e9a13efbce", "address": "fa:16:3e:b2:53:f2", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af975ec-2a", "ovs_interfaceid": "6af975ec-2ae8-44fc-8762-90e9a13efbce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:06:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-a5cefca1-ae22-41fb-aebd-99c711d46a15 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Releasing lock "refresh_cache-52f1f390-1599-4dda-9418-f12a48ef582c" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:06:13 user nova-compute[71113]: DEBUG nova.objects.instance [None req-a5cefca1-ae22-41fb-aebd-99c711d46a15 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lazy-loading 'flavor' on Instance uuid 52f1f390-1599-4dda-9418-f12a48ef582c {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:06:13 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:06:13 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:06:13 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:06:13 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:06:14 user nova-compute[71113]: DEBUG nova.compute.manager [req-417782fa-9bcf-48b8-abf2-0c5a6de716db req-863596d9-72d9-4d96-ba3b-5b7bf77d3820 service nova] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Received event network-vif-unplugged-6af975ec-2ae8-44fc-8762-90e9a13efbce {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:06:14 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-417782fa-9bcf-48b8-abf2-0c5a6de716db req-863596d9-72d9-4d96-ba3b-5b7bf77d3820 service nova] Acquiring lock "52f1f390-1599-4dda-9418-f12a48ef582c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:06:14 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-417782fa-9bcf-48b8-abf2-0c5a6de716db req-863596d9-72d9-4d96-ba3b-5b7bf77d3820 service nova] Lock "52f1f390-1599-4dda-9418-f12a48ef582c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:06:14 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-417782fa-9bcf-48b8-abf2-0c5a6de716db req-863596d9-72d9-4d96-ba3b-5b7bf77d3820 service nova] Lock "52f1f390-1599-4dda-9418-f12a48ef582c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:06:14 user nova-compute[71113]: DEBUG nova.compute.manager [req-417782fa-9bcf-48b8-abf2-0c5a6de716db req-863596d9-72d9-4d96-ba3b-5b7bf77d3820 service nova] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] No waiting events found dispatching network-vif-unplugged-6af975ec-2ae8-44fc-8762-90e9a13efbce {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:06:14 user nova-compute[71113]: WARNING nova.compute.manager [req-417782fa-9bcf-48b8-abf2-0c5a6de716db req-863596d9-72d9-4d96-ba3b-5b7bf77d3820 service nova] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Received unexpected event network-vif-unplugged-6af975ec-2ae8-44fc-8762-90e9a13efbce for instance with vm_state rescued and task_state unrescuing.
Jul 31 10:06:14 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Instance destroyed successfully.
Jul 31 10:06:14 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:06:14 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:06:14 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:06:14 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:06:14 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:06:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:06:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:06:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:06:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:06:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:06:16 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 10:06:16 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 10:06:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c7bd88d-2991-4660-928e-298c0a0b2e18/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:06:16 user nova-compute[71113]: DEBUG nova.compute.manager [req-dca15cf7-0ed4-4093-8d31-f0c562d316eb req-4dbb5a94-fed7-430e-9d2b-ca5f5750c954 service nova] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Received event network-vif-plugged-6af975ec-2ae8-44fc-8762-90e9a13efbce {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:06:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-dca15cf7-0ed4-4093-8d31-f0c562d316eb req-4dbb5a94-fed7-430e-9d2b-ca5f5750c954 service nova] Acquiring lock "52f1f390-1599-4dda-9418-f12a48ef582c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:06:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-dca15cf7-0ed4-4093-8d31-f0c562d316eb req-4dbb5a94-fed7-430e-9d2b-ca5f5750c954 service nova] Lock "52f1f390-1599-4dda-9418-f12a48ef582c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:06:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-dca15cf7-0ed4-4093-8d31-f0c562d316eb req-4dbb5a94-fed7-430e-9d2b-ca5f5750c954 service nova] Lock "52f1f390-1599-4dda-9418-f12a48ef582c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:06:16 user nova-compute[71113]: DEBUG nova.compute.manager [req-dca15cf7-0ed4-4093-8d31-f0c562d316eb req-4dbb5a94-fed7-430e-9d2b-ca5f5750c954 service nova] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] No waiting events found dispatching network-vif-plugged-6af975ec-2ae8-44fc-8762-90e9a13efbce {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:06:16 user nova-compute[71113]: WARNING nova.compute.manager [req-dca15cf7-0ed4-4093-8d31-f0c562d316eb req-4dbb5a94-fed7-430e-9d2b-ca5f5750c954 service nova] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Received unexpected event network-vif-plugged-6af975ec-2ae8-44fc-8762-90e9a13efbce for instance with vm_state rescued and task_state unrescuing.
Jul 31 10:06:16 user nova-compute[71113]: DEBUG nova.compute.manager [req-dca15cf7-0ed4-4093-8d31-f0c562d316eb req-4dbb5a94-fed7-430e-9d2b-ca5f5750c954 service nova] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Received event network-vif-plugged-6af975ec-2ae8-44fc-8762-90e9a13efbce {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:06:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-dca15cf7-0ed4-4093-8d31-f0c562d316eb req-4dbb5a94-fed7-430e-9d2b-ca5f5750c954 service nova] Acquiring lock "52f1f390-1599-4dda-9418-f12a48ef582c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:06:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-dca15cf7-0ed4-4093-8d31-f0c562d316eb req-4dbb5a94-fed7-430e-9d2b-ca5f5750c954 service nova] Lock "52f1f390-1599-4dda-9418-f12a48ef582c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:06:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-dca15cf7-0ed4-4093-8d31-f0c562d316eb req-4dbb5a94-fed7-430e-9d2b-ca5f5750c954 service nova] Lock "52f1f390-1599-4dda-9418-f12a48ef582c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:06:16 user nova-compute[71113]: DEBUG nova.compute.manager [req-dca15cf7-0ed4-4093-8d31-f0c562d316eb req-4dbb5a94-fed7-430e-9d2b-ca5f5750c954 service nova] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] No waiting events found dispatching network-vif-plugged-6af975ec-2ae8-44fc-8762-90e9a13efbce {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:06:16 user nova-compute[71113]: WARNING nova.compute.manager [req-dca15cf7-0ed4-4093-8d31-f0c562d316eb req-4dbb5a94-fed7-430e-9d2b-ca5f5750c954 service nova] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Received unexpected event network-vif-plugged-6af975ec-2ae8-44fc-8762-90e9a13efbce for instance with vm_state rescued and task_state unrescuing.
Jul 31 10:06:16 user nova-compute[71113]: DEBUG nova.compute.manager [req-dca15cf7-0ed4-4093-8d31-f0c562d316eb req-4dbb5a94-fed7-430e-9d2b-ca5f5750c954 service nova] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Received event network-vif-plugged-6af975ec-2ae8-44fc-8762-90e9a13efbce {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:06:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-dca15cf7-0ed4-4093-8d31-f0c562d316eb req-4dbb5a94-fed7-430e-9d2b-ca5f5750c954 service nova] Acquiring lock "52f1f390-1599-4dda-9418-f12a48ef582c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:06:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-dca15cf7-0ed4-4093-8d31-f0c562d316eb req-4dbb5a94-fed7-430e-9d2b-ca5f5750c954 service nova] Lock "52f1f390-1599-4dda-9418-f12a48ef582c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:06:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-dca15cf7-0ed4-4093-8d31-f0c562d316eb req-4dbb5a94-fed7-430e-9d2b-ca5f5750c954 service nova] Lock "52f1f390-1599-4dda-9418-f12a48ef582c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:06:16 user nova-compute[71113]: DEBUG nova.compute.manager [req-dca15cf7-0ed4-4093-8d31-f0c562d316eb req-4dbb5a94-fed7-430e-9d2b-ca5f5750c954 service nova] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] No waiting events found dispatching network-vif-plugged-6af975ec-2ae8-44fc-8762-90e9a13efbce {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:06:16 user nova-compute[71113]: WARNING nova.compute.manager [req-dca15cf7-0ed4-4093-8d31-f0c562d316eb req-4dbb5a94-fed7-430e-9d2b-ca5f5750c954 service nova] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Received unexpected event network-vif-plugged-6af975ec-2ae8-44fc-8762-90e9a13efbce for instance with vm_state rescued and task_state unrescuing.
Jul 31 10:06:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c7bd88d-2991-4660-928e-298c0a0b2e18/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:06:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c7bd88d-2991-4660-928e-298c0a0b2e18/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:06:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c7bd88d-2991-4660-928e-298c0a0b2e18/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:06:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f020f166-07b6-4cf5-9f17-2ab108b55c30/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:06:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f020f166-07b6-4cf5-9f17-2ab108b55c30/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:06:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f020f166-07b6-4cf5-9f17-2ab108b55c30/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:06:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f020f166-07b6-4cf5-9f17-2ab108b55c30/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:06:16 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 10:06:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:06:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:06:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:06:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:06:16 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:06:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:06:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:06:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:06:17 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:06:17 user nova-compute[71113]: DEBUG nova.compute.manager [None req-a5cefca1-ae22-41fb-aebd-99c711d46a15 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:06:17 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Removed pending event for 52f1f390-1599-4dda-9418-f12a48ef582c due to event {{(pid=71113) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 31 10:06:17 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797977.5952682, 52f1f390-1599-4dda-9418-f12a48ef582c => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:06:17 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] VM Resumed (Lifecycle Event)
Jul 31 10:06:17 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:06:17 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:06:17 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=8024MB free_disk=25.076400756835938GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:06:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:06:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:06:17 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:06:17 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:06:17 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 31 10:06:17 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690797977.596329, 52f1f390-1599-4dda-9418-f12a48ef582c => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:06:17 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] VM Started (Lifecycle Event)
Jul 31 10:06:17 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:06:17 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:06:17 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 31 10:06:17 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 3157a7a6-b8a9-4e2d-a157-360bce4c625d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:06:17 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 92d25a03-98ce-4bde-a3cc-20313ae77d41 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:06:17 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance f020f166-07b6-4cf5-9f17-2ab108b55c30 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:06:17 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 52f1f390-1599-4dda-9418-f12a48ef582c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:06:17 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 95a84d3c-7aa2-4294-a419-995926a2782f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:06:17 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 2c7bd88d-2991-4660-928e-298c0a0b2e18 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:06:17 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 5ffa30ea-7458-4914-a6f4-9d8310ca977c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:06:17 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:06:17 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:06:18 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:06:18 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:06:18 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:06:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.371s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:06:20 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:06:20 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:06:20 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:06:20 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:06:20 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:06:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:06:20 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:06:20 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:06:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "refresh_cache-f020f166-07b6-4cf5-9f17-2ab108b55c30" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:06:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquired lock "refresh_cache-f020f166-07b6-4cf5-9f17-2ab108b55c30" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:06:21 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Forcefully refreshing network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 10:06:21 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Updating instance_info_cache with network_info: [{"id": "88414b9a-7489-4664-9eff-ef29d6fce020", "address": "fa:16:3e:ec:d1:0f", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88414b9a-74", "ovs_interfaceid": "88414b9a-7489-4664-9eff-ef29d6fce020", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:06:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Releasing lock "refresh_cache-f020f166-07b6-4cf5-9f17-2ab108b55c30" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:06:21 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Updated the network info_cache for instance {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 10:06:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:06:22 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:06:24 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:06:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:06:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:06:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:06:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:06:35 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "5145337d-6a13-4107-a636-6d817efcc434" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:06:35 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "5145337d-6a13-4107-a636-6d817efcc434" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:06:35 user nova-compute[71113]: DEBUG nova.compute.manager [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Starting instance... {{(pid=71113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 10:06:35 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:06:35 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:06:35 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 10:06:35 user nova-compute[71113]: INFO nova.compute.claims [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Claim successful on node user
Jul 31 10:06:35 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:06:35 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:06:35 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.354s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:06:35 user nova-compute[71113]: DEBUG nova.compute.manager [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Start building networks asynchronously for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 10:06:35 user nova-compute[71113]: DEBUG nova.compute.manager [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Allocating IP information in the background. {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 10:06:35 user nova-compute[71113]: DEBUG nova.network.neutron [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 5145337d-6a13-4107-a636-6d817efcc434] allocate_for_instance() {{(pid=71113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 10:06:36 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 10:06:36 user nova-compute[71113]: DEBUG nova.compute.manager [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Start building block device mappings for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 10:06:36 user nova-compute[71113]: INFO nova.virt.block_device [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Booting with volume 393f83a1-d2bd-43b9-a499-cee6c4f93fb3 at /dev/vda
Jul 31 10:06:36 user nova-compute[71113]: DEBUG nova.policy [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a58fe92488ed47b696fc5d6d990b1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa2add2e2a24b9cb8e48042b06931d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71113) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 10:06:36 user nova-compute[71113]: DEBUG os_brick.utils [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:06:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:06:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:06:36 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4b7b23-8375-4265-b7f1-1a69775ae076]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:06:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:06:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:06:36 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ca7a27-96b4-4238-b96d-f27c3c58dffd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:06:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:06:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:06:36 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a4b81f-430a-4da4-bd98-b39fd4f94a86]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:06:36 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65c0106-55b8-4234-bce4-67ea09f27b6a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:06:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:06:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 10:06:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 10:06:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:06:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 10:06:36 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 10:06:36 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0d79ec-a91e-4ea0-96ac-87dcb47e7273]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:06:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 10:06:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 10:06:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 10:06:36 user nova-compute[71113]: DEBUG os_brick.utils [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:06:36 user nova-compute[71113]: DEBUG nova.virt.block_device [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Updating existing volume attachment record: 9f440a27-5fb3-4692-b69c-cbf3c3812f25 {{(pid=71113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 10:06:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:06:37 user nova-compute[71113]: DEBUG nova.network.neutron [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Successfully created port: ba4973f9-3752-466c-988a-9aca7185c5e0 {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 10:06:38 user nova-compute[71113]: DEBUG nova.network.neutron [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Successfully updated port: ba4973f9-3752-466c-988a-9aca7185c5e0 {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 10:06:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "refresh_cache-5145337d-6a13-4107-a636-6d817efcc434" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:06:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquired lock "refresh_cache-5145337d-6a13-4107-a636-6d817efcc434" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:06:38 user nova-compute[71113]: DEBUG nova.network.neutron [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 10:06:38 user nova-compute[71113]: DEBUG nova.compute.manager [req-80eb7610-8dde-4cbe-8fc2-d11ff2576fe8 req-dfd40be6-fe14-4f13-bea6-26ca57ba05e0 service nova] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Received event network-changed-ba4973f9-3752-466c-988a-9aca7185c5e0 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:06:38 user nova-compute[71113]: DEBUG nova.compute.manager [req-80eb7610-8dde-4cbe-8fc2-d11ff2576fe8 req-dfd40be6-fe14-4f13-bea6-26ca57ba05e0 service nova] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Refreshing instance network info cache due to event network-changed-ba4973f9-3752-466c-988a-9aca7185c5e0. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 10:06:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-80eb7610-8dde-4cbe-8fc2-d11ff2576fe8 req-dfd40be6-fe14-4f13-bea6-26ca57ba05e0 service nova] Acquiring lock "refresh_cache-5145337d-6a13-4107-a636-6d817efcc434" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:06:38 user nova-compute[71113]: DEBUG nova.network.neutron [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 10:06:38 user nova-compute[71113]: DEBUG nova.network.neutron [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Updating instance_info_cache with network_info: [{"id": "ba4973f9-3752-466c-988a-9aca7185c5e0", "address": "fa:16:3e:0e:1e:5d", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4973f9-37", "ovs_interfaceid": "ba4973f9-3752-466c-988a-9aca7185c5e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:06:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Releasing lock "refresh_cache-5145337d-6a13-4107-a636-6d817efcc434" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:06:38 user nova-compute[71113]: DEBUG nova.compute.manager [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Instance network_info: |[{"id": "ba4973f9-3752-466c-988a-9aca7185c5e0", "address": "fa:16:3e:0e:1e:5d", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4973f9-37", "ovs_interfaceid": "ba4973f9-3752-466c-988a-9aca7185c5e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 10:06:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-80eb7610-8dde-4cbe-8fc2-d11ff2576fe8 req-dfd40be6-fe14-4f13-bea6-26ca57ba05e0 service nova] Acquired lock "refresh_cache-5145337d-6a13-4107-a636-6d817efcc434" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:06:38 user nova-compute[71113]: DEBUG nova.network.neutron [req-80eb7610-8dde-4cbe-8fc2-d11ff2576fe8 req-dfd40be6-fe14-4f13-bea6-26ca57ba05e0 service nova] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Refreshing network info cache for port ba4973f9-3752-466c-988a-9aca7185c5e0 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 10:06:39 user nova-compute[71113]: DEBUG nova.network.neutron [req-80eb7610-8dde-4cbe-8fc2-d11ff2576fe8 req-dfd40be6-fe14-4f13-bea6-26ca57ba05e0 service nova] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Updated VIF entry in instance network info cache for port ba4973f9-3752-466c-988a-9aca7185c5e0. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 10:06:39 user nova-compute[71113]: DEBUG nova.network.neutron [req-80eb7610-8dde-4cbe-8fc2-d11ff2576fe8 req-dfd40be6-fe14-4f13-bea6-26ca57ba05e0 service nova] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Updating instance_info_cache with network_info: [{"id": "ba4973f9-3752-466c-988a-9aca7185c5e0", "address": "fa:16:3e:0e:1e:5d", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4973f9-37", "ovs_interfaceid": "ba4973f9-3752-466c-988a-9aca7185c5e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:06:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-80eb7610-8dde-4cbe-8fc2-d11ff2576fe8 req-dfd40be6-fe14-4f13-bea6-26ca57ba05e0 service nova] Releasing lock "refresh_cache-5145337d-6a13-4107-a636-6d817efcc434" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:06:40 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:06:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:06:43 user nova-compute[71113]: DEBUG nova.compute.manager [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Start spawning the instance on the hypervisor. {{(pid=71113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 10:06:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 10:06:43 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Creating image(s)
Jul 31 10:06:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Did not create local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 10:06:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Ensure instance console log exists: /opt/stack/data/nova/instances/5145337d-6a13-4107-a636-6d817efcc434/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 10:06:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:06:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:06:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:06:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Start _get_guest_xml network_info=[{"id": "ba4973f9-3752-466c-988a-9aca7185c5e0", "address": "fa:16:3e:0e:1e:5d", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4973f9-37", "ovs_interfaceid": "ba4973f9-3752-466c-988a-9aca7185c5e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '9f440a27-5fb3-4692-b69c-cbf3c3812f25', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cYTyAjsO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5145337d-6a13-4107-a636-6d817efcc434', 'attached_at': '', 'detached_at': '', 'volume_id': '393f83a1-d2bd-43b9-a499-cee6c4f93fb3', 'serial': '393f83a1-d2bd-43b9-a499-cee6c4f93fb3'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 10:06:43 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:06:43 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:06:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 10:06:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 10:06:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 10:06:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 10:06:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 10:06:43 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 10:06:43 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 10:06:43 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 10:06:43 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 10:06:43 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 10:06:43 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 10:06:43 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 10:06:43 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 10:06:43 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 10:06:43 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 10:06:43 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 10:06:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 10:06:43 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cYTyAjsO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:06:43 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:06:43 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:06:43 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:06:43 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:06:43 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:06:43 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:06:43 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 10:06:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:06:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:06:43 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3834cb42-6ae8-4603-9c5a-0af982b0cea0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:06:43 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 10:06:43 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:06:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:06:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:06:43 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0e4d37-1f47-42eb-8740-6f67632b91b0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:06:43 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3] added
Jul 31 10:06:43 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:06:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:06:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:06:43 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc2cea6-01c1-4c37-98a7-cc8f0c939f82]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:06:43 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:06:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:06:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:06:43 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[511eb1bd-ca30-40bb-a7a3-ba882795d3bf]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:06:43 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:06:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cYTyAjsO {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:06:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cYTyAjsO" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:06:43 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a755be0a-c2e9-4c97-b2ea-9b6c7ad7c85d]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:06:43 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cYTyAjsO'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:06:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:06:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:06:43 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee46782-d986-468b-905c-4df569acc4a2]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:06:43 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:06:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:06:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:06:44 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7108971b-a3af-4c4d-b2e6-68e30c1ad1fe]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:06:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:06:44 user nova-compute[71113]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)
Jul 31 10:06:44 user nova-compute[71113]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d (non-flash)
Jul 31 10:06:44 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:06:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:06:44 user nova-compute[71113]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)
Jul 31 10:06:44 user nova-compute[71113]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d (non-flash)
Jul 31 10:06:44 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:06:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:06:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:06:44 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6a6e79-b6b1-4349-b271-45dd777a877d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:06:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3, portal: 172.16.0.220,3260]
Jul 31 10:06:44 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3, portal: 172.16.0.220,3260] successful.
Jul 31 10:06:44 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:06:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:06:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:06:44 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[80135d4f-ff58-46b9-b50b-74a3edf9b6fb]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:06:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:06:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:06:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:06:44 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3aee57d-b5e9-4676-853e-a908b91dc49f]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:06:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:06:44 user nova-compute[71113]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)
Jul 31 10:06:44 user nova-compute[71113]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d (non-flash)
Jul 31 10:06:44 user nova-compute[71113]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)
Jul 31 10:06:44 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:06:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:06:44 user nova-compute[71113]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)
Jul 31 10:06:44 user nova-compute[71113]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d (non-flash)
Jul 31 10:06:44 user nova-compute[71113]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)
Jul 31 10:06:44 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:06:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:06:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 10:06:44 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 10:06:44 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 10:06:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:06:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:06:44 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[739951ec-065c-4478-baf9-5109b0abaaca]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:06:44 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 10:06:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cYTyAjsO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 10:06:45 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:06:45 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '26636373265653962', 'path': '/dev/sdc'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:06:45 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636373265653962', 'path': '/dev/sdc'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 10:06:45 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:06:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1409391423',display_name='tempest-TestVolumeBootPattern-server-1409391423',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1409391423',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHyhNSNVW4Lo+ZOw5JhvHTNH16DxMgCVmk57hIQmCoVWxH+PN+/8jM3YwsIxSsGBxRIiU3keHG6Pnt6GG0CTGlGIZ1kKVEix0HYiRgqMpyBqoT4aBeWmvyv0uyNPZ+vFFg==',key_name='tempest-TestVolumeBootPattern-165282511',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3aa2add2e2a24b9cb8e48042b06931d3',ramdisk_id='',reservation_id='r-80i82qmg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1754399827',owner_user_name='tempest-TestVolumeBootPattern-1754399827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T10:06:36Z,user_data=None,user_id='a58fe92488ed47b696fc5d6d990b1acd',uuid=5145337d-6a13-4107-a636-6d817efcc434,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba4973f9-3752-466c-988a-9aca7185c5e0", "address": "fa:16:3e:0e:1e:5d", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4973f9-37", "ovs_interfaceid": "ba4973f9-3752-466c-988a-9aca7185c5e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 10:06:45 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Converting VIF {"id": "ba4973f9-3752-466c-988a-9aca7185c5e0", "address": "fa:16:3e:0e:1e:5d", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4973f9-37", "ovs_interfaceid": "ba4973f9-3752-466c-988a-9aca7185c5e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:06:45 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:1e:5d,bridge_name='br-int',has_traffic_filtering=True,id=ba4973f9-3752-466c-988a-9aca7185c5e0,network=Network(fa792d7a-ddf6-4a2d-acb9-802f8daf87ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4973f9-37') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:06:45 user nova-compute[71113]: DEBUG nova.objects.instance [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lazy-loading 'pci_devices' on Instance uuid 5145337d-6a13-4107-a636-6d817efcc434 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:06:45 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 5145337d-6a13-4107-a636-6d817efcc434] End _get_guest_xml xml=<domain type="kvm">
Jul 31 10:06:45 user nova-compute[71113]:   <uuid>5145337d-6a13-4107-a636-6d817efcc434</uuid>
Jul 31 10:06:45 user nova-compute[71113]:   <name>instance-00000026</name>
Jul 31 10:06:45 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 10:06:45 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 10:06:45 user nova-compute[71113]:   <metadata>
Jul 31 10:06:45 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 10:06:45 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 10:06:45 user nova-compute[71113]:       <nova:name>tempest-TestVolumeBootPattern-server-1409391423</nova:name>
Jul 31 10:06:45 user nova-compute[71113]:       <nova:creationTime>2023-07-31 10:06:43</nova:creationTime>
Jul 31 10:06:45 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 10:06:45 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 10:06:45 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 10:06:45 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 10:06:45 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 10:06:45 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 10:06:45 user nova-compute[71113]:       </nova:flavor>
Jul 31 10:06:45 user nova-compute[71113]:       <nova:owner>
Jul 31 10:06:45 user nova-compute[71113]:         <nova:user uuid="a58fe92488ed47b696fc5d6d990b1acd">tempest-TestVolumeBootPattern-1754399827-project-member</nova:user>
Jul 31 10:06:45 user nova-compute[71113]:         <nova:project uuid="3aa2add2e2a24b9cb8e48042b06931d3">tempest-TestVolumeBootPattern-1754399827</nova:project>
Jul 31 10:06:45 user nova-compute[71113]:       </nova:owner>
Jul 31 10:06:45 user nova-compute[71113]:       <nova:ports>
Jul 31 10:06:45 user nova-compute[71113]:         <nova:port uuid="ba4973f9-3752-466c-988a-9aca7185c5e0">
Jul 31 10:06:45 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 31 10:06:45 user nova-compute[71113]:         </nova:port>
Jul 31 10:06:45 user nova-compute[71113]:       </nova:ports>
Jul 31 10:06:45 user nova-compute[71113]:     </nova:instance>
Jul 31 10:06:45 user nova-compute[71113]:   </metadata>
Jul 31 10:06:45 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 10:06:45 user nova-compute[71113]:     <system>
Jul 31 10:06:45 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 10:06:45 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 10:06:45 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 10:06:45 user nova-compute[71113]:       <entry name="serial">5145337d-6a13-4107-a636-6d817efcc434</entry>
Jul 31 10:06:45 user nova-compute[71113]:       <entry name="uuid">5145337d-6a13-4107-a636-6d817efcc434</entry>
Jul 31 10:06:45 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 10:06:45 user nova-compute[71113]:     </system>
Jul 31 10:06:45 user nova-compute[71113]:   </sysinfo>
Jul 31 10:06:45 user nova-compute[71113]:   <os>
Jul 31 10:06:45 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 10:06:45 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 10:06:45 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 10:06:45 user nova-compute[71113]:   </os>
Jul 31 10:06:45 user nova-compute[71113]:   <features>
Jul 31 10:06:45 user nova-compute[71113]:     <acpi/>
Jul 31 10:06:45 user nova-compute[71113]:     <apic/>
Jul 31 10:06:45 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 10:06:45 user nova-compute[71113]:   </features>
Jul 31 10:06:45 user nova-compute[71113]:   <clock offset="utc">
Jul 31 10:06:45 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 10:06:45 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 10:06:45 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 10:06:45 user nova-compute[71113]:   </clock>
Jul 31 10:06:45 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 10:06:45 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 10:06:45 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 10:06:45 user nova-compute[71113]:   </cpu>
Jul 31 10:06:45 user nova-compute[71113]:   <devices>
Jul 31 10:06:45 user nova-compute[71113]:     <disk type="block" device="disk">
Jul 31 10:06:45 user nova-compute[71113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:06:45 user nova-compute[71113]:       <source dev="/dev/sdc"/>
Jul 31 10:06:45 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 10:06:45 user nova-compute[71113]:       <serial>393f83a1-d2bd-43b9-a499-cee6c4f93fb3</serial>
Jul 31 10:06:45 user nova-compute[71113]:     </disk>
Jul 31 10:06:45 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 10:06:45 user nova-compute[71113]:       <mac address="fa:16:3e:0e:1e:5d"/>
Jul 31 10:06:45 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:06:45 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 10:06:45 user nova-compute[71113]:       <target dev="tapba4973f9-37"/>
Jul 31 10:06:45 user nova-compute[71113]:     </interface>
Jul 31 10:06:45 user nova-compute[71113]:     <serial type="pty">
Jul 31 10:06:45 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/5145337d-6a13-4107-a636-6d817efcc434/console.log" append="off"/>
Jul 31 10:06:45 user nova-compute[71113]:     </serial>
Jul 31 10:06:45 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 10:06:45 user nova-compute[71113]:     <video>
Jul 31 10:06:45 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:06:45 user nova-compute[71113]:     </video>
Jul 31 10:06:45 user nova-compute[71113]:     <rng model="virtio">
Jul 31 10:06:45 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 10:06:45 user nova-compute[71113]:     </rng>
Jul 31 10:06:45 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 10:06:45 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 10:06:45 user nova-compute[71113]:       <stats period="10"/>
Jul 31 10:06:45 user nova-compute[71113]:     </memballoon>
Jul 31 10:06:45 user nova-compute[71113]:   </devices>
Jul 31 10:06:45 user nova-compute[71113]: </domain>
Jul 31 10:06:45 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 10:06:45 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:06:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1409391423',display_name='tempest-TestVolumeBootPattern-server-1409391423',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1409391423',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHyhNSNVW4Lo+ZOw5JhvHTNH16DxMgCVmk57hIQmCoVWxH+PN+/8jM3YwsIxSsGBxRIiU3keHG6Pnt6GG0CTGlGIZ1kKVEix0HYiRgqMpyBqoT4aBeWmvyv0uyNPZ+vFFg==',key_name='tempest-TestVolumeBootPattern-165282511',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3aa2add2e2a24b9cb8e48042b06931d3',ramdisk_id='',reservation_id='r-80i82qmg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1754399827',owner_user_name='tempest-TestVolumeBootPattern-1754399827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T10:06:36Z,user_data=None,user_id='a58fe92488ed47b696fc5d6d990b1acd',uuid=5145337d-6a13-4107-a636-6d817efcc434,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba4973f9-3752-466c-988a-9aca7185c5e0", "address": "fa:16:3e:0e:1e:5d", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4973f9-37", "ovs_interfaceid": "ba4973f9-3752-466c-988a-9aca7185c5e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 10:06:45 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Converting VIF {"id": "ba4973f9-3752-466c-988a-9aca7185c5e0", "address": "fa:16:3e:0e:1e:5d", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4973f9-37", "ovs_interfaceid": "ba4973f9-3752-466c-988a-9aca7185c5e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:06:45 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:1e:5d,bridge_name='br-int',has_traffic_filtering=True,id=ba4973f9-3752-466c-988a-9aca7185c5e0,network=Network(fa792d7a-ddf6-4a2d-acb9-802f8daf87ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4973f9-37') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:06:45 user nova-compute[71113]: DEBUG os_vif [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:1e:5d,bridge_name='br-int',has_traffic_filtering=True,id=ba4973f9-3752-466c-988a-9aca7185c5e0,network=Network(fa792d7a-ddf6-4a2d-acb9-802f8daf87ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4973f9-37') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 10:06:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:06:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:06:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 10:06:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:06:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba4973f9-37, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:06:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapba4973f9-37, col_values=(('external_ids', {'iface-id': 'ba4973f9-3752-466c-988a-9aca7185c5e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:1e:5d', 'vm-uuid': '5145337d-6a13-4107-a636-6d817efcc434'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:06:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:06:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:06:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:06:45 user nova-compute[71113]: INFO os_vif [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:1e:5d,bridge_name='br-int',has_traffic_filtering=True,id=ba4973f9-3752-466c-988a-9aca7185c5e0,network=Network(fa792d7a-ddf6-4a2d-acb9-802f8daf87ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4973f9-37')
Jul 31 10:06:45 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:06:45 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] No VIF found with MAC fa:16:3e:0e:1e:5d, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 10:06:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:06:46 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:06:46 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:06:46 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:06:46 user nova-compute[71113]: DEBUG nova.compute.manager [req-7fe7b1c4-7bec-4e60-a537-4dc80f055886 req-d2a7ce4d-fc2b-44c9-8df1-d40ab4873f73 service nova] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Received event network-vif-plugged-ba4973f9-3752-466c-988a-9aca7185c5e0 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:06:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7fe7b1c4-7bec-4e60-a537-4dc80f055886 req-d2a7ce4d-fc2b-44c9-8df1-d40ab4873f73 service nova] Acquiring lock "5145337d-6a13-4107-a636-6d817efcc434-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:06:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7fe7b1c4-7bec-4e60-a537-4dc80f055886 req-d2a7ce4d-fc2b-44c9-8df1-d40ab4873f73 service nova] Lock "5145337d-6a13-4107-a636-6d817efcc434-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:06:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7fe7b1c4-7bec-4e60-a537-4dc80f055886 req-d2a7ce4d-fc2b-44c9-8df1-d40ab4873f73 service nova] Lock "5145337d-6a13-4107-a636-6d817efcc434-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:06:46 user nova-compute[71113]: DEBUG nova.compute.manager [req-7fe7b1c4-7bec-4e60-a537-4dc80f055886 req-d2a7ce4d-fc2b-44c9-8df1-d40ab4873f73 service nova] [instance: 5145337d-6a13-4107-a636-6d817efcc434] No waiting events found dispatching network-vif-plugged-ba4973f9-3752-466c-988a-9aca7185c5e0 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:06:46 user nova-compute[71113]: WARNING nova.compute.manager [req-7fe7b1c4-7bec-4e60-a537-4dc80f055886 req-d2a7ce4d-fc2b-44c9-8df1-d40ab4873f73 service nova] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Received unexpected event network-vif-plugged-ba4973f9-3752-466c-988a-9aca7185c5e0 for instance with vm_state building and task_state spawning.
Jul 31 10:06:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:06:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:06:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:06:48 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690798008.7509723, 5145337d-6a13-4107-a636-6d817efcc434 => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:06:48 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 5145337d-6a13-4107-a636-6d817efcc434] VM Resumed (Lifecycle Event)
Jul 31 10:06:48 user nova-compute[71113]: DEBUG nova.compute.manager [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 10:06:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 10:06:48 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Instance spawned successfully.
Jul 31 10:06:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 10:06:48 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:06:48 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:06:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Found default for hw_cdrom_bus of ide {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:06:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Found default for hw_disk_bus of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:06:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Found default for hw_input_bus of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:06:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Found default for hw_pointer_model of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:06:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Found default for hw_video_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:06:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Found default for hw_vif_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:06:48 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 5145337d-6a13-4107-a636-6d817efcc434] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 10:06:48 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690798008.753266, 5145337d-6a13-4107-a636-6d817efcc434 => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:06:48 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 5145337d-6a13-4107-a636-6d817efcc434] VM Started (Lifecycle Event)
Jul 31 10:06:48 user nova-compute[71113]: DEBUG nova.compute.manager [req-ad44e688-78bc-47a0-9d84-8ac5eebf8043 req-a6ab0aa8-21d4-43a3-af45-f4904462ae32 service nova] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Received event network-vif-plugged-ba4973f9-3752-466c-988a-9aca7185c5e0 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:06:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ad44e688-78bc-47a0-9d84-8ac5eebf8043 req-a6ab0aa8-21d4-43a3-af45-f4904462ae32 service nova] Acquiring lock "5145337d-6a13-4107-a636-6d817efcc434-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:06:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ad44e688-78bc-47a0-9d84-8ac5eebf8043 req-a6ab0aa8-21d4-43a3-af45-f4904462ae32 service nova] Lock "5145337d-6a13-4107-a636-6d817efcc434-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:06:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ad44e688-78bc-47a0-9d84-8ac5eebf8043 req-a6ab0aa8-21d4-43a3-af45-f4904462ae32 service nova] Lock "5145337d-6a13-4107-a636-6d817efcc434-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:06:48 user nova-compute[71113]: DEBUG nova.compute.manager [req-ad44e688-78bc-47a0-9d84-8ac5eebf8043 req-a6ab0aa8-21d4-43a3-af45-f4904462ae32 service nova] [instance: 5145337d-6a13-4107-a636-6d817efcc434] No waiting events found dispatching network-vif-plugged-ba4973f9-3752-466c-988a-9aca7185c5e0 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:06:48 user nova-compute[71113]: WARNING nova.compute.manager [req-ad44e688-78bc-47a0-9d84-8ac5eebf8043 req-a6ab0aa8-21d4-43a3-af45-f4904462ae32 service nova] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Received unexpected event network-vif-plugged-ba4973f9-3752-466c-988a-9aca7185c5e0 for instance with vm_state building and task_state spawning.
Jul 31 10:06:48 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:06:48 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:06:48 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 5145337d-6a13-4107-a636-6d817efcc434] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 10:06:48 user nova-compute[71113]: INFO nova.compute.manager [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Took 5.14 seconds to spawn the instance on the hypervisor.
Jul 31 10:06:48 user nova-compute[71113]: DEBUG nova.compute.manager [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:06:48 user nova-compute[71113]: INFO nova.compute.manager [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Took 13.45 seconds to build instance.
Jul 31 10:06:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9d9a051f-7a3e-4f05-87ce-2a465c991aee tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "5145337d-6a13-4107-a636-6d817efcc434" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.547s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:06:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:06:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:06:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:07:00 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:07:00 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:07:00 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:07:00 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:07:00 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:07:00 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:07:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:07:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:07:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:07:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:07:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:07:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:07:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:07:09 user nova-compute[71113]: DEBUG nova.compute.manager [req-7ede677d-2cb5-490e-b12b-6c05deea4c5d req-d090a425-59e3-437f-9fba-767f3460d3ec service nova] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Received event network-changed-3a203223-ccaa-4246-960c-686b0f431f07 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:07:09 user nova-compute[71113]: DEBUG nova.compute.manager [req-7ede677d-2cb5-490e-b12b-6c05deea4c5d req-d090a425-59e3-437f-9fba-767f3460d3ec service nova] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Refreshing instance network info cache due to event network-changed-3a203223-ccaa-4246-960c-686b0f431f07. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 10:07:09 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7ede677d-2cb5-490e-b12b-6c05deea4c5d req-d090a425-59e3-437f-9fba-767f3460d3ec service nova] Acquiring lock "refresh_cache-2c7bd88d-2991-4660-928e-298c0a0b2e18" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:07:09 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7ede677d-2cb5-490e-b12b-6c05deea4c5d req-d090a425-59e3-437f-9fba-767f3460d3ec service nova] Acquired lock "refresh_cache-2c7bd88d-2991-4660-928e-298c0a0b2e18" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:07:09 user nova-compute[71113]: DEBUG nova.network.neutron [req-7ede677d-2cb5-490e-b12b-6c05deea4c5d req-d090a425-59e3-437f-9fba-767f3460d3ec service nova] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Refreshing network info cache for port 3a203223-ccaa-4246-960c-686b0f431f07 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 10:07:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:07:10 user nova-compute[71113]: DEBUG nova.network.neutron [req-7ede677d-2cb5-490e-b12b-6c05deea4c5d req-d090a425-59e3-437f-9fba-767f3460d3ec service nova] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Updated VIF entry in instance network info cache for port 3a203223-ccaa-4246-960c-686b0f431f07. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 10:07:10 user nova-compute[71113]: DEBUG nova.network.neutron [req-7ede677d-2cb5-490e-b12b-6c05deea4c5d req-d090a425-59e3-437f-9fba-767f3460d3ec service nova] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Updating instance_info_cache with network_info: [{"id": "3a203223-ccaa-4246-960c-686b0f431f07", "address": "fa:16:3e:a1:ae:09", "network": {"id": "4b030626-e3f1-4617-89c2-f6389226652f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441335951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7000d6a2a6b147ddbc38208b316574cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a203223-cc", "ovs_interfaceid": "3a203223-ccaa-4246-960c-686b0f431f07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:07:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7ede677d-2cb5-490e-b12b-6c05deea4c5d req-d090a425-59e3-437f-9fba-767f3460d3ec service nova] Releasing lock "refresh_cache-2c7bd88d-2991-4660-928e-298c0a0b2e18" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:07:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:07:12 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:07:12 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:07:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-d1f40128-4539-45f6-a43c-d40ded51083c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquiring lock "2c7bd88d-2991-4660-928e-298c0a0b2e18" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:07:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-d1f40128-4539-45f6-a43c-d40ded51083c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "2c7bd88d-2991-4660-928e-298c0a0b2e18" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:07:13 user nova-compute[71113]: DEBUG nova.objects.instance [None req-d1f40128-4539-45f6-a43c-d40ded51083c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lazy-loading 'flavor' on Instance uuid 2c7bd88d-2991-4660-928e-298c0a0b2e18 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:07:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-d1f40128-4539-45f6-a43c-d40ded51083c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "2c7bd88d-2991-4660-928e-298c0a0b2e18" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:07:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-d1f40128-4539-45f6-a43c-d40ded51083c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquiring lock "2c7bd88d-2991-4660-928e-298c0a0b2e18" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:07:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-d1f40128-4539-45f6-a43c-d40ded51083c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "2c7bd88d-2991-4660-928e-298c0a0b2e18" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:07:13 user nova-compute[71113]: INFO nova.compute.manager [None req-d1f40128-4539-45f6-a43c-d40ded51083c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Attaching volume 0611f81f-a00b-45e2-9cdb-f046e672b833 to /dev/vdb
Jul 31 10:07:13 user nova-compute[71113]: DEBUG os_brick.utils [None req-d1f40128-4539-45f6-a43c-d40ded51083c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:07:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:13 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1e9c00-3401-4079-b9d3-73c37ddc9f05]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:07:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:13 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f46310-4697-4007-89df-0b5abe7793e7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:07:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:13 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b78810-cab7-4336-a396-5cedeb8aed82]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:07:13 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3a5fd9-65a4-48a0-9a82-a637c500eb7b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:07:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-d1f40128-4539-45f6-a43c-d40ded51083c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-d1f40128-4539-45f6-a43c-d40ded51083c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 10:07:13 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d1f40128-4539-45f6-a43c-d40ded51083c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 10:07:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 10:07:13 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 10:07:13 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5485cf2b-c1d8-4ddd-b92e-8daf31ccc2fe]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:07:13 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-d1f40128-4539-45f6-a43c-d40ded51083c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 10:07:13 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-d1f40128-4539-45f6-a43c-d40ded51083c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 10:07:13 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-d1f40128-4539-45f6-a43c-d40ded51083c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 10:07:13 user nova-compute[71113]: DEBUG os_brick.utils [None req-d1f40128-4539-45f6-a43c-d40ded51083c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:07:13 user nova-compute[71113]: DEBUG nova.virt.block_device [None req-d1f40128-4539-45f6-a43c-d40ded51083c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Updating existing volume attachment record: 442b4d51-9cd7-4503-8a7b-56181332887c {{(pid=71113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 10:07:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:07:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:07:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:07:16 user nova-compute[71113]: DEBUG nova.compute.manager [req-a4fc4034-effa-435c-9194-48a6b900d218 req-b609fde5-ce81-4c13-9392-3ae6cfb19112 service nova] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Received event network-changed-8a38b464-522f-48bd-90b6-4447f9a6eb21 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:07:16 user nova-compute[71113]: DEBUG nova.compute.manager [req-a4fc4034-effa-435c-9194-48a6b900d218 req-b609fde5-ce81-4c13-9392-3ae6cfb19112 service nova] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Refreshing instance network info cache due to event network-changed-8a38b464-522f-48bd-90b6-4447f9a6eb21. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 10:07:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-a4fc4034-effa-435c-9194-48a6b900d218 req-b609fde5-ce81-4c13-9392-3ae6cfb19112 service nova] Acquiring lock "refresh_cache-5ffa30ea-7458-4914-a6f4-9d8310ca977c" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:07:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-a4fc4034-effa-435c-9194-48a6b900d218 req-b609fde5-ce81-4c13-9392-3ae6cfb19112 service nova] Acquired lock "refresh_cache-5ffa30ea-7458-4914-a6f4-9d8310ca977c" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:07:16 user nova-compute[71113]: DEBUG nova.network.neutron [req-a4fc4034-effa-435c-9194-48a6b900d218 req-b609fde5-ce81-4c13-9392-3ae6cfb19112 service nova] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Refreshing network info cache for port 8a38b464-522f-48bd-90b6-4447f9a6eb21 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 10:07:16 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:07:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:07:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:07:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:07:16 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:07:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ea0d4a15-8bbd-456c-994c-589e03c886ef tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Acquiring lock "5ffa30ea-7458-4914-a6f4-9d8310ca977c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:07:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ea0d4a15-8bbd-456c-994c-589e03c886ef tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Lock "5ffa30ea-7458-4914-a6f4-9d8310ca977c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:07:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ea0d4a15-8bbd-456c-994c-589e03c886ef tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Acquiring lock "5ffa30ea-7458-4914-a6f4-9d8310ca977c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:07:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ea0d4a15-8bbd-456c-994c-589e03c886ef tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Lock "5ffa30ea-7458-4914-a6f4-9d8310ca977c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:07:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ea0d4a15-8bbd-456c-994c-589e03c886ef tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Lock "5ffa30ea-7458-4914-a6f4-9d8310ca977c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:07:16 user nova-compute[71113]: INFO nova.compute.manager [None req-ea0d4a15-8bbd-456c-994c-589e03c886ef tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Terminating instance
Jul 31 10:07:16 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ea0d4a15-8bbd-456c-994c-589e03c886ef tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Start destroying the instance on the hypervisor. {{(pid=71113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 10:07:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:07:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:07:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:07:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:07:17 user nova-compute[71113]: DEBUG nova.network.neutron [req-a4fc4034-effa-435c-9194-48a6b900d218 req-b609fde5-ce81-4c13-9392-3ae6cfb19112 service nova] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Updated VIF entry in instance network info cache for port 8a38b464-522f-48bd-90b6-4447f9a6eb21. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 10:07:17 user nova-compute[71113]: DEBUG nova.network.neutron [req-a4fc4034-effa-435c-9194-48a6b900d218 req-b609fde5-ce81-4c13-9392-3ae6cfb19112 service nova] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Updating instance_info_cache with network_info: [{"id": "8a38b464-522f-48bd-90b6-4447f9a6eb21", "address": "fa:16:3e:8f:24:b1", "network": {"id": "a88a6414-c6fd-4581-bbb5-7250ebcb1345", "bridge": "br-int", "label": "tempest-TestShelveInstance-1094508903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c17b9322f9049d390ad212ad8ce7905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a38b464-52", "ovs_interfaceid": "8a38b464-522f-48bd-90b6-4447f9a6eb21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:07:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-a4fc4034-effa-435c-9194-48a6b900d218 req-b609fde5-ce81-4c13-9392-3ae6cfb19112 service nova] Releasing lock "refresh_cache-5ffa30ea-7458-4914-a6f4-9d8310ca977c" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:07:17 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 10:07:17 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Instance destroyed successfully.
Jul 31 10:07:17 user nova-compute[71113]: DEBUG nova.objects.instance [None req-ea0d4a15-8bbd-456c-994c-589e03c886ef tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Lazy-loading 'resources' on Instance uuid 5ffa30ea-7458-4914-a6f4-9d8310ca977c {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:07:17 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 10:07:17 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 10:07:17 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-ea0d4a15-8bbd-456c-994c-589e03c886ef tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T10:01:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1588137860',display_name='tempest-TestShelveInstance-server-1588137860',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1588137860',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbaQKqzXS+iGAdyU+IEYcpzfIkkhUCBcV/jtcllq2kAmrkSuKN+HhjRpB+JHeg80k59esL5yAramhhM5R6CSY2dBC3P+p41xS0uXt2ByFPfGSwj17CP/Ai/tBqcEiPsRA==',key_name='tempest-TestShelveInstance-735724819',keypairs=<?>,launch_index=0,launched_at=2023-07-31T10:05:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9c17b9322f9049d390ad212ad8ce7905',ramdisk_id='',reservation_id='r-mtlq72k6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1763207303',owner_user_name='tempest-TestShelveInstance-1763207303-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T10:05:41Z,user_data=None,user_id='31f12483848e44098cbb078851c5f8d7',uuid=5ffa30ea-7458-4914-a6f4-9d8310ca977c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a38b464-522f-48bd-90b6-4447f9a6eb21", "address": "fa:16:3e:8f:24:b1", "network": {"id": "a88a6414-c6fd-4581-bbb5-7250ebcb1345", "bridge": "br-int", "label": "tempest-TestShelveInstance-1094508903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c17b9322f9049d390ad212ad8ce7905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a38b464-52", "ovs_interfaceid": "8a38b464-522f-48bd-90b6-4447f9a6eb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 10:07:17 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-ea0d4a15-8bbd-456c-994c-589e03c886ef tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Converting VIF {"id": "8a38b464-522f-48bd-90b6-4447f9a6eb21", "address": "fa:16:3e:8f:24:b1", "network": {"id": "a88a6414-c6fd-4581-bbb5-7250ebcb1345", "bridge": "br-int", "label": "tempest-TestShelveInstance-1094508903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c17b9322f9049d390ad212ad8ce7905", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a38b464-52", "ovs_interfaceid": "8a38b464-522f-48bd-90b6-4447f9a6eb21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:07:17 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-ea0d4a15-8bbd-456c-994c-589e03c886ef tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:24:b1,bridge_name='br-int',has_traffic_filtering=True,id=8a38b464-522f-48bd-90b6-4447f9a6eb21,network=Network(a88a6414-c6fd-4581-bbb5-7250ebcb1345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a38b464-52') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:07:17 user nova-compute[71113]: DEBUG os_vif [None req-ea0d4a15-8bbd-456c-994c-589e03c886ef tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:24:b1,bridge_name='br-int',has_traffic_filtering=True,id=8a38b464-522f-48bd-90b6-4447f9a6eb21,network=Network(a88a6414-c6fd-4581-bbb5-7250ebcb1345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a38b464-52') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 10:07:17 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:07:17 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a38b464-52, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:07:17 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:07:17 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:07:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c7bd88d-2991-4660-928e-298c0a0b2e18/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:17 user nova-compute[71113]: INFO os_vif [None req-ea0d4a15-8bbd-456c-994c-589e03c886ef tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:24:b1,bridge_name='br-int',has_traffic_filtering=True,id=8a38b464-522f-48bd-90b6-4447f9a6eb21,network=Network(a88a6414-c6fd-4581-bbb5-7250ebcb1345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a38b464-52')
Jul 31 10:07:17 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea0d4a15-8bbd-456c-994c-589e03c886ef tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 10:07:17 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea0d4a15-8bbd-456c-994c-589e03c886ef tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'egBnzlMD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:07:17 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-ea0d4a15-8bbd-456c-994c-589e03c886ef tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:07:17 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-ea0d4a15-8bbd-456c-994c-589e03c886ef tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:07:17 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-ea0d4a15-8bbd-456c-994c-589e03c886ef tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:07:17 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea0d4a15-8bbd-456c-994c-589e03c886ef tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 10:07:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:17 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b625828b-78de-418f-b706-5736e1ab7da6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:07:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:17 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f721d3d5-4465-4af7-b0a1-52100e0a76f9]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:07:17 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea0d4a15-8bbd-456c-994c-589e03c886ef tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:07:17 user nova-compute[71113]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)
Jul 31 10:07:17 user nova-compute[71113]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d (non-flash)
Jul 31 10:07:17 user nova-compute[71113]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)
Jul 31 10:07:17 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:07:17 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea0d4a15-8bbd-456c-994c-589e03c886ef tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:07:17 user nova-compute[71113]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)
Jul 31 10:07:17 user nova-compute[71113]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d (non-flash)
Jul 31 10:07:17 user nova-compute[71113]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)
Jul 31 10:07:17 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:07:17 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea0d4a15-8bbd-456c-994c-589e03c886ef tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f78cc74c8b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d'): ({'sdb'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 10:07:17 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-ea0d4a15-8bbd-456c-994c-589e03c886ef tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Removing single pathed devices sdb {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 10:07:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c7bd88d-2991-4660-928e-298c0a0b2e18/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c7bd88d-2991-4660-928e-298c0a0b2e18/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:17 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d26130a-ad0b-476c-b51b-e46697d747e6]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:07:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:17 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21454d2-c2b8-4a39-a29d-bb4e236f8bdb]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:07:17 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-ea0d4a15-8bbd-456c-994c-589e03c886ef tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Flushing IO for device /dev/sdb {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 10:07:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:17 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d18df4e-0c19-4a27-b01d-5b55e24324dd]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:07:17 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-ea0d4a15-8bbd-456c-994c-589e03c886ef tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 10:07:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:17 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[670108dd-0703-460b-9051-a0ab0c592972]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:07:17 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-ea0d4a15-8bbd-456c-994c-589e03c886ef tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 10:07:17 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-ea0d4a15-8bbd-456c-994c-589e03c886ef tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] SCSI volumes sdb have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 10:07:17 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea0d4a15-8bbd-456c-994c-589e03c886ef tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 10:07:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c7bd88d-2991-4660-928e-298c0a0b2e18/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:17 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b477efc9-c8c8-4374-b8e5-97eae1a4bb00]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:07:17 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea0d4a15-8bbd-456c-994c-589e03c886ef tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:07:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f020f166-07b6-4cf5-9f17-2ab108b55c30/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:17 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6d8596-efcd-4c47-9662-70f5fd19a4c5]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:07:18 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea0d4a15-8bbd-456c-994c-589e03c886ef tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d, portal: 172.16.0.220,3260]
Jul 31 10:07:18 user nova-compute[71113]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d, portal: 172.16.0.220,3260] successful.
Jul 31 10:07:18 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:07:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:561d8e35-12d8-4f9f-878d-dd377eb2394d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:18 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[df16be03-bd44-434f-90cf-9318c9bf219b]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:07:18 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea0d4a15-8bbd-456c-994c-589e03c886ef tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:07:18 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-ea0d4a15-8bbd-456c-994c-589e03c886ef tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:07:18 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea0d4a15-8bbd-456c-994c-589e03c886ef tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] <== disconnect_volume: return (355ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:07:18 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea0d4a15-8bbd-456c-994c-589e03c886ef tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 10:07:18 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-ea0d4a15-8bbd-456c-994c-589e03c886ef tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Deleting instance files /opt/stack/data/nova/instances/5ffa30ea-7458-4914-a6f4-9d8310ca977c_del
Jul 31 10:07:18 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-ea0d4a15-8bbd-456c-994c-589e03c886ef tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Deletion of /opt/stack/data/nova/instances/5ffa30ea-7458-4914-a6f4-9d8310ca977c_del complete
Jul 31 10:07:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f020f166-07b6-4cf5-9f17-2ab108b55c30/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f020f166-07b6-4cf5-9f17-2ab108b55c30/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:18 user nova-compute[71113]: INFO nova.compute.manager [None req-ea0d4a15-8bbd-456c-994c-589e03c886ef tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Took 1.32 seconds to destroy the instance on the hypervisor.
Jul 31 10:07:18 user nova-compute[71113]: DEBUG oslo.service.loopingcall [None req-ea0d4a15-8bbd-456c-994c-589e03c886ef tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71113) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 10:07:18 user nova-compute[71113]: DEBUG nova.compute.manager [-] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Deallocating network for instance {{(pid=71113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 10:07:18 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] deallocate_for_instance() {{(pid=71113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 10:07:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f020f166-07b6-4cf5-9f17-2ab108b55c30/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:18 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 10:07:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:18 user nova-compute[71113]: DEBUG nova.compute.manager [req-cde09b2f-b5ed-491f-8173-a7dd341461b4 req-8074537b-4bd1-4f0f-a60e-79a87217cc41 service nova] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Received event network-vif-unplugged-8a38b464-522f-48bd-90b6-4447f9a6eb21 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:07:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-cde09b2f-b5ed-491f-8173-a7dd341461b4 req-8074537b-4bd1-4f0f-a60e-79a87217cc41 service nova] Acquiring lock "5ffa30ea-7458-4914-a6f4-9d8310ca977c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:07:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-cde09b2f-b5ed-491f-8173-a7dd341461b4 req-8074537b-4bd1-4f0f-a60e-79a87217cc41 service nova] Lock "5ffa30ea-7458-4914-a6f4-9d8310ca977c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:07:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-cde09b2f-b5ed-491f-8173-a7dd341461b4 req-8074537b-4bd1-4f0f-a60e-79a87217cc41 service nova] Lock "5ffa30ea-7458-4914-a6f4-9d8310ca977c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:07:18 user nova-compute[71113]: DEBUG nova.compute.manager [req-cde09b2f-b5ed-491f-8173-a7dd341461b4 req-8074537b-4bd1-4f0f-a60e-79a87217cc41 service nova] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] No waiting events found dispatching network-vif-unplugged-8a38b464-522f-48bd-90b6-4447f9a6eb21 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:07:18 user nova-compute[71113]: DEBUG nova.compute.manager [req-cde09b2f-b5ed-491f-8173-a7dd341461b4 req-8074537b-4bd1-4f0f-a60e-79a87217cc41 service nova] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Received event network-vif-unplugged-8a38b464-522f-48bd-90b6-4447f9a6eb21 for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 10:07:18 user nova-compute[71113]: DEBUG nova.compute.manager [req-cde09b2f-b5ed-491f-8173-a7dd341461b4 req-8074537b-4bd1-4f0f-a60e-79a87217cc41 service nova] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Received event network-vif-plugged-8a38b464-522f-48bd-90b6-4447f9a6eb21 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:07:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-cde09b2f-b5ed-491f-8173-a7dd341461b4 req-8074537b-4bd1-4f0f-a60e-79a87217cc41 service nova] Acquiring lock "5ffa30ea-7458-4914-a6f4-9d8310ca977c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:07:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-cde09b2f-b5ed-491f-8173-a7dd341461b4 req-8074537b-4bd1-4f0f-a60e-79a87217cc41 service nova] Lock "5ffa30ea-7458-4914-a6f4-9d8310ca977c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:07:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-cde09b2f-b5ed-491f-8173-a7dd341461b4 req-8074537b-4bd1-4f0f-a60e-79a87217cc41 service nova] Lock "5ffa30ea-7458-4914-a6f4-9d8310ca977c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:07:18 user nova-compute[71113]: DEBUG nova.compute.manager [req-cde09b2f-b5ed-491f-8173-a7dd341461b4 req-8074537b-4bd1-4f0f-a60e-79a87217cc41 service nova] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] No waiting events found dispatching network-vif-plugged-8a38b464-522f-48bd-90b6-4447f9a6eb21 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:07:18 user nova-compute[71113]: WARNING nova.compute.manager [req-cde09b2f-b5ed-491f-8173-a7dd341461b4 req-8074537b-4bd1-4f0f-a60e-79a87217cc41 service nova] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Received unexpected event network-vif-plugged-8a38b464-522f-48bd-90b6-4447f9a6eb21 for instance with vm_state active and task_state deleting.
Jul 31 10:07:18 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:07:18 user nova-compute[71113]: DEBUG nova.compute.manager [req-293df750-1327-46d8-965a-6b1eab0e424a req-bf661b81-1c3f-4985-9ea4-84207fde8daf service nova] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Received event network-vif-deleted-8a38b464-522f-48bd-90b6-4447f9a6eb21 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:07:18 user nova-compute[71113]: INFO nova.compute.manager [req-293df750-1327-46d8-965a-6b1eab0e424a req-bf661b81-1c3f-4985-9ea4-84207fde8daf service nova] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Neutron deleted interface 8a38b464-522f-48bd-90b6-4447f9a6eb21; detaching it from the instance and deleting it from the info cache
Jul 31 10:07:18 user nova-compute[71113]: DEBUG nova.network.neutron [req-293df750-1327-46d8-965a-6b1eab0e424a req-bf661b81-1c3f-4985-9ea4-84207fde8daf service nova] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:07:18 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Took 0.68 seconds to deallocate network for instance.
Jul 31 10:07:18 user nova-compute[71113]: DEBUG nova.compute.manager [req-293df750-1327-46d8-965a-6b1eab0e424a req-bf661b81-1c3f-4985-9ea4-84207fde8daf service nova] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Detach interface failed, port_id=8a38b464-522f-48bd-90b6-4447f9a6eb21, reason: Instance 5ffa30ea-7458-4914-a6f4-9d8310ca977c could not be found. {{(pid=71113) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 10:07:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:19 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:07:19 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:07:19 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=7911MB free_disk=25.073936462402344GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:07:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:07:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:07:19 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 3157a7a6-b8a9-4e2d-a157-360bce4c625d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:07:19 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 92d25a03-98ce-4bde-a3cc-20313ae77d41 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:07:19 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance f020f166-07b6-4cf5-9f17-2ab108b55c30 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:07:19 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 52f1f390-1599-4dda-9418-f12a48ef582c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:07:19 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 95a84d3c-7aa2-4294-a419-995926a2782f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:07:19 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 2c7bd88d-2991-4660-928e-298c0a0b2e18 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:07:19 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 5ffa30ea-7458-4914-a6f4-9d8310ca977c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:07:19 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 5145337d-6a13-4107-a636-6d817efcc434 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:07:19 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:07:19 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:07:19 user nova-compute[71113]: INFO nova.compute.manager [None req-ea0d4a15-8bbd-456c-994c-589e03c886ef tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Took 0.77 seconds to detach 1 volumes for instance.
Jul 31 10:07:19 user nova-compute[71113]: DEBUG nova.compute.manager [None req-ea0d4a15-8bbd-456c-994c-589e03c886ef tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Deleting volume: 561d8e35-12d8-4f9f-878d-dd377eb2394d {{(pid=71113) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 31 10:07:19 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Refreshing inventories for resource provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 31 10:07:19 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Updating ProviderTree inventory for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 31 10:07:19 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Updating inventory in ProviderTree for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 31 10:07:19 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Refreshing aggregate associations for resource provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05, aggregates: None {{(pid=71113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 31 10:07:19 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Refreshing trait associations for resource provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE2,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS {{(pid=71113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 31 10:07:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ea0d4a15-8bbd-456c-994c-589e03c886ef tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:07:19 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:07:19 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:07:20 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:07:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.702s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:07:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ea0d4a15-8bbd-456c-994c-589e03c886ef tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.306s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:07:20 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:07:20 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Cleaning up deleted instances {{(pid=71113) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 31 10:07:20 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] There are 0 instances to clean {{(pid=71113) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 31 10:07:20 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-ea0d4a15-8bbd-456c-994c-589e03c886ef tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:07:20 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-ea0d4a15-8bbd-456c-994c-589e03c886ef tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:07:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ea0d4a15-8bbd-456c-994c-589e03c886ef tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.304s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:07:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:07:20 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-ea0d4a15-8bbd-456c-994c-589e03c886ef tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Deleted allocations for instance 5ffa30ea-7458-4914-a6f4-9d8310ca977c
Jul 31 10:07:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ea0d4a15-8bbd-456c-994c-589e03c886ef tempest-TestShelveInstance-1763207303 tempest-TestShelveInstance-1763207303-project-member] Lock "5ffa30ea-7458-4914-a6f4-9d8310ca977c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.642s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1f40128-4539-45f6-a43c-d40ded51083c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f40128-4539-45f6-a43c-d40ded51083c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JdUlBGba', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:07:21 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-d1f40128-4539-45f6-a43c-d40ded51083c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:07:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-d1f40128-4539-45f6-a43c-d40ded51083c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-d1f40128-4539-45f6-a43c-d40ded51083c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:07:21 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-d1f40128-4539-45f6-a43c-d40ded51083c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:07:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-d1f40128-4539-45f6-a43c-d40ded51083c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-d1f40128-4539-45f6-a43c-d40ded51083c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:07:21 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-d1f40128-4539-45f6-a43c-d40ded51083c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 10:07:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833 -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e077ddc-5131-4991-936d-4c51fd0835b9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f40128-4539-45f6-a43c-d40ded51083c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 10:07:21 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833 -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b2d7c7-3e3d-4afd-94fe-a47db4daca90]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f40128-4539-45f6-a43c-d40ded51083c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833] added
Jul 31 10:07:21 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd65cff-fedc-46be-bb0a-da71d46026ee]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f40128-4539-45f6-a43c-d40ded51083c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "refresh_cache-52f1f390-1599-4dda-9418-f12a48ef582c" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquired lock "refresh_cache-52f1f390-1599-4dda-9418-f12a48ef582c" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Forcefully refreshing network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c28e93-1b84-4733-83cd-08cfc31ff9b7]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f40128-4539-45f6-a43c-d40ded51083c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JdUlBGba {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JdUlBGba" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee709a13-6452-4863-ae42-6924d7b1f9a7]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f40128-4539-45f6-a43c-d40ded51083c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JdUlBGba'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee3ffb0-344f-406b-abef-7dda0ae6988f]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f40128-4539-45f6-a43c-d40ded51083c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aeb0bb2-53ec-44b9-99a8-d018a190df2c]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f40128-4539-45f6-a43c-d40ded51083c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:07:21 user nova-compute[71113]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)
Jul 31 10:07:21 user nova-compute[71113]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)
Jul 31 10:07:21 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f40128-4539-45f6-a43c-d40ded51083c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:07:21 user nova-compute[71113]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)
Jul 31 10:07:21 user nova-compute[71113]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)
Jul 31 10:07:21 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833 -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[46449492-23ca-4220-8a2c-c456e2338bf4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f40128-4539-45f6-a43c-d40ded51083c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833, portal: 172.16.0.220,3260]
Jul 31 10:07:21 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833, portal: 172.16.0.220,3260] successful.
Jul 31 10:07:21 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6b6f13-053b-4569-bfdf-b9e490e89108]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f40128-4539-45f6-a43c-d40ded51083c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c53c0d2-5dfd-424b-af1c-6b13d6bf82d4]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f40128-4539-45f6-a43c-d40ded51083c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:07:21 user nova-compute[71113]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)
Jul 31 10:07:21 user nova-compute[71113]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)
Jul 31 10:07:21 user nova-compute[71113]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833 (non-flash)
Jul 31 10:07:21 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f40128-4539-45f6-a43c-d40ded51083c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:07:21 user nova-compute[71113]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)
Jul 31 10:07:21 user nova-compute[71113]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)
Jul 31 10:07:21 user nova-compute[71113]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833 (non-flash)
Jul 31 10:07:21 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-d1f40128-4539-45f6-a43c-d40ded51083c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f40128-4539-45f6-a43c-d40ded51083c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-d1f40128-4539-45f6-a43c-d40ded51083c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-d1f40128-4539-45f6-a43c-d40ded51083c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07b707d-bc05-4c3f-87ba-e84cd8d144c3]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-d1f40128-4539-45f6-a43c-d40ded51083c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: None {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Updating instance_info_cache with network_info: [{"id": "6af975ec-2ae8-44fc-8762-90e9a13efbce", "address": "fa:16:3e:b2:53:f2", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af975ec-2a", "ovs_interfaceid": "6af975ec-2ae8-44fc-8762-90e9a13efbce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Releasing lock "refresh_cache-52f1f390-1599-4dda-9418-f12a48ef582c" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Updated the network info_cache for instance {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:07:21 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:07:22 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-d1f40128-4539-45f6-a43c-d40ded51083c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 10:07:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f40128-4539-45f6-a43c-d40ded51083c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JdUlBGba', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 10:07:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-d1f40128-4539-45f6-a43c-d40ded51083c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:07:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f40128-4539-45f6-a43c-d40ded51083c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23865373430323138', 'path': '/dev/sdb'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:07:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1f40128-4539-45f6-a43c-d40ded51083c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865373430323138', 'path': '/dev/sdb'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 10:07:22 user nova-compute[71113]: DEBUG nova.objects.instance [None req-d1f40128-4539-45f6-a43c-d40ded51083c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lazy-loading 'flavor' on Instance uuid 2c7bd88d-2991-4660-928e-298c0a0b2e18 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:07:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-d1f40128-4539-45f6-a43c-d40ded51083c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 10:07:22 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:07:22 user nova-compute[71113]:   <source dev="/dev/sdb"/>
Jul 31 10:07:22 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 10:07:22 user nova-compute[71113]:   <serial>0611f81f-a00b-45e2-9cdb-f046e672b833</serial>
Jul 31 10:07:22 user nova-compute[71113]: </disk>
Jul 31 10:07:22 user nova-compute[71113]:  {{(pid=71113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 10:07:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:07:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-d1f40128-4539-45f6-a43c-d40ded51083c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:07:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-d1f40128-4539-45f6-a43c-d40ded51083c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:07:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-d1f40128-4539-45f6-a43c-d40ded51083c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] No VIF found with MAC fa:16:3e:a1:ae:09, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 10:07:22 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-d1f40128-4539-45f6-a43c-d40ded51083c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "2c7bd88d-2991-4660-928e-298c0a0b2e18" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.549s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:07:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:07:26 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquiring lock "5365410d-3994-48cd-8747-698f27d98222" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:07:26 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "5365410d-3994-48cd-8747-698f27d98222" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:07:26 user nova-compute[71113]: DEBUG nova.compute.manager [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 5365410d-3994-48cd-8747-698f27d98222] Starting instance... {{(pid=71113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 10:07:26 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:07:26 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:07:26 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 10:07:26 user nova-compute[71113]: INFO nova.compute.claims [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 5365410d-3994-48cd-8747-698f27d98222] Claim successful on node user
Jul 31 10:07:26 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:07:26 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:07:26 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.359s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:07:26 user nova-compute[71113]: DEBUG nova.compute.manager [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 5365410d-3994-48cd-8747-698f27d98222] Start building networks asynchronously for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 10:07:26 user nova-compute[71113]: DEBUG nova.compute.manager [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 5365410d-3994-48cd-8747-698f27d98222] Allocating IP information in the background. {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 10:07:26 user nova-compute[71113]: DEBUG nova.network.neutron [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 5365410d-3994-48cd-8747-698f27d98222] allocate_for_instance() {{(pid=71113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 10:07:26 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 5365410d-3994-48cd-8747-698f27d98222] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 10:07:26 user nova-compute[71113]: DEBUG nova.compute.manager [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 5365410d-3994-48cd-8747-698f27d98222] Start building block device mappings for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 10:07:26 user nova-compute[71113]: DEBUG nova.policy [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd9883a5677fb4852ae031137736a9ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7000d6a2a6b147ddbc38208b316574cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71113) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 10:07:26 user nova-compute[71113]: DEBUG nova.compute.manager [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 5365410d-3994-48cd-8747-698f27d98222] Start spawning the instance on the hypervisor. {{(pid=71113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 10:07:26 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 5365410d-3994-48cd-8747-698f27d98222] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 10:07:26 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 5365410d-3994-48cd-8747-698f27d98222] Creating image(s)
Jul 31 10:07:26 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquiring lock "/opt/stack/data/nova/instances/5365410d-3994-48cd-8747-698f27d98222/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:07:26 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "/opt/stack/data/nova/instances/5365410d-3994-48cd-8747-698f27d98222/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:07:26 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "/opt/stack/data/nova/instances/5365410d-3994-48cd-8747-698f27d98222/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:07:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:27 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.179s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquiring lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:07:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:07:27 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:27 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.139s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:27 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/5365410d-3994-48cd-8747-698f27d98222/disk 1073741824 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:27 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/5365410d-3994-48cd-8747-698f27d98222/disk 1073741824" returned: 0 in 0.055s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:07:27 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:27 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:07:27 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.136s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:27 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5365410d-3994-48cd-8747-698f27d98222/disk. size=1073741824 {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 10:07:27 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5365410d-3994-48cd-8747-698f27d98222/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:27 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5365410d-3994-48cd-8747-698f27d98222/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:27 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Cannot resize image /opt/stack/data/nova/instances/5365410d-3994-48cd-8747-698f27d98222/disk to a smaller size. {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 10:07:27 user nova-compute[71113]: DEBUG nova.objects.instance [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lazy-loading 'migration_context' on Instance uuid 5365410d-3994-48cd-8747-698f27d98222 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:07:27 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 5365410d-3994-48cd-8747-698f27d98222] Created local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 10:07:27 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 5365410d-3994-48cd-8747-698f27d98222] Ensure instance console log exists: /opt/stack/data/nova/instances/5365410d-3994-48cd-8747-698f27d98222/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 10:07:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:07:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:07:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:07:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:07:27 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:07:27 user nova-compute[71113]: DEBUG nova.network.neutron [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 5365410d-3994-48cd-8747-698f27d98222] Successfully created port: c8e66573-782b-4698-833c-b38a2749a7f9 {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 10:07:28 user nova-compute[71113]: DEBUG nova.network.neutron [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 5365410d-3994-48cd-8747-698f27d98222] Successfully updated port: c8e66573-782b-4698-833c-b38a2749a7f9 {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 10:07:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquiring lock "refresh_cache-5365410d-3994-48cd-8747-698f27d98222" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:07:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquired lock "refresh_cache-5365410d-3994-48cd-8747-698f27d98222" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:07:28 user nova-compute[71113]: DEBUG nova.network.neutron [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 5365410d-3994-48cd-8747-698f27d98222] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 10:07:28 user nova-compute[71113]: DEBUG nova.compute.manager [req-07db4ecf-f423-469c-be9f-d35050bc8da1 req-316e2fbc-5b21-4952-9d42-334b081744ba service nova] [instance: 5365410d-3994-48cd-8747-698f27d98222] Received event network-changed-c8e66573-782b-4698-833c-b38a2749a7f9 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:07:28 user nova-compute[71113]: DEBUG nova.compute.manager [req-07db4ecf-f423-469c-be9f-d35050bc8da1 req-316e2fbc-5b21-4952-9d42-334b081744ba service nova] [instance: 5365410d-3994-48cd-8747-698f27d98222] Refreshing instance network info cache due to event network-changed-c8e66573-782b-4698-833c-b38a2749a7f9. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 10:07:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-07db4ecf-f423-469c-be9f-d35050bc8da1 req-316e2fbc-5b21-4952-9d42-334b081744ba service nova] Acquiring lock "refresh_cache-5365410d-3994-48cd-8747-698f27d98222" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:07:28 user nova-compute[71113]: DEBUG nova.network.neutron [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 5365410d-3994-48cd-8747-698f27d98222] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 10:07:29 user nova-compute[71113]: DEBUG nova.network.neutron [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 5365410d-3994-48cd-8747-698f27d98222] Updating instance_info_cache with network_info: [{"id": "c8e66573-782b-4698-833c-b38a2749a7f9", "address": "fa:16:3e:65:36:46", "network": {"id": "4b030626-e3f1-4617-89c2-f6389226652f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441335951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7000d6a2a6b147ddbc38208b316574cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8e66573-78", "ovs_interfaceid": "c8e66573-782b-4698-833c-b38a2749a7f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:07:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Releasing lock "refresh_cache-5365410d-3994-48cd-8747-698f27d98222" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:07:29 user nova-compute[71113]: DEBUG nova.compute.manager [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 5365410d-3994-48cd-8747-698f27d98222] Instance network_info: |[{"id": "c8e66573-782b-4698-833c-b38a2749a7f9", "address": "fa:16:3e:65:36:46", "network": {"id": "4b030626-e3f1-4617-89c2-f6389226652f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441335951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7000d6a2a6b147ddbc38208b316574cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8e66573-78", "ovs_interfaceid": "c8e66573-782b-4698-833c-b38a2749a7f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 10:07:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-07db4ecf-f423-469c-be9f-d35050bc8da1 req-316e2fbc-5b21-4952-9d42-334b081744ba service nova] Acquired lock "refresh_cache-5365410d-3994-48cd-8747-698f27d98222" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:07:29 user nova-compute[71113]: DEBUG nova.network.neutron [req-07db4ecf-f423-469c-be9f-d35050bc8da1 req-316e2fbc-5b21-4952-9d42-334b081744ba service nova] [instance: 5365410d-3994-48cd-8747-698f27d98222] Refreshing network info cache for port c8e66573-782b-4698-833c-b38a2749a7f9 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 10:07:29 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 5365410d-3994-48cd-8747-698f27d98222] Start _get_guest_xml network_info=[{"id": "c8e66573-782b-4698-833c-b38a2749a7f9", "address": "fa:16:3e:65:36:46", "network": {"id": "4b030626-e3f1-4617-89c2-f6389226652f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441335951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7000d6a2a6b147ddbc38208b316574cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8e66573-78", "ovs_interfaceid": "c8e66573-782b-4698-833c-b38a2749a7f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'image_id': '078646fe-b504-41ed-a147-61072e903e51'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 10:07:29 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:07:29 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:07:29 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 10:07:29 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 10:07:29 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 10:07:29 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 10:07:29 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 10:07:29 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 10:07:29 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 10:07:29 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 10:07:29 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 10:07:29 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 10:07:29 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 10:07:29 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 10:07:29 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 10:07:29 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 10:07:29 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 10:07:29 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 10:07:29 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:07:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-69238182',display_name='tempest-AttachVolumeNegativeTest-server-69238182',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-69238182',id=39,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHunRvE0Nr1oxlPQXXNR/M8FQPEKuy6KJtIKiuIKoWsRQ7NF9HPJhVM7DgKyvFB5o8A6wGMVa0mFFALQIX/QY7Raltiedqkc6j4dAxTsk1v7JBpd/js7tEGrBV8r01yUCw==',key_name='tempest-keypair-1874560186',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7000d6a2a6b147ddbc38208b316574cd',ramdisk_id='',reservation_id='r-fiu21g29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2110881646',owner_user_name='tempest-AttachVolumeNegativeTest-2110881646-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T10:07:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9883a5677fb4852ae031137736a9ee4',uuid=5365410d-3994-48cd-8747-698f27d98222,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8e66573-782b-4698-833c-b38a2749a7f9", "address": "fa:16:3e:65:36:46", "network": {"id": "4b030626-e3f1-4617-89c2-f6389226652f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441335951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7000d6a2a6b147ddbc38208b316574cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8e66573-78", "ovs_interfaceid": "c8e66573-782b-4698-833c-b38a2749a7f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 10:07:29 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Converting VIF {"id": "c8e66573-782b-4698-833c-b38a2749a7f9", "address": "fa:16:3e:65:36:46", "network": {"id": "4b030626-e3f1-4617-89c2-f6389226652f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441335951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7000d6a2a6b147ddbc38208b316574cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8e66573-78", "ovs_interfaceid": "c8e66573-782b-4698-833c-b38a2749a7f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:07:29 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:36:46,bridge_name='br-int',has_traffic_filtering=True,id=c8e66573-782b-4698-833c-b38a2749a7f9,network=Network(4b030626-e3f1-4617-89c2-f6389226652f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8e66573-78') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:07:29 user nova-compute[71113]: DEBUG nova.objects.instance [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lazy-loading 'pci_devices' on Instance uuid 5365410d-3994-48cd-8747-698f27d98222 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:07:29 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 5365410d-3994-48cd-8747-698f27d98222] End _get_guest_xml xml=<domain type="kvm">
Jul 31 10:07:29 user nova-compute[71113]:   <uuid>5365410d-3994-48cd-8747-698f27d98222</uuid>
Jul 31 10:07:29 user nova-compute[71113]:   <name>instance-00000027</name>
Jul 31 10:07:29 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 10:07:29 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 10:07:29 user nova-compute[71113]:   <metadata>
Jul 31 10:07:29 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 10:07:29 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 10:07:29 user nova-compute[71113]:       <nova:name>tempest-AttachVolumeNegativeTest-server-69238182</nova:name>
Jul 31 10:07:29 user nova-compute[71113]:       <nova:creationTime>2023-07-31 10:07:29</nova:creationTime>
Jul 31 10:07:29 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 10:07:29 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 10:07:29 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 10:07:29 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 10:07:29 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 10:07:29 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 10:07:29 user nova-compute[71113]:       </nova:flavor>
Jul 31 10:07:29 user nova-compute[71113]:       <nova:owner>
Jul 31 10:07:29 user nova-compute[71113]:         <nova:user uuid="d9883a5677fb4852ae031137736a9ee4">tempest-AttachVolumeNegativeTest-2110881646-project-member</nova:user>
Jul 31 10:07:29 user nova-compute[71113]:         <nova:project uuid="7000d6a2a6b147ddbc38208b316574cd">tempest-AttachVolumeNegativeTest-2110881646</nova:project>
Jul 31 10:07:29 user nova-compute[71113]:       </nova:owner>
Jul 31 10:07:29 user nova-compute[71113]:       <nova:root type="image" uuid="078646fe-b504-41ed-a147-61072e903e51"/>
Jul 31 10:07:29 user nova-compute[71113]:       <nova:ports>
Jul 31 10:07:29 user nova-compute[71113]:         <nova:port uuid="c8e66573-782b-4698-833c-b38a2749a7f9">
Jul 31 10:07:29 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 31 10:07:29 user nova-compute[71113]:         </nova:port>
Jul 31 10:07:29 user nova-compute[71113]:       </nova:ports>
Jul 31 10:07:29 user nova-compute[71113]:     </nova:instance>
Jul 31 10:07:29 user nova-compute[71113]:   </metadata>
Jul 31 10:07:29 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 10:07:29 user nova-compute[71113]:     <system>
Jul 31 10:07:29 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 10:07:29 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 10:07:29 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 10:07:29 user nova-compute[71113]:       <entry name="serial">5365410d-3994-48cd-8747-698f27d98222</entry>
Jul 31 10:07:29 user nova-compute[71113]:       <entry name="uuid">5365410d-3994-48cd-8747-698f27d98222</entry>
Jul 31 10:07:29 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 10:07:29 user nova-compute[71113]:     </system>
Jul 31 10:07:29 user nova-compute[71113]:   </sysinfo>
Jul 31 10:07:29 user nova-compute[71113]:   <os>
Jul 31 10:07:29 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 10:07:29 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 10:07:29 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 10:07:29 user nova-compute[71113]:   </os>
Jul 31 10:07:29 user nova-compute[71113]:   <features>
Jul 31 10:07:29 user nova-compute[71113]:     <acpi/>
Jul 31 10:07:29 user nova-compute[71113]:     <apic/>
Jul 31 10:07:29 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 10:07:29 user nova-compute[71113]:   </features>
Jul 31 10:07:29 user nova-compute[71113]:   <clock offset="utc">
Jul 31 10:07:29 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 10:07:29 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 10:07:29 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 10:07:29 user nova-compute[71113]:   </clock>
Jul 31 10:07:29 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 10:07:29 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 10:07:29 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 10:07:29 user nova-compute[71113]:   </cpu>
Jul 31 10:07:29 user nova-compute[71113]:   <devices>
Jul 31 10:07:29 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 10:07:29 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 10:07:29 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/5365410d-3994-48cd-8747-698f27d98222/disk"/>
Jul 31 10:07:29 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 10:07:29 user nova-compute[71113]:     </disk>
Jul 31 10:07:29 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 10:07:29 user nova-compute[71113]:       <mac address="fa:16:3e:65:36:46"/>
Jul 31 10:07:29 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:07:29 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 10:07:29 user nova-compute[71113]:       <target dev="tapc8e66573-78"/>
Jul 31 10:07:29 user nova-compute[71113]:     </interface>
Jul 31 10:07:29 user nova-compute[71113]:     <serial type="pty">
Jul 31 10:07:29 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/5365410d-3994-48cd-8747-698f27d98222/console.log" append="off"/>
Jul 31 10:07:29 user nova-compute[71113]:     </serial>
Jul 31 10:07:29 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 10:07:29 user nova-compute[71113]:     <video>
Jul 31 10:07:29 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:07:29 user nova-compute[71113]:     </video>
Jul 31 10:07:29 user nova-compute[71113]:     <rng model="virtio">
Jul 31 10:07:29 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 10:07:29 user nova-compute[71113]:     </rng>
Jul 31 10:07:29 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 10:07:29 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 10:07:29 user nova-compute[71113]:       <stats period="10"/>
Jul 31 10:07:29 user nova-compute[71113]:     </memballoon>
Jul 31 10:07:29 user nova-compute[71113]:   </devices>
Jul 31 10:07:29 user nova-compute[71113]: </domain>
Jul 31 10:07:29 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 10:07:29 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:07:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-69238182',display_name='tempest-AttachVolumeNegativeTest-server-69238182',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-69238182',id=39,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHunRvE0Nr1oxlPQXXNR/M8FQPEKuy6KJtIKiuIKoWsRQ7NF9HPJhVM7DgKyvFB5o8A6wGMVa0mFFALQIX/QY7Raltiedqkc6j4dAxTsk1v7JBpd/js7tEGrBV8r01yUCw==',key_name='tempest-keypair-1874560186',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7000d6a2a6b147ddbc38208b316574cd',ramdisk_id='',reservation_id='r-fiu21g29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2110881646',owner_user_name='tempest-AttachVolumeNegativeTest-2110881646-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T10:07:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9883a5677fb4852ae031137736a9ee4',uuid=5365410d-3994-48cd-8747-698f27d98222,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8e66573-782b-4698-833c-b38a2749a7f9", "address": "fa:16:3e:65:36:46", "network": {"id": "4b030626-e3f1-4617-89c2-f6389226652f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441335951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7000d6a2a6b147ddbc38208b316574cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8e66573-78", "ovs_interfaceid": "c8e66573-782b-4698-833c-b38a2749a7f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 10:07:29 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Converting VIF {"id": "c8e66573-782b-4698-833c-b38a2749a7f9", "address": "fa:16:3e:65:36:46", "network": {"id": "4b030626-e3f1-4617-89c2-f6389226652f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441335951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7000d6a2a6b147ddbc38208b316574cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8e66573-78", "ovs_interfaceid": "c8e66573-782b-4698-833c-b38a2749a7f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:07:29 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:36:46,bridge_name='br-int',has_traffic_filtering=True,id=c8e66573-782b-4698-833c-b38a2749a7f9,network=Network(4b030626-e3f1-4617-89c2-f6389226652f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8e66573-78') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:07:29 user nova-compute[71113]: DEBUG os_vif [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:36:46,bridge_name='br-int',has_traffic_filtering=True,id=c8e66573-782b-4698-833c-b38a2749a7f9,network=Network(4b030626-e3f1-4617-89c2-f6389226652f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8e66573-78') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 10:07:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:07:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:07:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 10:07:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:07:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc8e66573-78, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:07:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc8e66573-78, col_values=(('external_ids', {'iface-id': 'c8e66573-782b-4698-833c-b38a2749a7f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:36:46', 'vm-uuid': '5365410d-3994-48cd-8747-698f27d98222'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:07:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:07:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:07:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:07:29 user nova-compute[71113]: INFO os_vif [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:36:46,bridge_name='br-int',has_traffic_filtering=True,id=c8e66573-782b-4698-833c-b38a2749a7f9,network=Network(4b030626-e3f1-4617-89c2-f6389226652f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8e66573-78')
Jul 31 10:07:29 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:07:29 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] No VIF found with MAC fa:16:3e:65:36:46, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 10:07:29 user nova-compute[71113]: DEBUG nova.network.neutron [req-07db4ecf-f423-469c-be9f-d35050bc8da1 req-316e2fbc-5b21-4952-9d42-334b081744ba service nova] [instance: 5365410d-3994-48cd-8747-698f27d98222] Updated VIF entry in instance network info cache for port c8e66573-782b-4698-833c-b38a2749a7f9. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 10:07:29 user nova-compute[71113]: DEBUG nova.network.neutron [req-07db4ecf-f423-469c-be9f-d35050bc8da1 req-316e2fbc-5b21-4952-9d42-334b081744ba service nova] [instance: 5365410d-3994-48cd-8747-698f27d98222] Updating instance_info_cache with network_info: [{"id": "c8e66573-782b-4698-833c-b38a2749a7f9", "address": "fa:16:3e:65:36:46", "network": {"id": "4b030626-e3f1-4617-89c2-f6389226652f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441335951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7000d6a2a6b147ddbc38208b316574cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8e66573-78", "ovs_interfaceid": "c8e66573-782b-4698-833c-b38a2749a7f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:07:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-07db4ecf-f423-469c-be9f-d35050bc8da1 req-316e2fbc-5b21-4952-9d42-334b081744ba service nova] Releasing lock "refresh_cache-5365410d-3994-48cd-8747-698f27d98222" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:07:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:07:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:07:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:07:31 user nova-compute[71113]: DEBUG nova.compute.manager [req-ba181b7f-9ab2-4d5d-8ee8-f58662b568cd req-59083e00-8493-4bb1-a7c7-dea8561325d3 service nova] [instance: 5365410d-3994-48cd-8747-698f27d98222] Received event network-vif-plugged-c8e66573-782b-4698-833c-b38a2749a7f9 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:07:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ba181b7f-9ab2-4d5d-8ee8-f58662b568cd req-59083e00-8493-4bb1-a7c7-dea8561325d3 service nova] Acquiring lock "5365410d-3994-48cd-8747-698f27d98222-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:07:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ba181b7f-9ab2-4d5d-8ee8-f58662b568cd req-59083e00-8493-4bb1-a7c7-dea8561325d3 service nova] Lock "5365410d-3994-48cd-8747-698f27d98222-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:07:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ba181b7f-9ab2-4d5d-8ee8-f58662b568cd req-59083e00-8493-4bb1-a7c7-dea8561325d3 service nova] Lock "5365410d-3994-48cd-8747-698f27d98222-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:07:31 user nova-compute[71113]: DEBUG nova.compute.manager [req-ba181b7f-9ab2-4d5d-8ee8-f58662b568cd req-59083e00-8493-4bb1-a7c7-dea8561325d3 service nova] [instance: 5365410d-3994-48cd-8747-698f27d98222] No waiting events found dispatching network-vif-plugged-c8e66573-782b-4698-833c-b38a2749a7f9 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:07:31 user nova-compute[71113]: WARNING nova.compute.manager [req-ba181b7f-9ab2-4d5d-8ee8-f58662b568cd req-59083e00-8493-4bb1-a7c7-dea8561325d3 service nova] [instance: 5365410d-3994-48cd-8747-698f27d98222] Received unexpected event network-vif-plugged-c8e66573-782b-4698-833c-b38a2749a7f9 for instance with vm_state building and task_state spawning.
Jul 31 10:07:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:07:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:07:32 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690798037.5773034, 5ffa30ea-7458-4914-a6f4-9d8310ca977c => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:07:32 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] VM Stopped (Lifecycle Event)
Jul 31 10:07:32 user nova-compute[71113]: DEBUG nova.compute.manager [None req-bd5a78f9-e44b-48b6-814e-9564464ad20d None None] [instance: 5ffa30ea-7458-4914-a6f4-9d8310ca977c] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:07:33 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690798053.0604124, 5365410d-3994-48cd-8747-698f27d98222 => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:07:33 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 5365410d-3994-48cd-8747-698f27d98222] VM Resumed (Lifecycle Event)
Jul 31 10:07:33 user nova-compute[71113]: DEBUG nova.compute.manager [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 5365410d-3994-48cd-8747-698f27d98222] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 10:07:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 5365410d-3994-48cd-8747-698f27d98222] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 10:07:33 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 5365410d-3994-48cd-8747-698f27d98222] Instance spawned successfully.
Jul 31 10:07:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 5365410d-3994-48cd-8747-698f27d98222] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 10:07:33 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 5365410d-3994-48cd-8747-698f27d98222] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:07:33 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 5365410d-3994-48cd-8747-698f27d98222] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:07:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 5365410d-3994-48cd-8747-698f27d98222] Found default for hw_cdrom_bus of ide {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:07:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 5365410d-3994-48cd-8747-698f27d98222] Found default for hw_disk_bus of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:07:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 5365410d-3994-48cd-8747-698f27d98222] Found default for hw_input_bus of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:07:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 5365410d-3994-48cd-8747-698f27d98222] Found default for hw_pointer_model of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:07:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 5365410d-3994-48cd-8747-698f27d98222] Found default for hw_video_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:07:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 5365410d-3994-48cd-8747-698f27d98222] Found default for hw_vif_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:07:33 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 5365410d-3994-48cd-8747-698f27d98222] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 10:07:33 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690798053.0619771, 5365410d-3994-48cd-8747-698f27d98222 => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:07:33 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 5365410d-3994-48cd-8747-698f27d98222] VM Started (Lifecycle Event)
Jul 31 10:07:33 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 5365410d-3994-48cd-8747-698f27d98222] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:07:33 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 5365410d-3994-48cd-8747-698f27d98222] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:07:33 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 5365410d-3994-48cd-8747-698f27d98222] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 10:07:33 user nova-compute[71113]: INFO nova.compute.manager [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 5365410d-3994-48cd-8747-698f27d98222] Took 6.31 seconds to spawn the instance on the hypervisor.
Jul 31 10:07:33 user nova-compute[71113]: DEBUG nova.compute.manager [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 5365410d-3994-48cd-8747-698f27d98222] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:07:33 user nova-compute[71113]: DEBUG nova.compute.manager [req-5d55d8b8-77da-4ba3-99f4-f2590cd98a64 req-c841249f-5615-4cf0-a0f2-1a80bc02d350 service nova] [instance: 5365410d-3994-48cd-8747-698f27d98222] Received event network-vif-plugged-c8e66573-782b-4698-833c-b38a2749a7f9 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:07:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-5d55d8b8-77da-4ba3-99f4-f2590cd98a64 req-c841249f-5615-4cf0-a0f2-1a80bc02d350 service nova] Acquiring lock "5365410d-3994-48cd-8747-698f27d98222-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:07:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-5d55d8b8-77da-4ba3-99f4-f2590cd98a64 req-c841249f-5615-4cf0-a0f2-1a80bc02d350 service nova] Lock "5365410d-3994-48cd-8747-698f27d98222-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:07:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-5d55d8b8-77da-4ba3-99f4-f2590cd98a64 req-c841249f-5615-4cf0-a0f2-1a80bc02d350 service nova] Lock "5365410d-3994-48cd-8747-698f27d98222-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:07:33 user nova-compute[71113]: DEBUG nova.compute.manager [req-5d55d8b8-77da-4ba3-99f4-f2590cd98a64 req-c841249f-5615-4cf0-a0f2-1a80bc02d350 service nova] [instance: 5365410d-3994-48cd-8747-698f27d98222] No waiting events found dispatching network-vif-plugged-c8e66573-782b-4698-833c-b38a2749a7f9 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:07:33 user nova-compute[71113]: WARNING nova.compute.manager [req-5d55d8b8-77da-4ba3-99f4-f2590cd98a64 req-c841249f-5615-4cf0-a0f2-1a80bc02d350 service nova] [instance: 5365410d-3994-48cd-8747-698f27d98222] Received unexpected event network-vif-plugged-c8e66573-782b-4698-833c-b38a2749a7f9 for instance with vm_state building and task_state spawning.
Jul 31 10:07:33 user nova-compute[71113]: INFO nova.compute.manager [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 5365410d-3994-48cd-8747-698f27d98222] Took 7.00 seconds to build instance.
Jul 31 10:07:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5d3319cc-cc00-46bf-84db-49fe035741ce tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "5365410d-3994-48cd-8747-698f27d98222" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.124s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:07:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:07:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:07:38 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:07:38 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71113) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 31 10:07:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:07:40 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:07:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-fd13ccfa-ba1e-4c93-a5dc-256f613f4d37 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Acquiring lock "95a84d3c-7aa2-4294-a419-995926a2782f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:07:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-fd13ccfa-ba1e-4c93-a5dc-256f613f4d37 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Lock "95a84d3c-7aa2-4294-a419-995926a2782f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:07:43 user nova-compute[71113]: DEBUG nova.objects.instance [None req-fd13ccfa-ba1e-4c93-a5dc-256f613f4d37 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Lazy-loading 'flavor' on Instance uuid 95a84d3c-7aa2-4294-a419-995926a2782f {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:07:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-fd13ccfa-ba1e-4c93-a5dc-256f613f4d37 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Lock "95a84d3c-7aa2-4294-a419-995926a2782f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:07:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-fd13ccfa-ba1e-4c93-a5dc-256f613f4d37 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Acquiring lock "95a84d3c-7aa2-4294-a419-995926a2782f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:07:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-fd13ccfa-ba1e-4c93-a5dc-256f613f4d37 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Lock "95a84d3c-7aa2-4294-a419-995926a2782f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:07:43 user nova-compute[71113]: INFO nova.compute.manager [None req-fd13ccfa-ba1e-4c93-a5dc-256f613f4d37 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Attaching volume 80311835-07f0-4221-8a86-1fae9750ed0c to /dev/vdb
Jul 31 10:07:43 user nova-compute[71113]: DEBUG os_brick.utils [None req-fd13ccfa-ba1e-4c93-a5dc-256f613f4d37 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:07:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:43 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5f4c9c-997e-4501-84fa-40f33cd1ff5a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:07:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:43 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d58ebd-4377-4d69-81b5-b24b3ea121ee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:07:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:43 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e0a553-c664-48ef-91af-a389b10c6897]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:07:43 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7a96a0-fbe2-4a4c-bcfb-288ce8ed952f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:07:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-fd13ccfa-ba1e-4c93-a5dc-256f613f4d37 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-fd13ccfa-ba1e-4c93-a5dc-256f613f4d37 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 10:07:43 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fd13ccfa-ba1e-4c93-a5dc-256f613f4d37 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 10:07:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 10:07:43 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 10:07:43 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[163dc2a2-6065-49dc-932d-f6392e48d4c2]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:07:43 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-fd13ccfa-ba1e-4c93-a5dc-256f613f4d37 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 10:07:43 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-fd13ccfa-ba1e-4c93-a5dc-256f613f4d37 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 10:07:43 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-fd13ccfa-ba1e-4c93-a5dc-256f613f4d37 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 10:07:43 user nova-compute[71113]: DEBUG os_brick.utils [None req-fd13ccfa-ba1e-4c93-a5dc-256f613f4d37 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:07:43 user nova-compute[71113]: DEBUG nova.virt.block_device [None req-fd13ccfa-ba1e-4c93-a5dc-256f613f4d37 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Updating existing volume attachment record: 3fc7d0eb-d37c-4cdb-9abf-01237efa5d57 {{(pid=71113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 10:07:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:07:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:07:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:07:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:07:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:07:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:07:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:07:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:07:51 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd13ccfa-ba1e-4c93-a5dc-256f613f4d37 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 10:07:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd13ccfa-ba1e-4c93-a5dc-256f613f4d37 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MidtxNfZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:07:51 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-fd13ccfa-ba1e-4c93-a5dc-256f613f4d37 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:07:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-fd13ccfa-ba1e-4c93-a5dc-256f613f4d37 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:07:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-fd13ccfa-ba1e-4c93-a5dc-256f613f4d37 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:07:51 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-fd13ccfa-ba1e-4c93-a5dc-256f613f4d37 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:07:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-fd13ccfa-ba1e-4c93-a5dc-256f613f4d37 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:07:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-fd13ccfa-ba1e-4c93-a5dc-256f613f4d37 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:07:51 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-fd13ccfa-ba1e-4c93-a5dc-256f613f4d37 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 10:07:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:51 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a782357-0292-4f03-a8ef-f98bc4c442b9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:07:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd13ccfa-ba1e-4c93-a5dc-256f613f4d37 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 10:07:51 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:07:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:51 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8802f376-cd93-45fb-b064-822420f0cb84]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:07:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd13ccfa-ba1e-4c93-a5dc-256f613f4d37 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c] added
Jul 31 10:07:51 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:07:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:51 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e6e6d7-e136-47be-b1c5-cb98da6dc59d]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:07:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd13ccfa-ba1e-4c93-a5dc-256f613f4d37 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:07:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:51 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14cd97b-41ce-4ac4-aa50-df76afde2429]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:07:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd13ccfa-ba1e-4c93-a5dc-256f613f4d37 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:07:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MidtxNfZ {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MidtxNfZ" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:51 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[461d5a32-97c3-42b5-b626-3a21f1ca78e1]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:07:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd13ccfa-ba1e-4c93-a5dc-256f613f4d37 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MidtxNfZ'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:07:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:51 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d3d6c8-efa5-4a93-903d-28d9337a836a]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:07:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd13ccfa-ba1e-4c93-a5dc-256f613f4d37 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:07:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:51 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb4d296-0e1d-4f10-8d29-e48dfdf5fb9e]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:07:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd13ccfa-ba1e-4c93-a5dc-256f613f4d37 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:07:51 user nova-compute[71113]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)
Jul 31 10:07:51 user nova-compute[71113]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)
Jul 31 10:07:51 user nova-compute[71113]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833 (non-flash)
Jul 31 10:07:51 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:07:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd13ccfa-ba1e-4c93-a5dc-256f613f4d37 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:07:51 user nova-compute[71113]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)
Jul 31 10:07:51 user nova-compute[71113]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)
Jul 31 10:07:51 user nova-compute[71113]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833 (non-flash)
Jul 31 10:07:51 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:07:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:51 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0f6c3e-a683-45d8-b0df-e7327f548554]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:07:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd13ccfa-ba1e-4c93-a5dc-256f613f4d37 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c, portal: 172.16.0.220,3260]
Jul 31 10:07:51 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c, portal: 172.16.0.220,3260] successful.
Jul 31 10:07:51 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:07:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:51 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[be955ca6-85e8-437f-8f1d-350bbfa1950c]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:07:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd13ccfa-ba1e-4c93-a5dc-256f613f4d37 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:07:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:51 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[daefa69e-e7d1-43ae-aa6f-6aa25f13e872]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:07:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd13ccfa-ba1e-4c93-a5dc-256f613f4d37 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:07:51 user nova-compute[71113]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)
Jul 31 10:07:51 user nova-compute[71113]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)
Jul 31 10:07:51 user nova-compute[71113]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833 (non-flash)
Jul 31 10:07:51 user nova-compute[71113]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c (non-flash)
Jul 31 10:07:51 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:07:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd13ccfa-ba1e-4c93-a5dc-256f613f4d37 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:07:51 user nova-compute[71113]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)
Jul 31 10:07:51 user nova-compute[71113]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)
Jul 31 10:07:51 user nova-compute[71113]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833 (non-flash)
Jul 31 10:07:51 user nova-compute[71113]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c (non-flash)
Jul 31 10:07:51 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:07:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-fd13ccfa-ba1e-4c93-a5dc-256f613f4d37 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:07:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd13ccfa-ba1e-4c93-a5dc-256f613f4d37 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 10:07:51 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-fd13ccfa-ba1e-4c93-a5dc-256f613f4d37 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] HCTL ('35', '-', '-', 0) found on session 46 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 10:07:51 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-fd13ccfa-ba1e-4c93-a5dc-256f613f4d37 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 10:07:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:51 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d279cc0-58d0-492e-9dee-9f23e31da7d5]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:07:51 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-fd13ccfa-ba1e-4c93-a5dc-256f613f4d37 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 10:07:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd13ccfa-ba1e-4c93-a5dc-256f613f4d37 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MidtxNfZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 10:07:52 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-fd13ccfa-ba1e-4c93-a5dc-256f613f4d37 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:07:52 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd13ccfa-ba1e-4c93-a5dc-256f613f4d37 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23064343964643535', 'path': '/dev/sdd'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:07:52 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd13ccfa-ba1e-4c93-a5dc-256f613f4d37 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23064343964643535', 'path': '/dev/sdd'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 10:07:52 user nova-compute[71113]: DEBUG nova.objects.instance [None req-fd13ccfa-ba1e-4c93-a5dc-256f613f4d37 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Lazy-loading 'flavor' on Instance uuid 95a84d3c-7aa2-4294-a419-995926a2782f {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:07:52 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-fd13ccfa-ba1e-4c93-a5dc-256f613f4d37 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 10:07:52 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:07:52 user nova-compute[71113]:   <source dev="/dev/sdd"/>
Jul 31 10:07:52 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 10:07:52 user nova-compute[71113]:   <serial>80311835-07f0-4221-8a86-1fae9750ed0c</serial>
Jul 31 10:07:52 user nova-compute[71113]: </disk>
Jul 31 10:07:52 user nova-compute[71113]:  {{(pid=71113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 10:07:53 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-fd13ccfa-ba1e-4c93-a5dc-256f613f4d37 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:07:53 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-fd13ccfa-ba1e-4c93-a5dc-256f613f4d37 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:07:53 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-fd13ccfa-ba1e-4c93-a5dc-256f613f4d37 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] No VIF found with MAC fa:16:3e:d0:99:09, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 10:07:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-fd13ccfa-ba1e-4c93-a5dc-256f613f4d37 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Lock "95a84d3c-7aa2-4294-a419-995926a2782f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.627s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:07:53 user nova-compute[71113]: INFO nova.compute.manager [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Rescuing
Jul 31 10:07:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Acquiring lock "refresh_cache-95a84d3c-7aa2-4294-a419-995926a2782f" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:07:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Acquired lock "refresh_cache-95a84d3c-7aa2-4294-a419-995926a2782f" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:07:53 user nova-compute[71113]: DEBUG nova.network.neutron [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 10:07:54 user nova-compute[71113]: DEBUG nova.network.neutron [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Updating instance_info_cache with network_info: [{"id": "a856eb89-910c-456e-bc0e-a9f92ce20248", "address": "fa:16:3e:d0:99:09", "network": {"id": "67fc40ba-b2c8-43f9-a714-46ef13acf5ed", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1597196996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f8d203e3c534371b05a2ec4c6c07a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa856eb89-91", "ovs_interfaceid": "a856eb89-910c-456e-bc0e-a9f92ce20248", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:07:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Releasing lock "refresh_cache-95a84d3c-7aa2-4294-a419-995926a2782f" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:07:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:07:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:07:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:07:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:07:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:07:54 user nova-compute[71113]: DEBUG nova.compute.manager [req-34769706-5f0a-43d9-8093-8a26da3591a0 req-edc0aa67-81ce-4eaa-b0a0-999e8f85488a service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Received event network-vif-unplugged-a856eb89-910c-456e-bc0e-a9f92ce20248 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:07:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-34769706-5f0a-43d9-8093-8a26da3591a0 req-edc0aa67-81ce-4eaa-b0a0-999e8f85488a service nova] Acquiring lock "95a84d3c-7aa2-4294-a419-995926a2782f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:07:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-34769706-5f0a-43d9-8093-8a26da3591a0 req-edc0aa67-81ce-4eaa-b0a0-999e8f85488a service nova] Lock "95a84d3c-7aa2-4294-a419-995926a2782f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:07:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-34769706-5f0a-43d9-8093-8a26da3591a0 req-edc0aa67-81ce-4eaa-b0a0-999e8f85488a service nova] Lock "95a84d3c-7aa2-4294-a419-995926a2782f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:07:54 user nova-compute[71113]: DEBUG nova.compute.manager [req-34769706-5f0a-43d9-8093-8a26da3591a0 req-edc0aa67-81ce-4eaa-b0a0-999e8f85488a service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] No waiting events found dispatching network-vif-unplugged-a856eb89-910c-456e-bc0e-a9f92ce20248 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:07:54 user nova-compute[71113]: WARNING nova.compute.manager [req-34769706-5f0a-43d9-8093-8a26da3591a0 req-edc0aa67-81ce-4eaa-b0a0-999e8f85488a service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Received unexpected event network-vif-unplugged-a856eb89-910c-456e-bc0e-a9f92ce20248 for instance with vm_state active and task_state rescuing.
Jul 31 10:07:55 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Instance destroyed successfully.
Jul 31 10:07:55 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Attempting a stable device rescue
Jul 31 10:07:55 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=71113) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 31 10:07:55 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Instance directory exists: not creating {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 31 10:07:55 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Creating image(s)
Jul 31 10:07:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Acquiring lock "/opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:07:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Lock "/opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:07:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Lock "/opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:07:55 user nova-compute[71113]: DEBUG nova.objects.instance [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Lazy-loading 'trusted_certs' on Instance uuid 95a84d3c-7aa2-4294-a419-995926a2782f {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:07:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Acquiring lock "ec19842b3b081c2df3995370cc1625b071225e56" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:07:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Lock "ec19842b3b081c2df3995370cc1625b071225e56" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:07:56 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec19842b3b081c2df3995370cc1625b071225e56.part --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:07:56 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec19842b3b081c2df3995370cc1625b071225e56.part --force-share --output=json" returned: 0 in 0.170s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:56 user nova-compute[71113]: DEBUG nova.virt.images [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] 36de78b5-f9e6-4903-b996-2d394cd7d072 was qcow2, converting to raw {{(pid=71113) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 31 10:07:56 user nova-compute[71113]: DEBUG nova.privsep.utils [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71113) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 10:07:56 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ec19842b3b081c2df3995370cc1625b071225e56.part /opt/stack/data/nova/instances/_base/ec19842b3b081c2df3995370cc1625b071225e56.converted {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG nova.compute.manager [req-b885b3d4-d2b2-4ced-9415-5a17a480fd8a req-48b94dc3-9349-4a3d-a537-010c7f791285 service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Received event network-vif-plugged-a856eb89-910c-456e-bc0e-a9f92ce20248 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-b885b3d4-d2b2-4ced-9415-5a17a480fd8a req-48b94dc3-9349-4a3d-a537-010c7f791285 service nova] Acquiring lock "95a84d3c-7aa2-4294-a419-995926a2782f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-b885b3d4-d2b2-4ced-9415-5a17a480fd8a req-48b94dc3-9349-4a3d-a537-010c7f791285 service nova] Lock "95a84d3c-7aa2-4294-a419-995926a2782f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-b885b3d4-d2b2-4ced-9415-5a17a480fd8a req-48b94dc3-9349-4a3d-a537-010c7f791285 service nova] Lock "95a84d3c-7aa2-4294-a419-995926a2782f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG nova.compute.manager [req-b885b3d4-d2b2-4ced-9415-5a17a480fd8a req-48b94dc3-9349-4a3d-a537-010c7f791285 service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] No waiting events found dispatching network-vif-plugged-a856eb89-910c-456e-bc0e-a9f92ce20248 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:07:57 user nova-compute[71113]: WARNING nova.compute.manager [req-b885b3d4-d2b2-4ced-9415-5a17a480fd8a req-48b94dc3-9349-4a3d-a537-010c7f791285 service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Received unexpected event network-vif-plugged-a856eb89-910c-456e-bc0e-a9f92ce20248 for instance with vm_state active and task_state rescuing.
Jul 31 10:07:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ec19842b3b081c2df3995370cc1625b071225e56.part /opt/stack/data/nova/instances/_base/ec19842b3b081c2df3995370cc1625b071225e56.converted" returned: 0 in 0.572s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec19842b3b081c2df3995370cc1625b071225e56.converted --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec19842b3b081c2df3995370cc1625b071225e56.converted --force-share --output=json" returned: 0 in 0.138s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Lock "ec19842b3b081c2df3995370cc1625b071225e56" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.057s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Acquiring lock "ec19842b3b081c2df3995370cc1625b071225e56" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Lock "ec19842b3b081c2df3995370cc1625b071225e56" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec19842b3b081c2df3995370cc1625b071225e56 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec19842b3b081c2df3995370cc1625b071225e56 --force-share --output=json" returned: 0 in 0.134s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ec19842b3b081c2df3995370cc1625b071225e56,backing_fmt=raw /opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk.rescue {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ec19842b3b081c2df3995370cc1625b071225e56,backing_fmt=raw /opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk.rescue" returned: 0 in 0.051s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Lock "ec19842b3b081c2df3995370cc1625b071225e56" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG nova.objects.instance [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Lazy-loading 'migration_context' on Instance uuid 95a84d3c-7aa2-4294-a419-995926a2782f {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Created local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Start _get_guest_xml network_info=[{"id": "a856eb89-910c-456e-bc0e-a9f92ce20248", "address": "fa:16:3e:d0:99:09", "network": {"id": "67fc40ba-b2c8-43f9-a714-46ef13acf5ed", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1597196996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1597196996-network", "vif_mac": "fa:16:3e:d0:99:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f8d203e3c534371b05a2ec4c6c07a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa856eb89-91", "ovs_interfaceid": "a856eb89-910c-456e-bc0e-a9f92ce20248", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '36de78b5-f9e6-4903-b996-2d394cd7d072', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'image_id': '078646fe-b504-41ed-a147-61072e903e51'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '3fc7d0eb-d37c-4cdb-9abf-01237efa5d57', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MidtxNfZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '95a84d3c-7aa2-4294-a419-995926a2782f', 'attached_at': '', 'detached_at': '', 'volume_id': '80311835-07f0-4221-8a86-1fae9750ed0c', 'serial': '80311835-07f0-4221-8a86-1fae9750ed0c'}, 'boot_index': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG nova.objects.instance [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Lazy-loading 'resources' on Instance uuid 95a84d3c-7aa2-4294-a419-995926a2782f {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG nova.objects.instance [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Lazy-loading 'numa_topology' on Instance uuid 95a84d3c-7aa2-4294-a419-995926a2782f {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:07:57 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:07:57 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:07:57 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG nova.objects.instance [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Lazy-loading 'vcpu_model' on Instance uuid 95a84d3c-7aa2-4294-a419-995926a2782f {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MidtxNfZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:07:57 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:07:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:07:57 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:07:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:07:57 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 10:07:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[acedbae0-f76a-459e-82a0-aef548940f1b]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = MidtxNfZ\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 31 10:07:57 user nova-compute[71113]: node.name = iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c
Jul 31 10:07:57 user nova-compute[71113]: node.tpgt = -1
Jul 31 10:07:57 user nova-compute[71113]: node.startup = automatic
Jul 31 10:07:57 user nova-compute[71113]: node.leading_login = No
Jul 31 10:07:57 user nova-compute[71113]: iface.iscsi_ifacename = default
Jul 31 10:07:57 user nova-compute[71113]: iface.net_ifacename = <empty>
Jul 31 10:07:57 user nova-compute[71113]: iface.ipaddress = <empty>
Jul 31 10:07:57 user nova-compute[71113]: iface.prefix_len = 0
Jul 31 10:07:57 user nova-compute[71113]: iface.hwaddress = <empty>
Jul 31 10:07:57 user nova-compute[71113]: iface.transport_name = tcp
Jul 31 10:07:57 user nova-compute[71113]: iface.initiatorname = <empty>
Jul 31 10:07:57 user nova-compute[71113]: iface.state = <empty>
Jul 31 10:07:57 user nova-compute[71113]: iface.vlan_id = 0
Jul 31 10:07:57 user nova-compute[71113]: iface.vlan_priority = 0
Jul 31 10:07:57 user nova-compute[71113]: iface.vlan_state = <empty>
Jul 31 10:07:57 user nova-compute[71113]: iface.iface_num = 0
Jul 31 10:07:57 user nova-compute[71113]: iface.mtu = 0
Jul 31 10:07:57 user nova-compute[71113]: iface.port = 0
Jul 31 10:07:57 user nova-compute[71113]: iface.bootproto = <empty>
Jul 31 10:07:57 user nova-compute[71113]: iface.subnet_mask = <empty>
Jul 31 10:07:57 user nova-compute[71113]: iface.gateway = <empty>
Jul 31 10:07:57 user nova-compute[71113]: iface.dhcp_alt_client_id_state = <empty>
Jul 31 10:07:57 user nova-compute[71113]: iface.dhcp_alt_client_id = <empty>
Jul 31 10:07:57 user nova-compute[71113]: iface.dhcp_dns = <empty>
Jul 31 10:07:57 user nova-compute[71113]: iface.dhcp_learn_iqn = <empty>
Jul 31 10:07:57 user nova-compute[71113]: iface.dhcp_req_vendor_id_state = <empty>
Jul 31 10:07:57 user nova-compute[71113]: iface.dhcp_vendor_id_state = <empty>
Jul 31 10:07:57 user nova-compute[71113]: iface.dhcp_vendor_id = <empty>
Jul 31 10:07:57 user nova-compute[71113]: iface.dhcp_slp_da = <empty>
Jul 31 10:07:57 user nova-compute[71113]: iface.fragmentation = <empty>
Jul 31 10:07:57 user nova-compute[71113]: iface.gratuitous_arp = <empty>
Jul 31 10:07:57 user nova-compute[71113]: iface.incoming_forwarding = <empty>
Jul 31 10:07:57 user nova-compute[71113]: iface.tos_state = <empty>
Jul 31 10:07:57 user nova-compute[71113]: iface.tos = 0
Jul 31 10:07:57 user nova-compute[71113]: iface.ttl = 0
Jul 31 10:07:57 user nova-compute[71113]: iface.delayed_ack = <empty>
Jul 31 10:07:57 user nova-compute[71113]: iface.tcp_nagle = <empty>
Jul 31 10:07:57 user nova-compute[71113]: iface.tcp_wsf_state = <empty>
Jul 31 10:07:57 user nova-compute[71113]: iface.tcp_wsf = 0
Jul 31 10:07:57 user nova-compute[71113]: iface.tcp_timer_scale = 0
Jul 31 10:07:57 user nova-compute[71113]: iface.tcp_timestamp = <empty>
Jul 31 10:07:57 user nova-compute[71113]: iface.redirect = <empty>
Jul 31 10:07:57 user nova-compute[71113]: iface.def_task_mgmt_timeout = 0
Jul 31 10:07:57 user nova-compute[71113]: iface.header_digest = <empty>
Jul 31 10:07:57 user nova-compute[71113]: iface.data_digest = <empty>
Jul 31 10:07:57 user nova-compute[71113]: iface.immediate_data = <empty>
Jul 31 10:07:57 user nova-compute[71113]: iface.initial_r2t = <empty>
Jul 31 10:07:57 user nova-compute[71113]: iface.data_seq_inorder = <empty>
Jul 31 10:07:57 user nova-compute[71113]: iface.data_pdu_inorder = <empty>
Jul 31 10:07:57 user nova-compute[71113]: iface.erl = 0
Jul 31 10:07:57 user nova-compute[71113]: iface.max_receive_data_len = 0
Jul 31 10:07:57 user nova-compute[71113]: iface.first_burst_len = 0
Jul 31 10:07:57 user nova-compute[71113]: iface.max_outstanding_r2t = 0
Jul 31 10:07:57 user nova-compute[71113]: iface.max_burst_len = 0
Jul 31 10:07:57 user nova-compute[71113]: iface.chap_auth = <empty>
Jul 31 10:07:57 user nova-compute[71113]: iface.bidi_chap = <empty>
Jul 31 10:07:57 user nova-compute[71113]: iface.strict_login_compliance = <empty>
Jul 31 10:07:57 user nova-compute[71113]: iface.discovery_auth = <empty>
Jul 31 10:07:57 user nova-compute[71113]: iface.discovery_logout = <empty>
Jul 31 10:07:57 user nova-compute[71113]: node.discovery_address = <empty>
Jul 31 10:07:57 user nova-compute[71113]: node.discovery_port = 0
Jul 31 10:07:57 user nova-compute[71113]: node.discovery_type = static
Jul 31 10:07:57 user nova-compute[71113]: node.session.initial_cmdsn = 0
Jul 31 10:07:57 user nova-compute[71113]: node.session.initial_login_retry_max = 8
Jul 31 10:07:57 user nova-compute[71113]: node.session.xmit_thread_priority = -20
Jul 31 10:07:57 user nova-compute[71113]: node.session.cmds_max = 128
Jul 31 10:07:57 user nova-compute[71113]: node.session.queue_depth = 32
Jul 31 10:07:57 user nova-compute[71113]: node.session.nr_sessions = 1
Jul 31 10:07:57 user nova-compute[71113]: node.session.auth.authmethod = CHAP
Jul 31 10:07:57 user nova-compute[71113]: node.session.auth.username = MidtxNfZ
Jul 31 10:07:57 user nova-compute[71113]: node.session.auth.password = ***
Jul 31 10:07:57 user nova-compute[71113]: node.session.auth.username_in = <empty>
Jul 31 10:07:57 user nova-compute[71113]: node.session.auth.password_in = <empty>
Jul 31 10:07:57 user nova-compute[71113]: node.session.auth.chap_algs = MD5
Jul 31 10:07:57 user nova-compute[71113]: node.session.timeo.replacement_timeout = 120
Jul 31 10:07:57 user nova-compute[71113]: node.session.err_timeo.abort_timeout = 15
Jul 31 10:07:57 user nova-compute[71113]: node.session.err_timeo.lu_reset_timeout = 30
Jul 31 10:07:57 user nova-compute[71113]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 31 10:07:57 user nova-compute[71113]: node.session.err_timeo.host_reset_timeout = 60
Jul 31 10:07:57 user nova-compute[71113]: node.session.iscsi.FastAbort = Yes
Jul 31 10:07:57 user nova-compute[71113]: node.session.iscsi.InitialR2T = No
Jul 31 10:07:57 user nova-compute[71113]: node.session.iscsi.ImmediateData = Yes
Jul 31 10:07:57 user nova-compute[71113]: node.session.iscsi.FirstBurstLength = 262144
Jul 31 10:07:57 user nova-compute[71113]: node.session.iscsi.MaxBurstLength = 16776192
Jul 31 10:07:57 user nova-compute[71113]: node.session.iscsi.DefaultTime2Retain = 0
Jul 31 10:07:57 user nova-compute[71113]: node.session.iscsi.DefaultTime2Wait = 2
Jul 31 10:07:57 user nova-compute[71113]: node.session.iscsi.MaxConnections = 1
Jul 31 10:07:57 user nova-compute[71113]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 31 10:07:57 user nova-compute[71113]: node.session.iscsi.ERL = 0
Jul 31 10:07:57 user nova-compute[71113]: node.session.scan = manual
Jul 31 10:07:57 user nova-compute[71113]: node.session.reopen_max = 0
Jul 31 10:07:57 user nova-compute[71113]: node.conn[0].address = 172.16.0.220
Jul 31 10:07:57 user nova-compute[71113]: node.conn[0].port = 3260
Jul 31 10:07:57 user nova-compute[71113]: node.conn[0].startup = manual
Jul 31 10:07:57 user nova-compute[71113]: node.conn[0].tcp.window_size = 524288
Jul 31 10:07:57 user nova-compute[71113]: node.conn[0].tcp.type_of_service = 0
Jul 31 10:07:57 user nova-compute[71113]: node.conn[0].timeo.logout_timeout = 15
Jul 31 10:07:57 user nova-compute[71113]: node.conn[0].timeo.login_timeout = 15
Jul 31 10:07:57 user nova-compute[71113]: node.conn[0].timeo.auth_timeout = 45
Jul 31 10:07:57 user nova-compute[71113]: node.conn[0].timeo.noop_out_interval = 5
Jul 31 10:07:57 user nova-compute[71113]: node.conn[0].timeo.noop_out_timeout = 5
Jul 31 10:07:57 user nova-compute[71113]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 31 10:07:57 user nova-compute[71113]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 31 10:07:57 user nova-compute[71113]: node.conn[0].iscsi.HeaderDigest = None
Jul 31 10:07:57 user nova-compute[71113]: node.conn[0].iscsi.DataDigest = None
Jul 31 10:07:57 user nova-compute[71113]: node.conn[0].iscsi.IFMarker = No
Jul 31 10:07:57 user nova-compute[71113]: node.conn[0].iscsi.OFMarker = No
Jul 31 10:07:57 user nova-compute[71113]: # END RECORD
Jul 31 10:07:57 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c423d11c-ed7a-4bc8-85cd-5bd03614f11b]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0b7bb0-c6fe-4387-a746-051722ebc7f1]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MidtxNfZ {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MidtxNfZ" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b046ae4-1ed6-4074-b2e6-0d4cff979125]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MidtxNfZ'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f072a28-bd3d-4298-807b-06bffcc0af98]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[752cf1c7-bad2-4bbe-ae76-479a5d0dcdcd]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:07:57 user nova-compute[71113]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)
Jul 31 10:07:57 user nova-compute[71113]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)
Jul 31 10:07:57 user nova-compute[71113]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833 (non-flash)
Jul 31 10:07:57 user nova-compute[71113]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c (non-flash)
Jul 31 10:07:57 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:07:57 user nova-compute[71113]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)
Jul 31 10:07:57 user nova-compute[71113]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)
Jul 31 10:07:57 user nova-compute[71113]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833 (non-flash)
Jul 31 10:07:57 user nova-compute[71113]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c (non-flash)
Jul 31 10:07:57 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.145s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] HCTL ('35', '0', '0', 0) found on session 46 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.014s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde8874c-8b7b-406a-9f78-cdc0db325108]: (4, ('0 0 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Searching for a device in session 46 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MidtxNfZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.168s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] <== connect_volume: return (169ms) {'type': 'block', 'scsi_wwn': '23064343964643535', 'path': '/dev/sdd'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23064343964643535', 'path': '/dev/sdd'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:03:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2103964806',display_name='tempest-ServerStableDeviceRescueTest-server-2103964806',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2103964806',id=36,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdl8SX645/Muc/9M6HuPzDTOvIdM6KrFE61+dTZHqyrZ0zWuC0IOgJE5YL7IjPgvGTYTgBzjZJL8AHFSZVMP6dsDsN1FtFI6gizkdDAM6HYW8d03e+SFHeZYZOyP/3S4w==',key_name='tempest-keypair-1251481522',keypairs=<?>,launch_index=0,launched_at=2023-07-31T10:04:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f8d203e3c534371b05a2ec4c6c07a61',ramdisk_id='',reservation_id='r-fanuve5b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1277436113',owner_user_name='tempest-ServerStableDeviceRescueTest-1277436113-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T10:05:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4c2f8d82f494a5d8255984f4bd3806b',uuid=95a84d3c-7aa2-4294-a419-995926a2782f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a856eb89-910c-456e-bc0e-a9f92ce20248", "address": "fa:16:3e:d0:99:09", "network": {"id": "67fc40ba-b2c8-43f9-a714-46ef13acf5ed", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1597196996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1597196996-network", "vif_mac": "fa:16:3e:d0:99:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f8d203e3c534371b05a2ec4c6c07a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa856eb89-91", "ovs_interfaceid": "a856eb89-910c-456e-bc0e-a9f92ce20248", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Converting VIF {"id": "a856eb89-910c-456e-bc0e-a9f92ce20248", "address": "fa:16:3e:d0:99:09", "network": {"id": "67fc40ba-b2c8-43f9-a714-46ef13acf5ed", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1597196996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1597196996-network", "vif_mac": "fa:16:3e:d0:99:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f8d203e3c534371b05a2ec4c6c07a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa856eb89-91", "ovs_interfaceid": "a856eb89-910c-456e-bc0e-a9f92ce20248", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:99:09,bridge_name='br-int',has_traffic_filtering=True,id=a856eb89-910c-456e-bc0e-a9f92ce20248,network=Network(67fc40ba-b2c8-43f9-a714-46ef13acf5ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa856eb89-91') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG nova.objects.instance [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Lazy-loading 'pci_devices' on Instance uuid 95a84d3c-7aa2-4294-a419-995926a2782f {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] End _get_guest_xml xml=<domain type="kvm">
Jul 31 10:07:57 user nova-compute[71113]:   <uuid>95a84d3c-7aa2-4294-a419-995926a2782f</uuid>
Jul 31 10:07:57 user nova-compute[71113]:   <name>instance-00000024</name>
Jul 31 10:07:57 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 10:07:57 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 10:07:57 user nova-compute[71113]:   <metadata>
Jul 31 10:07:57 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 10:07:57 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 10:07:57 user nova-compute[71113]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-2103964806</nova:name>
Jul 31 10:07:57 user nova-compute[71113]:       <nova:creationTime>2023-07-31 10:07:57</nova:creationTime>
Jul 31 10:07:57 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 10:07:57 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 10:07:57 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 10:07:57 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 10:07:57 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 10:07:57 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 10:07:57 user nova-compute[71113]:       </nova:flavor>
Jul 31 10:07:57 user nova-compute[71113]:       <nova:owner>
Jul 31 10:07:57 user nova-compute[71113]:         <nova:user uuid="c4c2f8d82f494a5d8255984f4bd3806b">tempest-ServerStableDeviceRescueTest-1277436113-project-member</nova:user>
Jul 31 10:07:57 user nova-compute[71113]:         <nova:project uuid="6f8d203e3c534371b05a2ec4c6c07a61">tempest-ServerStableDeviceRescueTest-1277436113</nova:project>
Jul 31 10:07:57 user nova-compute[71113]:       </nova:owner>
Jul 31 10:07:57 user nova-compute[71113]:       <nova:root type="image" uuid="078646fe-b504-41ed-a147-61072e903e51"/>
Jul 31 10:07:57 user nova-compute[71113]:       <nova:ports>
Jul 31 10:07:57 user nova-compute[71113]:         <nova:port uuid="a856eb89-910c-456e-bc0e-a9f92ce20248">
Jul 31 10:07:57 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 31 10:07:57 user nova-compute[71113]:         </nova:port>
Jul 31 10:07:57 user nova-compute[71113]:       </nova:ports>
Jul 31 10:07:57 user nova-compute[71113]:     </nova:instance>
Jul 31 10:07:57 user nova-compute[71113]:   </metadata>
Jul 31 10:07:57 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 10:07:57 user nova-compute[71113]:     <system>
Jul 31 10:07:57 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 10:07:57 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 10:07:57 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 10:07:57 user nova-compute[71113]:       <entry name="serial">95a84d3c-7aa2-4294-a419-995926a2782f</entry>
Jul 31 10:07:57 user nova-compute[71113]:       <entry name="uuid">95a84d3c-7aa2-4294-a419-995926a2782f</entry>
Jul 31 10:07:57 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 10:07:57 user nova-compute[71113]:     </system>
Jul 31 10:07:57 user nova-compute[71113]:   </sysinfo>
Jul 31 10:07:57 user nova-compute[71113]:   <os>
Jul 31 10:07:57 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 10:07:57 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 10:07:57 user nova-compute[71113]:   </os>
Jul 31 10:07:57 user nova-compute[71113]:   <features>
Jul 31 10:07:57 user nova-compute[71113]:     <acpi/>
Jul 31 10:07:57 user nova-compute[71113]:     <apic/>
Jul 31 10:07:57 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 10:07:57 user nova-compute[71113]:   </features>
Jul 31 10:07:57 user nova-compute[71113]:   <clock offset="utc">
Jul 31 10:07:57 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 10:07:57 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 10:07:57 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 10:07:57 user nova-compute[71113]:   </clock>
Jul 31 10:07:57 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 10:07:57 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 10:07:57 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 10:07:57 user nova-compute[71113]:   </cpu>
Jul 31 10:07:57 user nova-compute[71113]:   <devices>
Jul 31 10:07:57 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 10:07:57 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 10:07:57 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk"/>
Jul 31 10:07:57 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 10:07:57 user nova-compute[71113]:     </disk>
Jul 31 10:07:57 user nova-compute[71113]:     <disk type="block" device="disk">
Jul 31 10:07:57 user nova-compute[71113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:07:57 user nova-compute[71113]:       <source dev="/dev/sdd"/>
Jul 31 10:07:57 user nova-compute[71113]:       <target dev="vdb" bus="virtio"/>
Jul 31 10:07:57 user nova-compute[71113]:       <serial>80311835-07f0-4221-8a86-1fae9750ed0c</serial>
Jul 31 10:07:57 user nova-compute[71113]:     </disk>
Jul 31 10:07:57 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 10:07:57 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 10:07:57 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk.rescue"/>
Jul 31 10:07:57 user nova-compute[71113]:       <target dev="vdc" bus="virtio"/>
Jul 31 10:07:57 user nova-compute[71113]:       <boot order="1"/>
Jul 31 10:07:57 user nova-compute[71113]:     </disk>
Jul 31 10:07:57 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 10:07:57 user nova-compute[71113]:       <mac address="fa:16:3e:d0:99:09"/>
Jul 31 10:07:57 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:07:57 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 10:07:57 user nova-compute[71113]:       <target dev="tapa856eb89-91"/>
Jul 31 10:07:57 user nova-compute[71113]:     </interface>
Jul 31 10:07:57 user nova-compute[71113]:     <serial type="pty">
Jul 31 10:07:57 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/console.log" append="off"/>
Jul 31 10:07:57 user nova-compute[71113]:     </serial>
Jul 31 10:07:57 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 10:07:57 user nova-compute[71113]:     <video>
Jul 31 10:07:57 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:07:57 user nova-compute[71113]:     </video>
Jul 31 10:07:57 user nova-compute[71113]:     <rng model="virtio">
Jul 31 10:07:57 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 10:07:57 user nova-compute[71113]:     </rng>
Jul 31 10:07:57 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 10:07:57 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 10:07:57 user nova-compute[71113]:       <stats period="10"/>
Jul 31 10:07:57 user nova-compute[71113]:     </memballoon>
Jul 31 10:07:57 user nova-compute[71113]:   </devices>
Jul 31 10:07:57 user nova-compute[71113]: </domain>
Jul 31 10:07:57 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 10:07:57 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Instance destroyed successfully.
Jul 31 10:07:57 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:07:57 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] No VIF found with MAC fa:16:3e:d0:99:09, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 10:07:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:07:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:07:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:07:59 user nova-compute[71113]: DEBUG nova.compute.manager [req-8ca1fdcf-f6bc-45d8-94a7-0bc43c7bf020 req-2104d3ea-d413-45cc-ab4d-2001406cf96a service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Received event network-vif-plugged-a856eb89-910c-456e-bc0e-a9f92ce20248 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:07:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8ca1fdcf-f6bc-45d8-94a7-0bc43c7bf020 req-2104d3ea-d413-45cc-ab4d-2001406cf96a service nova] Acquiring lock "95a84d3c-7aa2-4294-a419-995926a2782f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:07:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8ca1fdcf-f6bc-45d8-94a7-0bc43c7bf020 req-2104d3ea-d413-45cc-ab4d-2001406cf96a service nova] Lock "95a84d3c-7aa2-4294-a419-995926a2782f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:07:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8ca1fdcf-f6bc-45d8-94a7-0bc43c7bf020 req-2104d3ea-d413-45cc-ab4d-2001406cf96a service nova] Lock "95a84d3c-7aa2-4294-a419-995926a2782f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:07:59 user nova-compute[71113]: DEBUG nova.compute.manager [req-8ca1fdcf-f6bc-45d8-94a7-0bc43c7bf020 req-2104d3ea-d413-45cc-ab4d-2001406cf96a service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] No waiting events found dispatching network-vif-plugged-a856eb89-910c-456e-bc0e-a9f92ce20248 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:07:59 user nova-compute[71113]: WARNING nova.compute.manager [req-8ca1fdcf-f6bc-45d8-94a7-0bc43c7bf020 req-2104d3ea-d413-45cc-ab4d-2001406cf96a service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Received unexpected event network-vif-plugged-a856eb89-910c-456e-bc0e-a9f92ce20248 for instance with vm_state active and task_state rescuing.
Jul 31 10:07:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:07:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:07:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:08:00 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:08:01 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Removed pending event for 95a84d3c-7aa2-4294-a419-995926a2782f due to event {{(pid=71113) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 31 10:08:01 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690798081.4582887, 95a84d3c-7aa2-4294-a419-995926a2782f => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:08:01 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] VM Resumed (Lifecycle Event)
Jul 31 10:08:01 user nova-compute[71113]: DEBUG nova.compute.manager [None req-27fd5e89-4cf0-4f52-a6d3-d40975509c6e tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:08:01 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:08:01 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:08:01 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 31 10:08:01 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690798081.46023, 95a84d3c-7aa2-4294-a419-995926a2782f => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:08:01 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] VM Started (Lifecycle Event)
Jul 31 10:08:01 user nova-compute[71113]: DEBUG nova.compute.manager [req-3bd03eaa-a03f-4c05-b035-426fc1e99a62 req-58efd09a-0732-439e-9bc2-1ddf79f3b7e2 service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Received event network-vif-plugged-a856eb89-910c-456e-bc0e-a9f92ce20248 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:08:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3bd03eaa-a03f-4c05-b035-426fc1e99a62 req-58efd09a-0732-439e-9bc2-1ddf79f3b7e2 service nova] Acquiring lock "95a84d3c-7aa2-4294-a419-995926a2782f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:08:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3bd03eaa-a03f-4c05-b035-426fc1e99a62 req-58efd09a-0732-439e-9bc2-1ddf79f3b7e2 service nova] Lock "95a84d3c-7aa2-4294-a419-995926a2782f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:08:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3bd03eaa-a03f-4c05-b035-426fc1e99a62 req-58efd09a-0732-439e-9bc2-1ddf79f3b7e2 service nova] Lock "95a84d3c-7aa2-4294-a419-995926a2782f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:08:01 user nova-compute[71113]: DEBUG nova.compute.manager [req-3bd03eaa-a03f-4c05-b035-426fc1e99a62 req-58efd09a-0732-439e-9bc2-1ddf79f3b7e2 service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] No waiting events found dispatching network-vif-plugged-a856eb89-910c-456e-bc0e-a9f92ce20248 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:08:01 user nova-compute[71113]: WARNING nova.compute.manager [req-3bd03eaa-a03f-4c05-b035-426fc1e99a62 req-58efd09a-0732-439e-9bc2-1ddf79f3b7e2 service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Received unexpected event network-vif-plugged-a856eb89-910c-456e-bc0e-a9f92ce20248 for instance with vm_state active and task_state rescuing.
Jul 31 10:08:01 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:08:01 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:08:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f4a6b602-9ed6-43e7-a797-00c184722711 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquiring lock "52f1f390-1599-4dda-9418-f12a48ef582c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:08:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f4a6b602-9ed6-43e7-a797-00c184722711 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "52f1f390-1599-4dda-9418-f12a48ef582c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:08:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f4a6b602-9ed6-43e7-a797-00c184722711 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquiring lock "52f1f390-1599-4dda-9418-f12a48ef582c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:08:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f4a6b602-9ed6-43e7-a797-00c184722711 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "52f1f390-1599-4dda-9418-f12a48ef582c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:08:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f4a6b602-9ed6-43e7-a797-00c184722711 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "52f1f390-1599-4dda-9418-f12a48ef582c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:08:03 user nova-compute[71113]: INFO nova.compute.manager [None req-f4a6b602-9ed6-43e7-a797-00c184722711 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Terminating instance
Jul 31 10:08:03 user nova-compute[71113]: DEBUG nova.compute.manager [None req-f4a6b602-9ed6-43e7-a797-00c184722711 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Start destroying the instance on the hypervisor. {{(pid=71113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 10:08:03 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:08:03 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG nova.compute.manager [req-e8595991-0e54-4e56-b752-2d4b70b63eba req-14a660f0-bb98-4f8e-a3c9-b6f8b25de7d0 service nova] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Received event network-vif-unplugged-6af975ec-2ae8-44fc-8762-90e9a13efbce {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e8595991-0e54-4e56-b752-2d4b70b63eba req-14a660f0-bb98-4f8e-a3c9-b6f8b25de7d0 service nova] Acquiring lock "52f1f390-1599-4dda-9418-f12a48ef582c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e8595991-0e54-4e56-b752-2d4b70b63eba req-14a660f0-bb98-4f8e-a3c9-b6f8b25de7d0 service nova] Lock "52f1f390-1599-4dda-9418-f12a48ef582c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e8595991-0e54-4e56-b752-2d4b70b63eba req-14a660f0-bb98-4f8e-a3c9-b6f8b25de7d0 service nova] Lock "52f1f390-1599-4dda-9418-f12a48ef582c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG nova.compute.manager [req-e8595991-0e54-4e56-b752-2d4b70b63eba req-14a660f0-bb98-4f8e-a3c9-b6f8b25de7d0 service nova] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] No waiting events found dispatching network-vif-unplugged-6af975ec-2ae8-44fc-8762-90e9a13efbce {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG nova.compute.manager [req-e8595991-0e54-4e56-b752-2d4b70b63eba req-14a660f0-bb98-4f8e-a3c9-b6f8b25de7d0 service nova] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Received event network-vif-unplugged-6af975ec-2ae8-44fc-8762-90e9a13efbce for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 10:08:04 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Instance destroyed successfully.
Jul 31 10:08:04 user nova-compute[71113]: DEBUG nova.objects.instance [None req-f4a6b602-9ed6-43e7-a797-00c184722711 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lazy-loading 'resources' on Instance uuid 52f1f390-1599-4dda-9418-f12a48ef582c {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-f4a6b602-9ed6-43e7-a797-00c184722711 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:02:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1367258869',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1367258869',id=34,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T10:04:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88bbf2636f6248fcbe644af4eab0c823',ramdisk_id='',reservation_id='r-zhtgqe4c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1194948978',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T10:06:18Z,user_data=None,user_id='f4f505d5eddc4df48ec267f6f69a01f9',uuid=52f1f390-1599-4dda-9418-f12a48ef582c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6af975ec-2ae8-44fc-8762-90e9a13efbce", "address": "fa:16:3e:b2:53:f2", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af975ec-2a", "ovs_interfaceid": "6af975ec-2ae8-44fc-8762-90e9a13efbce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-f4a6b602-9ed6-43e7-a797-00c184722711 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Converting VIF {"id": "6af975ec-2ae8-44fc-8762-90e9a13efbce", "address": "fa:16:3e:b2:53:f2", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6af975ec-2a", "ovs_interfaceid": "6af975ec-2ae8-44fc-8762-90e9a13efbce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-f4a6b602-9ed6-43e7-a797-00c184722711 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:53:f2,bridge_name='br-int',has_traffic_filtering=True,id=6af975ec-2ae8-44fc-8762-90e9a13efbce,network=Network(6f88bfaa-d58d-4ac2-b43d-0689d50456ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6af975ec-2a') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG os_vif [None req-f4a6b602-9ed6-43e7-a797-00c184722711 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:53:f2,bridge_name='br-int',has_traffic_filtering=True,id=6af975ec-2ae8-44fc-8762-90e9a13efbce,network=Network(6f88bfaa-d58d-4ac2-b43d-0689d50456ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6af975ec-2a') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6af975ec-2a, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:08:04 user nova-compute[71113]: INFO os_vif [None req-f4a6b602-9ed6-43e7-a797-00c184722711 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:53:f2,bridge_name='br-int',has_traffic_filtering=True,id=6af975ec-2ae8-44fc-8762-90e9a13efbce,network=Network(6f88bfaa-d58d-4ac2-b43d-0689d50456ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6af975ec-2a')
Jul 31 10:08:04 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4a6b602-9ed6-43e7-a797-00c184722711 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a6b602-9ed6-43e7-a797-00c184722711 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OCHGdVDP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:08:04 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-f4a6b602-9ed6-43e7-a797-00c184722711 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:08:04 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-f4a6b602-9ed6-43e7-a797-00c184722711 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-f4a6b602-9ed6-43e7-a797-00c184722711 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.005s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a6b602-9ed6-43e7-a797-00c184722711 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3714ab59-3faf-40f7-b97e-3f8dbbf5683f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[570d6f98-3bb9-495f-9229-d268f257dc51]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a6b602-9ed6-43e7-a797-00c184722711 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:08:04 user nova-compute[71113]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)
Jul 31 10:08:04 user nova-compute[71113]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)
Jul 31 10:08:04 user nova-compute[71113]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833 (non-flash)
Jul 31 10:08:04 user nova-compute[71113]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c (non-flash)
Jul 31 10:08:04 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a6b602-9ed6-43e7-a797-00c184722711 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:08:04 user nova-compute[71113]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 (non-flash)
Jul 31 10:08:04 user nova-compute[71113]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)
Jul 31 10:08:04 user nova-compute[71113]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833 (non-flash)
Jul 31 10:08:04 user nova-compute[71113]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c (non-flash)
Jul 31 10:08:04 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a6b602-9ed6-43e7-a797-00c184722711 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f78cc76c280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7'): ({'sdf'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-f4a6b602-9ed6-43e7-a797-00c184722711 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Removing single pathed devices sdf {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99be299-9e9e-4af4-83e8-95f82b2d6680]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbcd7415-ff63-445d-ac53-f67641e8791b]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-f4a6b602-9ed6-43e7-a797-00c184722711 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Flushing IO for device /dev/sdf {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea1a0ea-0d6b-451c-92b8-b9ededff1111]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-f4a6b602-9ed6-43e7-a797-00c184722711 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d023537-f170-4a3c-89df-3377c6c15b28]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-f4a6b602-9ed6-43e7-a797-00c184722711 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-f4a6b602-9ed6-43e7-a797-00c184722711 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] SCSI volumes sdf have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23065323163386162', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_9b3ec2be', '/dev/disk/by-id/scsi-1SCST_BIO9b3ec2be-0e21c8ab2b658f80') {{(pid=81983) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9be763-27b5-4aa3-b08c-22f8b03a721a]: (4, None) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a6b602-9ed6-43e7-a797-00c184722711 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d16ca9-c859-4e6c-afb9-5d43e0ab16d3]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a6b602-9ed6-43e7-a797-00c184722711 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2327e24b-e09f-4d16-8ff4-0de2f6458677]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a6b602-9ed6-43e7-a797-00c184722711 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7, portal: 172.16.0.220,3260]
Jul 31 10:08:04 user nova-compute[71113]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7, portal: 172.16.0.220,3260] successful.
Jul 31 10:08:04 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4041c37-33ce-4873-b87c-b4f145dd6fe7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9051fef-814a-4aa2-9609-286d73c489a2]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a6b602-9ed6-43e7-a797-00c184722711 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-f4a6b602-9ed6-43e7-a797-00c184722711 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4a6b602-9ed6-43e7-a797-00c184722711 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] <== disconnect_volume: return (315ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:08:04 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4a6b602-9ed6-43e7-a797-00c184722711 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 10:08:04 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-f4a6b602-9ed6-43e7-a797-00c184722711 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Deleting instance files /opt/stack/data/nova/instances/52f1f390-1599-4dda-9418-f12a48ef582c_del
Jul 31 10:08:04 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-f4a6b602-9ed6-43e7-a797-00c184722711 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Deletion of /opt/stack/data/nova/instances/52f1f390-1599-4dda-9418-f12a48ef582c_del complete
Jul 31 10:08:05 user nova-compute[71113]: INFO nova.compute.manager [None req-f4a6b602-9ed6-43e7-a797-00c184722711 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Took 1.18 seconds to destroy the instance on the hypervisor.
Jul 31 10:08:05 user nova-compute[71113]: DEBUG oslo.service.loopingcall [None req-f4a6b602-9ed6-43e7-a797-00c184722711 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71113) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 10:08:05 user nova-compute[71113]: DEBUG nova.compute.manager [-] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Deallocating network for instance {{(pid=71113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 10:08:05 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] deallocate_for_instance() {{(pid=71113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 10:08:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:08:05 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:08:05 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Took 0.58 seconds to deallocate network for instance.
Jul 31 10:08:05 user nova-compute[71113]: DEBUG nova.compute.manager [req-724f4965-fac3-4cad-a913-db03e5f04bb0 req-f592ab7b-a873-41a3-84b3-bf2f61081c75 service nova] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Received event network-vif-deleted-6af975ec-2ae8-44fc-8762-90e9a13efbce {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:08:06 user nova-compute[71113]: DEBUG nova.compute.manager [req-96606cb4-4689-4782-8817-6a67affed21a req-a2005895-ee71-4428-9f12-f7977bf44acf service nova] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Received event network-vif-plugged-6af975ec-2ae8-44fc-8762-90e9a13efbce {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:08:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-96606cb4-4689-4782-8817-6a67affed21a req-a2005895-ee71-4428-9f12-f7977bf44acf service nova] Acquiring lock "52f1f390-1599-4dda-9418-f12a48ef582c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:08:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-96606cb4-4689-4782-8817-6a67affed21a req-a2005895-ee71-4428-9f12-f7977bf44acf service nova] Lock "52f1f390-1599-4dda-9418-f12a48ef582c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:08:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-96606cb4-4689-4782-8817-6a67affed21a req-a2005895-ee71-4428-9f12-f7977bf44acf service nova] Lock "52f1f390-1599-4dda-9418-f12a48ef582c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:08:06 user nova-compute[71113]: DEBUG nova.compute.manager [req-96606cb4-4689-4782-8817-6a67affed21a req-a2005895-ee71-4428-9f12-f7977bf44acf service nova] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] No waiting events found dispatching network-vif-plugged-6af975ec-2ae8-44fc-8762-90e9a13efbce {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:08:06 user nova-compute[71113]: WARNING nova.compute.manager [req-96606cb4-4689-4782-8817-6a67affed21a req-a2005895-ee71-4428-9f12-f7977bf44acf service nova] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Received unexpected event network-vif-plugged-6af975ec-2ae8-44fc-8762-90e9a13efbce for instance with vm_state active and task_state deleting.
Jul 31 10:08:06 user nova-compute[71113]: INFO nova.compute.manager [None req-f4a6b602-9ed6-43e7-a797-00c184722711 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Took 0.88 seconds to detach 1 volumes for instance.
Jul 31 10:08:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f4a6b602-9ed6-43e7-a797-00c184722711 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:08:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f4a6b602-9ed6-43e7-a797-00c184722711 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:08:06 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-f4a6b602-9ed6-43e7-a797-00c184722711 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:08:06 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-f4a6b602-9ed6-43e7-a797-00c184722711 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:08:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f4a6b602-9ed6-43e7-a797-00c184722711 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.290s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:08:06 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-f4a6b602-9ed6-43e7-a797-00c184722711 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Deleted allocations for instance 52f1f390-1599-4dda-9418-f12a48ef582c
Jul 31 10:08:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f4a6b602-9ed6-43e7-a797-00c184722711 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "52f1f390-1599-4dda-9418-f12a48ef582c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.112s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:08:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:08:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:08:12 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:08:13 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:08:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:08:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:08:17 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:08:18 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:08:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:08:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:08:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:08:18 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:08:18 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 10:08:18 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 10:08:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c7bd88d-2991-4660-928e-298c0a0b2e18/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:08:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c7bd88d-2991-4660-928e-298c0a0b2e18/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:08:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c7bd88d-2991-4660-928e-298c0a0b2e18/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:08:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c7bd88d-2991-4660-928e-298c0a0b2e18/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:08:19 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 10:08:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5365410d-3994-48cd-8747-698f27d98222/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:08:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5365410d-3994-48cd-8747-698f27d98222/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:08:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5365410d-3994-48cd-8747-698f27d98222/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:08:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5365410d-3994-48cd-8747-698f27d98222/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:08:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f020f166-07b6-4cf5-9f17-2ab108b55c30/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:08:19 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690798084.5793986, 52f1f390-1599-4dda-9418-f12a48ef582c => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:08:19 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] VM Stopped (Lifecycle Event)
Jul 31 10:08:19 user nova-compute[71113]: DEBUG nova.compute.manager [None req-83bf6576-628c-4d5c-a907-57aae0a04713 None None] [instance: 52f1f390-1599-4dda-9418-f12a48ef582c] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:08:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:08:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f020f166-07b6-4cf5-9f17-2ab108b55c30/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:08:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f020f166-07b6-4cf5-9f17-2ab108b55c30/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:08:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f020f166-07b6-4cf5-9f17-2ab108b55c30/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:08:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:08:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:08:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:08:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:08:20 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 10:08:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk.rescue --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:08:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:08:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk.rescue --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:08:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:08:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:08:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:08:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:08:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:08:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:08:21 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:08:21 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:08:21 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=8109MB free_disk=24.93905258178711GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:08:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:08:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:08:21 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 3157a7a6-b8a9-4e2d-a157-360bce4c625d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:08:21 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 92d25a03-98ce-4bde-a3cc-20313ae77d41 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:08:21 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance f020f166-07b6-4cf5-9f17-2ab108b55c30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:08:21 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 95a84d3c-7aa2-4294-a419-995926a2782f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:08:21 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 2c7bd88d-2991-4660-928e-298c0a0b2e18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:08:21 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 5145337d-6a13-4107-a636-6d817efcc434 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:08:21 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 5365410d-3994-48cd-8747-698f27d98222 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:08:21 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:08:21 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:08:21 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:08:21 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:08:21 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:08:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.397s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:08:23 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:08:23 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:08:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "refresh_cache-95a84d3c-7aa2-4294-a419-995926a2782f" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:08:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquired lock "refresh_cache-95a84d3c-7aa2-4294-a419-995926a2782f" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:08:23 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Forcefully refreshing network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 10:08:24 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Updating instance_info_cache with network_info: [{"id": "a856eb89-910c-456e-bc0e-a9f92ce20248", "address": "fa:16:3e:d0:99:09", "network": {"id": "67fc40ba-b2c8-43f9-a714-46ef13acf5ed", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1597196996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f8d203e3c534371b05a2ec4c6c07a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa856eb89-91", "ovs_interfaceid": "a856eb89-910c-456e-bc0e-a9f92ce20248", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:08:24 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Releasing lock "refresh_cache-95a84d3c-7aa2-4294-a419-995926a2782f" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:08:24 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Updated the network info_cache for instance {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 10:08:24 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:08:24 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:08:24 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:08:24 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:08:24 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:08:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:08:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:08:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:08:28 user nova-compute[71113]: DEBUG nova.compute.manager [req-b6ed07dd-1b57-47a7-aa9e-2a67bc5b148c req-cd47ea91-f362-4b2d-a313-d398d55b3905 service nova] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Received event network-changed-ba4973f9-3752-466c-988a-9aca7185c5e0 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:08:28 user nova-compute[71113]: DEBUG nova.compute.manager [req-b6ed07dd-1b57-47a7-aa9e-2a67bc5b148c req-cd47ea91-f362-4b2d-a313-d398d55b3905 service nova] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Refreshing instance network info cache due to event network-changed-ba4973f9-3752-466c-988a-9aca7185c5e0. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 10:08:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-b6ed07dd-1b57-47a7-aa9e-2a67bc5b148c req-cd47ea91-f362-4b2d-a313-d398d55b3905 service nova] Acquiring lock "refresh_cache-5145337d-6a13-4107-a636-6d817efcc434" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:08:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-b6ed07dd-1b57-47a7-aa9e-2a67bc5b148c req-cd47ea91-f362-4b2d-a313-d398d55b3905 service nova] Acquired lock "refresh_cache-5145337d-6a13-4107-a636-6d817efcc434" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:08:28 user nova-compute[71113]: DEBUG nova.network.neutron [req-b6ed07dd-1b57-47a7-aa9e-2a67bc5b148c req-cd47ea91-f362-4b2d-a313-d398d55b3905 service nova] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Refreshing network info cache for port ba4973f9-3752-466c-988a-9aca7185c5e0 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 10:08:28 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:08:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f04a9ace-84eb-4026-9b01-996d362dc92d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "5145337d-6a13-4107-a636-6d817efcc434" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:08:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f04a9ace-84eb-4026-9b01-996d362dc92d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "5145337d-6a13-4107-a636-6d817efcc434" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:08:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f04a9ace-84eb-4026-9b01-996d362dc92d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "5145337d-6a13-4107-a636-6d817efcc434-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:08:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f04a9ace-84eb-4026-9b01-996d362dc92d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "5145337d-6a13-4107-a636-6d817efcc434-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:08:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f04a9ace-84eb-4026-9b01-996d362dc92d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "5145337d-6a13-4107-a636-6d817efcc434-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:08:28 user nova-compute[71113]: INFO nova.compute.manager [None req-f04a9ace-84eb-4026-9b01-996d362dc92d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Terminating instance
Jul 31 10:08:28 user nova-compute[71113]: DEBUG nova.compute.manager [None req-f04a9ace-84eb-4026-9b01-996d362dc92d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Start destroying the instance on the hypervisor. {{(pid=71113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 10:08:28 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:08:28 user nova-compute[71113]: DEBUG nova.network.neutron [req-b6ed07dd-1b57-47a7-aa9e-2a67bc5b148c req-cd47ea91-f362-4b2d-a313-d398d55b3905 service nova] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Updated VIF entry in instance network info cache for port ba4973f9-3752-466c-988a-9aca7185c5e0. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 10:08:28 user nova-compute[71113]: DEBUG nova.network.neutron [req-b6ed07dd-1b57-47a7-aa9e-2a67bc5b148c req-cd47ea91-f362-4b2d-a313-d398d55b3905 service nova] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Updating instance_info_cache with network_info: [{"id": "ba4973f9-3752-466c-988a-9aca7185c5e0", "address": "fa:16:3e:0e:1e:5d", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4973f9-37", "ovs_interfaceid": "ba4973f9-3752-466c-988a-9aca7185c5e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:08:28 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:08:28 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-b6ed07dd-1b57-47a7-aa9e-2a67bc5b148c req-cd47ea91-f362-4b2d-a313-d398d55b3905 service nova] Releasing lock "refresh_cache-5145337d-6a13-4107-a636-6d817efcc434" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:08:29 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Instance destroyed successfully.
Jul 31 10:08:29 user nova-compute[71113]: DEBUG nova.objects.instance [None req-f04a9ace-84eb-4026-9b01-996d362dc92d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lazy-loading 'resources' on Instance uuid 5145337d-6a13-4107-a636-6d817efcc434 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-f04a9ace-84eb-4026-9b01-996d362dc92d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:06:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1409391423',display_name='tempest-TestVolumeBootPattern-server-1409391423',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1409391423',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHyhNSNVW4Lo+ZOw5JhvHTNH16DxMgCVmk57hIQmCoVWxH+PN+/8jM3YwsIxSsGBxRIiU3keHG6Pnt6GG0CTGlGIZ1kKVEix0HYiRgqMpyBqoT4aBeWmvyv0uyNPZ+vFFg==',key_name='tempest-TestVolumeBootPattern-165282511',keypairs=<?>,launch_index=0,launched_at=2023-07-31T10:06:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3aa2add2e2a24b9cb8e48042b06931d3',ramdisk_id='',reservation_id='r-80i82qmg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1754399827',owner_user_name='tempest-TestVolumeBootPattern-1754399827-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T10:06:49Z,user_data=None,user_id='a58fe92488ed47b696fc5d6d990b1acd',uuid=5145337d-6a13-4107-a636-6d817efcc434,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba4973f9-3752-466c-988a-9aca7185c5e0", "address": "fa:16:3e:0e:1e:5d", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4973f9-37", "ovs_interfaceid": "ba4973f9-3752-466c-988a-9aca7185c5e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-f04a9ace-84eb-4026-9b01-996d362dc92d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Converting VIF {"id": "ba4973f9-3752-466c-988a-9aca7185c5e0", "address": "fa:16:3e:0e:1e:5d", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4973f9-37", "ovs_interfaceid": "ba4973f9-3752-466c-988a-9aca7185c5e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-f04a9ace-84eb-4026-9b01-996d362dc92d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:1e:5d,bridge_name='br-int',has_traffic_filtering=True,id=ba4973f9-3752-466c-988a-9aca7185c5e0,network=Network(fa792d7a-ddf6-4a2d-acb9-802f8daf87ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4973f9-37') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG os_vif [None req-f04a9ace-84eb-4026-9b01-996d362dc92d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:1e:5d,bridge_name='br-int',has_traffic_filtering=True,id=ba4973f9-3752-466c-988a-9aca7185c5e0,network=Network(fa792d7a-ddf6-4a2d-acb9-802f8daf87ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4973f9-37') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba4973f9-37, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:08:29 user nova-compute[71113]: INFO os_vif [None req-f04a9ace-84eb-4026-9b01-996d362dc92d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:1e:5d,bridge_name='br-int',has_traffic_filtering=True,id=ba4973f9-3752-466c-988a-9aca7185c5e0,network=Network(fa792d7a-ddf6-4a2d-acb9-802f8daf87ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4973f9-37')
Jul 31 10:08:29 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f04a9ace-84eb-4026-9b01-996d362dc92d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 5145337d-6a13-4107-a636-6d817efcc434] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f04a9ace-84eb-4026-9b01-996d362dc92d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cYTyAjsO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:08:29 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-f04a9ace-84eb-4026-9b01-996d362dc92d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:08:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-f04a9ace-84eb-4026-9b01-996d362dc92d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-f04a9ace-84eb-4026-9b01-996d362dc92d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f04a9ace-84eb-4026-9b01-996d362dc92d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[95cdbec6-50f3-489c-8f5b-8eeb5fbe8067]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e004bd47-fdca-4ff8-954a-218977aa67a8]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f04a9ace-84eb-4026-9b01-996d362dc92d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:08:29 user nova-compute[71113]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)
Jul 31 10:08:29 user nova-compute[71113]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833 (non-flash)
Jul 31 10:08:29 user nova-compute[71113]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c (non-flash)
Jul 31 10:08:29 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f04a9ace-84eb-4026-9b01-996d362dc92d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:08:29 user nova-compute[71113]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)
Jul 31 10:08:29 user nova-compute[71113]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833 (non-flash)
Jul 31 10:08:29 user nova-compute[71113]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c (non-flash)
Jul 31 10:08:29 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f04a9ace-84eb-4026-9b01-996d362dc92d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f78cc72ff40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3'): ({'sdc'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-f04a9ace-84eb-4026-9b01-996d362dc92d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Removing single pathed devices sdc {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc2a34e-359f-4e9f-8211-4d70b1efcace]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[68bae2fc-c8b7-4f16-8c49-ec753a0394ab]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-f04a9ace-84eb-4026-9b01-996d362dc92d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Flushing IO for device /dev/sdc {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[02dbe98a-1d8e-4c37-809f-f4b3c1c8de71]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-f04a9ace-84eb-4026-9b01-996d362dc92d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af58fc4-17f7-4da4-ae6a-705636d410a6]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-f04a9ace-84eb-4026-9b01-996d362dc92d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-f04a9ace-84eb-4026-9b01-996d362dc92d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] SCSI volumes sdc have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOf63b9d32-f672ee9b4d9f2b69', '/dev/disk/by-id/scsi-26636373265653962', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f63b9d32') {{(pid=81983) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b40b005-469e-45e2-9cd4-7d68052931ca]: (4, None) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f04a9ace-84eb-4026-9b01-996d362dc92d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b485e4-0d08-4381-9ba3-a3591d163ca5]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f04a9ace-84eb-4026-9b01-996d362dc92d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb71d60a-c222-416f-9811-f50f2bf4e03e]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f04a9ace-84eb-4026-9b01-996d362dc92d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3, portal: 172.16.0.220,3260]
Jul 31 10:08:29 user nova-compute[71113]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3, portal: 172.16.0.220,3260] successful.
Jul 31 10:08:29 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c296b07-fcdd-432b-8741-c5e2d3e97072]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f04a9ace-84eb-4026-9b01-996d362dc92d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-f04a9ace-84eb-4026-9b01-996d362dc92d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f04a9ace-84eb-4026-9b01-996d362dc92d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] <== disconnect_volume: return (301ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:08:29 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f04a9ace-84eb-4026-9b01-996d362dc92d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 10:08:29 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-f04a9ace-84eb-4026-9b01-996d362dc92d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Deleting instance files /opt/stack/data/nova/instances/5145337d-6a13-4107-a636-6d817efcc434_del
Jul 31 10:08:29 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-f04a9ace-84eb-4026-9b01-996d362dc92d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Deletion of /opt/stack/data/nova/instances/5145337d-6a13-4107-a636-6d817efcc434_del complete
Jul 31 10:08:30 user nova-compute[71113]: INFO nova.compute.manager [None req-f04a9ace-84eb-4026-9b01-996d362dc92d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Took 1.16 seconds to destroy the instance on the hypervisor.
Jul 31 10:08:30 user nova-compute[71113]: DEBUG oslo.service.loopingcall [None req-f04a9ace-84eb-4026-9b01-996d362dc92d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71113) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 10:08:30 user nova-compute[71113]: DEBUG nova.compute.manager [-] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Deallocating network for instance {{(pid=71113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 10:08:30 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: 5145337d-6a13-4107-a636-6d817efcc434] deallocate_for_instance() {{(pid=71113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 10:08:30 user nova-compute[71113]: DEBUG nova.compute.manager [req-7d7760f0-af18-49a2-9da6-a6a5945ded85 req-0ba63166-3783-49e7-9fe5-5a6816969d36 service nova] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Received event network-vif-unplugged-ba4973f9-3752-466c-988a-9aca7185c5e0 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:08:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7d7760f0-af18-49a2-9da6-a6a5945ded85 req-0ba63166-3783-49e7-9fe5-5a6816969d36 service nova] Acquiring lock "5145337d-6a13-4107-a636-6d817efcc434-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:08:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7d7760f0-af18-49a2-9da6-a6a5945ded85 req-0ba63166-3783-49e7-9fe5-5a6816969d36 service nova] Lock "5145337d-6a13-4107-a636-6d817efcc434-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:08:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7d7760f0-af18-49a2-9da6-a6a5945ded85 req-0ba63166-3783-49e7-9fe5-5a6816969d36 service nova] Lock "5145337d-6a13-4107-a636-6d817efcc434-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:08:30 user nova-compute[71113]: DEBUG nova.compute.manager [req-7d7760f0-af18-49a2-9da6-a6a5945ded85 req-0ba63166-3783-49e7-9fe5-5a6816969d36 service nova] [instance: 5145337d-6a13-4107-a636-6d817efcc434] No waiting events found dispatching network-vif-unplugged-ba4973f9-3752-466c-988a-9aca7185c5e0 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:08:30 user nova-compute[71113]: DEBUG nova.compute.manager [req-7d7760f0-af18-49a2-9da6-a6a5945ded85 req-0ba63166-3783-49e7-9fe5-5a6816969d36 service nova] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Received event network-vif-unplugged-ba4973f9-3752-466c-988a-9aca7185c5e0 for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 10:08:30 user nova-compute[71113]: DEBUG nova.compute.manager [req-7d7760f0-af18-49a2-9da6-a6a5945ded85 req-0ba63166-3783-49e7-9fe5-5a6816969d36 service nova] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Received event network-vif-plugged-ba4973f9-3752-466c-988a-9aca7185c5e0 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:08:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7d7760f0-af18-49a2-9da6-a6a5945ded85 req-0ba63166-3783-49e7-9fe5-5a6816969d36 service nova] Acquiring lock "5145337d-6a13-4107-a636-6d817efcc434-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:08:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7d7760f0-af18-49a2-9da6-a6a5945ded85 req-0ba63166-3783-49e7-9fe5-5a6816969d36 service nova] Lock "5145337d-6a13-4107-a636-6d817efcc434-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:08:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7d7760f0-af18-49a2-9da6-a6a5945ded85 req-0ba63166-3783-49e7-9fe5-5a6816969d36 service nova] Lock "5145337d-6a13-4107-a636-6d817efcc434-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:08:30 user nova-compute[71113]: DEBUG nova.compute.manager [req-7d7760f0-af18-49a2-9da6-a6a5945ded85 req-0ba63166-3783-49e7-9fe5-5a6816969d36 service nova] [instance: 5145337d-6a13-4107-a636-6d817efcc434] No waiting events found dispatching network-vif-plugged-ba4973f9-3752-466c-988a-9aca7185c5e0 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:08:30 user nova-compute[71113]: WARNING nova.compute.manager [req-7d7760f0-af18-49a2-9da6-a6a5945ded85 req-0ba63166-3783-49e7-9fe5-5a6816969d36 service nova] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Received unexpected event network-vif-plugged-ba4973f9-3752-466c-988a-9aca7185c5e0 for instance with vm_state active and task_state deleting.
Jul 31 10:08:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:08:31 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:08:31 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Took 1.33 seconds to deallocate network for instance.
Jul 31 10:08:31 user nova-compute[71113]: DEBUG nova.compute.manager [req-ce612453-ba29-4aa2-9735-a4400fd49200 req-1dcf6173-e538-4bd7-bfb6-3825686a90e5 service nova] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Received event network-vif-deleted-ba4973f9-3752-466c-988a-9aca7185c5e0 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:08:31 user nova-compute[71113]: INFO nova.compute.manager [req-ce612453-ba29-4aa2-9735-a4400fd49200 req-1dcf6173-e538-4bd7-bfb6-3825686a90e5 service nova] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Neutron deleted interface ba4973f9-3752-466c-988a-9aca7185c5e0; detaching it from the instance and deleting it from the info cache
Jul 31 10:08:31 user nova-compute[71113]: DEBUG nova.network.neutron [req-ce612453-ba29-4aa2-9735-a4400fd49200 req-1dcf6173-e538-4bd7-bfb6-3825686a90e5 service nova] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:08:31 user nova-compute[71113]: DEBUG nova.compute.manager [req-ce612453-ba29-4aa2-9735-a4400fd49200 req-1dcf6173-e538-4bd7-bfb6-3825686a90e5 service nova] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Detach interface failed, port_id=ba4973f9-3752-466c-988a-9aca7185c5e0, reason: Instance 5145337d-6a13-4107-a636-6d817efcc434 could not be found. {{(pid=71113) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 10:08:32 user nova-compute[71113]: INFO nova.compute.manager [None req-f04a9ace-84eb-4026-9b01-996d362dc92d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Took 0.71 seconds to detach 1 volumes for instance.
Jul 31 10:08:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f04a9ace-84eb-4026-9b01-996d362dc92d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:08:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f04a9ace-84eb-4026-9b01-996d362dc92d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:08:32 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-f04a9ace-84eb-4026-9b01-996d362dc92d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:08:32 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-f04a9ace-84eb-4026-9b01-996d362dc92d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:08:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f04a9ace-84eb-4026-9b01-996d362dc92d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.239s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:08:32 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-f04a9ace-84eb-4026-9b01-996d362dc92d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Deleted allocations for instance 5145337d-6a13-4107-a636-6d817efcc434
Jul 31 10:08:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f04a9ace-84eb-4026-9b01-996d362dc92d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "5145337d-6a13-4107-a636-6d817efcc434" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.619s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:08:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:08:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:08:44 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690798109.6292326, 5145337d-6a13-4107-a636-6d817efcc434 => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:08:44 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 5145337d-6a13-4107-a636-6d817efcc434] VM Stopped (Lifecycle Event)
Jul 31 10:08:44 user nova-compute[71113]: DEBUG nova.compute.manager [None req-a529ade6-0e51-4c75-9807-6a75f4e532aa None None] [instance: 5145337d-6a13-4107-a636-6d817efcc434] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:08:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:08:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:08:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:08:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:08:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:08:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:08:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:08:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9594202b-3dfe-400a-bf83-19176412d93d tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquiring lock "f020f166-07b6-4cf5-9f17-2ab108b55c30" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:08:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9594202b-3dfe-400a-bf83-19176412d93d tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "f020f166-07b6-4cf5-9f17-2ab108b55c30" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:08:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9594202b-3dfe-400a-bf83-19176412d93d tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquiring lock "f020f166-07b6-4cf5-9f17-2ab108b55c30-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:08:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9594202b-3dfe-400a-bf83-19176412d93d tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "f020f166-07b6-4cf5-9f17-2ab108b55c30-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:08:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9594202b-3dfe-400a-bf83-19176412d93d tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "f020f166-07b6-4cf5-9f17-2ab108b55c30-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:08:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:08:54 user nova-compute[71113]: INFO nova.compute.manager [None req-9594202b-3dfe-400a-bf83-19176412d93d tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Terminating instance
Jul 31 10:08:54 user nova-compute[71113]: DEBUG nova.compute.manager [None req-9594202b-3dfe-400a-bf83-19176412d93d tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Start destroying the instance on the hypervisor. {{(pid=71113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 10:08:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:08:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:08:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:08:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:08:55 user nova-compute[71113]: DEBUG nova.compute.manager [req-3c0bfcb4-da72-47cb-82a5-5e6fbe5505d7 req-a1756aaf-7cb9-4277-b6eb-06f41ddcb11c service nova] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Received event network-vif-unplugged-88414b9a-7489-4664-9eff-ef29d6fce020 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:08:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3c0bfcb4-da72-47cb-82a5-5e6fbe5505d7 req-a1756aaf-7cb9-4277-b6eb-06f41ddcb11c service nova] Acquiring lock "f020f166-07b6-4cf5-9f17-2ab108b55c30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:08:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3c0bfcb4-da72-47cb-82a5-5e6fbe5505d7 req-a1756aaf-7cb9-4277-b6eb-06f41ddcb11c service nova] Lock "f020f166-07b6-4cf5-9f17-2ab108b55c30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:08:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3c0bfcb4-da72-47cb-82a5-5e6fbe5505d7 req-a1756aaf-7cb9-4277-b6eb-06f41ddcb11c service nova] Lock "f020f166-07b6-4cf5-9f17-2ab108b55c30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:08:55 user nova-compute[71113]: DEBUG nova.compute.manager [req-3c0bfcb4-da72-47cb-82a5-5e6fbe5505d7 req-a1756aaf-7cb9-4277-b6eb-06f41ddcb11c service nova] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] No waiting events found dispatching network-vif-unplugged-88414b9a-7489-4664-9eff-ef29d6fce020 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:08:55 user nova-compute[71113]: DEBUG nova.compute.manager [req-3c0bfcb4-da72-47cb-82a5-5e6fbe5505d7 req-a1756aaf-7cb9-4277-b6eb-06f41ddcb11c service nova] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Received event network-vif-unplugged-88414b9a-7489-4664-9eff-ef29d6fce020 for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 10:08:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:08:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:08:55 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Instance destroyed successfully.
Jul 31 10:08:55 user nova-compute[71113]: DEBUG nova.objects.instance [None req-9594202b-3dfe-400a-bf83-19176412d93d tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lazy-loading 'resources' on Instance uuid f020f166-07b6-4cf5-9f17-2ab108b55c30 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:08:55 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-9594202b-3dfe-400a-bf83-19176412d93d tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:59:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-183894675',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-183894675',id=30,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:59:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88bbf2636f6248fcbe644af4eab0c823',ramdisk_id='',reservation_id='r-5drui0a6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1194948978',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T10:01:29Z,user_data=None,user_id='f4f505d5eddc4df48ec267f6f69a01f9',uuid=f020f166-07b6-4cf5-9f17-2ab108b55c30,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "88414b9a-7489-4664-9eff-ef29d6fce020", "address": "fa:16:3e:ec:d1:0f", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88414b9a-74", "ovs_interfaceid": "88414b9a-7489-4664-9eff-ef29d6fce020", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 10:08:55 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-9594202b-3dfe-400a-bf83-19176412d93d tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Converting VIF {"id": "88414b9a-7489-4664-9eff-ef29d6fce020", "address": "fa:16:3e:ec:d1:0f", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88414b9a-74", "ovs_interfaceid": "88414b9a-7489-4664-9eff-ef29d6fce020", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:08:55 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-9594202b-3dfe-400a-bf83-19176412d93d tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:d1:0f,bridge_name='br-int',has_traffic_filtering=True,id=88414b9a-7489-4664-9eff-ef29d6fce020,network=Network(6f88bfaa-d58d-4ac2-b43d-0689d50456ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88414b9a-74') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:08:55 user nova-compute[71113]: DEBUG os_vif [None req-9594202b-3dfe-400a-bf83-19176412d93d tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:d1:0f,bridge_name='br-int',has_traffic_filtering=True,id=88414b9a-7489-4664-9eff-ef29d6fce020,network=Network(6f88bfaa-d58d-4ac2-b43d-0689d50456ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88414b9a-74') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 10:08:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:08:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap88414b9a-74, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:08:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:08:55 user nova-compute[71113]: INFO os_vif [None req-9594202b-3dfe-400a-bf83-19176412d93d tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:d1:0f,bridge_name='br-int',has_traffic_filtering=True,id=88414b9a-7489-4664-9eff-ef29d6fce020,network=Network(6f88bfaa-d58d-4ac2-b43d-0689d50456ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88414b9a-74')
Jul 31 10:08:55 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-9594202b-3dfe-400a-bf83-19176412d93d tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Deleting instance files /opt/stack/data/nova/instances/f020f166-07b6-4cf5-9f17-2ab108b55c30_del
Jul 31 10:08:55 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-9594202b-3dfe-400a-bf83-19176412d93d tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Deletion of /opt/stack/data/nova/instances/f020f166-07b6-4cf5-9f17-2ab108b55c30_del complete
Jul 31 10:08:55 user nova-compute[71113]: INFO nova.compute.manager [None req-9594202b-3dfe-400a-bf83-19176412d93d tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Took 0.92 seconds to destroy the instance on the hypervisor.
Jul 31 10:08:55 user nova-compute[71113]: DEBUG oslo.service.loopingcall [None req-9594202b-3dfe-400a-bf83-19176412d93d tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71113) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 10:08:55 user nova-compute[71113]: DEBUG nova.compute.manager [-] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Deallocating network for instance {{(pid=71113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 10:08:55 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] deallocate_for_instance() {{(pid=71113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 10:08:56 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:08:56 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Took 0.57 seconds to deallocate network for instance.
Jul 31 10:08:56 user nova-compute[71113]: DEBUG nova.compute.manager [req-83f89985-c647-4aad-89b1-00df0babaaf5 req-d492ae58-e6e7-4377-8b05-b48e29ef3f38 service nova] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Received event network-vif-deleted-88414b9a-7489-4664-9eff-ef29d6fce020 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:08:56 user nova-compute[71113]: INFO nova.compute.manager [req-83f89985-c647-4aad-89b1-00df0babaaf5 req-d492ae58-e6e7-4377-8b05-b48e29ef3f38 service nova] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Neutron deleted interface 88414b9a-7489-4664-9eff-ef29d6fce020; detaching it from the instance and deleting it from the info cache
Jul 31 10:08:56 user nova-compute[71113]: DEBUG nova.network.neutron [req-83f89985-c647-4aad-89b1-00df0babaaf5 req-d492ae58-e6e7-4377-8b05-b48e29ef3f38 service nova] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:08:56 user nova-compute[71113]: DEBUG nova.compute.manager [req-83f89985-c647-4aad-89b1-00df0babaaf5 req-d492ae58-e6e7-4377-8b05-b48e29ef3f38 service nova] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Detach interface failed, port_id=88414b9a-7489-4664-9eff-ef29d6fce020, reason: Instance f020f166-07b6-4cf5-9f17-2ab108b55c30 could not be found. {{(pid=71113) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 10:08:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9594202b-3dfe-400a-bf83-19176412d93d tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:08:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9594202b-3dfe-400a-bf83-19176412d93d tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:08:56 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-9594202b-3dfe-400a-bf83-19176412d93d tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:08:56 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-9594202b-3dfe-400a-bf83-19176412d93d tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:08:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9594202b-3dfe-400a-bf83-19176412d93d tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.265s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:08:56 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-9594202b-3dfe-400a-bf83-19176412d93d tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Deleted allocations for instance f020f166-07b6-4cf5-9f17-2ab108b55c30
Jul 31 10:08:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9594202b-3dfe-400a-bf83-19176412d93d tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "f020f166-07b6-4cf5-9f17-2ab108b55c30" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.945s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:08:57 user nova-compute[71113]: DEBUG nova.compute.manager [req-7092cd29-0138-4743-83a7-ee6b780b83af req-67010ebe-7151-4c62-8ccb-a14a5da5237a service nova] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Received event network-vif-plugged-88414b9a-7489-4664-9eff-ef29d6fce020 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:08:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7092cd29-0138-4743-83a7-ee6b780b83af req-67010ebe-7151-4c62-8ccb-a14a5da5237a service nova] Acquiring lock "f020f166-07b6-4cf5-9f17-2ab108b55c30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:08:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7092cd29-0138-4743-83a7-ee6b780b83af req-67010ebe-7151-4c62-8ccb-a14a5da5237a service nova] Lock "f020f166-07b6-4cf5-9f17-2ab108b55c30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:08:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7092cd29-0138-4743-83a7-ee6b780b83af req-67010ebe-7151-4c62-8ccb-a14a5da5237a service nova] Lock "f020f166-07b6-4cf5-9f17-2ab108b55c30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:08:57 user nova-compute[71113]: DEBUG nova.compute.manager [req-7092cd29-0138-4743-83a7-ee6b780b83af req-67010ebe-7151-4c62-8ccb-a14a5da5237a service nova] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] No waiting events found dispatching network-vif-plugged-88414b9a-7489-4664-9eff-ef29d6fce020 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:08:57 user nova-compute[71113]: WARNING nova.compute.manager [req-7092cd29-0138-4743-83a7-ee6b780b83af req-67010ebe-7151-4c62-8ccb-a14a5da5237a service nova] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Received unexpected event network-vif-plugged-88414b9a-7489-4664-9eff-ef29d6fce020 for instance with vm_state deleted and task_state None.
Jul 31 10:09:00 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:09:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:09:10 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690798135.4894059, f020f166-07b6-4cf5-9f17-2ab108b55c30 => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:09:10 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] VM Stopped (Lifecycle Event)
Jul 31 10:09:10 user nova-compute[71113]: DEBUG nova.compute.manager [None req-6209ab95-ad94-44d1-835a-5f58b5dc8718 None None] [instance: f020f166-07b6-4cf5-9f17-2ab108b55c30] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:09:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:09:13 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:09:14 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:09:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:09:17 user nova-compute[71113]: DEBUG nova.compute.manager [req-40200ca5-5d9a-4e90-91e5-f1499325ed88 req-88ae501c-ebc8-4a44-a96e-f6c8905dd040 service nova] [instance: 5365410d-3994-48cd-8747-698f27d98222] Received event network-changed-c8e66573-782b-4698-833c-b38a2749a7f9 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:09:17 user nova-compute[71113]: DEBUG nova.compute.manager [req-40200ca5-5d9a-4e90-91e5-f1499325ed88 req-88ae501c-ebc8-4a44-a96e-f6c8905dd040 service nova] [instance: 5365410d-3994-48cd-8747-698f27d98222] Refreshing instance network info cache due to event network-changed-c8e66573-782b-4698-833c-b38a2749a7f9. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 10:09:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-40200ca5-5d9a-4e90-91e5-f1499325ed88 req-88ae501c-ebc8-4a44-a96e-f6c8905dd040 service nova] Acquiring lock "refresh_cache-5365410d-3994-48cd-8747-698f27d98222" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:09:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-40200ca5-5d9a-4e90-91e5-f1499325ed88 req-88ae501c-ebc8-4a44-a96e-f6c8905dd040 service nova] Acquired lock "refresh_cache-5365410d-3994-48cd-8747-698f27d98222" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:09:17 user nova-compute[71113]: DEBUG nova.network.neutron [req-40200ca5-5d9a-4e90-91e5-f1499325ed88 req-88ae501c-ebc8-4a44-a96e-f6c8905dd040 service nova] [instance: 5365410d-3994-48cd-8747-698f27d98222] Refreshing network info cache for port c8e66573-782b-4698-833c-b38a2749a7f9 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 10:09:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-adf4c927-3462-4680-9106-a2d755fef6a4 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquiring lock "5365410d-3994-48cd-8747-698f27d98222" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:09:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-adf4c927-3462-4680-9106-a2d755fef6a4 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "5365410d-3994-48cd-8747-698f27d98222" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:09:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-adf4c927-3462-4680-9106-a2d755fef6a4 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquiring lock "5365410d-3994-48cd-8747-698f27d98222-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:09:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-adf4c927-3462-4680-9106-a2d755fef6a4 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "5365410d-3994-48cd-8747-698f27d98222-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:09:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-adf4c927-3462-4680-9106-a2d755fef6a4 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "5365410d-3994-48cd-8747-698f27d98222-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:09:17 user nova-compute[71113]: INFO nova.compute.manager [None req-adf4c927-3462-4680-9106-a2d755fef6a4 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 5365410d-3994-48cd-8747-698f27d98222] Terminating instance
Jul 31 10:09:17 user nova-compute[71113]: DEBUG nova.compute.manager [None req-adf4c927-3462-4680-9106-a2d755fef6a4 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 5365410d-3994-48cd-8747-698f27d98222] Start destroying the instance on the hypervisor. {{(pid=71113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 10:09:17 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:09:17 user nova-compute[71113]: DEBUG nova.network.neutron [req-40200ca5-5d9a-4e90-91e5-f1499325ed88 req-88ae501c-ebc8-4a44-a96e-f6c8905dd040 service nova] [instance: 5365410d-3994-48cd-8747-698f27d98222] Updated VIF entry in instance network info cache for port c8e66573-782b-4698-833c-b38a2749a7f9. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 10:09:17 user nova-compute[71113]: DEBUG nova.network.neutron [req-40200ca5-5d9a-4e90-91e5-f1499325ed88 req-88ae501c-ebc8-4a44-a96e-f6c8905dd040 service nova] [instance: 5365410d-3994-48cd-8747-698f27d98222] Updating instance_info_cache with network_info: [{"id": "c8e66573-782b-4698-833c-b38a2749a7f9", "address": "fa:16:3e:65:36:46", "network": {"id": "4b030626-e3f1-4617-89c2-f6389226652f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441335951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7000d6a2a6b147ddbc38208b316574cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8e66573-78", "ovs_interfaceid": "c8e66573-782b-4698-833c-b38a2749a7f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:09:17 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:09:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-40200ca5-5d9a-4e90-91e5-f1499325ed88 req-88ae501c-ebc8-4a44-a96e-f6c8905dd040 service nova] Releasing lock "refresh_cache-5365410d-3994-48cd-8747-698f27d98222" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:09:17 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:09:17 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:09:18 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 5365410d-3994-48cd-8747-698f27d98222] Instance destroyed successfully.
Jul 31 10:09:18 user nova-compute[71113]: DEBUG nova.objects.instance [None req-adf4c927-3462-4680-9106-a2d755fef6a4 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lazy-loading 'resources' on Instance uuid 5365410d-3994-48cd-8747-698f27d98222 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:09:18 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-adf4c927-3462-4680-9106-a2d755fef6a4 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:07:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-69238182',display_name='tempest-AttachVolumeNegativeTest-server-69238182',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-69238182',id=39,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHunRvE0Nr1oxlPQXXNR/M8FQPEKuy6KJtIKiuIKoWsRQ7NF9HPJhVM7DgKyvFB5o8A6wGMVa0mFFALQIX/QY7Raltiedqkc6j4dAxTsk1v7JBpd/js7tEGrBV8r01yUCw==',key_name='tempest-keypair-1874560186',keypairs=<?>,launch_index=0,launched_at=2023-07-31T10:07:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7000d6a2a6b147ddbc38208b316574cd',ramdisk_id='',reservation_id='r-fiu21g29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2110881646',owner_user_name='tempest-AttachVolumeNegativeTest-2110881646-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T10:07:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9883a5677fb4852ae031137736a9ee4',uuid=5365410d-3994-48cd-8747-698f27d98222,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c8e66573-782b-4698-833c-b38a2749a7f9", "address": "fa:16:3e:65:36:46", "network": {"id": "4b030626-e3f1-4617-89c2-f6389226652f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441335951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7000d6a2a6b147ddbc38208b316574cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8e66573-78", "ovs_interfaceid": "c8e66573-782b-4698-833c-b38a2749a7f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 10:09:18 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-adf4c927-3462-4680-9106-a2d755fef6a4 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Converting VIF {"id": "c8e66573-782b-4698-833c-b38a2749a7f9", "address": "fa:16:3e:65:36:46", "network": {"id": "4b030626-e3f1-4617-89c2-f6389226652f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441335951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7000d6a2a6b147ddbc38208b316574cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8e66573-78", "ovs_interfaceid": "c8e66573-782b-4698-833c-b38a2749a7f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:09:18 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-adf4c927-3462-4680-9106-a2d755fef6a4 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:36:46,bridge_name='br-int',has_traffic_filtering=True,id=c8e66573-782b-4698-833c-b38a2749a7f9,network=Network(4b030626-e3f1-4617-89c2-f6389226652f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8e66573-78') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:09:18 user nova-compute[71113]: DEBUG os_vif [None req-adf4c927-3462-4680-9106-a2d755fef6a4 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:36:46,bridge_name='br-int',has_traffic_filtering=True,id=c8e66573-782b-4698-833c-b38a2749a7f9,network=Network(4b030626-e3f1-4617-89c2-f6389226652f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8e66573-78') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 10:09:18 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:09:18 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc8e66573-78, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:09:18 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:09:18 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:09:18 user nova-compute[71113]: INFO os_vif [None req-adf4c927-3462-4680-9106-a2d755fef6a4 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:36:46,bridge_name='br-int',has_traffic_filtering=True,id=c8e66573-782b-4698-833c-b38a2749a7f9,network=Network(4b030626-e3f1-4617-89c2-f6389226652f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8e66573-78')
Jul 31 10:09:18 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-adf4c927-3462-4680-9106-a2d755fef6a4 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 5365410d-3994-48cd-8747-698f27d98222] Deleting instance files /opt/stack/data/nova/instances/5365410d-3994-48cd-8747-698f27d98222_del
Jul 31 10:09:18 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-adf4c927-3462-4680-9106-a2d755fef6a4 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 5365410d-3994-48cd-8747-698f27d98222] Deletion of /opt/stack/data/nova/instances/5365410d-3994-48cd-8747-698f27d98222_del complete
Jul 31 10:09:18 user nova-compute[71113]: INFO nova.compute.manager [None req-adf4c927-3462-4680-9106-a2d755fef6a4 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 5365410d-3994-48cd-8747-698f27d98222] Took 0.65 seconds to destroy the instance on the hypervisor.
Jul 31 10:09:18 user nova-compute[71113]: DEBUG oslo.service.loopingcall [None req-adf4c927-3462-4680-9106-a2d755fef6a4 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71113) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 10:09:18 user nova-compute[71113]: DEBUG nova.compute.manager [-] [instance: 5365410d-3994-48cd-8747-698f27d98222] Deallocating network for instance {{(pid=71113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 10:09:18 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: 5365410d-3994-48cd-8747-698f27d98222] deallocate_for_instance() {{(pid=71113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 10:09:19 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: 5365410d-3994-48cd-8747-698f27d98222] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:09:19 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 5365410d-3994-48cd-8747-698f27d98222] Took 0.92 seconds to deallocate network for instance.
Jul 31 10:09:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-adf4c927-3462-4680-9106-a2d755fef6a4 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:09:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-adf4c927-3462-4680-9106-a2d755fef6a4 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:09:19 user nova-compute[71113]: DEBUG nova.compute.manager [req-ceb27c6c-a75a-437f-9fc0-bc61da68983e req-5c1a3c8e-0995-44e7-bcb1-4737164d7ddd service nova] [instance: 5365410d-3994-48cd-8747-698f27d98222] Received event network-vif-unplugged-c8e66573-782b-4698-833c-b38a2749a7f9 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:09:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ceb27c6c-a75a-437f-9fc0-bc61da68983e req-5c1a3c8e-0995-44e7-bcb1-4737164d7ddd service nova] Acquiring lock "5365410d-3994-48cd-8747-698f27d98222-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:09:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ceb27c6c-a75a-437f-9fc0-bc61da68983e req-5c1a3c8e-0995-44e7-bcb1-4737164d7ddd service nova] Lock "5365410d-3994-48cd-8747-698f27d98222-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:09:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ceb27c6c-a75a-437f-9fc0-bc61da68983e req-5c1a3c8e-0995-44e7-bcb1-4737164d7ddd service nova] Lock "5365410d-3994-48cd-8747-698f27d98222-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:09:19 user nova-compute[71113]: DEBUG nova.compute.manager [req-ceb27c6c-a75a-437f-9fc0-bc61da68983e req-5c1a3c8e-0995-44e7-bcb1-4737164d7ddd service nova] [instance: 5365410d-3994-48cd-8747-698f27d98222] No waiting events found dispatching network-vif-unplugged-c8e66573-782b-4698-833c-b38a2749a7f9 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:09:19 user nova-compute[71113]: WARNING nova.compute.manager [req-ceb27c6c-a75a-437f-9fc0-bc61da68983e req-5c1a3c8e-0995-44e7-bcb1-4737164d7ddd service nova] [instance: 5365410d-3994-48cd-8747-698f27d98222] Received unexpected event network-vif-unplugged-c8e66573-782b-4698-833c-b38a2749a7f9 for instance with vm_state deleted and task_state None.
Jul 31 10:09:19 user nova-compute[71113]: DEBUG nova.compute.manager [req-ceb27c6c-a75a-437f-9fc0-bc61da68983e req-5c1a3c8e-0995-44e7-bcb1-4737164d7ddd service nova] [instance: 5365410d-3994-48cd-8747-698f27d98222] Received event network-vif-plugged-c8e66573-782b-4698-833c-b38a2749a7f9 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:09:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ceb27c6c-a75a-437f-9fc0-bc61da68983e req-5c1a3c8e-0995-44e7-bcb1-4737164d7ddd service nova] Acquiring lock "5365410d-3994-48cd-8747-698f27d98222-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:09:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ceb27c6c-a75a-437f-9fc0-bc61da68983e req-5c1a3c8e-0995-44e7-bcb1-4737164d7ddd service nova] Lock "5365410d-3994-48cd-8747-698f27d98222-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:09:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ceb27c6c-a75a-437f-9fc0-bc61da68983e req-5c1a3c8e-0995-44e7-bcb1-4737164d7ddd service nova] Lock "5365410d-3994-48cd-8747-698f27d98222-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:09:19 user nova-compute[71113]: DEBUG nova.compute.manager [req-ceb27c6c-a75a-437f-9fc0-bc61da68983e req-5c1a3c8e-0995-44e7-bcb1-4737164d7ddd service nova] [instance: 5365410d-3994-48cd-8747-698f27d98222] No waiting events found dispatching network-vif-plugged-c8e66573-782b-4698-833c-b38a2749a7f9 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:09:19 user nova-compute[71113]: WARNING nova.compute.manager [req-ceb27c6c-a75a-437f-9fc0-bc61da68983e req-5c1a3c8e-0995-44e7-bcb1-4737164d7ddd service nova] [instance: 5365410d-3994-48cd-8747-698f27d98222] Received unexpected event network-vif-plugged-c8e66573-782b-4698-833c-b38a2749a7f9 for instance with vm_state deleted and task_state None.
Jul 31 10:09:19 user nova-compute[71113]: DEBUG nova.compute.manager [req-ceb27c6c-a75a-437f-9fc0-bc61da68983e req-5c1a3c8e-0995-44e7-bcb1-4737164d7ddd service nova] [instance: 5365410d-3994-48cd-8747-698f27d98222] Received event network-vif-deleted-c8e66573-782b-4698-833c-b38a2749a7f9 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:09:19 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-adf4c927-3462-4680-9106-a2d755fef6a4 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:09:19 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-adf4c927-3462-4680-9106-a2d755fef6a4 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:09:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-adf4c927-3462-4680-9106-a2d755fef6a4 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.200s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:09:19 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-adf4c927-3462-4680-9106-a2d755fef6a4 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Deleted allocations for instance 5365410d-3994-48cd-8747-698f27d98222
Jul 31 10:09:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-adf4c927-3462-4680-9106-a2d755fef6a4 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "5365410d-3994-48cd-8747-698f27d98222" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.954s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:09:19 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:09:19 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:09:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:09:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:09:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:09:19 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:09:19 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 10:09:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c7bd88d-2991-4660-928e-298c0a0b2e18/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:09:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c7bd88d-2991-4660-928e-298c0a0b2e18/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:09:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c7bd88d-2991-4660-928e-298c0a0b2e18/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:09:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c7bd88d-2991-4660-928e-298c0a0b2e18/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:09:20 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 10:09:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:09:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:09:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:09:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:09:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:09:20 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 10:09:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk.rescue --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:09:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:09:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk.rescue --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:09:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "be9f0ded-8064-4675-99f7-8620f0fe3dda" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:09:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "be9f0ded-8064-4675-99f7-8620f0fe3dda" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:09:20 user nova-compute[71113]: DEBUG nova.compute.manager [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Starting instance... {{(pid=71113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 10:09:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:09:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:09:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:09:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:09:20 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 10:09:20 user nova-compute[71113]: INFO nova.compute.claims [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Claim successful on node user
Jul 31 10:09:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:09:20 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:09:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:09:21 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:09:21 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:09:21 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=8471MB free_disk=25.090431213378906GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:09:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:09:21 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:09:21 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:09:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.730s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:09:21 user nova-compute[71113]: DEBUG nova.compute.manager [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Start building networks asynchronously for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 10:09:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.078s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:09:21 user nova-compute[71113]: DEBUG nova.compute.manager [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Allocating IP information in the background. {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 10:09:21 user nova-compute[71113]: DEBUG nova.network.neutron [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] allocate_for_instance() {{(pid=71113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 10:09:21 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 10:09:21 user nova-compute[71113]: DEBUG nova.compute.manager [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Start building block device mappings for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 10:09:21 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 3157a7a6-b8a9-4e2d-a157-360bce4c625d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:09:21 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 92d25a03-98ce-4bde-a3cc-20313ae77d41 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:09:21 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 95a84d3c-7aa2-4294-a419-995926a2782f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:09:21 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 2c7bd88d-2991-4660-928e-298c0a0b2e18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:09:21 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance be9f0ded-8064-4675-99f7-8620f0fe3dda actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:09:21 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:09:21 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:09:21 user nova-compute[71113]: INFO nova.virt.block_device [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Booting with volume 393f83a1-d2bd-43b9-a499-cee6c4f93fb3 at /dev/vda
Jul 31 10:09:21 user nova-compute[71113]: DEBUG os_brick.utils [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:09:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:09:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:09:21 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1137e7-ff28-4b22-b442-943f91146dd8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:09:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:09:21 user nova-compute[71113]: DEBUG nova.policy [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a58fe92488ed47b696fc5d6d990b1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa2add2e2a24b9cb8e48042b06931d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71113) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 10:09:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:09:21 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:09:21 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2edf2ee-24ac-4d49-a5ac-3a0d44ad9561]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:09:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:09:21 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:09:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:09:21 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7200dea0-396b-49b0-b6c6-d149e78265c6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:09:21 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eaa714e-3558-42c5-a0a9-10ae1e323318]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:09:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:09:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 10:09:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 10:09:21 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:09:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.328s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:09:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:09:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 10:09:21 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 10:09:21 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c35f73-ae96-4f69-b2b4-502bc6975c44]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:09:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 10:09:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 10:09:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 10:09:21 user nova-compute[71113]: DEBUG os_brick.utils [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:09:21 user nova-compute[71113]: DEBUG nova.virt.block_device [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Updating existing volume attachment record: 70c442a5-0b64-4a2f-8180-a34cea9aa2cf {{(pid=71113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 10:09:22 user nova-compute[71113]: DEBUG nova.network.neutron [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Successfully created port: a125e6d6-59a1-4aac-8081-abfbe030359b {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 10:09:23 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:09:23 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:09:23 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Rebuilding the list of instances to heal {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 10:09:23 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Skipping network cache update for instance because it is Building. {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Jul 31 10:09:23 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:09:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "refresh_cache-3157a7a6-b8a9-4e2d-a157-360bce4c625d" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:09:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquired lock "refresh_cache-3157a7a6-b8a9-4e2d-a157-360bce4c625d" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:09:23 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Forcefully refreshing network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 10:09:23 user nova-compute[71113]: DEBUG nova.objects.instance [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lazy-loading 'info_cache' on Instance uuid 3157a7a6-b8a9-4e2d-a157-360bce4c625d {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:09:23 user nova-compute[71113]: DEBUG nova.network.neutron [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Successfully updated port: a125e6d6-59a1-4aac-8081-abfbe030359b {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 10:09:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "refresh_cache-be9f0ded-8064-4675-99f7-8620f0fe3dda" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:09:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquired lock "refresh_cache-be9f0ded-8064-4675-99f7-8620f0fe3dda" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:09:23 user nova-compute[71113]: DEBUG nova.network.neutron [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 10:09:23 user nova-compute[71113]: DEBUG nova.compute.manager [req-64c540ec-583d-4484-826d-53e991828405 req-7379bd95-069e-492c-951d-2e1ceb4dc2a1 service nova] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Received event network-changed-a125e6d6-59a1-4aac-8081-abfbe030359b {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:09:23 user nova-compute[71113]: DEBUG nova.compute.manager [req-64c540ec-583d-4484-826d-53e991828405 req-7379bd95-069e-492c-951d-2e1ceb4dc2a1 service nova] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Refreshing instance network info cache due to event network-changed-a125e6d6-59a1-4aac-8081-abfbe030359b. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 10:09:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-64c540ec-583d-4484-826d-53e991828405 req-7379bd95-069e-492c-951d-2e1ceb4dc2a1 service nova] Acquiring lock "refresh_cache-be9f0ded-8064-4675-99f7-8620f0fe3dda" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:09:23 user nova-compute[71113]: DEBUG nova.network.neutron [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 10:09:23 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Updating instance_info_cache with network_info: [{"id": "179480f5-30b9-4a11-9771-95d88f21574f", "address": "fa:16:3e:42:ea:05", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap179480f5-30", "ovs_interfaceid": "179480f5-30b9-4a11-9771-95d88f21574f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:09:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Releasing lock "refresh_cache-3157a7a6-b8a9-4e2d-a157-360bce4c625d" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:09:23 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Updated the network info_cache for instance {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 10:09:23 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:09:23 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:09:23 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:09:23 user nova-compute[71113]: DEBUG nova.network.neutron [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Updating instance_info_cache with network_info: [{"id": "a125e6d6-59a1-4aac-8081-abfbe030359b", "address": "fa:16:3e:61:da:b6", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa125e6d6-59", "ovs_interfaceid": "a125e6d6-59a1-4aac-8081-abfbe030359b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:09:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Releasing lock "refresh_cache-be9f0ded-8064-4675-99f7-8620f0fe3dda" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:09:23 user nova-compute[71113]: DEBUG nova.compute.manager [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Instance network_info: |[{"id": "a125e6d6-59a1-4aac-8081-abfbe030359b", "address": "fa:16:3e:61:da:b6", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa125e6d6-59", "ovs_interfaceid": "a125e6d6-59a1-4aac-8081-abfbe030359b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 10:09:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-64c540ec-583d-4484-826d-53e991828405 req-7379bd95-069e-492c-951d-2e1ceb4dc2a1 service nova] Acquired lock "refresh_cache-be9f0ded-8064-4675-99f7-8620f0fe3dda" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:09:23 user nova-compute[71113]: DEBUG nova.network.neutron [req-64c540ec-583d-4484-826d-53e991828405 req-7379bd95-069e-492c-951d-2e1ceb4dc2a1 service nova] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Refreshing network info cache for port a125e6d6-59a1-4aac-8081-abfbe030359b {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 10:09:24 user nova-compute[71113]: DEBUG nova.network.neutron [req-64c540ec-583d-4484-826d-53e991828405 req-7379bd95-069e-492c-951d-2e1ceb4dc2a1 service nova] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Updated VIF entry in instance network info cache for port a125e6d6-59a1-4aac-8081-abfbe030359b. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 10:09:24 user nova-compute[71113]: DEBUG nova.network.neutron [req-64c540ec-583d-4484-826d-53e991828405 req-7379bd95-069e-492c-951d-2e1ceb4dc2a1 service nova] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Updating instance_info_cache with network_info: [{"id": "a125e6d6-59a1-4aac-8081-abfbe030359b", "address": "fa:16:3e:61:da:b6", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa125e6d6-59", "ovs_interfaceid": "a125e6d6-59a1-4aac-8081-abfbe030359b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:09:24 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-64c540ec-583d-4484-826d-53e991828405 req-7379bd95-069e-492c-951d-2e1ceb4dc2a1 service nova] Releasing lock "refresh_cache-be9f0ded-8064-4675-99f7-8620f0fe3dda" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:09:24 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:09:28 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:09:28 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG nova.compute.manager [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Start spawning the instance on the hypervisor. {{(pid=71113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 10:09:29 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Creating image(s)
Jul 31 10:09:29 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Did not create local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Ensure instance console log exists: /opt/stack/data/nova/instances/be9f0ded-8064-4675-99f7-8620f0fe3dda/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Start _get_guest_xml network_info=[{"id": "a125e6d6-59a1-4aac-8081-abfbe030359b", "address": "fa:16:3e:61:da:b6", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa125e6d6-59", "ovs_interfaceid": "a125e6d6-59a1-4aac-8081-abfbe030359b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '70c442a5-0b64-4a2f-8180-a34cea9aa2cf', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cYTyAjsO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'be9f0ded-8064-4675-99f7-8620f0fe3dda', 'attached_at': '', 'detached_at': '', 'volume_id': '393f83a1-d2bd-43b9-a499-cee6c4f93fb3', 'serial': '393f83a1-d2bd-43b9-a499-cee6c4f93fb3'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 10:09:29 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:09:29 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:09:29 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cYTyAjsO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:09:29 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:09:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:09:29 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:09:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:09:29 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 10:09:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd4eae9-69df-4c79-acb7-fc97de0a2a29]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 10:09:29 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d01d4c-ab30-4c7e-9c08-d0dbdd7cbfb8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3] added
Jul 31 10:09:29 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d64bc10-b323-4ed7-8d6f-03d540eddae5]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7752170-9109-4a22-a5db-12ff692b4a95]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cYTyAjsO {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cYTyAjsO" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e68349-eeea-47af-9759-0c9ab76a8bac]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cYTyAjsO'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b44519-c850-4a64-8f30-c6d91db0491f]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5249bde9-82e9-4a0d-81d3-72b7b5aa920d]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:09:29 user nova-compute[71113]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833 (non-flash)
Jul 31 10:09:29 user nova-compute[71113]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c (non-flash)
Jul 31 10:09:29 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:09:29 user nova-compute[71113]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833 (non-flash)
Jul 31 10:09:29 user nova-compute[71113]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c (non-flash)
Jul 31 10:09:29 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8ff257-357d-4a3d-b398-aa98ebb0ff60]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3, portal: 172.16.0.220,3260]
Jul 31 10:09:29 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3, portal: 172.16.0.220,3260] successful.
Jul 31 10:09:29 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a973257-737a-4fca-a04b-4b329e6d7fce]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb578e7-eb38-41c8-b951-d09dca26e4fc]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:09:29 user nova-compute[71113]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833 (non-flash)
Jul 31 10:09:29 user nova-compute[71113]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c (non-flash)
Jul 31 10:09:29 user nova-compute[71113]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)
Jul 31 10:09:29 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:09:29 user nova-compute[71113]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833 (non-flash)
Jul 31 10:09:29 user nova-compute[71113]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c (non-flash)
Jul 31 10:09:29 user nova-compute[71113]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)
Jul 31 10:09:29 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9961e226-a5d2-4bb2-9b48-a77294b60272]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:09:29 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: None {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 10:09:30 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 10:09:30 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cYTyAjsO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 10:09:30 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:09:30 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '26636373265653962', 'path': '/dev/sdc'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:09:30 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636373265653962', 'path': '/dev/sdc'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 10:09:30 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:09:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-264888098',display_name='tempest-TestVolumeBootPattern-server-264888098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-264888098',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHyhNSNVW4Lo+ZOw5JhvHTNH16DxMgCVmk57hIQmCoVWxH+PN+/8jM3YwsIxSsGBxRIiU3keHG6Pnt6GG0CTGlGIZ1kKVEix0HYiRgqMpyBqoT4aBeWmvyv0uyNPZ+vFFg==',key_name='tempest-TestVolumeBootPattern-165282511',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3aa2add2e2a24b9cb8e48042b06931d3',ramdisk_id='',reservation_id='r-0xxbdtbk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1754399827',owner_user_name='tempest-TestVolumeBootPattern-1754399827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T10:09:22Z,user_data=None,user_id='a58fe92488ed47b696fc5d6d990b1acd',uuid=be9f0ded-8064-4675-99f7-8620f0fe3dda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a125e6d6-59a1-4aac-8081-abfbe030359b", "address": "fa:16:3e:61:da:b6", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa125e6d6-59", "ovs_interfaceid": "a125e6d6-59a1-4aac-8081-abfbe030359b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 10:09:30 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Converting VIF {"id": "a125e6d6-59a1-4aac-8081-abfbe030359b", "address": "fa:16:3e:61:da:b6", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa125e6d6-59", "ovs_interfaceid": "a125e6d6-59a1-4aac-8081-abfbe030359b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:09:30 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:da:b6,bridge_name='br-int',has_traffic_filtering=True,id=a125e6d6-59a1-4aac-8081-abfbe030359b,network=Network(fa792d7a-ddf6-4a2d-acb9-802f8daf87ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa125e6d6-59') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:09:30 user nova-compute[71113]: DEBUG nova.objects.instance [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lazy-loading 'pci_devices' on Instance uuid be9f0ded-8064-4675-99f7-8620f0fe3dda {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:09:30 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] End _get_guest_xml xml=<domain type="kvm">
Jul 31 10:09:30 user nova-compute[71113]:   <uuid>be9f0ded-8064-4675-99f7-8620f0fe3dda</uuid>
Jul 31 10:09:30 user nova-compute[71113]:   <name>instance-00000028</name>
Jul 31 10:09:30 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 10:09:30 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 10:09:30 user nova-compute[71113]:   <metadata>
Jul 31 10:09:30 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 10:09:30 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 10:09:30 user nova-compute[71113]:       <nova:name>tempest-TestVolumeBootPattern-server-264888098</nova:name>
Jul 31 10:09:30 user nova-compute[71113]:       <nova:creationTime>2023-07-31 10:09:29</nova:creationTime>
Jul 31 10:09:30 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 10:09:30 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 10:09:30 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 10:09:30 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 10:09:30 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 10:09:30 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 10:09:30 user nova-compute[71113]:       </nova:flavor>
Jul 31 10:09:30 user nova-compute[71113]:       <nova:owner>
Jul 31 10:09:30 user nova-compute[71113]:         <nova:user uuid="a58fe92488ed47b696fc5d6d990b1acd">tempest-TestVolumeBootPattern-1754399827-project-member</nova:user>
Jul 31 10:09:30 user nova-compute[71113]:         <nova:project uuid="3aa2add2e2a24b9cb8e48042b06931d3">tempest-TestVolumeBootPattern-1754399827</nova:project>
Jul 31 10:09:30 user nova-compute[71113]:       </nova:owner>
Jul 31 10:09:30 user nova-compute[71113]:       <nova:ports>
Jul 31 10:09:30 user nova-compute[71113]:         <nova:port uuid="a125e6d6-59a1-4aac-8081-abfbe030359b">
Jul 31 10:09:30 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 31 10:09:30 user nova-compute[71113]:         </nova:port>
Jul 31 10:09:30 user nova-compute[71113]:       </nova:ports>
Jul 31 10:09:30 user nova-compute[71113]:     </nova:instance>
Jul 31 10:09:30 user nova-compute[71113]:   </metadata>
Jul 31 10:09:30 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 10:09:30 user nova-compute[71113]:     <system>
Jul 31 10:09:30 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 10:09:30 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 10:09:30 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 10:09:30 user nova-compute[71113]:       <entry name="serial">be9f0ded-8064-4675-99f7-8620f0fe3dda</entry>
Jul 31 10:09:30 user nova-compute[71113]:       <entry name="uuid">be9f0ded-8064-4675-99f7-8620f0fe3dda</entry>
Jul 31 10:09:30 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 10:09:30 user nova-compute[71113]:     </system>
Jul 31 10:09:30 user nova-compute[71113]:   </sysinfo>
Jul 31 10:09:30 user nova-compute[71113]:   <os>
Jul 31 10:09:30 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 10:09:30 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 10:09:30 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 10:09:30 user nova-compute[71113]:   </os>
Jul 31 10:09:30 user nova-compute[71113]:   <features>
Jul 31 10:09:30 user nova-compute[71113]:     <acpi/>
Jul 31 10:09:30 user nova-compute[71113]:     <apic/>
Jul 31 10:09:30 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 10:09:30 user nova-compute[71113]:   </features>
Jul 31 10:09:30 user nova-compute[71113]:   <clock offset="utc">
Jul 31 10:09:30 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 10:09:30 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 10:09:30 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 10:09:30 user nova-compute[71113]:   </clock>
Jul 31 10:09:30 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 10:09:30 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 10:09:30 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 10:09:30 user nova-compute[71113]:   </cpu>
Jul 31 10:09:30 user nova-compute[71113]:   <devices>
Jul 31 10:09:30 user nova-compute[71113]:     <disk type="block" device="disk">
Jul 31 10:09:30 user nova-compute[71113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:09:30 user nova-compute[71113]:       <source dev="/dev/sdc"/>
Jul 31 10:09:30 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 10:09:30 user nova-compute[71113]:       <serial>393f83a1-d2bd-43b9-a499-cee6c4f93fb3</serial>
Jul 31 10:09:30 user nova-compute[71113]:     </disk>
Jul 31 10:09:30 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 10:09:30 user nova-compute[71113]:       <mac address="fa:16:3e:61:da:b6"/>
Jul 31 10:09:30 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:09:30 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 10:09:30 user nova-compute[71113]:       <target dev="tapa125e6d6-59"/>
Jul 31 10:09:30 user nova-compute[71113]:     </interface>
Jul 31 10:09:30 user nova-compute[71113]:     <serial type="pty">
Jul 31 10:09:30 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/be9f0ded-8064-4675-99f7-8620f0fe3dda/console.log" append="off"/>
Jul 31 10:09:30 user nova-compute[71113]:     </serial>
Jul 31 10:09:30 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 10:09:30 user nova-compute[71113]:     <video>
Jul 31 10:09:30 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:09:30 user nova-compute[71113]:     </video>
Jul 31 10:09:30 user nova-compute[71113]:     <rng model="virtio">
Jul 31 10:09:30 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 10:09:30 user nova-compute[71113]:     </rng>
Jul 31 10:09:30 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 10:09:30 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 10:09:30 user nova-compute[71113]:       <stats period="10"/>
Jul 31 10:09:30 user nova-compute[71113]:     </memballoon>
Jul 31 10:09:30 user nova-compute[71113]:   </devices>
Jul 31 10:09:30 user nova-compute[71113]: </domain>
Jul 31 10:09:30 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 10:09:30 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:09:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-264888098',display_name='tempest-TestVolumeBootPattern-server-264888098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-264888098',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHyhNSNVW4Lo+ZOw5JhvHTNH16DxMgCVmk57hIQmCoVWxH+PN+/8jM3YwsIxSsGBxRIiU3keHG6Pnt6GG0CTGlGIZ1kKVEix0HYiRgqMpyBqoT4aBeWmvyv0uyNPZ+vFFg==',key_name='tempest-TestVolumeBootPattern-165282511',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3aa2add2e2a24b9cb8e48042b06931d3',ramdisk_id='',reservation_id='r-0xxbdtbk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1754399827',owner_user_name='tempest-TestVolumeBootPattern-1754399827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T10:09:22Z,user_data=None,user_id='a58fe92488ed47b696fc5d6d990b1acd',uuid=be9f0ded-8064-4675-99f7-8620f0fe3dda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a125e6d6-59a1-4aac-8081-abfbe030359b", "address": "fa:16:3e:61:da:b6", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa125e6d6-59", "ovs_interfaceid": "a125e6d6-59a1-4aac-8081-abfbe030359b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 10:09:30 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Converting VIF {"id": "a125e6d6-59a1-4aac-8081-abfbe030359b", "address": "fa:16:3e:61:da:b6", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa125e6d6-59", "ovs_interfaceid": "a125e6d6-59a1-4aac-8081-abfbe030359b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:09:30 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:da:b6,bridge_name='br-int',has_traffic_filtering=True,id=a125e6d6-59a1-4aac-8081-abfbe030359b,network=Network(fa792d7a-ddf6-4a2d-acb9-802f8daf87ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa125e6d6-59') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:09:30 user nova-compute[71113]: DEBUG os_vif [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:da:b6,bridge_name='br-int',has_traffic_filtering=True,id=a125e6d6-59a1-4aac-8081-abfbe030359b,network=Network(fa792d7a-ddf6-4a2d-acb9-802f8daf87ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa125e6d6-59') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 10:09:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:09:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:09:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 10:09:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:09:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa125e6d6-59, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:09:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa125e6d6-59, col_values=(('external_ids', {'iface-id': 'a125e6d6-59a1-4aac-8081-abfbe030359b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:da:b6', 'vm-uuid': 'be9f0ded-8064-4675-99f7-8620f0fe3dda'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:09:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:09:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:09:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:09:30 user nova-compute[71113]: INFO os_vif [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:da:b6,bridge_name='br-int',has_traffic_filtering=True,id=a125e6d6-59a1-4aac-8081-abfbe030359b,network=Network(fa792d7a-ddf6-4a2d-acb9-802f8daf87ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa125e6d6-59')
Jul 31 10:09:30 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:09:30 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] No VIF found with MAC fa:16:3e:61:da:b6, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 10:09:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:09:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:09:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:09:32 user nova-compute[71113]: DEBUG nova.compute.manager [req-506a6557-42e7-454c-936c-ca94b5da43d1 req-079001fd-8164-4630-b5f6-c627778a5642 service nova] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Received event network-vif-plugged-a125e6d6-59a1-4aac-8081-abfbe030359b {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:09:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-506a6557-42e7-454c-936c-ca94b5da43d1 req-079001fd-8164-4630-b5f6-c627778a5642 service nova] Acquiring lock "be9f0ded-8064-4675-99f7-8620f0fe3dda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:09:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-506a6557-42e7-454c-936c-ca94b5da43d1 req-079001fd-8164-4630-b5f6-c627778a5642 service nova] Lock "be9f0ded-8064-4675-99f7-8620f0fe3dda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:09:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-506a6557-42e7-454c-936c-ca94b5da43d1 req-079001fd-8164-4630-b5f6-c627778a5642 service nova] Lock "be9f0ded-8064-4675-99f7-8620f0fe3dda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:09:32 user nova-compute[71113]: DEBUG nova.compute.manager [req-506a6557-42e7-454c-936c-ca94b5da43d1 req-079001fd-8164-4630-b5f6-c627778a5642 service nova] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] No waiting events found dispatching network-vif-plugged-a125e6d6-59a1-4aac-8081-abfbe030359b {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:09:32 user nova-compute[71113]: WARNING nova.compute.manager [req-506a6557-42e7-454c-936c-ca94b5da43d1 req-079001fd-8164-4630-b5f6-c627778a5642 service nova] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Received unexpected event network-vif-plugged-a125e6d6-59a1-4aac-8081-abfbe030359b for instance with vm_state building and task_state spawning.
Jul 31 10:09:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:09:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:09:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:09:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:09:33 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690798158.1730275, 5365410d-3994-48cd-8747-698f27d98222 => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:09:33 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 5365410d-3994-48cd-8747-698f27d98222] VM Stopped (Lifecycle Event)
Jul 31 10:09:33 user nova-compute[71113]: DEBUG nova.compute.manager [None req-407e0e8d-e533-4b98-8639-062b36d8df1c None None] [instance: 5365410d-3994-48cd-8747-698f27d98222] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:09:34 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690798174.1048393, be9f0ded-8064-4675-99f7-8620f0fe3dda => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:09:34 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] VM Resumed (Lifecycle Event)
Jul 31 10:09:34 user nova-compute[71113]: DEBUG nova.compute.manager [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 10:09:34 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 10:09:34 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Instance spawned successfully.
Jul 31 10:09:34 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 10:09:34 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:09:34 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:09:34 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Found default for hw_cdrom_bus of ide {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:09:34 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Found default for hw_disk_bus of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:09:34 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Found default for hw_input_bus of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:09:34 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Found default for hw_pointer_model of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:09:34 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Found default for hw_video_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:09:34 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Found default for hw_vif_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:09:34 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 10:09:34 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690798174.108656, be9f0ded-8064-4675-99f7-8620f0fe3dda => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:09:34 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] VM Started (Lifecycle Event)
Jul 31 10:09:34 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:09:34 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:09:34 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 10:09:34 user nova-compute[71113]: INFO nova.compute.manager [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Took 4.96 seconds to spawn the instance on the hypervisor.
Jul 31 10:09:34 user nova-compute[71113]: DEBUG nova.compute.manager [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:09:34 user nova-compute[71113]: INFO nova.compute.manager [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Took 13.44 seconds to build instance.
Jul 31 10:09:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-795cabc1-a594-496d-b6c9-9ff161084d1d tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "be9f0ded-8064-4675-99f7-8620f0fe3dda" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.549s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:09:34 user nova-compute[71113]: DEBUG nova.compute.manager [req-e8c62efa-ef62-47d3-83cc-bd6b88d9d7a1 req-60ec7d89-cb86-49eb-9f47-7d95b70f4263 service nova] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Received event network-vif-plugged-a125e6d6-59a1-4aac-8081-abfbe030359b {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:09:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e8c62efa-ef62-47d3-83cc-bd6b88d9d7a1 req-60ec7d89-cb86-49eb-9f47-7d95b70f4263 service nova] Acquiring lock "be9f0ded-8064-4675-99f7-8620f0fe3dda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:09:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e8c62efa-ef62-47d3-83cc-bd6b88d9d7a1 req-60ec7d89-cb86-49eb-9f47-7d95b70f4263 service nova] Lock "be9f0ded-8064-4675-99f7-8620f0fe3dda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:09:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e8c62efa-ef62-47d3-83cc-bd6b88d9d7a1 req-60ec7d89-cb86-49eb-9f47-7d95b70f4263 service nova] Lock "be9f0ded-8064-4675-99f7-8620f0fe3dda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:09:34 user nova-compute[71113]: DEBUG nova.compute.manager [req-e8c62efa-ef62-47d3-83cc-bd6b88d9d7a1 req-60ec7d89-cb86-49eb-9f47-7d95b70f4263 service nova] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] No waiting events found dispatching network-vif-plugged-a125e6d6-59a1-4aac-8081-abfbe030359b {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:09:34 user nova-compute[71113]: WARNING nova.compute.manager [req-e8c62efa-ef62-47d3-83cc-bd6b88d9d7a1 req-60ec7d89-cb86-49eb-9f47-7d95b70f4263 service nova] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Received unexpected event network-vif-plugged-a125e6d6-59a1-4aac-8081-abfbe030359b for instance with vm_state active and task_state None.
Jul 31 10:09:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:09:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:09:40 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:09:40 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:09:40 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:09:40 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:09:40 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:09:40 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:09:44 user nova-compute[71113]: INFO nova.compute.manager [None req-d4d9fa83-e1f5-4ebc-a734-a3abbf0fcf5c tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Unrescuing
Jul 31 10:09:44 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-d4d9fa83-e1f5-4ebc-a734-a3abbf0fcf5c tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Acquiring lock "refresh_cache-95a84d3c-7aa2-4294-a419-995926a2782f" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:09:44 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-d4d9fa83-e1f5-4ebc-a734-a3abbf0fcf5c tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Acquired lock "refresh_cache-95a84d3c-7aa2-4294-a419-995926a2782f" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:09:44 user nova-compute[71113]: DEBUG nova.network.neutron [None req-d4d9fa83-e1f5-4ebc-a734-a3abbf0fcf5c tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 10:09:45 user nova-compute[71113]: DEBUG nova.network.neutron [None req-d4d9fa83-e1f5-4ebc-a734-a3abbf0fcf5c tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Updating instance_info_cache with network_info: [{"id": "a856eb89-910c-456e-bc0e-a9f92ce20248", "address": "fa:16:3e:d0:99:09", "network": {"id": "67fc40ba-b2c8-43f9-a714-46ef13acf5ed", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1597196996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f8d203e3c534371b05a2ec4c6c07a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa856eb89-91", "ovs_interfaceid": "a856eb89-910c-456e-bc0e-a9f92ce20248", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:09:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-d4d9fa83-e1f5-4ebc-a734-a3abbf0fcf5c tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Releasing lock "refresh_cache-95a84d3c-7aa2-4294-a419-995926a2782f" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:09:45 user nova-compute[71113]: DEBUG nova.objects.instance [None req-d4d9fa83-e1f5-4ebc-a734-a3abbf0fcf5c tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Lazy-loading 'flavor' on Instance uuid 95a84d3c-7aa2-4294-a419-995926a2782f {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:09:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:09:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:09:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:09:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:09:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-6d58609f-1e18-40fd-b90f-dd2792063eed tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquiring lock "92d25a03-98ce-4bde-a3cc-20313ae77d41" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:09:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-6d58609f-1e18-40fd-b90f-dd2792063eed tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "92d25a03-98ce-4bde-a3cc-20313ae77d41" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:09:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-6d58609f-1e18-40fd-b90f-dd2792063eed tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquiring lock "92d25a03-98ce-4bde-a3cc-20313ae77d41-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:09:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-6d58609f-1e18-40fd-b90f-dd2792063eed tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "92d25a03-98ce-4bde-a3cc-20313ae77d41-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:09:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-6d58609f-1e18-40fd-b90f-dd2792063eed tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "92d25a03-98ce-4bde-a3cc-20313ae77d41-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:09:45 user nova-compute[71113]: INFO nova.compute.manager [None req-6d58609f-1e18-40fd-b90f-dd2792063eed tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Terminating instance
Jul 31 10:09:45 user nova-compute[71113]: DEBUG nova.compute.manager [None req-6d58609f-1e18-40fd-b90f-dd2792063eed tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Start destroying the instance on the hypervisor. {{(pid=71113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 10:09:45 user nova-compute[71113]: DEBUG nova.compute.manager [req-05f602b6-7da8-4021-960a-864ae7a248bf req-cfe12001-b699-49c8-8199-a3dad474c871 service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Received event network-vif-unplugged-a856eb89-910c-456e-bc0e-a9f92ce20248 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:09:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-05f602b6-7da8-4021-960a-864ae7a248bf req-cfe12001-b699-49c8-8199-a3dad474c871 service nova] Acquiring lock "95a84d3c-7aa2-4294-a419-995926a2782f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:09:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-05f602b6-7da8-4021-960a-864ae7a248bf req-cfe12001-b699-49c8-8199-a3dad474c871 service nova] Lock "95a84d3c-7aa2-4294-a419-995926a2782f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:09:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-05f602b6-7da8-4021-960a-864ae7a248bf req-cfe12001-b699-49c8-8199-a3dad474c871 service nova] Lock "95a84d3c-7aa2-4294-a419-995926a2782f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:09:45 user nova-compute[71113]: DEBUG nova.compute.manager [req-05f602b6-7da8-4021-960a-864ae7a248bf req-cfe12001-b699-49c8-8199-a3dad474c871 service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] No waiting events found dispatching network-vif-unplugged-a856eb89-910c-456e-bc0e-a9f92ce20248 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:09:45 user nova-compute[71113]: WARNING nova.compute.manager [req-05f602b6-7da8-4021-960a-864ae7a248bf req-cfe12001-b699-49c8-8199-a3dad474c871 service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Received unexpected event network-vif-unplugged-a856eb89-910c-456e-bc0e-a9f92ce20248 for instance with vm_state rescued and task_state unrescuing.
Jul 31 10:09:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:09:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:09:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:09:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:09:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:09:46 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:09:46 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:09:46 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:09:46 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:09:46 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Instance destroyed successfully.
Jul 31 10:09:46 user nova-compute[71113]: DEBUG nova.compute.manager [req-903c8963-24aa-4387-bcf2-6823caa6b428 req-472ee472-776f-4c34-ac18-8ffdb93d6b3e service nova] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Received event network-vif-unplugged-e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:09:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-903c8963-24aa-4387-bcf2-6823caa6b428 req-472ee472-776f-4c34-ac18-8ffdb93d6b3e service nova] Acquiring lock "92d25a03-98ce-4bde-a3cc-20313ae77d41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:09:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-903c8963-24aa-4387-bcf2-6823caa6b428 req-472ee472-776f-4c34-ac18-8ffdb93d6b3e service nova] Lock "92d25a03-98ce-4bde-a3cc-20313ae77d41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:09:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-903c8963-24aa-4387-bcf2-6823caa6b428 req-472ee472-776f-4c34-ac18-8ffdb93d6b3e service nova] Lock "92d25a03-98ce-4bde-a3cc-20313ae77d41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:09:46 user nova-compute[71113]: DEBUG nova.compute.manager [req-903c8963-24aa-4387-bcf2-6823caa6b428 req-472ee472-776f-4c34-ac18-8ffdb93d6b3e service nova] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] No waiting events found dispatching network-vif-unplugged-e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:09:46 user nova-compute[71113]: DEBUG nova.compute.manager [req-903c8963-24aa-4387-bcf2-6823caa6b428 req-472ee472-776f-4c34-ac18-8ffdb93d6b3e service nova] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Received event network-vif-unplugged-e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 10:09:47 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Instance destroyed successfully.
Jul 31 10:09:47 user nova-compute[71113]: DEBUG nova.objects.instance [None req-6d58609f-1e18-40fd-b90f-dd2792063eed tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lazy-loading 'resources' on Instance uuid 92d25a03-98ce-4bde-a3cc-20313ae77d41 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-6d58609f-1e18-40fd-b90f-dd2792063eed tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:53:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-931201663',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-931201663',id=21,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:55:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88bbf2636f6248fcbe644af4eab0c823',ramdisk_id='',reservation_id='r-x25o75li',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1194948978',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:57:45Z,user_data=None,user_id='f4f505d5eddc4df48ec267f6f69a01f9',uuid=92d25a03-98ce-4bde-a3cc-20313ae77d41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d", "address": "fa:16:3e:2c:5b:c3", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape82fc7e2-25", "ovs_interfaceid": "e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-6d58609f-1e18-40fd-b90f-dd2792063eed tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Converting VIF {"id": "e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d", "address": "fa:16:3e:2c:5b:c3", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape82fc7e2-25", "ovs_interfaceid": "e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-6d58609f-1e18-40fd-b90f-dd2792063eed tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:5b:c3,bridge_name='br-int',has_traffic_filtering=True,id=e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d,network=Network(6f88bfaa-d58d-4ac2-b43d-0689d50456ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape82fc7e2-25') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG os_vif [None req-6d58609f-1e18-40fd-b90f-dd2792063eed tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:5b:c3,bridge_name='br-int',has_traffic_filtering=True,id=e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d,network=Network(6f88bfaa-d58d-4ac2-b43d-0689d50456ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape82fc7e2-25') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape82fc7e2-25, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:09:47 user nova-compute[71113]: INFO os_vif [None req-6d58609f-1e18-40fd-b90f-dd2792063eed tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:5b:c3,bridge_name='br-int',has_traffic_filtering=True,id=e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d,network=Network(6f88bfaa-d58d-4ac2-b43d-0689d50456ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape82fc7e2-25')
Jul 31 10:09:47 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d58609f-1e18-40fd-b90f-dd2792063eed tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d58609f-1e18-40fd-b90f-dd2792063eed tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MFWCkIfi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:09:47 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-6d58609f-1e18-40fd-b90f-dd2792063eed tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:09:47 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-6d58609f-1e18-40fd-b90f-dd2792063eed tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-6d58609f-1e18-40fd-b90f-dd2792063eed tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d58609f-1e18-40fd-b90f-dd2792063eed tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee2fc7a-bf31-43d1-b53e-2aab91397dbb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0d0767-e76f-4772-8836-b40267c4e34c]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d58609f-1e18-40fd-b90f-dd2792063eed tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:09:47 user nova-compute[71113]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833 (non-flash)
Jul 31 10:09:47 user nova-compute[71113]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c (non-flash)
Jul 31 10:09:47 user nova-compute[71113]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)
Jul 31 10:09:47 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d58609f-1e18-40fd-b90f-dd2792063eed tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 (non-flash)
Jul 31 10:09:47 user nova-compute[71113]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833 (non-flash)
Jul 31 10:09:47 user nova-compute[71113]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c (non-flash)
Jul 31 10:09:47 user nova-compute[71113]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)
Jul 31 10:09:47 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d58609f-1e18-40fd-b90f-dd2792063eed tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79083927a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407'): ({'sde'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-6d58609f-1e18-40fd-b90f-dd2792063eed tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Removing single pathed devices sde {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[da346192-3088-45f7-9370-dbaad844294b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a0b0da-4d97-41e4-a232-7d16c3c1c792]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-6d58609f-1e18-40fd-b90f-dd2792063eed tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Flushing IO for device /dev/sde {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7abab6-3cc4-4bad-b434-ede733ff4cee]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-6d58609f-1e18-40fd-b90f-dd2792063eed tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.030s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7e0bd8-d302-4edb-87da-49469ef751de]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-6d58609f-1e18-40fd-b90f-dd2792063eed tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-6d58609f-1e18-40fd-b90f-dd2792063eed tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] SCSI volumes sde have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d58609f-1e18-40fd-b90f-dd2792063eed tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c74425-46d2-4564-a0b1-a670624721b5]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d58609f-1e18-40fd-b90f-dd2792063eed tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e97e70-4ccc-405f-bf23-c9cc302e02ae]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d58609f-1e18-40fd-b90f-dd2792063eed tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407, portal: 172.16.0.220,3260]
Jul 31 10:09:47 user nova-compute[71113]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407, portal: 172.16.0.220,3260] successful.
Jul 31 10:09:47 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e143852-2ce0-4b78-9b3e-2e2efb1d1407 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a98d7e0-90fb-41d4-9aed-04f449ad3167]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d58609f-1e18-40fd-b90f-dd2792063eed tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-6d58609f-1e18-40fd-b90f-dd2792063eed tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.262s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d58609f-1e18-40fd-b90f-dd2792063eed tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] <== disconnect_volume: return (263ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d58609f-1e18-40fd-b90f-dd2792063eed tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 10:09:47 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-6d58609f-1e18-40fd-b90f-dd2792063eed tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Deleting instance files /opt/stack/data/nova/instances/92d25a03-98ce-4bde-a3cc-20313ae77d41_del
Jul 31 10:09:47 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-6d58609f-1e18-40fd-b90f-dd2792063eed tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Deletion of /opt/stack/data/nova/instances/92d25a03-98ce-4bde-a3cc-20313ae77d41_del complete
Jul 31 10:09:47 user nova-compute[71113]: INFO nova.compute.manager [None req-6d58609f-1e18-40fd-b90f-dd2792063eed tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Took 1.95 seconds to destroy the instance on the hypervisor.
Jul 31 10:09:47 user nova-compute[71113]: DEBUG oslo.service.loopingcall [None req-6d58609f-1e18-40fd-b90f-dd2792063eed tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71113) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG nova.compute.manager [-] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Deallocating network for instance {{(pid=71113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] deallocate_for_instance() {{(pid=71113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG nova.compute.manager [req-e469b21d-1d39-4fcc-aabf-769b35124438 req-bd305402-93c6-4c68-8009-5e3488a54885 service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Received event network-vif-plugged-a856eb89-910c-456e-bc0e-a9f92ce20248 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e469b21d-1d39-4fcc-aabf-769b35124438 req-bd305402-93c6-4c68-8009-5e3488a54885 service nova] Acquiring lock "95a84d3c-7aa2-4294-a419-995926a2782f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e469b21d-1d39-4fcc-aabf-769b35124438 req-bd305402-93c6-4c68-8009-5e3488a54885 service nova] Lock "95a84d3c-7aa2-4294-a419-995926a2782f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e469b21d-1d39-4fcc-aabf-769b35124438 req-bd305402-93c6-4c68-8009-5e3488a54885 service nova] Lock "95a84d3c-7aa2-4294-a419-995926a2782f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG nova.compute.manager [req-e469b21d-1d39-4fcc-aabf-769b35124438 req-bd305402-93c6-4c68-8009-5e3488a54885 service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] No waiting events found dispatching network-vif-plugged-a856eb89-910c-456e-bc0e-a9f92ce20248 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:09:47 user nova-compute[71113]: WARNING nova.compute.manager [req-e469b21d-1d39-4fcc-aabf-769b35124438 req-bd305402-93c6-4c68-8009-5e3488a54885 service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Received unexpected event network-vif-plugged-a856eb89-910c-456e-bc0e-a9f92ce20248 for instance with vm_state rescued and task_state unrescuing.
Jul 31 10:09:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:09:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:09:48 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:09:48 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Took 0.91 seconds to deallocate network for instance.
Jul 31 10:09:48 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:09:48 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:09:48 user nova-compute[71113]: DEBUG nova.compute.manager [req-924492a0-cb38-4a9b-94f8-13c025190c90 req-e4fa4f9f-fb58-4637-bdfd-46b178f2ea7d service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Received event network-changed-a856eb89-910c-456e-bc0e-a9f92ce20248 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:09:48 user nova-compute[71113]: DEBUG nova.compute.manager [req-924492a0-cb38-4a9b-94f8-13c025190c90 req-e4fa4f9f-fb58-4637-bdfd-46b178f2ea7d service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Refreshing instance network info cache due to event network-changed-a856eb89-910c-456e-bc0e-a9f92ce20248. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 10:09:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-924492a0-cb38-4a9b-94f8-13c025190c90 req-e4fa4f9f-fb58-4637-bdfd-46b178f2ea7d service nova] Acquiring lock "refresh_cache-95a84d3c-7aa2-4294-a419-995926a2782f" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:09:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-924492a0-cb38-4a9b-94f8-13c025190c90 req-e4fa4f9f-fb58-4637-bdfd-46b178f2ea7d service nova] Acquired lock "refresh_cache-95a84d3c-7aa2-4294-a419-995926a2782f" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:09:48 user nova-compute[71113]: DEBUG nova.network.neutron [req-924492a0-cb38-4a9b-94f8-13c025190c90 req-e4fa4f9f-fb58-4637-bdfd-46b178f2ea7d service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Refreshing network info cache for port a856eb89-910c-456e-bc0e-a9f92ce20248 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 10:09:49 user nova-compute[71113]: INFO nova.compute.manager [None req-6d58609f-1e18-40fd-b90f-dd2792063eed tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Took 0.75 seconds to detach 1 volumes for instance.
Jul 31 10:09:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-6d58609f-1e18-40fd-b90f-dd2792063eed tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:09:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-6d58609f-1e18-40fd-b90f-dd2792063eed tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:09:49 user nova-compute[71113]: DEBUG nova.network.neutron [req-924492a0-cb38-4a9b-94f8-13c025190c90 req-e4fa4f9f-fb58-4637-bdfd-46b178f2ea7d service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Updated VIF entry in instance network info cache for port a856eb89-910c-456e-bc0e-a9f92ce20248. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 10:09:49 user nova-compute[71113]: DEBUG nova.network.neutron [req-924492a0-cb38-4a9b-94f8-13c025190c90 req-e4fa4f9f-fb58-4637-bdfd-46b178f2ea7d service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Updating instance_info_cache with network_info: [{"id": "a856eb89-910c-456e-bc0e-a9f92ce20248", "address": "fa:16:3e:d0:99:09", "network": {"id": "67fc40ba-b2c8-43f9-a714-46ef13acf5ed", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1597196996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f8d203e3c534371b05a2ec4c6c07a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa856eb89-91", "ovs_interfaceid": "a856eb89-910c-456e-bc0e-a9f92ce20248", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:09:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-924492a0-cb38-4a9b-94f8-13c025190c90 req-e4fa4f9f-fb58-4637-bdfd-46b178f2ea7d service nova] Releasing lock "refresh_cache-95a84d3c-7aa2-4294-a419-995926a2782f" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:09:49 user nova-compute[71113]: DEBUG nova.compute.manager [req-924492a0-cb38-4a9b-94f8-13c025190c90 req-e4fa4f9f-fb58-4637-bdfd-46b178f2ea7d service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Received event network-changed-a856eb89-910c-456e-bc0e-a9f92ce20248 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:09:49 user nova-compute[71113]: DEBUG nova.compute.manager [req-924492a0-cb38-4a9b-94f8-13c025190c90 req-e4fa4f9f-fb58-4637-bdfd-46b178f2ea7d service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Refreshing instance network info cache due to event network-changed-a856eb89-910c-456e-bc0e-a9f92ce20248. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 10:09:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-924492a0-cb38-4a9b-94f8-13c025190c90 req-e4fa4f9f-fb58-4637-bdfd-46b178f2ea7d service nova] Acquiring lock "refresh_cache-95a84d3c-7aa2-4294-a419-995926a2782f" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:09:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-924492a0-cb38-4a9b-94f8-13c025190c90 req-e4fa4f9f-fb58-4637-bdfd-46b178f2ea7d service nova] Acquired lock "refresh_cache-95a84d3c-7aa2-4294-a419-995926a2782f" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:09:49 user nova-compute[71113]: DEBUG nova.network.neutron [req-924492a0-cb38-4a9b-94f8-13c025190c90 req-e4fa4f9f-fb58-4637-bdfd-46b178f2ea7d service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Refreshing network info cache for port a856eb89-910c-456e-bc0e-a9f92ce20248 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 10:09:49 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-6d58609f-1e18-40fd-b90f-dd2792063eed tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:09:49 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-6d58609f-1e18-40fd-b90f-dd2792063eed tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:09:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-6d58609f-1e18-40fd-b90f-dd2792063eed tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.232s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:09:49 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-6d58609f-1e18-40fd-b90f-dd2792063eed tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Deleted allocations for instance 92d25a03-98ce-4bde-a3cc-20313ae77d41
Jul 31 10:09:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-6d58609f-1e18-40fd-b90f-dd2792063eed tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "92d25a03-98ce-4bde-a3cc-20313ae77d41" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.025s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:09:49 user nova-compute[71113]: DEBUG nova.network.neutron [req-924492a0-cb38-4a9b-94f8-13c025190c90 req-e4fa4f9f-fb58-4637-bdfd-46b178f2ea7d service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Updated VIF entry in instance network info cache for port a856eb89-910c-456e-bc0e-a9f92ce20248. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 10:09:49 user nova-compute[71113]: DEBUG nova.network.neutron [req-924492a0-cb38-4a9b-94f8-13c025190c90 req-e4fa4f9f-fb58-4637-bdfd-46b178f2ea7d service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Updating instance_info_cache with network_info: [{"id": "a856eb89-910c-456e-bc0e-a9f92ce20248", "address": "fa:16:3e:d0:99:09", "network": {"id": "67fc40ba-b2c8-43f9-a714-46ef13acf5ed", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1597196996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f8d203e3c534371b05a2ec4c6c07a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa856eb89-91", "ovs_interfaceid": "a856eb89-910c-456e-bc0e-a9f92ce20248", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:09:49 user nova-compute[71113]: DEBUG nova.compute.manager [req-547ab13d-59cc-4498-8556-a03020a64c27 req-34c5dc49-5648-44c7-a440-5fa700a68288 service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Received event network-vif-plugged-a856eb89-910c-456e-bc0e-a9f92ce20248 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:09:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-547ab13d-59cc-4498-8556-a03020a64c27 req-34c5dc49-5648-44c7-a440-5fa700a68288 service nova] Acquiring lock "95a84d3c-7aa2-4294-a419-995926a2782f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:09:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-547ab13d-59cc-4498-8556-a03020a64c27 req-34c5dc49-5648-44c7-a440-5fa700a68288 service nova] Lock "95a84d3c-7aa2-4294-a419-995926a2782f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:09:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-547ab13d-59cc-4498-8556-a03020a64c27 req-34c5dc49-5648-44c7-a440-5fa700a68288 service nova] Lock "95a84d3c-7aa2-4294-a419-995926a2782f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:09:49 user nova-compute[71113]: DEBUG nova.compute.manager [req-547ab13d-59cc-4498-8556-a03020a64c27 req-34c5dc49-5648-44c7-a440-5fa700a68288 service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] No waiting events found dispatching network-vif-plugged-a856eb89-910c-456e-bc0e-a9f92ce20248 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:09:49 user nova-compute[71113]: WARNING nova.compute.manager [req-547ab13d-59cc-4498-8556-a03020a64c27 req-34c5dc49-5648-44c7-a440-5fa700a68288 service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Received unexpected event network-vif-plugged-a856eb89-910c-456e-bc0e-a9f92ce20248 for instance with vm_state rescued and task_state unrescuing.
Jul 31 10:09:49 user nova-compute[71113]: DEBUG nova.compute.manager [req-547ab13d-59cc-4498-8556-a03020a64c27 req-34c5dc49-5648-44c7-a440-5fa700a68288 service nova] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Received event network-vif-deleted-e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:09:49 user nova-compute[71113]: DEBUG nova.compute.manager [req-547ab13d-59cc-4498-8556-a03020a64c27 req-34c5dc49-5648-44c7-a440-5fa700a68288 service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Received event network-vif-plugged-a856eb89-910c-456e-bc0e-a9f92ce20248 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:09:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-547ab13d-59cc-4498-8556-a03020a64c27 req-34c5dc49-5648-44c7-a440-5fa700a68288 service nova] Acquiring lock "95a84d3c-7aa2-4294-a419-995926a2782f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:09:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-547ab13d-59cc-4498-8556-a03020a64c27 req-34c5dc49-5648-44c7-a440-5fa700a68288 service nova] Lock "95a84d3c-7aa2-4294-a419-995926a2782f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:09:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-547ab13d-59cc-4498-8556-a03020a64c27 req-34c5dc49-5648-44c7-a440-5fa700a68288 service nova] Lock "95a84d3c-7aa2-4294-a419-995926a2782f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:09:49 user nova-compute[71113]: DEBUG nova.compute.manager [req-547ab13d-59cc-4498-8556-a03020a64c27 req-34c5dc49-5648-44c7-a440-5fa700a68288 service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] No waiting events found dispatching network-vif-plugged-a856eb89-910c-456e-bc0e-a9f92ce20248 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:09:49 user nova-compute[71113]: WARNING nova.compute.manager [req-547ab13d-59cc-4498-8556-a03020a64c27 req-34c5dc49-5648-44c7-a440-5fa700a68288 service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Received unexpected event network-vif-plugged-a856eb89-910c-456e-bc0e-a9f92ce20248 for instance with vm_state rescued and task_state unrescuing.
Jul 31 10:09:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-924492a0-cb38-4a9b-94f8-13c025190c90 req-e4fa4f9f-fb58-4637-bdfd-46b178f2ea7d service nova] Releasing lock "refresh_cache-95a84d3c-7aa2-4294-a419-995926a2782f" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:09:49 user nova-compute[71113]: DEBUG nova.compute.manager [req-924492a0-cb38-4a9b-94f8-13c025190c90 req-e4fa4f9f-fb58-4637-bdfd-46b178f2ea7d service nova] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Received event network-vif-plugged-e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:09:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-924492a0-cb38-4a9b-94f8-13c025190c90 req-e4fa4f9f-fb58-4637-bdfd-46b178f2ea7d service nova] Acquiring lock "92d25a03-98ce-4bde-a3cc-20313ae77d41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:09:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-924492a0-cb38-4a9b-94f8-13c025190c90 req-e4fa4f9f-fb58-4637-bdfd-46b178f2ea7d service nova] Lock "92d25a03-98ce-4bde-a3cc-20313ae77d41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:09:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-924492a0-cb38-4a9b-94f8-13c025190c90 req-e4fa4f9f-fb58-4637-bdfd-46b178f2ea7d service nova] Lock "92d25a03-98ce-4bde-a3cc-20313ae77d41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:09:49 user nova-compute[71113]: DEBUG nova.compute.manager [req-924492a0-cb38-4a9b-94f8-13c025190c90 req-e4fa4f9f-fb58-4637-bdfd-46b178f2ea7d service nova] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] No waiting events found dispatching network-vif-plugged-e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:09:49 user nova-compute[71113]: WARNING nova.compute.manager [req-924492a0-cb38-4a9b-94f8-13c025190c90 req-e4fa4f9f-fb58-4637-bdfd-46b178f2ea7d service nova] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Received unexpected event network-vif-plugged-e82fc7e2-2505-4e1c-8efe-cda0ca5d1f6d for instance with vm_state active and task_state deleting.
Jul 31 10:09:49 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Removed pending event for 95a84d3c-7aa2-4294-a419-995926a2782f due to event {{(pid=71113) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 31 10:09:49 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690798189.9168024, 95a84d3c-7aa2-4294-a419-995926a2782f => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:09:49 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] VM Resumed (Lifecycle Event)
Jul 31 10:09:49 user nova-compute[71113]: DEBUG nova.compute.manager [None req-d4d9fa83-e1f5-4ebc-a734-a3abbf0fcf5c tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:09:49 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:09:49 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:09:49 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 31 10:09:49 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690798189.9179766, 95a84d3c-7aa2-4294-a419-995926a2782f => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:09:49 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] VM Started (Lifecycle Event)
Jul 31 10:09:49 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:09:50 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:09:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:09:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:09:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:09:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:10:00 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:10:02 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690798187.081079, 92d25a03-98ce-4bde-a3cc-20313ae77d41 => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:10:02 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] VM Stopped (Lifecycle Event)
Jul 31 10:10:02 user nova-compute[71113]: DEBUG nova.compute.manager [None req-90ed1544-1f51-417f-a3e5-84fb6b8afdf5 None None] [instance: 92d25a03-98ce-4bde-a3cc-20313ae77d41] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:10:02 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:10:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:10:07 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:10:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-3341e6b1-1cb0-487c-a2c6-75ebd0a95e51 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquiring lock "2c7bd88d-2991-4660-928e-298c0a0b2e18" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:10:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-3341e6b1-1cb0-487c-a2c6-75ebd0a95e51 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "2c7bd88d-2991-4660-928e-298c0a0b2e18" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:10:08 user nova-compute[71113]: INFO nova.compute.manager [None req-3341e6b1-1cb0-487c-a2c6-75ebd0a95e51 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Detaching volume 0611f81f-a00b-45e2-9cdb-f046e672b833
Jul 31 10:10:08 user nova-compute[71113]: INFO nova.virt.block_device [None req-3341e6b1-1cb0-487c-a2c6-75ebd0a95e51 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Attempting to driver detach volume 0611f81f-a00b-45e2-9cdb-f046e672b833 from mountpoint /dev/vdb
Jul 31 10:10:08 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-3341e6b1-1cb0-487c-a2c6-75ebd0a95e51 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Attempting to detach device vdb from instance 2c7bd88d-2991-4660-928e-298c0a0b2e18 from the persistent domain config. {{(pid=71113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 10:10:08 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-3341e6b1-1cb0-487c-a2c6-75ebd0a95e51 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 10:10:08 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:10:08 user nova-compute[71113]:   <source dev="/dev/sdb"/>
Jul 31 10:10:08 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 10:10:08 user nova-compute[71113]:   <serial>0611f81f-a00b-45e2-9cdb-f046e672b833</serial>
Jul 31 10:10:08 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 10:10:08 user nova-compute[71113]: </disk>
Jul 31 10:10:08 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 10:10:09 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-3341e6b1-1cb0-487c-a2c6-75ebd0a95e51 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Successfully detached device vdb from instance 2c7bd88d-2991-4660-928e-298c0a0b2e18 from the persistent domain config.
Jul 31 10:10:09 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-3341e6b1-1cb0-487c-a2c6-75ebd0a95e51 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2c7bd88d-2991-4660-928e-298c0a0b2e18 from the live domain config. {{(pid=71113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 10:10:09 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-3341e6b1-1cb0-487c-a2c6-75ebd0a95e51 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 10:10:09 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:10:09 user nova-compute[71113]:   <source dev="/dev/sdb"/>
Jul 31 10:10:09 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 10:10:09 user nova-compute[71113]:   <serial>0611f81f-a00b-45e2-9cdb-f046e672b833</serial>
Jul 31 10:10:09 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 10:10:09 user nova-compute[71113]: </disk>
Jul 31 10:10:09 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 10:10:09 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Received event <DeviceRemovedEvent: 1690798209.4453242, 2c7bd88d-2991-4660-928e-298c0a0b2e18 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71113) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 10:10:09 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-3341e6b1-1cb0-487c-a2c6-75ebd0a95e51 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2c7bd88d-2991-4660-928e-298c0a0b2e18 {{(pid=71113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 10:10:09 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-3341e6b1-1cb0-487c-a2c6-75ebd0a95e51 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Successfully detached device vdb from instance 2c7bd88d-2991-4660-928e-298c0a0b2e18 from the live domain config.
Jul 31 10:10:09 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3341e6b1-1cb0-487c-a2c6-75ebd0a95e51 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 10:10:09 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3341e6b1-1cb0-487c-a2c6-75ebd0a95e51 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JdUlBGba', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:10:09 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-3341e6b1-1cb0-487c-a2c6-75ebd0a95e51 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:10:09 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-3341e6b1-1cb0-487c-a2c6-75ebd0a95e51 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:10:09 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-3341e6b1-1cb0-487c-a2c6-75ebd0a95e51 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:10:09 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3341e6b1-1cb0-487c-a2c6-75ebd0a95e51 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 10:10:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:10:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:10:09 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f820d8-d3b7-475f-9fd9-cadfe568f35f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:10:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:10:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:10:09 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d6988a-d82e-43e7-b6f0-18bed1caa5ab]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:10:09 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3341e6b1-1cb0-487c-a2c6-75ebd0a95e51 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833 (non-flash)
Jul 31 10:10:09 user nova-compute[71113]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c (non-flash)
Jul 31 10:10:09 user nova-compute[71113]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)
Jul 31 10:10:09 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:10:09 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3341e6b1-1cb0-487c-a2c6-75ebd0a95e51 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833 (non-flash)
Jul 31 10:10:09 user nova-compute[71113]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c (non-flash)
Jul 31 10:10:09 user nova-compute[71113]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)
Jul 31 10:10:09 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:10:09 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3341e6b1-1cb0-487c-a2c6-75ebd0a95e51 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f78f07aeef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833'): ({'sdb'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 10:10:09 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-3341e6b1-1cb0-487c-a2c6-75ebd0a95e51 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Removing single pathed devices sdb {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 10:10:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:10:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:10:09 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a8826d-881b-4a98-9f66-3818d56dc3e6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:10:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:10:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:10:09 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90d07e8-4ccf-4a3e-a5a7-38ab7cc01855]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:10:09 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-3341e6b1-1cb0-487c-a2c6-75ebd0a95e51 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Flushing IO for device /dev/sdb {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 10:10:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:10:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:10:09 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56d5659-59b1-48dd-98cd-598a81d11604]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:10:09 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-3341e6b1-1cb0-487c-a2c6-75ebd0a95e51 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 10:10:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:10:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:10:09 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac24d34f-6b31-45e6-954d-262ade141dd3]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:10:09 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-3341e6b1-1cb0-487c-a2c6-75ebd0a95e51 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 10:10:09 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-3341e6b1-1cb0-487c-a2c6-75ebd0a95e51 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] SCSI volumes sdb have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 10:10:09 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3341e6b1-1cb0-487c-a2c6-75ebd0a95e51 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 10:10:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:10:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:10:09 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b729a65d-ec6b-4151-ae16-774b055cddbe]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:10:09 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3341e6b1-1cb0-487c-a2c6-75ebd0a95e51 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:10:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833 -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:10:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:10:09 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[75add6c0-b331-4636-b07a-b6f75575e25f]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:10:09 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3341e6b1-1cb0-487c-a2c6-75ebd0a95e51 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833, portal: 172.16.0.220,3260]
Jul 31 10:10:09 user nova-compute[71113]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833, portal: 172.16.0.220,3260] successful.
Jul 31 10:10:09 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:10:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833 -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:10:09 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0611f81f-a00b-45e2-9cdb-f046e672b833 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:10:09 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1078fb-01a1-49e0-b135-da7a224b99db]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:10:09 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3341e6b1-1cb0-487c-a2c6-75ebd0a95e51 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:10:09 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-3341e6b1-1cb0-487c-a2c6-75ebd0a95e51 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:10:09 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-3341e6b1-1cb0-487c-a2c6-75ebd0a95e51 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] <== disconnect_volume: return (272ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:10:09 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3341e6b1-1cb0-487c-a2c6-75ebd0a95e51 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 10:10:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:10:10 user nova-compute[71113]: DEBUG nova.objects.instance [None req-3341e6b1-1cb0-487c-a2c6-75ebd0a95e51 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lazy-loading 'flavor' on Instance uuid 2c7bd88d-2991-4660-928e-298c0a0b2e18 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:10:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-3341e6b1-1cb0-487c-a2c6-75ebd0a95e51 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "2c7bd88d-2991-4660-928e-298c0a0b2e18" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.589s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:10:12 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:10:13 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:10:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:10:15 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:10:17 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:10:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-470541fd-dd60-44d7-afe8-956c3a191f22 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Acquiring lock "95a84d3c-7aa2-4294-a419-995926a2782f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:10:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-470541fd-dd60-44d7-afe8-956c3a191f22 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Lock "95a84d3c-7aa2-4294-a419-995926a2782f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:10:18 user nova-compute[71113]: INFO nova.compute.manager [None req-470541fd-dd60-44d7-afe8-956c3a191f22 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Detaching volume 80311835-07f0-4221-8a86-1fae9750ed0c
Jul 31 10:10:18 user nova-compute[71113]: INFO nova.virt.block_device [None req-470541fd-dd60-44d7-afe8-956c3a191f22 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Attempting to driver detach volume 80311835-07f0-4221-8a86-1fae9750ed0c from mountpoint /dev/vdb
Jul 31 10:10:19 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-470541fd-dd60-44d7-afe8-956c3a191f22 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Attempting to detach device vdb from instance 95a84d3c-7aa2-4294-a419-995926a2782f from the persistent domain config. {{(pid=71113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 10:10:19 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-470541fd-dd60-44d7-afe8-956c3a191f22 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 10:10:19 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:10:19 user nova-compute[71113]:   <source dev="/dev/sdd"/>
Jul 31 10:10:19 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 10:10:19 user nova-compute[71113]:   <serial>80311835-07f0-4221-8a86-1fae9750ed0c</serial>
Jul 31 10:10:19 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 10:10:19 user nova-compute[71113]: </disk>
Jul 31 10:10:19 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 10:10:19 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-470541fd-dd60-44d7-afe8-956c3a191f22 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Successfully detached device vdb from instance 95a84d3c-7aa2-4294-a419-995926a2782f from the persistent domain config.
Jul 31 10:10:19 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-470541fd-dd60-44d7-afe8-956c3a191f22 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 95a84d3c-7aa2-4294-a419-995926a2782f from the live domain config. {{(pid=71113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 10:10:19 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-470541fd-dd60-44d7-afe8-956c3a191f22 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 10:10:19 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:10:19 user nova-compute[71113]:   <source dev="/dev/sdd"/>
Jul 31 10:10:19 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 10:10:19 user nova-compute[71113]:   <serial>80311835-07f0-4221-8a86-1fae9750ed0c</serial>
Jul 31 10:10:19 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 10:10:19 user nova-compute[71113]: </disk>
Jul 31 10:10:19 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 10:10:19 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Received event <DeviceRemovedEvent: 1690798219.456525, 95a84d3c-7aa2-4294-a419-995926a2782f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71113) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 10:10:19 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-470541fd-dd60-44d7-afe8-956c3a191f22 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 95a84d3c-7aa2-4294-a419-995926a2782f {{(pid=71113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 10:10:19 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-470541fd-dd60-44d7-afe8-956c3a191f22 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Successfully detached device vdb from instance 95a84d3c-7aa2-4294-a419-995926a2782f from the live domain config.
Jul 31 10:10:19 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-470541fd-dd60-44d7-afe8-956c3a191f22 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 10:10:19 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-470541fd-dd60-44d7-afe8-956c3a191f22 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MidtxNfZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:10:19 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-470541fd-dd60-44d7-afe8-956c3a191f22 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:10:19 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-470541fd-dd60-44d7-afe8-956c3a191f22 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:10:19 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-470541fd-dd60-44d7-afe8-956c3a191f22 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:10:19 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-470541fd-dd60-44d7-afe8-956c3a191f22 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 10:10:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:10:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:10:19 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d6a8cc-871a-4b61-ae55-cc79997d8bdd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:10:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:10:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:10:19 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d815487c-89be-4a0c-b8e9-9be42c50df02]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:10:19 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-470541fd-dd60-44d7-afe8-956c3a191f22 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c (non-flash)
Jul 31 10:10:19 user nova-compute[71113]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)
Jul 31 10:10:19 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:10:19 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-470541fd-dd60-44d7-afe8-956c3a191f22 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c (non-flash)
Jul 31 10:10:19 user nova-compute[71113]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)
Jul 31 10:10:19 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:10:19 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-470541fd-dd60-44d7-afe8-956c3a191f22 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f78cc72e290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c'): ({'sdd'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 10:10:19 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-470541fd-dd60-44d7-afe8-956c3a191f22 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Removing single pathed devices sdd {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 10:10:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:10:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:10:19 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa2d41e-e5af-4184-89f5-2b89c25f4014]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:10:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:10:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:10:19 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4cce86-2816-4f40-9c3a-52ba401e728c]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:10:19 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-470541fd-dd60-44d7-afe8-956c3a191f22 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Flushing IO for device /dev/sdd {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 10:10:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:10:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:10:19 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3a1c7c-d214-4e29-8d97-06a66cb22126]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:10:19 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-470541fd-dd60-44d7-afe8-956c3a191f22 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 10:10:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:10:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:10:19 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9f2de9-9222-406e-8b43-b790faac4ca6]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:10:19 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-470541fd-dd60-44d7-afe8-956c3a191f22 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 10:10:19 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-470541fd-dd60-44d7-afe8-956c3a191f22 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] SCSI volumes sdd have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 10:10:19 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-470541fd-dd60-44d7-afe8-956c3a191f22 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 10:10:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:10:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:10:19 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0530856-27f7-4637-b5d8-01e758b33797]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:10:19 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-470541fd-dd60-44d7-afe8-956c3a191f22 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:10:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:10:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:10:19 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[657aca83-2dfa-4f28-b885-4bcbb0c9957f]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:10:19 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-470541fd-dd60-44d7-afe8-956c3a191f22 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c, portal: 172.16.0.220,3260]
Jul 31 10:10:19 user nova-compute[71113]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c, portal: 172.16.0.220,3260] successful.
Jul 31 10:10:19 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:10:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:10:19 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:10:19 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80311835-07f0-4221-8a86-1fae9750ed0c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:10:19 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7666a2b-b17d-4d33-ba23-dc5d33ff088c]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:10:19 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-470541fd-dd60-44d7-afe8-956c3a191f22 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:10:19 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-470541fd-dd60-44d7-afe8-956c3a191f22 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:10:19 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-470541fd-dd60-44d7-afe8-956c3a191f22 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] <== disconnect_volume: return (279ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:10:19 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-470541fd-dd60-44d7-afe8-956c3a191f22 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 10:10:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:10:20 user nova-compute[71113]: DEBUG nova.objects.instance [None req-470541fd-dd60-44d7-afe8-956c3a191f22 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Lazy-loading 'flavor' on Instance uuid 95a84d3c-7aa2-4294-a419-995926a2782f {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:10:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-470541fd-dd60-44d7-afe8-956c3a191f22 tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Lock "95a84d3c-7aa2-4294-a419-995926a2782f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.591s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:10:20 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:10:20 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:10:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "refresh_cache-95a84d3c-7aa2-4294-a419-995926a2782f" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:10:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquired lock "refresh_cache-95a84d3c-7aa2-4294-a419-995926a2782f" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:10:20 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Forcefully refreshing network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 10:10:21 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Updating instance_info_cache with network_info: [{"id": "a856eb89-910c-456e-bc0e-a9f92ce20248", "address": "fa:16:3e:d0:99:09", "network": {"id": "67fc40ba-b2c8-43f9-a714-46ef13acf5ed", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1597196996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f8d203e3c534371b05a2ec4c6c07a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa856eb89-91", "ovs_interfaceid": "a856eb89-910c-456e-bc0e-a9f92ce20248", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:10:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Releasing lock "refresh_cache-95a84d3c-7aa2-4294-a419-995926a2782f" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:10:21 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Updated the network info_cache for instance {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 10:10:21 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:10:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:10:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:10:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:10:21 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:10:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c7bd88d-2991-4660-928e-298c0a0b2e18/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:10:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c7bd88d-2991-4660-928e-298c0a0b2e18/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:10:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c7bd88d-2991-4660-928e-298c0a0b2e18/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:10:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:10:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c7bd88d-2991-4660-928e-298c0a0b2e18/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:10:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 10:10:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:10:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:10:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:10:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:10:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:10:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:10:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:10:22 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:10:23 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:10:23 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:10:23 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=8373MB free_disk=25.088584899902344GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:10:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:10:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:10:23 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 3157a7a6-b8a9-4e2d-a157-360bce4c625d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:10:23 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 95a84d3c-7aa2-4294-a419-995926a2782f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:10:23 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 2c7bd88d-2991-4660-928e-298c0a0b2e18 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:10:23 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance be9f0ded-8064-4675-99f7-8620f0fe3dda actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:10:23 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:10:23 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:10:23 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:10:23 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:10:23 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:10:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.301s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:10:26 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:10:26 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:10:26 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:10:26 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:10:26 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:10:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:10:28 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:10:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:10:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:10:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:10:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:10:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:10:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:10:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f3d18e25-432c-488f-862c-3487dc9e56c7 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquiring lock "3157a7a6-b8a9-4e2d-a157-360bce4c625d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:10:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f3d18e25-432c-488f-862c-3487dc9e56c7 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "3157a7a6-b8a9-4e2d-a157-360bce4c625d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:10:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f3d18e25-432c-488f-862c-3487dc9e56c7 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquiring lock "3157a7a6-b8a9-4e2d-a157-360bce4c625d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:10:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f3d18e25-432c-488f-862c-3487dc9e56c7 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "3157a7a6-b8a9-4e2d-a157-360bce4c625d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:10:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f3d18e25-432c-488f-862c-3487dc9e56c7 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "3157a7a6-b8a9-4e2d-a157-360bce4c625d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:10:37 user nova-compute[71113]: INFO nova.compute.manager [None req-f3d18e25-432c-488f-862c-3487dc9e56c7 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Terminating instance
Jul 31 10:10:37 user nova-compute[71113]: DEBUG nova.compute.manager [None req-f3d18e25-432c-488f-862c-3487dc9e56c7 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Start destroying the instance on the hypervisor. {{(pid=71113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 10:10:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:10:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:10:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:10:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:10:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:10:37 user nova-compute[71113]: DEBUG nova.compute.manager [req-be661d14-049c-422f-a226-a5f3e0559138 req-0094c929-b402-4ca0-8350-8f6096b08661 service nova] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Received event network-vif-unplugged-179480f5-30b9-4a11-9771-95d88f21574f {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:10:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-be661d14-049c-422f-a226-a5f3e0559138 req-0094c929-b402-4ca0-8350-8f6096b08661 service nova] Acquiring lock "3157a7a6-b8a9-4e2d-a157-360bce4c625d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:10:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-be661d14-049c-422f-a226-a5f3e0559138 req-0094c929-b402-4ca0-8350-8f6096b08661 service nova] Lock "3157a7a6-b8a9-4e2d-a157-360bce4c625d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:10:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-be661d14-049c-422f-a226-a5f3e0559138 req-0094c929-b402-4ca0-8350-8f6096b08661 service nova] Lock "3157a7a6-b8a9-4e2d-a157-360bce4c625d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:10:37 user nova-compute[71113]: DEBUG nova.compute.manager [req-be661d14-049c-422f-a226-a5f3e0559138 req-0094c929-b402-4ca0-8350-8f6096b08661 service nova] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] No waiting events found dispatching network-vif-unplugged-179480f5-30b9-4a11-9771-95d88f21574f {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:10:37 user nova-compute[71113]: DEBUG nova.compute.manager [req-be661d14-049c-422f-a226-a5f3e0559138 req-0094c929-b402-4ca0-8350-8f6096b08661 service nova] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Received event network-vif-unplugged-179480f5-30b9-4a11-9771-95d88f21574f for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 10:10:37 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Instance destroyed successfully.
Jul 31 10:10:37 user nova-compute[71113]: DEBUG nova.objects.instance [None req-f3d18e25-432c-488f-862c-3487dc9e56c7 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lazy-loading 'resources' on Instance uuid 3157a7a6-b8a9-4e2d-a157-360bce4c625d {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:10:37 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-f3d18e25-432c-488f-862c-3487dc9e56c7 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T09:50:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1017207621',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1017207621',id=16,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T09:51:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88bbf2636f6248fcbe644af4eab0c823',ramdisk_id='',reservation_id='r-z062qlau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1194948978',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T09:52:54Z,user_data=None,user_id='f4f505d5eddc4df48ec267f6f69a01f9',uuid=3157a7a6-b8a9-4e2d-a157-360bce4c625d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "179480f5-30b9-4a11-9771-95d88f21574f", "address": "fa:16:3e:42:ea:05", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap179480f5-30", "ovs_interfaceid": "179480f5-30b9-4a11-9771-95d88f21574f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 10:10:37 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-f3d18e25-432c-488f-862c-3487dc9e56c7 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Converting VIF {"id": "179480f5-30b9-4a11-9771-95d88f21574f", "address": "fa:16:3e:42:ea:05", "network": {"id": "6f88bfaa-d58d-4ac2-b43d-0689d50456ef", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1248441561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88bbf2636f6248fcbe644af4eab0c823", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap179480f5-30", "ovs_interfaceid": "179480f5-30b9-4a11-9771-95d88f21574f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:10:37 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-f3d18e25-432c-488f-862c-3487dc9e56c7 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:ea:05,bridge_name='br-int',has_traffic_filtering=True,id=179480f5-30b9-4a11-9771-95d88f21574f,network=Network(6f88bfaa-d58d-4ac2-b43d-0689d50456ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap179480f5-30') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:10:37 user nova-compute[71113]: DEBUG os_vif [None req-f3d18e25-432c-488f-862c-3487dc9e56c7 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:ea:05,bridge_name='br-int',has_traffic_filtering=True,id=179480f5-30b9-4a11-9771-95d88f21574f,network=Network(6f88bfaa-d58d-4ac2-b43d-0689d50456ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap179480f5-30') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 10:10:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:10:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap179480f5-30, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:10:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:10:37 user nova-compute[71113]: INFO os_vif [None req-f3d18e25-432c-488f-862c-3487dc9e56c7 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:ea:05,bridge_name='br-int',has_traffic_filtering=True,id=179480f5-30b9-4a11-9771-95d88f21574f,network=Network(6f88bfaa-d58d-4ac2-b43d-0689d50456ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap179480f5-30')
Jul 31 10:10:37 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-f3d18e25-432c-488f-862c-3487dc9e56c7 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Deleting instance files /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d_del
Jul 31 10:10:37 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-f3d18e25-432c-488f-862c-3487dc9e56c7 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Deletion of /opt/stack/data/nova/instances/3157a7a6-b8a9-4e2d-a157-360bce4c625d_del complete
Jul 31 10:10:37 user nova-compute[71113]: INFO nova.compute.manager [None req-f3d18e25-432c-488f-862c-3487dc9e56c7 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Took 0.87 seconds to destroy the instance on the hypervisor.
Jul 31 10:10:37 user nova-compute[71113]: DEBUG oslo.service.loopingcall [None req-f3d18e25-432c-488f-862c-3487dc9e56c7 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71113) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 10:10:37 user nova-compute[71113]: DEBUG nova.compute.manager [-] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Deallocating network for instance {{(pid=71113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 10:10:37 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] deallocate_for_instance() {{(pid=71113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 10:10:38 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:10:38 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:10:38 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Took 0.64 seconds to deallocate network for instance.
Jul 31 10:10:38 user nova-compute[71113]: DEBUG nova.compute.manager [req-f2c49fca-86d3-47ee-a948-1c50db795ccb req-a06f23d2-d1ff-44e8-b136-c8e7bf60bdd7 service nova] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Received event network-vif-deleted-179480f5-30b9-4a11-9771-95d88f21574f {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:10:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f3d18e25-432c-488f-862c-3487dc9e56c7 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:10:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f3d18e25-432c-488f-862c-3487dc9e56c7 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:10:38 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-f3d18e25-432c-488f-862c-3487dc9e56c7 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:10:38 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-f3d18e25-432c-488f-862c-3487dc9e56c7 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:10:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f3d18e25-432c-488f-862c-3487dc9e56c7 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.189s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:10:38 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-f3d18e25-432c-488f-862c-3487dc9e56c7 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Deleted allocations for instance 3157a7a6-b8a9-4e2d-a157-360bce4c625d
Jul 31 10:10:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f3d18e25-432c-488f-862c-3487dc9e56c7 tempest-ServerBootFromVolumeStableRescueTest-1194948978 tempest-ServerBootFromVolumeStableRescueTest-1194948978-project-member] Lock "3157a7a6-b8a9-4e2d-a157-360bce4c625d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.880s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:10:39 user nova-compute[71113]: DEBUG nova.compute.manager [req-98b91d76-61da-4c05-8cbf-3c6068de552c req-a454a7ad-0e3d-4dda-8741-bb14a2c91d1c service nova] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Received event network-vif-plugged-179480f5-30b9-4a11-9771-95d88f21574f {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:10:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-98b91d76-61da-4c05-8cbf-3c6068de552c req-a454a7ad-0e3d-4dda-8741-bb14a2c91d1c service nova] Acquiring lock "3157a7a6-b8a9-4e2d-a157-360bce4c625d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:10:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-98b91d76-61da-4c05-8cbf-3c6068de552c req-a454a7ad-0e3d-4dda-8741-bb14a2c91d1c service nova] Lock "3157a7a6-b8a9-4e2d-a157-360bce4c625d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:10:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-98b91d76-61da-4c05-8cbf-3c6068de552c req-a454a7ad-0e3d-4dda-8741-bb14a2c91d1c service nova] Lock "3157a7a6-b8a9-4e2d-a157-360bce4c625d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:10:39 user nova-compute[71113]: DEBUG nova.compute.manager [req-98b91d76-61da-4c05-8cbf-3c6068de552c req-a454a7ad-0e3d-4dda-8741-bb14a2c91d1c service nova] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] No waiting events found dispatching network-vif-plugged-179480f5-30b9-4a11-9771-95d88f21574f {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:10:39 user nova-compute[71113]: WARNING nova.compute.manager [req-98b91d76-61da-4c05-8cbf-3c6068de552c req-a454a7ad-0e3d-4dda-8741-bb14a2c91d1c service nova] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Received unexpected event network-vif-plugged-179480f5-30b9-4a11-9771-95d88f21574f for instance with vm_state deleted and task_state None.
Jul 31 10:10:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:10:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:10:52 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690798237.8428497, 3157a7a6-b8a9-4e2d-a157-360bce4c625d => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:10:52 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] VM Stopped (Lifecycle Event)
Jul 31 10:10:52 user nova-compute[71113]: DEBUG nova.compute.manager [None req-67c39916-de7b-4f01-aaf9-b9a4efc89a17 None None] [instance: 3157a7a6-b8a9-4e2d-a157-360bce4c625d] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:10:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:10:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:10:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:10:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:10:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:10:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:10:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:10:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-eae1cacb-728c-4670-a108-42e5a568d632 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquiring lock "2c7bd88d-2991-4660-928e-298c0a0b2e18" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:10:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-eae1cacb-728c-4670-a108-42e5a568d632 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "2c7bd88d-2991-4660-928e-298c0a0b2e18" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:10:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-eae1cacb-728c-4670-a108-42e5a568d632 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquiring lock "2c7bd88d-2991-4660-928e-298c0a0b2e18-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:10:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-eae1cacb-728c-4670-a108-42e5a568d632 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "2c7bd88d-2991-4660-928e-298c0a0b2e18-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:10:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-eae1cacb-728c-4670-a108-42e5a568d632 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "2c7bd88d-2991-4660-928e-298c0a0b2e18-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:10:59 user nova-compute[71113]: INFO nova.compute.manager [None req-eae1cacb-728c-4670-a108-42e5a568d632 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Terminating instance
Jul 31 10:10:59 user nova-compute[71113]: DEBUG nova.compute.manager [None req-eae1cacb-728c-4670-a108-42e5a568d632 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Start destroying the instance on the hypervisor. {{(pid=71113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 10:10:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:10:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:10:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:10:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:10:59 user nova-compute[71113]: DEBUG nova.compute.manager [req-d2898b3d-b477-42fd-960b-fa7d58f893b1 req-cccd953f-2b51-4264-8d57-a2498f254cc2 service nova] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Received event network-vif-unplugged-3a203223-ccaa-4246-960c-686b0f431f07 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:10:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-d2898b3d-b477-42fd-960b-fa7d58f893b1 req-cccd953f-2b51-4264-8d57-a2498f254cc2 service nova] Acquiring lock "2c7bd88d-2991-4660-928e-298c0a0b2e18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:10:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-d2898b3d-b477-42fd-960b-fa7d58f893b1 req-cccd953f-2b51-4264-8d57-a2498f254cc2 service nova] Lock "2c7bd88d-2991-4660-928e-298c0a0b2e18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:10:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-d2898b3d-b477-42fd-960b-fa7d58f893b1 req-cccd953f-2b51-4264-8d57-a2498f254cc2 service nova] Lock "2c7bd88d-2991-4660-928e-298c0a0b2e18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:10:59 user nova-compute[71113]: DEBUG nova.compute.manager [req-d2898b3d-b477-42fd-960b-fa7d58f893b1 req-cccd953f-2b51-4264-8d57-a2498f254cc2 service nova] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] No waiting events found dispatching network-vif-unplugged-3a203223-ccaa-4246-960c-686b0f431f07 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:10:59 user nova-compute[71113]: DEBUG nova.compute.manager [req-d2898b3d-b477-42fd-960b-fa7d58f893b1 req-cccd953f-2b51-4264-8d57-a2498f254cc2 service nova] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Received event network-vif-unplugged-3a203223-ccaa-4246-960c-686b0f431f07 for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 10:11:00 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Instance destroyed successfully.
Jul 31 10:11:00 user nova-compute[71113]: DEBUG nova.objects.instance [None req-eae1cacb-728c-4670-a108-42e5a568d632 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lazy-loading 'resources' on Instance uuid 2c7bd88d-2991-4660-928e-298c0a0b2e18 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:11:00 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-eae1cacb-728c-4670-a108-42e5a568d632 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:05:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-640721173',display_name='tempest-AttachVolumeNegativeTest-server-640721173',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-640721173',id=37,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmXiItTwuYYSVLtzin7xW3g5ye4crVlybmaPNMULubChk/s5W/MiImHjmXoTQ2j1Q+CMssyy/c5yNqvpzYG6IhkXve232ryGExiwqKEybw3erRtzojQmciWVQVuGUv2/A==',key_name='tempest-keypair-668613639',keypairs=<?>,launch_index=0,launched_at=2023-07-31T10:05:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7000d6a2a6b147ddbc38208b316574cd',ramdisk_id='',reservation_id='r-g82x0ruj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2110881646',owner_user_name='tempest-AttachVolumeNegativeTest-2110881646-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T10:05:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9883a5677fb4852ae031137736a9ee4',uuid=2c7bd88d-2991-4660-928e-298c0a0b2e18,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a203223-ccaa-4246-960c-686b0f431f07", "address": "fa:16:3e:a1:ae:09", "network": {"id": "4b030626-e3f1-4617-89c2-f6389226652f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441335951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7000d6a2a6b147ddbc38208b316574cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a203223-cc", "ovs_interfaceid": "3a203223-ccaa-4246-960c-686b0f431f07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 10:11:00 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-eae1cacb-728c-4670-a108-42e5a568d632 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Converting VIF {"id": "3a203223-ccaa-4246-960c-686b0f431f07", "address": "fa:16:3e:a1:ae:09", "network": {"id": "4b030626-e3f1-4617-89c2-f6389226652f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441335951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7000d6a2a6b147ddbc38208b316574cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a203223-cc", "ovs_interfaceid": "3a203223-ccaa-4246-960c-686b0f431f07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:11:00 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-eae1cacb-728c-4670-a108-42e5a568d632 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:ae:09,bridge_name='br-int',has_traffic_filtering=True,id=3a203223-ccaa-4246-960c-686b0f431f07,network=Network(4b030626-e3f1-4617-89c2-f6389226652f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a203223-cc') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:11:00 user nova-compute[71113]: DEBUG os_vif [None req-eae1cacb-728c-4670-a108-42e5a568d632 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:ae:09,bridge_name='br-int',has_traffic_filtering=True,id=3a203223-ccaa-4246-960c-686b0f431f07,network=Network(4b030626-e3f1-4617-89c2-f6389226652f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a203223-cc') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 10:11:00 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:00 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a203223-cc, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:11:00 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:00 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:11:00 user nova-compute[71113]: INFO os_vif [None req-eae1cacb-728c-4670-a108-42e5a568d632 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:ae:09,bridge_name='br-int',has_traffic_filtering=True,id=3a203223-ccaa-4246-960c-686b0f431f07,network=Network(4b030626-e3f1-4617-89c2-f6389226652f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a203223-cc')
Jul 31 10:11:00 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-eae1cacb-728c-4670-a108-42e5a568d632 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Deleting instance files /opt/stack/data/nova/instances/2c7bd88d-2991-4660-928e-298c0a0b2e18_del
Jul 31 10:11:00 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-eae1cacb-728c-4670-a108-42e5a568d632 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Deletion of /opt/stack/data/nova/instances/2c7bd88d-2991-4660-928e-298c0a0b2e18_del complete
Jul 31 10:11:00 user nova-compute[71113]: INFO nova.compute.manager [None req-eae1cacb-728c-4670-a108-42e5a568d632 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Took 0.88 seconds to destroy the instance on the hypervisor.
Jul 31 10:11:00 user nova-compute[71113]: DEBUG oslo.service.loopingcall [None req-eae1cacb-728c-4670-a108-42e5a568d632 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71113) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 10:11:00 user nova-compute[71113]: DEBUG nova.compute.manager [-] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Deallocating network for instance {{(pid=71113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 10:11:00 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] deallocate_for_instance() {{(pid=71113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 10:11:01 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:11:01 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Took 1.02 seconds to deallocate network for instance.
Jul 31 10:11:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-eae1cacb-728c-4670-a108-42e5a568d632 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:11:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-eae1cacb-728c-4670-a108-42e5a568d632 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:11:01 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-eae1cacb-728c-4670-a108-42e5a568d632 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:11:01 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-eae1cacb-728c-4670-a108-42e5a568d632 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:11:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-eae1cacb-728c-4670-a108-42e5a568d632 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.160s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:11:01 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-eae1cacb-728c-4670-a108-42e5a568d632 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Deleted allocations for instance 2c7bd88d-2991-4660-928e-298c0a0b2e18
Jul 31 10:11:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-eae1cacb-728c-4670-a108-42e5a568d632 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "2c7bd88d-2991-4660-928e-298c0a0b2e18" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.281s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:11:01 user nova-compute[71113]: DEBUG nova.compute.manager [req-6121cee1-472d-4a18-b1e7-2007f4f07ef9 req-f371755a-6903-4db1-b7f8-89340335673d service nova] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Received event network-vif-plugged-3a203223-ccaa-4246-960c-686b0f431f07 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:11:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-6121cee1-472d-4a18-b1e7-2007f4f07ef9 req-f371755a-6903-4db1-b7f8-89340335673d service nova] Acquiring lock "2c7bd88d-2991-4660-928e-298c0a0b2e18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:11:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-6121cee1-472d-4a18-b1e7-2007f4f07ef9 req-f371755a-6903-4db1-b7f8-89340335673d service nova] Lock "2c7bd88d-2991-4660-928e-298c0a0b2e18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:11:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-6121cee1-472d-4a18-b1e7-2007f4f07ef9 req-f371755a-6903-4db1-b7f8-89340335673d service nova] Lock "2c7bd88d-2991-4660-928e-298c0a0b2e18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:11:01 user nova-compute[71113]: DEBUG nova.compute.manager [req-6121cee1-472d-4a18-b1e7-2007f4f07ef9 req-f371755a-6903-4db1-b7f8-89340335673d service nova] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] No waiting events found dispatching network-vif-plugged-3a203223-ccaa-4246-960c-686b0f431f07 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:11:01 user nova-compute[71113]: WARNING nova.compute.manager [req-6121cee1-472d-4a18-b1e7-2007f4f07ef9 req-f371755a-6903-4db1-b7f8-89340335673d service nova] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Received unexpected event network-vif-plugged-3a203223-ccaa-4246-960c-686b0f431f07 for instance with vm_state deleted and task_state None.
Jul 31 10:11:01 user nova-compute[71113]: DEBUG nova.compute.manager [req-6121cee1-472d-4a18-b1e7-2007f4f07ef9 req-f371755a-6903-4db1-b7f8-89340335673d service nova] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Received event network-vif-deleted-3a203223-ccaa-4246-960c-686b0f431f07 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:11:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:11:12 user nova-compute[71113]: DEBUG nova.compute.manager [req-101921ad-55f0-46b1-97d0-71bc021c2b83 req-e07cc817-c309-4c9b-98fc-b28d81d03736 service nova] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Received event network-changed-a125e6d6-59a1-4aac-8081-abfbe030359b {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:11:12 user nova-compute[71113]: DEBUG nova.compute.manager [req-101921ad-55f0-46b1-97d0-71bc021c2b83 req-e07cc817-c309-4c9b-98fc-b28d81d03736 service nova] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Refreshing instance network info cache due to event network-changed-a125e6d6-59a1-4aac-8081-abfbe030359b. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 10:11:12 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-101921ad-55f0-46b1-97d0-71bc021c2b83 req-e07cc817-c309-4c9b-98fc-b28d81d03736 service nova] Acquiring lock "refresh_cache-be9f0ded-8064-4675-99f7-8620f0fe3dda" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:11:12 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-101921ad-55f0-46b1-97d0-71bc021c2b83 req-e07cc817-c309-4c9b-98fc-b28d81d03736 service nova] Acquired lock "refresh_cache-be9f0ded-8064-4675-99f7-8620f0fe3dda" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:11:12 user nova-compute[71113]: DEBUG nova.network.neutron [req-101921ad-55f0-46b1-97d0-71bc021c2b83 req-e07cc817-c309-4c9b-98fc-b28d81d03736 service nova] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Refreshing network info cache for port a125e6d6-59a1-4aac-8081-abfbe030359b {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 10:11:13 user nova-compute[71113]: DEBUG nova.network.neutron [req-101921ad-55f0-46b1-97d0-71bc021c2b83 req-e07cc817-c309-4c9b-98fc-b28d81d03736 service nova] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Updated VIF entry in instance network info cache for port a125e6d6-59a1-4aac-8081-abfbe030359b. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 10:11:13 user nova-compute[71113]: DEBUG nova.network.neutron [req-101921ad-55f0-46b1-97d0-71bc021c2b83 req-e07cc817-c309-4c9b-98fc-b28d81d03736 service nova] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Updating instance_info_cache with network_info: [{"id": "a125e6d6-59a1-4aac-8081-abfbe030359b", "address": "fa:16:3e:61:da:b6", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa125e6d6-59", "ovs_interfaceid": "a125e6d6-59a1-4aac-8081-abfbe030359b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:11:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-101921ad-55f0-46b1-97d0-71bc021c2b83 req-e07cc817-c309-4c9b-98fc-b28d81d03736 service nova] Releasing lock "refresh_cache-be9f0ded-8064-4675-99f7-8620f0fe3dda" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:11:13 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:11:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9c957d16-08fe-49f1-b53c-f024e0027b4d tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Acquiring lock "95a84d3c-7aa2-4294-a419-995926a2782f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:11:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9c957d16-08fe-49f1-b53c-f024e0027b4d tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Lock "95a84d3c-7aa2-4294-a419-995926a2782f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:11:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9c957d16-08fe-49f1-b53c-f024e0027b4d tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Acquiring lock "95a84d3c-7aa2-4294-a419-995926a2782f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:11:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9c957d16-08fe-49f1-b53c-f024e0027b4d tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Lock "95a84d3c-7aa2-4294-a419-995926a2782f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:11:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9c957d16-08fe-49f1-b53c-f024e0027b4d tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Lock "95a84d3c-7aa2-4294-a419-995926a2782f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:11:13 user nova-compute[71113]: INFO nova.compute.manager [None req-9c957d16-08fe-49f1-b53c-f024e0027b4d tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Terminating instance
Jul 31 10:11:13 user nova-compute[71113]: DEBUG nova.compute.manager [None req-9c957d16-08fe-49f1-b53c-f024e0027b4d tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Start destroying the instance on the hypervisor. {{(pid=71113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 10:11:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:14 user nova-compute[71113]: DEBUG nova.compute.manager [req-fba0b44e-9ac8-41db-a04b-d87d7f0275c4 req-549b7cec-7de8-4f18-9cb6-d9fb54294369 service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Received event network-vif-unplugged-a856eb89-910c-456e-bc0e-a9f92ce20248 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:11:14 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-fba0b44e-9ac8-41db-a04b-d87d7f0275c4 req-549b7cec-7de8-4f18-9cb6-d9fb54294369 service nova] Acquiring lock "95a84d3c-7aa2-4294-a419-995926a2782f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:11:14 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-fba0b44e-9ac8-41db-a04b-d87d7f0275c4 req-549b7cec-7de8-4f18-9cb6-d9fb54294369 service nova] Lock "95a84d3c-7aa2-4294-a419-995926a2782f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:11:14 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-fba0b44e-9ac8-41db-a04b-d87d7f0275c4 req-549b7cec-7de8-4f18-9cb6-d9fb54294369 service nova] Lock "95a84d3c-7aa2-4294-a419-995926a2782f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:11:14 user nova-compute[71113]: DEBUG nova.compute.manager [req-fba0b44e-9ac8-41db-a04b-d87d7f0275c4 req-549b7cec-7de8-4f18-9cb6-d9fb54294369 service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] No waiting events found dispatching network-vif-unplugged-a856eb89-910c-456e-bc0e-a9f92ce20248 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:11:14 user nova-compute[71113]: DEBUG nova.compute.manager [req-fba0b44e-9ac8-41db-a04b-d87d7f0275c4 req-549b7cec-7de8-4f18-9cb6-d9fb54294369 service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Received event network-vif-unplugged-a856eb89-910c-456e-bc0e-a9f92ce20248 for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 10:11:14 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Instance destroyed successfully.
Jul 31 10:11:14 user nova-compute[71113]: DEBUG nova.objects.instance [None req-9c957d16-08fe-49f1-b53c-f024e0027b4d tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Lazy-loading 'resources' on Instance uuid 95a84d3c-7aa2-4294-a419-995926a2782f {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:11:14 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-9c957d16-08fe-49f1-b53c-f024e0027b4d tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:03:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2103964806',display_name='tempest-ServerStableDeviceRescueTest-server-2103964806',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2103964806',id=36,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdl8SX645/Muc/9M6HuPzDTOvIdM6KrFE61+dTZHqyrZ0zWuC0IOgJE5YL7IjPgvGTYTgBzjZJL8AHFSZVMP6dsDsN1FtFI6gizkdDAM6HYW8d03e+SFHeZYZOyP/3S4w==',key_name='tempest-keypair-1251481522',keypairs=<?>,launch_index=0,launched_at=2023-07-31T10:08:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f8d203e3c534371b05a2ec4c6c07a61',ramdisk_id='',reservation_id='r-fanuve5b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1277436113',owner_user_name='tempest-ServerStableDeviceRescueTest-1277436113-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T10:09:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4c2f8d82f494a5d8255984f4bd3806b',uuid=95a84d3c-7aa2-4294-a419-995926a2782f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a856eb89-910c-456e-bc0e-a9f92ce20248", "address": "fa:16:3e:d0:99:09", "network": {"id": "67fc40ba-b2c8-43f9-a714-46ef13acf5ed", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1597196996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f8d203e3c534371b05a2ec4c6c07a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa856eb89-91", "ovs_interfaceid": "a856eb89-910c-456e-bc0e-a9f92ce20248", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 10:11:14 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-9c957d16-08fe-49f1-b53c-f024e0027b4d tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Converting VIF {"id": "a856eb89-910c-456e-bc0e-a9f92ce20248", "address": "fa:16:3e:d0:99:09", "network": {"id": "67fc40ba-b2c8-43f9-a714-46ef13acf5ed", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1597196996-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f8d203e3c534371b05a2ec4c6c07a61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa856eb89-91", "ovs_interfaceid": "a856eb89-910c-456e-bc0e-a9f92ce20248", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:11:14 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-9c957d16-08fe-49f1-b53c-f024e0027b4d tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:99:09,bridge_name='br-int',has_traffic_filtering=True,id=a856eb89-910c-456e-bc0e-a9f92ce20248,network=Network(67fc40ba-b2c8-43f9-a714-46ef13acf5ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa856eb89-91') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:11:14 user nova-compute[71113]: DEBUG os_vif [None req-9c957d16-08fe-49f1-b53c-f024e0027b4d tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:99:09,bridge_name='br-int',has_traffic_filtering=True,id=a856eb89-910c-456e-bc0e-a9f92ce20248,network=Network(67fc40ba-b2c8-43f9-a714-46ef13acf5ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa856eb89-91') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 10:11:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa856eb89-91, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:11:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:11:14 user nova-compute[71113]: INFO os_vif [None req-9c957d16-08fe-49f1-b53c-f024e0027b4d tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:99:09,bridge_name='br-int',has_traffic_filtering=True,id=a856eb89-910c-456e-bc0e-a9f92ce20248,network=Network(67fc40ba-b2c8-43f9-a714-46ef13acf5ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa856eb89-91')
Jul 31 10:11:14 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-9c957d16-08fe-49f1-b53c-f024e0027b4d tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Deleting instance files /opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f_del
Jul 31 10:11:14 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-9c957d16-08fe-49f1-b53c-f024e0027b4d tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Deletion of /opt/stack/data/nova/instances/95a84d3c-7aa2-4294-a419-995926a2782f_del complete
Jul 31 10:11:14 user nova-compute[71113]: INFO nova.compute.manager [None req-9c957d16-08fe-49f1-b53c-f024e0027b4d tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Took 0.88 seconds to destroy the instance on the hypervisor.
Jul 31 10:11:14 user nova-compute[71113]: DEBUG oslo.service.loopingcall [None req-9c957d16-08fe-49f1-b53c-f024e0027b4d tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71113) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 10:11:14 user nova-compute[71113]: DEBUG nova.compute.manager [-] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Deallocating network for instance {{(pid=71113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 10:11:14 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] deallocate_for_instance() {{(pid=71113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 10:11:15 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690798260.1400523, 2c7bd88d-2991-4660-928e-298c0a0b2e18 => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:11:15 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] VM Stopped (Lifecycle Event)
Jul 31 10:11:15 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0e315919-47fe-4a70-ab31-c103093e042d None None] [instance: 2c7bd88d-2991-4660-928e-298c0a0b2e18] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:11:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:15 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:11:16 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:11:16 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Took 1.19 seconds to deallocate network for instance.
Jul 31 10:11:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9c957d16-08fe-49f1-b53c-f024e0027b4d tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:11:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9c957d16-08fe-49f1-b53c-f024e0027b4d tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:11:16 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-9c957d16-08fe-49f1-b53c-f024e0027b4d tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:11:16 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-9c957d16-08fe-49f1-b53c-f024e0027b4d tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:11:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9c957d16-08fe-49f1-b53c-f024e0027b4d tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.159s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:11:16 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-9c957d16-08fe-49f1-b53c-f024e0027b4d tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Deleted allocations for instance 95a84d3c-7aa2-4294-a419-995926a2782f
Jul 31 10:11:16 user nova-compute[71113]: DEBUG nova.compute.manager [req-9206d392-9a73-4a92-9f6f-c87254d30444 req-fda13558-1f8c-46b4-95e3-effaae1cb47d service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Received event network-vif-plugged-a856eb89-910c-456e-bc0e-a9f92ce20248 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:11:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9206d392-9a73-4a92-9f6f-c87254d30444 req-fda13558-1f8c-46b4-95e3-effaae1cb47d service nova] Acquiring lock "95a84d3c-7aa2-4294-a419-995926a2782f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:11:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9206d392-9a73-4a92-9f6f-c87254d30444 req-fda13558-1f8c-46b4-95e3-effaae1cb47d service nova] Lock "95a84d3c-7aa2-4294-a419-995926a2782f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:11:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9206d392-9a73-4a92-9f6f-c87254d30444 req-fda13558-1f8c-46b4-95e3-effaae1cb47d service nova] Lock "95a84d3c-7aa2-4294-a419-995926a2782f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:11:16 user nova-compute[71113]: DEBUG nova.compute.manager [req-9206d392-9a73-4a92-9f6f-c87254d30444 req-fda13558-1f8c-46b4-95e3-effaae1cb47d service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] No waiting events found dispatching network-vif-plugged-a856eb89-910c-456e-bc0e-a9f92ce20248 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:11:16 user nova-compute[71113]: WARNING nova.compute.manager [req-9206d392-9a73-4a92-9f6f-c87254d30444 req-fda13558-1f8c-46b4-95e3-effaae1cb47d service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Received unexpected event network-vif-plugged-a856eb89-910c-456e-bc0e-a9f92ce20248 for instance with vm_state deleted and task_state None.
Jul 31 10:11:16 user nova-compute[71113]: DEBUG nova.compute.manager [req-9206d392-9a73-4a92-9f6f-c87254d30444 req-fda13558-1f8c-46b4-95e3-effaae1cb47d service nova] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Received event network-vif-deleted-a856eb89-910c-456e-bc0e-a9f92ce20248 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:11:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9c957d16-08fe-49f1-b53c-f024e0027b4d tempest-ServerStableDeviceRescueTest-1277436113 tempest-ServerStableDeviceRescueTest-1277436113-project-member] Lock "95a84d3c-7aa2-4294-a419-995926a2782f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.438s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:11:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:11:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:11:21 user nova-compute[71113]: DEBUG nova.compute.manager [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Starting instance... {{(pid=71113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 10:11:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:11:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:11:21 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 10:11:21 user nova-compute[71113]: INFO nova.compute.claims [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Claim successful on node user
Jul 31 10:11:21 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:11:21 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:11:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.216s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:11:21 user nova-compute[71113]: DEBUG nova.compute.manager [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Start building networks asynchronously for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 10:11:21 user nova-compute[71113]: DEBUG nova.compute.manager [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Allocating IP information in the background. {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 10:11:21 user nova-compute[71113]: DEBUG nova.network.neutron [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] allocate_for_instance() {{(pid=71113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 10:11:21 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 10:11:21 user nova-compute[71113]: DEBUG nova.compute.manager [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Start building block device mappings for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 10:11:21 user nova-compute[71113]: INFO nova.virt.block_device [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Booting with volume 6f4aab43-8b49-4c2a-b588-c9d5ba6d038d at /dev/vda
Jul 31 10:11:21 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:11:21 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:11:21 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Didn't find any instances for network info cache update. {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 10:11:21 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:11:21 user nova-compute[71113]: DEBUG os_brick.utils [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:11:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:11:21 user nova-compute[71113]: DEBUG nova.policy [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a58fe92488ed47b696fc5d6d990b1acd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa2add2e2a24b9cb8e48042b06931d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71113) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 10:11:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:11:21 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0b2fa9-19fc-469c-ba6a-be14e1dd46d0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:11:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:11:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:11:21 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[430396fa-ff71-4ecd-bc92-9cac73e7cbb5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:11:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:11:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:11:21 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75243ee-1151-43e7-a5bd-a90dbdcfb843]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:11:21 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8645e8fe-1694-4992-93fe-37e5287e9fb7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:11:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:11:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 10:11:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 10:11:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:11:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 10:11:21 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 10:11:21 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe46147-772c-4ca8-8dd4-3ed0b9295407]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:11:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 10:11:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 10:11:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 10:11:21 user nova-compute[71113]: DEBUG os_brick.utils [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:11:21 user nova-compute[71113]: DEBUG nova.virt.block_device [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Updating existing volume attachment record: 6427be46-a129-4e0d-9f1f-dff2c93838d0 {{(pid=71113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 10:11:22 user nova-compute[71113]: DEBUG nova.network.neutron [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Successfully created port: c062800c-3049-4e28-a410-673e4be25d41 {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 10:11:22 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:11:22 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:11:22 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:11:22 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:11:22 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:11:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 10:11:23 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:11:23 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:11:23 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=8705MB free_disk=25.365581512451172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:11:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:11:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:11:23 user nova-compute[71113]: DEBUG nova.network.neutron [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Successfully updated port: c062800c-3049-4e28-a410-673e4be25d41 {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 10:11:23 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance be9f0ded-8064-4675-99f7-8620f0fe3dda actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:11:23 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:11:23 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:11:23 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:11:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "refresh_cache-ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:11:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquired lock "refresh_cache-ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:11:23 user nova-compute[71113]: DEBUG nova.network.neutron [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 10:11:23 user nova-compute[71113]: DEBUG nova.compute.manager [req-8eb3fcaf-6a9c-4844-a1c5-103b5fdc2bc6 req-2d3160db-adfd-4e6a-9f6e-2beae81eed6c service nova] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Received event network-changed-c062800c-3049-4e28-a410-673e4be25d41 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:11:23 user nova-compute[71113]: DEBUG nova.compute.manager [req-8eb3fcaf-6a9c-4844-a1c5-103b5fdc2bc6 req-2d3160db-adfd-4e6a-9f6e-2beae81eed6c service nova] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Refreshing instance network info cache due to event network-changed-c062800c-3049-4e28-a410-673e4be25d41. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 10:11:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8eb3fcaf-6a9c-4844-a1c5-103b5fdc2bc6 req-2d3160db-adfd-4e6a-9f6e-2beae81eed6c service nova] Acquiring lock "refresh_cache-ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:11:23 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:11:23 user nova-compute[71113]: DEBUG nova.network.neutron [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 10:11:23 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:11:23 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:11:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.220s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:11:23 user nova-compute[71113]: DEBUG nova.network.neutron [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Updating instance_info_cache with network_info: [{"id": "c062800c-3049-4e28-a410-673e4be25d41", "address": "fa:16:3e:ed:94:5f", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc062800c-30", "ovs_interfaceid": "c062800c-3049-4e28-a410-673e4be25d41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:11:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Releasing lock "refresh_cache-ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:11:23 user nova-compute[71113]: DEBUG nova.compute.manager [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Instance network_info: |[{"id": "c062800c-3049-4e28-a410-673e4be25d41", "address": "fa:16:3e:ed:94:5f", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc062800c-30", "ovs_interfaceid": "c062800c-3049-4e28-a410-673e4be25d41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 10:11:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8eb3fcaf-6a9c-4844-a1c5-103b5fdc2bc6 req-2d3160db-adfd-4e6a-9f6e-2beae81eed6c service nova] Acquired lock "refresh_cache-ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:11:23 user nova-compute[71113]: DEBUG nova.network.neutron [req-8eb3fcaf-6a9c-4844-a1c5-103b5fdc2bc6 req-2d3160db-adfd-4e6a-9f6e-2beae81eed6c service nova] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Refreshing network info cache for port c062800c-3049-4e28-a410-673e4be25d41 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 10:11:24 user nova-compute[71113]: DEBUG nova.network.neutron [req-8eb3fcaf-6a9c-4844-a1c5-103b5fdc2bc6 req-2d3160db-adfd-4e6a-9f6e-2beae81eed6c service nova] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Updated VIF entry in instance network info cache for port c062800c-3049-4e28-a410-673e4be25d41. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 10:11:24 user nova-compute[71113]: DEBUG nova.network.neutron [req-8eb3fcaf-6a9c-4844-a1c5-103b5fdc2bc6 req-2d3160db-adfd-4e6a-9f6e-2beae81eed6c service nova] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Updating instance_info_cache with network_info: [{"id": "c062800c-3049-4e28-a410-673e4be25d41", "address": "fa:16:3e:ed:94:5f", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc062800c-30", "ovs_interfaceid": "c062800c-3049-4e28-a410-673e4be25d41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:11:24 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8eb3fcaf-6a9c-4844-a1c5-103b5fdc2bc6 req-2d3160db-adfd-4e6a-9f6e-2beae81eed6c service nova] Releasing lock "refresh_cache-ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:11:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:25 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:11:25 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:11:25 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:11:27 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:11:28 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:28 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:11:28 user nova-compute[71113]: DEBUG nova.compute.manager [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Start spawning the instance on the hypervisor. {{(pid=71113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 10:11:28 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 10:11:28 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Creating image(s)
Jul 31 10:11:28 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Did not create local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 10:11:28 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Ensure instance console log exists: /opt/stack/data/nova/instances/ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 10:11:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:11:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:11:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:11:28 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Start _get_guest_xml network_info=[{"id": "c062800c-3049-4e28-a410-673e4be25d41", "address": "fa:16:3e:ed:94:5f", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc062800c-30", "ovs_interfaceid": "c062800c-3049-4e28-a410-673e4be25d41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '6427be46-a129-4e0d-9f1f-dff2c93838d0', 'mount_device': '/dev/vda', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6f4aab43-8b49-4c2a-b588-c9d5ba6d038d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eBqVFOWk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0', 'attached_at': '', 'detached_at': '', 'volume_id': '6f4aab43-8b49-4c2a-b588-c9d5ba6d038d', 'serial': '6f4aab43-8b49-4c2a-b588-c9d5ba6d038d'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 10:11:28 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:11:28 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:11:28 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 10:11:28 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 10:11:28 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 10:11:28 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 10:11:28 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 10:11:28 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 10:11:28 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 10:11:28 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 10:11:28 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 10:11:28 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 10:11:28 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 10:11:28 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 10:11:28 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 10:11:28 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 10:11:28 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 10:11:28 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 10:11:28 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 10:11:28 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6f4aab43-8b49-4c2a-b588-c9d5ba6d038d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eBqVFOWk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:11:28 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:11:28 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:11:28 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:11:28 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:11:28 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f4aab43-8b49-4c2a-b588-c9d5ba6d038d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:11:28 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f4aab43-8b49-4c2a-b588-c9d5ba6d038d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:11:28 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 10:11:28 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f4aab43-8b49-4c2a-b588-c9d5ba6d038d -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:11:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f4aab43-8b49-4c2a-b588-c9d5ba6d038d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:11:29 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9d55b0-7e79-4647-96ee-f33a9eabe940]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:11:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 10:11:29 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:11:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f4aab43-8b49-4c2a-b588-c9d5ba6d038d -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:11:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f4aab43-8b49-4c2a-b588-c9d5ba6d038d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:11:29 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b5304e-140a-4db7-a65d-e87d2473f5fd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f4aab43-8b49-4c2a-b588-c9d5ba6d038d] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:11:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f4aab43-8b49-4c2a-b588-c9d5ba6d038d] added
Jul 31 10:11:29 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:11:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f4aab43-8b49-4c2a-b588-c9d5ba6d038d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:11:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f4aab43-8b49-4c2a-b588-c9d5ba6d038d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:11:29 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbffe721-89ee-4b85-9148-1ba0754c4357]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:11:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:11:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f4aab43-8b49-4c2a-b588-c9d5ba6d038d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:11:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f4aab43-8b49-4c2a-b588-c9d5ba6d038d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:11:29 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb2f5f7-daca-4546-921d-a1278d59ea23]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:11:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:11:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f4aab43-8b49-4c2a-b588-c9d5ba6d038d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eBqVFOWk {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:11:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f4aab43-8b49-4c2a-b588-c9d5ba6d038d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eBqVFOWk" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:11:29 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2093fb8-bd89-45b4-a764-a21414495635]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:11:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eBqVFOWk'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:11:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f4aab43-8b49-4c2a-b588-c9d5ba6d038d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:11:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f4aab43-8b49-4c2a-b588-c9d5ba6d038d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:11:29 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9ee852-7f15-4195-aa80-6d21bb7b08ab]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:11:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:11:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:11:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:11:29 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68282a8-596e-409f-b1e6-04cb4eb8ca0a]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:11:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)
Jul 31 10:11:29 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:11:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)
Jul 31 10:11:29 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:11:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f4aab43-8b49-4c2a-b588-c9d5ba6d038d -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:11:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f4aab43-8b49-4c2a-b588-c9d5ba6d038d -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:11:29 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6664f3d-b2cf-43e1-9572-6f4247b5b5db]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f4aab43-8b49-4c2a-b588-c9d5ba6d038d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6f4aab43-8b49-4c2a-b588-c9d5ba6d038d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:11:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f4aab43-8b49-4c2a-b588-c9d5ba6d038d, portal: 172.16.0.220,3260]
Jul 31 10:11:29 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:6f4aab43-8b49-4c2a-b588-c9d5ba6d038d, portal: 172.16.0.220,3260] successful.
Jul 31 10:11:29 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:11:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f4aab43-8b49-4c2a-b588-c9d5ba6d038d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:11:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f4aab43-8b49-4c2a-b588-c9d5ba6d038d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:11:29 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[957fd7b1-e490-4815-8214-e5c0e8595911]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:11:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:11:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:11:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:11:29 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c29b4b5-7d4a-4767-95c6-e490dafee0f4]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f4aab43-8b49-4c2a-b588-c9d5ba6d038d (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:11:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)
Jul 31 10:11:29 user nova-compute[71113]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f4aab43-8b49-4c2a-b588-c9d5ba6d038d (non-flash)
Jul 31 10:11:29 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:11:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)
Jul 31 10:11:29 user nova-compute[71113]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f4aab43-8b49-4c2a-b588-c9d5ba6d038d (non-flash)
Jul 31 10:11:29 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:11:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f4aab43-8b49-4c2a-b588-c9d5ba6d038d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:11:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 10:11:29 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 10:11:29 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 10:11:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:11:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:11:29 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2300a051-b624-448c-b499-f6a86d435659]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:11:29 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 10:11:29 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eBqVFOWk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 10:11:29 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690798274.736191, 95a84d3c-7aa2-4294-a419-995926a2782f => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:11:29 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] VM Stopped (Lifecycle Event)
Jul 31 10:11:29 user nova-compute[71113]: DEBUG nova.compute.manager [None req-babec966-2eb6-4cd1-953e-3d949895eb9f None None] [instance: 95a84d3c-7aa2-4294-a419-995926a2782f] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:11:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:30 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:11:30 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '23366376264363337', 'path': '/dev/sdb'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:11:30 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366376264363337', 'path': '/dev/sdb'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 10:11:30 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:11:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1715148138',display_name='tempest-TestVolumeBootPattern-server-1715148138',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1715148138',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHyhNSNVW4Lo+ZOw5JhvHTNH16DxMgCVmk57hIQmCoVWxH+PN+/8jM3YwsIxSsGBxRIiU3keHG6Pnt6GG0CTGlGIZ1kKVEix0HYiRgqMpyBqoT4aBeWmvyv0uyNPZ+vFFg==',key_name='tempest-TestVolumeBootPattern-165282511',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3aa2add2e2a24b9cb8e48042b06931d3',ramdisk_id='',reservation_id='r-y365ikui',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1754399827',owner_user_name='tempest-TestVolumeBootPattern-1754399827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T10:11:22Z,user_data=None,user_id='a58fe92488ed47b696fc5d6d990b1acd',uuid=ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c062800c-3049-4e28-a410-673e4be25d41", "address": "fa:16:3e:ed:94:5f", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc062800c-30", "ovs_interfaceid": "c062800c-3049-4e28-a410-673e4be25d41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 10:11:30 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Converting VIF {"id": "c062800c-3049-4e28-a410-673e4be25d41", "address": "fa:16:3e:ed:94:5f", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc062800c-30", "ovs_interfaceid": "c062800c-3049-4e28-a410-673e4be25d41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:11:30 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:94:5f,bridge_name='br-int',has_traffic_filtering=True,id=c062800c-3049-4e28-a410-673e4be25d41,network=Network(fa792d7a-ddf6-4a2d-acb9-802f8daf87ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc062800c-30') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:11:30 user nova-compute[71113]: DEBUG nova.objects.instance [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lazy-loading 'pci_devices' on Instance uuid ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:11:30 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] End _get_guest_xml xml=<domain type="kvm">
Jul 31 10:11:30 user nova-compute[71113]:   <uuid>ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0</uuid>
Jul 31 10:11:30 user nova-compute[71113]:   <name>instance-00000029</name>
Jul 31 10:11:30 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 10:11:30 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 10:11:30 user nova-compute[71113]:   <metadata>
Jul 31 10:11:30 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 10:11:30 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 10:11:30 user nova-compute[71113]:       <nova:name>tempest-TestVolumeBootPattern-server-1715148138</nova:name>
Jul 31 10:11:30 user nova-compute[71113]:       <nova:creationTime>2023-07-31 10:11:28</nova:creationTime>
Jul 31 10:11:30 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 10:11:30 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 10:11:30 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 10:11:30 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 10:11:30 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 10:11:30 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 10:11:30 user nova-compute[71113]:       </nova:flavor>
Jul 31 10:11:30 user nova-compute[71113]:       <nova:owner>
Jul 31 10:11:30 user nova-compute[71113]:         <nova:user uuid="a58fe92488ed47b696fc5d6d990b1acd">tempest-TestVolumeBootPattern-1754399827-project-member</nova:user>
Jul 31 10:11:30 user nova-compute[71113]:         <nova:project uuid="3aa2add2e2a24b9cb8e48042b06931d3">tempest-TestVolumeBootPattern-1754399827</nova:project>
Jul 31 10:11:30 user nova-compute[71113]:       </nova:owner>
Jul 31 10:11:30 user nova-compute[71113]:       <nova:ports>
Jul 31 10:11:30 user nova-compute[71113]:         <nova:port uuid="c062800c-3049-4e28-a410-673e4be25d41">
Jul 31 10:11:30 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 31 10:11:30 user nova-compute[71113]:         </nova:port>
Jul 31 10:11:30 user nova-compute[71113]:       </nova:ports>
Jul 31 10:11:30 user nova-compute[71113]:     </nova:instance>
Jul 31 10:11:30 user nova-compute[71113]:   </metadata>
Jul 31 10:11:30 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 10:11:30 user nova-compute[71113]:     <system>
Jul 31 10:11:30 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 10:11:30 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 10:11:30 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 10:11:30 user nova-compute[71113]:       <entry name="serial">ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0</entry>
Jul 31 10:11:30 user nova-compute[71113]:       <entry name="uuid">ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0</entry>
Jul 31 10:11:30 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 10:11:30 user nova-compute[71113]:     </system>
Jul 31 10:11:30 user nova-compute[71113]:   </sysinfo>
Jul 31 10:11:30 user nova-compute[71113]:   <os>
Jul 31 10:11:30 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 10:11:30 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 10:11:30 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 10:11:30 user nova-compute[71113]:   </os>
Jul 31 10:11:30 user nova-compute[71113]:   <features>
Jul 31 10:11:30 user nova-compute[71113]:     <acpi/>
Jul 31 10:11:30 user nova-compute[71113]:     <apic/>
Jul 31 10:11:30 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 10:11:30 user nova-compute[71113]:   </features>
Jul 31 10:11:30 user nova-compute[71113]:   <clock offset="utc">
Jul 31 10:11:30 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 10:11:30 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 10:11:30 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 10:11:30 user nova-compute[71113]:   </clock>
Jul 31 10:11:30 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 10:11:30 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 10:11:30 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 10:11:30 user nova-compute[71113]:   </cpu>
Jul 31 10:11:30 user nova-compute[71113]:   <devices>
Jul 31 10:11:30 user nova-compute[71113]:     <disk type="block" device="disk">
Jul 31 10:11:30 user nova-compute[71113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:11:30 user nova-compute[71113]:       <source dev="/dev/sdb"/>
Jul 31 10:11:30 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 10:11:30 user nova-compute[71113]:       <serial>6f4aab43-8b49-4c2a-b588-c9d5ba6d038d</serial>
Jul 31 10:11:30 user nova-compute[71113]:     </disk>
Jul 31 10:11:30 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 10:11:30 user nova-compute[71113]:       <mac address="fa:16:3e:ed:94:5f"/>
Jul 31 10:11:30 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:11:30 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 10:11:30 user nova-compute[71113]:       <target dev="tapc062800c-30"/>
Jul 31 10:11:30 user nova-compute[71113]:     </interface>
Jul 31 10:11:30 user nova-compute[71113]:     <serial type="pty">
Jul 31 10:11:30 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0/console.log" append="off"/>
Jul 31 10:11:30 user nova-compute[71113]:     </serial>
Jul 31 10:11:30 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 10:11:30 user nova-compute[71113]:     <video>
Jul 31 10:11:30 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:11:30 user nova-compute[71113]:     </video>
Jul 31 10:11:30 user nova-compute[71113]:     <rng model="virtio">
Jul 31 10:11:30 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 10:11:30 user nova-compute[71113]:     </rng>
Jul 31 10:11:30 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 10:11:30 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 10:11:30 user nova-compute[71113]:       <stats period="10"/>
Jul 31 10:11:30 user nova-compute[71113]:     </memballoon>
Jul 31 10:11:30 user nova-compute[71113]:   </devices>
Jul 31 10:11:30 user nova-compute[71113]: </domain>
Jul 31 10:11:30 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 10:11:30 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:11:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1715148138',display_name='tempest-TestVolumeBootPattern-server-1715148138',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1715148138',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHyhNSNVW4Lo+ZOw5JhvHTNH16DxMgCVmk57hIQmCoVWxH+PN+/8jM3YwsIxSsGBxRIiU3keHG6Pnt6GG0CTGlGIZ1kKVEix0HYiRgqMpyBqoT4aBeWmvyv0uyNPZ+vFFg==',key_name='tempest-TestVolumeBootPattern-165282511',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3aa2add2e2a24b9cb8e48042b06931d3',ramdisk_id='',reservation_id='r-y365ikui',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1754399827',owner_user_name='tempest-TestVolumeBootPattern-1754399827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T10:11:22Z,user_data=None,user_id='a58fe92488ed47b696fc5d6d990b1acd',uuid=ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c062800c-3049-4e28-a410-673e4be25d41", "address": "fa:16:3e:ed:94:5f", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc062800c-30", "ovs_interfaceid": "c062800c-3049-4e28-a410-673e4be25d41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 10:11:30 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Converting VIF {"id": "c062800c-3049-4e28-a410-673e4be25d41", "address": "fa:16:3e:ed:94:5f", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc062800c-30", "ovs_interfaceid": "c062800c-3049-4e28-a410-673e4be25d41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:11:30 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:94:5f,bridge_name='br-int',has_traffic_filtering=True,id=c062800c-3049-4e28-a410-673e4be25d41,network=Network(fa792d7a-ddf6-4a2d-acb9-802f8daf87ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc062800c-30') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:11:30 user nova-compute[71113]: DEBUG os_vif [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:94:5f,bridge_name='br-int',has_traffic_filtering=True,id=c062800c-3049-4e28-a410-673e4be25d41,network=Network(fa792d7a-ddf6-4a2d-acb9-802f8daf87ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc062800c-30') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 10:11:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:11:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 10:11:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc062800c-30, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:11:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc062800c-30, col_values=(('external_ids', {'iface-id': 'c062800c-3049-4e28-a410-673e4be25d41', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:94:5f', 'vm-uuid': 'ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:11:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:11:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:30 user nova-compute[71113]: INFO os_vif [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:94:5f,bridge_name='br-int',has_traffic_filtering=True,id=c062800c-3049-4e28-a410-673e4be25d41,network=Network(fa792d7a-ddf6-4a2d-acb9-802f8daf87ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc062800c-30')
Jul 31 10:11:30 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:11:30 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] No VIF found with MAC fa:16:3e:ed:94:5f, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 10:11:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:31 user nova-compute[71113]: DEBUG nova.compute.manager [req-f3a6263a-97c5-4845-bce8-7344c965c14b req-0e69d5a7-cafd-4231-8f93-29ea5038bca1 service nova] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Received event network-vif-plugged-c062800c-3049-4e28-a410-673e4be25d41 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:11:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f3a6263a-97c5-4845-bce8-7344c965c14b req-0e69d5a7-cafd-4231-8f93-29ea5038bca1 service nova] Acquiring lock "ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:11:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f3a6263a-97c5-4845-bce8-7344c965c14b req-0e69d5a7-cafd-4231-8f93-29ea5038bca1 service nova] Lock "ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:11:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f3a6263a-97c5-4845-bce8-7344c965c14b req-0e69d5a7-cafd-4231-8f93-29ea5038bca1 service nova] Lock "ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:11:31 user nova-compute[71113]: DEBUG nova.compute.manager [req-f3a6263a-97c5-4845-bce8-7344c965c14b req-0e69d5a7-cafd-4231-8f93-29ea5038bca1 service nova] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] No waiting events found dispatching network-vif-plugged-c062800c-3049-4e28-a410-673e4be25d41 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:11:31 user nova-compute[71113]: WARNING nova.compute.manager [req-f3a6263a-97c5-4845-bce8-7344c965c14b req-0e69d5a7-cafd-4231-8f93-29ea5038bca1 service nova] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Received unexpected event network-vif-plugged-c062800c-3049-4e28-a410-673e4be25d41 for instance with vm_state building and task_state spawning.
Jul 31 10:11:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:33 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690798293.742261, ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0 => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:11:33 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] VM Resumed (Lifecycle Event)
Jul 31 10:11:33 user nova-compute[71113]: DEBUG nova.compute.manager [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 10:11:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 10:11:33 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Instance spawned successfully.
Jul 31 10:11:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 10:11:33 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:11:33 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:11:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Found default for hw_cdrom_bus of ide {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:11:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Found default for hw_disk_bus of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:11:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Found default for hw_input_bus of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:11:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Found default for hw_pointer_model of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:11:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Found default for hw_video_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:11:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Found default for hw_vif_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:11:33 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 10:11:33 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690798293.7438347, ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0 => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:11:33 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] VM Started (Lifecycle Event)
Jul 31 10:11:33 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:11:33 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:11:33 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 10:11:33 user nova-compute[71113]: INFO nova.compute.manager [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Took 4.95 seconds to spawn the instance on the hypervisor.
Jul 31 10:11:33 user nova-compute[71113]: DEBUG nova.compute.manager [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:11:33 user nova-compute[71113]: DEBUG nova.compute.manager [req-f95322e8-8e39-46df-8516-1b4b985aa5df req-958c96fb-e117-4e3d-bc88-1dc7ab19da1c service nova] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Received event network-vif-plugged-c062800c-3049-4e28-a410-673e4be25d41 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:11:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f95322e8-8e39-46df-8516-1b4b985aa5df req-958c96fb-e117-4e3d-bc88-1dc7ab19da1c service nova] Acquiring lock "ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:11:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f95322e8-8e39-46df-8516-1b4b985aa5df req-958c96fb-e117-4e3d-bc88-1dc7ab19da1c service nova] Lock "ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:11:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f95322e8-8e39-46df-8516-1b4b985aa5df req-958c96fb-e117-4e3d-bc88-1dc7ab19da1c service nova] Lock "ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:11:33 user nova-compute[71113]: DEBUG nova.compute.manager [req-f95322e8-8e39-46df-8516-1b4b985aa5df req-958c96fb-e117-4e3d-bc88-1dc7ab19da1c service nova] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] No waiting events found dispatching network-vif-plugged-c062800c-3049-4e28-a410-673e4be25d41 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:11:33 user nova-compute[71113]: WARNING nova.compute.manager [req-f95322e8-8e39-46df-8516-1b4b985aa5df req-958c96fb-e117-4e3d-bc88-1dc7ab19da1c service nova] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Received unexpected event network-vif-plugged-c062800c-3049-4e28-a410-673e4be25d41 for instance with vm_state building and task_state spawning.
Jul 31 10:11:33 user nova-compute[71113]: INFO nova.compute.manager [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Took 12.61 seconds to build instance.
Jul 31 10:11:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-bb2f0cd7-5d8a-40ad-a143-33a9bd093f05 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.739s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:11:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:40 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:40 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Acquiring lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:11:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:11:40 user nova-compute[71113]: DEBUG nova.compute.manager [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Starting instance... {{(pid=71113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 10:11:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:11:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:11:40 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 10:11:40 user nova-compute[71113]: INFO nova.compute.claims [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Claim successful on node user
Jul 31 10:11:40 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:11:40 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:11:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.302s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:11:41 user nova-compute[71113]: DEBUG nova.compute.manager [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Start building networks asynchronously for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 10:11:41 user nova-compute[71113]: DEBUG nova.compute.manager [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Allocating IP information in the background. {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 10:11:41 user nova-compute[71113]: DEBUG nova.network.neutron [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] allocate_for_instance() {{(pid=71113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 10:11:41 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 10:11:41 user nova-compute[71113]: DEBUG nova.compute.manager [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Start building block device mappings for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 10:11:41 user nova-compute[71113]: DEBUG nova.policy [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6023b7c67c0941d3975fa9c25140684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938c4f5af8a347cf9d700c8cdb5df356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71113) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 10:11:41 user nova-compute[71113]: DEBUG nova.compute.manager [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Start spawning the instance on the hypervisor. {{(pid=71113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 10:11:41 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 10:11:41 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Creating image(s)
Jul 31 10:11:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Acquiring lock "/opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:11:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "/opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:11:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "/opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:11:41 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:11:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Acquiring lock "8129456b-a22c-46e3-b5db-89fdcec87dec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:11:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "8129456b-a22c-46e3-b5db-89fdcec87dec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:11:41 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.150s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:11:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Acquiring lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:11:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:11:41 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:11:41 user nova-compute[71113]: DEBUG nova.compute.manager [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Starting instance... {{(pid=71113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 10:11:41 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.151s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:11:41 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk 1073741824 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:11:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:11:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:11:41 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk 1073741824" returned: 0 in 0.060s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:11:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:11:41 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:11:41 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 10:11:41 user nova-compute[71113]: INFO nova.compute.claims [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Claim successful on node user
Jul 31 10:11:41 user nova-compute[71113]: DEBUG nova.network.neutron [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Successfully created port: 85692854-658a-459b-9ab0-f448a6bf83f2 {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 10:11:41 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.156s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:11:41 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk. size=1073741824 {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 10:11:41 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:11:42 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:11:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:11:42 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Cannot resize image /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk to a smaller size. {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 10:11:42 user nova-compute[71113]: DEBUG nova.objects.instance [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lazy-loading 'migration_context' on Instance uuid c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:11:42 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:11:42 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Created local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 10:11:42 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Ensure instance console log exists: /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 10:11:42 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:11:42 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:11:42 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:11:42 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.373s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:11:42 user nova-compute[71113]: DEBUG nova.compute.manager [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Start building networks asynchronously for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 10:11:42 user nova-compute[71113]: DEBUG nova.compute.manager [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Allocating IP information in the background. {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 10:11:42 user nova-compute[71113]: DEBUG nova.network.neutron [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] allocate_for_instance() {{(pid=71113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 10:11:42 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 10:11:42 user nova-compute[71113]: DEBUG nova.compute.manager [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Start building block device mappings for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 10:11:42 user nova-compute[71113]: DEBUG nova.policy [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6023b7c67c0941d3975fa9c25140684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938c4f5af8a347cf9d700c8cdb5df356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71113) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 10:11:42 user nova-compute[71113]: DEBUG nova.compute.manager [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Start spawning the instance on the hypervisor. {{(pid=71113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 10:11:42 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 10:11:42 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Creating image(s)
Jul 31 10:11:42 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Acquiring lock "/opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:11:42 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "/opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:11:42 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "/opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:11:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:11:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.155s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:11:42 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Acquiring lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:11:42 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:11:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:11:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.137s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:11:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk 1073741824 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:11:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk 1073741824" returned: 0 in 0.058s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:11:42 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:11:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:11:42 user nova-compute[71113]: DEBUG nova.network.neutron [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Successfully created port: 1a2da0f9-2fb6-4880-96b5-be8dd9d12574 {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 10:11:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.163s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:11:42 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk. size=1073741824 {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 10:11:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG nova.network.neutron [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Successfully updated port: 85692854-658a-459b-9ab0-f448a6bf83f2 {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Acquiring lock "refresh_cache-c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Acquired lock "refresh_cache-c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG nova.network.neutron [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG nova.compute.manager [req-b1f62bb8-420b-4823-9d77-f095f79c6215 req-996dc5db-93b6-4911-b724-cffa459715f7 service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Received event network-changed-85692854-658a-459b-9ab0-f448a6bf83f2 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG nova.compute.manager [req-b1f62bb8-420b-4823-9d77-f095f79c6215 req-996dc5db-93b6-4911-b724-cffa459715f7 service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Refreshing instance network info cache due to event network-changed-85692854-658a-459b-9ab0-f448a6bf83f2. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-b1f62bb8-420b-4823-9d77-f095f79c6215 req-996dc5db-93b6-4911-b724-cffa459715f7 service nova] Acquiring lock "refresh_cache-c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Cannot resize image /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk to a smaller size. {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG nova.objects.instance [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lazy-loading 'migration_context' on Instance uuid 8129456b-a22c-46e3-b5db-89fdcec87dec {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Created local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Ensure instance console log exists: /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG nova.network.neutron [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG nova.network.neutron [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Updating instance_info_cache with network_info: [{"id": "85692854-658a-459b-9ab0-f448a6bf83f2", "address": "fa:16:3e:2b:2c:47", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85692854-65", "ovs_interfaceid": "85692854-658a-459b-9ab0-f448a6bf83f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Releasing lock "refresh_cache-c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG nova.compute.manager [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Instance network_info: |[{"id": "85692854-658a-459b-9ab0-f448a6bf83f2", "address": "fa:16:3e:2b:2c:47", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85692854-65", "ovs_interfaceid": "85692854-658a-459b-9ab0-f448a6bf83f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-b1f62bb8-420b-4823-9d77-f095f79c6215 req-996dc5db-93b6-4911-b724-cffa459715f7 service nova] Acquired lock "refresh_cache-c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG nova.network.neutron [req-b1f62bb8-420b-4823-9d77-f095f79c6215 req-996dc5db-93b6-4911-b724-cffa459715f7 service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Refreshing network info cache for port 85692854-658a-459b-9ab0-f448a6bf83f2 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Start _get_guest_xml network_info=[{"id": "85692854-658a-459b-9ab0-f448a6bf83f2", "address": "fa:16:3e:2b:2c:47", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85692854-65", "ovs_interfaceid": "85692854-658a-459b-9ab0-f448a6bf83f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'image_id': '078646fe-b504-41ed-a147-61072e903e51'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 10:11:43 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:11:43 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:11:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:11:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-206616969',display_name='tempest-ServerRescueNegativeTestJSON-server-206616969',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-206616969',id=42,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='938c4f5af8a347cf9d700c8cdb5df356',ramdisk_id='',reservation_id='r-80w6skid',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-549904406',owner_user_name='tempest-ServerRescueNegativeTestJSON-549904406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T10:11:41Z,user_data=None,user_id='6023b7c67c0941d3975fa9c25140684f',uuid=c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85692854-658a-459b-9ab0-f448a6bf83f2", "address": "fa:16:3e:2b:2c:47", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85692854-65", "ovs_interfaceid": "85692854-658a-459b-9ab0-f448a6bf83f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Converting VIF {"id": "85692854-658a-459b-9ab0-f448a6bf83f2", "address": "fa:16:3e:2b:2c:47", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85692854-65", "ovs_interfaceid": "85692854-658a-459b-9ab0-f448a6bf83f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:2c:47,bridge_name='br-int',has_traffic_filtering=True,id=85692854-658a-459b-9ab0-f448a6bf83f2,network=Network(328e0f8b-5788-457c-afc6-7fe314ca8b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85692854-65') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG nova.objects.instance [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lazy-loading 'pci_devices' on Instance uuid c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] End _get_guest_xml xml=<domain type="kvm">
Jul 31 10:11:43 user nova-compute[71113]:   <uuid>c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5</uuid>
Jul 31 10:11:43 user nova-compute[71113]:   <name>instance-0000002a</name>
Jul 31 10:11:43 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 10:11:43 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 10:11:43 user nova-compute[71113]:   <metadata>
Jul 31 10:11:43 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 10:11:43 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 10:11:43 user nova-compute[71113]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-206616969</nova:name>
Jul 31 10:11:43 user nova-compute[71113]:       <nova:creationTime>2023-07-31 10:11:43</nova:creationTime>
Jul 31 10:11:43 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 10:11:43 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 10:11:43 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 10:11:43 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 10:11:43 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 10:11:43 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 10:11:43 user nova-compute[71113]:       </nova:flavor>
Jul 31 10:11:43 user nova-compute[71113]:       <nova:owner>
Jul 31 10:11:43 user nova-compute[71113]:         <nova:user uuid="6023b7c67c0941d3975fa9c25140684f">tempest-ServerRescueNegativeTestJSON-549904406-project-member</nova:user>
Jul 31 10:11:43 user nova-compute[71113]:         <nova:project uuid="938c4f5af8a347cf9d700c8cdb5df356">tempest-ServerRescueNegativeTestJSON-549904406</nova:project>
Jul 31 10:11:43 user nova-compute[71113]:       </nova:owner>
Jul 31 10:11:43 user nova-compute[71113]:       <nova:root type="image" uuid="078646fe-b504-41ed-a147-61072e903e51"/>
Jul 31 10:11:43 user nova-compute[71113]:       <nova:ports>
Jul 31 10:11:43 user nova-compute[71113]:         <nova:port uuid="85692854-658a-459b-9ab0-f448a6bf83f2">
Jul 31 10:11:43 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 31 10:11:43 user nova-compute[71113]:         </nova:port>
Jul 31 10:11:43 user nova-compute[71113]:       </nova:ports>
Jul 31 10:11:43 user nova-compute[71113]:     </nova:instance>
Jul 31 10:11:43 user nova-compute[71113]:   </metadata>
Jul 31 10:11:43 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 10:11:43 user nova-compute[71113]:     <system>
Jul 31 10:11:43 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 10:11:43 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 10:11:43 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 10:11:43 user nova-compute[71113]:       <entry name="serial">c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5</entry>
Jul 31 10:11:43 user nova-compute[71113]:       <entry name="uuid">c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5</entry>
Jul 31 10:11:43 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 10:11:43 user nova-compute[71113]:     </system>
Jul 31 10:11:43 user nova-compute[71113]:   </sysinfo>
Jul 31 10:11:43 user nova-compute[71113]:   <os>
Jul 31 10:11:43 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 10:11:43 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 10:11:43 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 10:11:43 user nova-compute[71113]:   </os>
Jul 31 10:11:43 user nova-compute[71113]:   <features>
Jul 31 10:11:43 user nova-compute[71113]:     <acpi/>
Jul 31 10:11:43 user nova-compute[71113]:     <apic/>
Jul 31 10:11:43 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 10:11:43 user nova-compute[71113]:   </features>
Jul 31 10:11:43 user nova-compute[71113]:   <clock offset="utc">
Jul 31 10:11:43 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 10:11:43 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 10:11:43 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 10:11:43 user nova-compute[71113]:   </clock>
Jul 31 10:11:43 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 10:11:43 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 10:11:43 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 10:11:43 user nova-compute[71113]:   </cpu>
Jul 31 10:11:43 user nova-compute[71113]:   <devices>
Jul 31 10:11:43 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 10:11:43 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 10:11:43 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk"/>
Jul 31 10:11:43 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 10:11:43 user nova-compute[71113]:     </disk>
Jul 31 10:11:43 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 10:11:43 user nova-compute[71113]:       <mac address="fa:16:3e:2b:2c:47"/>
Jul 31 10:11:43 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:11:43 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 10:11:43 user nova-compute[71113]:       <target dev="tap85692854-65"/>
Jul 31 10:11:43 user nova-compute[71113]:     </interface>
Jul 31 10:11:43 user nova-compute[71113]:     <serial type="pty">
Jul 31 10:11:43 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/console.log" append="off"/>
Jul 31 10:11:43 user nova-compute[71113]:     </serial>
Jul 31 10:11:43 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 10:11:43 user nova-compute[71113]:     <video>
Jul 31 10:11:43 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:11:43 user nova-compute[71113]:     </video>
Jul 31 10:11:43 user nova-compute[71113]:     <rng model="virtio">
Jul 31 10:11:43 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 10:11:43 user nova-compute[71113]:     </rng>
Jul 31 10:11:43 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 10:11:43 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 10:11:43 user nova-compute[71113]:       <stats period="10"/>
Jul 31 10:11:43 user nova-compute[71113]:     </memballoon>
Jul 31 10:11:43 user nova-compute[71113]:   </devices>
Jul 31 10:11:43 user nova-compute[71113]: </domain>
Jul 31 10:11:43 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:11:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-206616969',display_name='tempest-ServerRescueNegativeTestJSON-server-206616969',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-206616969',id=42,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='938c4f5af8a347cf9d700c8cdb5df356',ramdisk_id='',reservation_id='r-80w6skid',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-549904406',owner_user_name='tempest-ServerRescueNegativeTestJSON-549904406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T10:11:41Z,user_data=None,user_id='6023b7c67c0941d3975fa9c25140684f',uuid=c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85692854-658a-459b-9ab0-f448a6bf83f2", "address": "fa:16:3e:2b:2c:47", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85692854-65", "ovs_interfaceid": "85692854-658a-459b-9ab0-f448a6bf83f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Converting VIF {"id": "85692854-658a-459b-9ab0-f448a6bf83f2", "address": "fa:16:3e:2b:2c:47", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85692854-65", "ovs_interfaceid": "85692854-658a-459b-9ab0-f448a6bf83f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:2c:47,bridge_name='br-int',has_traffic_filtering=True,id=85692854-658a-459b-9ab0-f448a6bf83f2,network=Network(328e0f8b-5788-457c-afc6-7fe314ca8b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85692854-65') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG os_vif [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:2c:47,bridge_name='br-int',has_traffic_filtering=True,id=85692854-658a-459b-9ab0-f448a6bf83f2,network=Network(328e0f8b-5788-457c-afc6-7fe314ca8b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85692854-65') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85692854-65, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap85692854-65, col_values=(('external_ids', {'iface-id': '85692854-658a-459b-9ab0-f448a6bf83f2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:2c:47', 'vm-uuid': 'c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:43 user nova-compute[71113]: INFO os_vif [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:2c:47,bridge_name='br-int',has_traffic_filtering=True,id=85692854-658a-459b-9ab0-f448a6bf83f2,network=Network(328e0f8b-5788-457c-afc6-7fe314ca8b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85692854-65')
Jul 31 10:11:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] No VIF found with MAC fa:16:3e:2b:2c:47, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG nova.network.neutron [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Successfully updated port: 1a2da0f9-2fb6-4880-96b5-be8dd9d12574 {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Acquiring lock "refresh_cache-8129456b-a22c-46e3-b5db-89fdcec87dec" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Acquired lock "refresh_cache-8129456b-a22c-46e3-b5db-89fdcec87dec" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG nova.network.neutron [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG nova.compute.manager [req-03e7c161-b62b-4472-8543-30a9a83626ff req-f89ce11b-79dd-4f77-bc98-e5bc711d3fec service nova] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Received event network-changed-1a2da0f9-2fb6-4880-96b5-be8dd9d12574 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG nova.compute.manager [req-03e7c161-b62b-4472-8543-30a9a83626ff req-f89ce11b-79dd-4f77-bc98-e5bc711d3fec service nova] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Refreshing instance network info cache due to event network-changed-1a2da0f9-2fb6-4880-96b5-be8dd9d12574. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-03e7c161-b62b-4472-8543-30a9a83626ff req-f89ce11b-79dd-4f77-bc98-e5bc711d3fec service nova] Acquiring lock "refresh_cache-8129456b-a22c-46e3-b5db-89fdcec87dec" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:11:43 user nova-compute[71113]: DEBUG nova.network.neutron [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 10:11:44 user nova-compute[71113]: DEBUG nova.network.neutron [req-b1f62bb8-420b-4823-9d77-f095f79c6215 req-996dc5db-93b6-4911-b724-cffa459715f7 service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Updated VIF entry in instance network info cache for port 85692854-658a-459b-9ab0-f448a6bf83f2. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 10:11:44 user nova-compute[71113]: DEBUG nova.network.neutron [req-b1f62bb8-420b-4823-9d77-f095f79c6215 req-996dc5db-93b6-4911-b724-cffa459715f7 service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Updating instance_info_cache with network_info: [{"id": "85692854-658a-459b-9ab0-f448a6bf83f2", "address": "fa:16:3e:2b:2c:47", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85692854-65", "ovs_interfaceid": "85692854-658a-459b-9ab0-f448a6bf83f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:11:44 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-b1f62bb8-420b-4823-9d77-f095f79c6215 req-996dc5db-93b6-4911-b724-cffa459715f7 service nova] Releasing lock "refresh_cache-c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:11:44 user nova-compute[71113]: DEBUG nova.network.neutron [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Updating instance_info_cache with network_info: [{"id": "1a2da0f9-2fb6-4880-96b5-be8dd9d12574", "address": "fa:16:3e:fe:2b:04", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a2da0f9-2f", "ovs_interfaceid": "1a2da0f9-2fb6-4880-96b5-be8dd9d12574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:11:44 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Releasing lock "refresh_cache-8129456b-a22c-46e3-b5db-89fdcec87dec" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:11:44 user nova-compute[71113]: DEBUG nova.compute.manager [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Instance network_info: |[{"id": "1a2da0f9-2fb6-4880-96b5-be8dd9d12574", "address": "fa:16:3e:fe:2b:04", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a2da0f9-2f", "ovs_interfaceid": "1a2da0f9-2fb6-4880-96b5-be8dd9d12574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 10:11:44 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-03e7c161-b62b-4472-8543-30a9a83626ff req-f89ce11b-79dd-4f77-bc98-e5bc711d3fec service nova] Acquired lock "refresh_cache-8129456b-a22c-46e3-b5db-89fdcec87dec" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:11:44 user nova-compute[71113]: DEBUG nova.network.neutron [req-03e7c161-b62b-4472-8543-30a9a83626ff req-f89ce11b-79dd-4f77-bc98-e5bc711d3fec service nova] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Refreshing network info cache for port 1a2da0f9-2fb6-4880-96b5-be8dd9d12574 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 10:11:44 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Start _get_guest_xml network_info=[{"id": "1a2da0f9-2fb6-4880-96b5-be8dd9d12574", "address": "fa:16:3e:fe:2b:04", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a2da0f9-2f", "ovs_interfaceid": "1a2da0f9-2fb6-4880-96b5-be8dd9d12574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'image_id': '078646fe-b504-41ed-a147-61072e903e51'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 10:11:44 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:11:44 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:11:44 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 10:11:44 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 10:11:44 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 10:11:44 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 10:11:44 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 10:11:44 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 10:11:44 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 10:11:44 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 10:11:44 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 10:11:44 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 10:11:44 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 10:11:44 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 10:11:44 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 10:11:44 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 10:11:44 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 10:11:44 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 10:11:44 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:11:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-271752726',display_name='tempest-ServerRescueNegativeTestJSON-server-271752726',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-271752726',id=43,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='938c4f5af8a347cf9d700c8cdb5df356',ramdisk_id='',reservation_id='r-10x57duk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-549904406',owner_user_name='tempest-ServerRescueNegativeTestJSON-549904406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T10:11:42Z,user_data=None,user_id='6023b7c67c0941d3975fa9c25140684f',uuid=8129456b-a22c-46e3-b5db-89fdcec87dec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a2da0f9-2fb6-4880-96b5-be8dd9d12574", "address": "fa:16:3e:fe:2b:04", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a2da0f9-2f", "ovs_interfaceid": "1a2da0f9-2fb6-4880-96b5-be8dd9d12574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 10:11:44 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Converting VIF {"id": "1a2da0f9-2fb6-4880-96b5-be8dd9d12574", "address": "fa:16:3e:fe:2b:04", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a2da0f9-2f", "ovs_interfaceid": "1a2da0f9-2fb6-4880-96b5-be8dd9d12574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:11:44 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:2b:04,bridge_name='br-int',has_traffic_filtering=True,id=1a2da0f9-2fb6-4880-96b5-be8dd9d12574,network=Network(328e0f8b-5788-457c-afc6-7fe314ca8b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a2da0f9-2f') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:11:44 user nova-compute[71113]: DEBUG nova.objects.instance [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lazy-loading 'pci_devices' on Instance uuid 8129456b-a22c-46e3-b5db-89fdcec87dec {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:11:44 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] End _get_guest_xml xml=<domain type="kvm">
Jul 31 10:11:44 user nova-compute[71113]:   <uuid>8129456b-a22c-46e3-b5db-89fdcec87dec</uuid>
Jul 31 10:11:44 user nova-compute[71113]:   <name>instance-0000002b</name>
Jul 31 10:11:44 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 10:11:44 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 10:11:44 user nova-compute[71113]:   <metadata>
Jul 31 10:11:44 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 10:11:44 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 10:11:44 user nova-compute[71113]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-271752726</nova:name>
Jul 31 10:11:44 user nova-compute[71113]:       <nova:creationTime>2023-07-31 10:11:44</nova:creationTime>
Jul 31 10:11:44 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 10:11:44 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 10:11:44 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 10:11:44 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 10:11:44 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 10:11:44 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 10:11:44 user nova-compute[71113]:       </nova:flavor>
Jul 31 10:11:44 user nova-compute[71113]:       <nova:owner>
Jul 31 10:11:44 user nova-compute[71113]:         <nova:user uuid="6023b7c67c0941d3975fa9c25140684f">tempest-ServerRescueNegativeTestJSON-549904406-project-member</nova:user>
Jul 31 10:11:44 user nova-compute[71113]:         <nova:project uuid="938c4f5af8a347cf9d700c8cdb5df356">tempest-ServerRescueNegativeTestJSON-549904406</nova:project>
Jul 31 10:11:44 user nova-compute[71113]:       </nova:owner>
Jul 31 10:11:44 user nova-compute[71113]:       <nova:root type="image" uuid="078646fe-b504-41ed-a147-61072e903e51"/>
Jul 31 10:11:44 user nova-compute[71113]:       <nova:ports>
Jul 31 10:11:44 user nova-compute[71113]:         <nova:port uuid="1a2da0f9-2fb6-4880-96b5-be8dd9d12574">
Jul 31 10:11:44 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 31 10:11:44 user nova-compute[71113]:         </nova:port>
Jul 31 10:11:44 user nova-compute[71113]:       </nova:ports>
Jul 31 10:11:44 user nova-compute[71113]:     </nova:instance>
Jul 31 10:11:44 user nova-compute[71113]:   </metadata>
Jul 31 10:11:44 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 10:11:44 user nova-compute[71113]:     <system>
Jul 31 10:11:44 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 10:11:44 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 10:11:44 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 10:11:44 user nova-compute[71113]:       <entry name="serial">8129456b-a22c-46e3-b5db-89fdcec87dec</entry>
Jul 31 10:11:44 user nova-compute[71113]:       <entry name="uuid">8129456b-a22c-46e3-b5db-89fdcec87dec</entry>
Jul 31 10:11:44 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 10:11:44 user nova-compute[71113]:     </system>
Jul 31 10:11:44 user nova-compute[71113]:   </sysinfo>
Jul 31 10:11:44 user nova-compute[71113]:   <os>
Jul 31 10:11:44 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 10:11:44 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 10:11:44 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 10:11:44 user nova-compute[71113]:   </os>
Jul 31 10:11:44 user nova-compute[71113]:   <features>
Jul 31 10:11:44 user nova-compute[71113]:     <acpi/>
Jul 31 10:11:44 user nova-compute[71113]:     <apic/>
Jul 31 10:11:44 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 10:11:44 user nova-compute[71113]:   </features>
Jul 31 10:11:44 user nova-compute[71113]:   <clock offset="utc">
Jul 31 10:11:44 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 10:11:44 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 10:11:44 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 10:11:44 user nova-compute[71113]:   </clock>
Jul 31 10:11:44 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 10:11:44 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 10:11:44 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 10:11:44 user nova-compute[71113]:   </cpu>
Jul 31 10:11:44 user nova-compute[71113]:   <devices>
Jul 31 10:11:44 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 10:11:44 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 10:11:44 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk"/>
Jul 31 10:11:44 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 10:11:44 user nova-compute[71113]:     </disk>
Jul 31 10:11:44 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 10:11:44 user nova-compute[71113]:       <mac address="fa:16:3e:fe:2b:04"/>
Jul 31 10:11:44 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:11:44 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 10:11:44 user nova-compute[71113]:       <target dev="tap1a2da0f9-2f"/>
Jul 31 10:11:44 user nova-compute[71113]:     </interface>
Jul 31 10:11:44 user nova-compute[71113]:     <serial type="pty">
Jul 31 10:11:44 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/console.log" append="off"/>
Jul 31 10:11:44 user nova-compute[71113]:     </serial>
Jul 31 10:11:44 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 10:11:44 user nova-compute[71113]:     <video>
Jul 31 10:11:44 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:11:44 user nova-compute[71113]:     </video>
Jul 31 10:11:44 user nova-compute[71113]:     <rng model="virtio">
Jul 31 10:11:44 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 10:11:44 user nova-compute[71113]:     </rng>
Jul 31 10:11:44 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 10:11:44 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 10:11:44 user nova-compute[71113]:       <stats period="10"/>
Jul 31 10:11:44 user nova-compute[71113]:     </memballoon>
Jul 31 10:11:44 user nova-compute[71113]:   </devices>
Jul 31 10:11:44 user nova-compute[71113]: </domain>
Jul 31 10:11:44 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 10:11:44 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:11:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-271752726',display_name='tempest-ServerRescueNegativeTestJSON-server-271752726',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-271752726',id=43,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='938c4f5af8a347cf9d700c8cdb5df356',ramdisk_id='',reservation_id='r-10x57duk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-549904406',owner_user_name='tempest-ServerRescueNegativeTestJSON-549904406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T10:11:42Z,user_data=None,user_id='6023b7c67c0941d3975fa9c25140684f',uuid=8129456b-a22c-46e3-b5db-89fdcec87dec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a2da0f9-2fb6-4880-96b5-be8dd9d12574", "address": "fa:16:3e:fe:2b:04", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a2da0f9-2f", "ovs_interfaceid": "1a2da0f9-2fb6-4880-96b5-be8dd9d12574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 10:11:44 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Converting VIF {"id": "1a2da0f9-2fb6-4880-96b5-be8dd9d12574", "address": "fa:16:3e:fe:2b:04", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a2da0f9-2f", "ovs_interfaceid": "1a2da0f9-2fb6-4880-96b5-be8dd9d12574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:11:44 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:2b:04,bridge_name='br-int',has_traffic_filtering=True,id=1a2da0f9-2fb6-4880-96b5-be8dd9d12574,network=Network(328e0f8b-5788-457c-afc6-7fe314ca8b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a2da0f9-2f') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:11:44 user nova-compute[71113]: DEBUG os_vif [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:2b:04,bridge_name='br-int',has_traffic_filtering=True,id=1a2da0f9-2fb6-4880-96b5-be8dd9d12574,network=Network(328e0f8b-5788-457c-afc6-7fe314ca8b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a2da0f9-2f') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 10:11:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:11:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 10:11:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1a2da0f9-2f, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:11:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1a2da0f9-2f, col_values=(('external_ids', {'iface-id': '1a2da0f9-2fb6-4880-96b5-be8dd9d12574', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:2b:04', 'vm-uuid': '8129456b-a22c-46e3-b5db-89fdcec87dec'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:11:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:11:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:44 user nova-compute[71113]: INFO os_vif [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:2b:04,bridge_name='br-int',has_traffic_filtering=True,id=1a2da0f9-2fb6-4880-96b5-be8dd9d12574,network=Network(328e0f8b-5788-457c-afc6-7fe314ca8b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a2da0f9-2f')
Jul 31 10:11:44 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:11:44 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] No VIF found with MAC fa:16:3e:fe:2b:04, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 10:11:44 user nova-compute[71113]: DEBUG nova.network.neutron [req-03e7c161-b62b-4472-8543-30a9a83626ff req-f89ce11b-79dd-4f77-bc98-e5bc711d3fec service nova] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Updated VIF entry in instance network info cache for port 1a2da0f9-2fb6-4880-96b5-be8dd9d12574. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 10:11:44 user nova-compute[71113]: DEBUG nova.network.neutron [req-03e7c161-b62b-4472-8543-30a9a83626ff req-f89ce11b-79dd-4f77-bc98-e5bc711d3fec service nova] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Updating instance_info_cache with network_info: [{"id": "1a2da0f9-2fb6-4880-96b5-be8dd9d12574", "address": "fa:16:3e:fe:2b:04", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a2da0f9-2f", "ovs_interfaceid": "1a2da0f9-2fb6-4880-96b5-be8dd9d12574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:11:44 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-03e7c161-b62b-4472-8543-30a9a83626ff req-f89ce11b-79dd-4f77-bc98-e5bc711d3fec service nova] Releasing lock "refresh_cache-8129456b-a22c-46e3-b5db-89fdcec87dec" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:11:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:45 user nova-compute[71113]: DEBUG nova.compute.manager [req-d44aee4b-61c7-4edc-9575-b977b30a4f0d req-a87609c3-1625-4d07-947e-574294b2b89b service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Received event network-vif-plugged-85692854-658a-459b-9ab0-f448a6bf83f2 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:11:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-d44aee4b-61c7-4edc-9575-b977b30a4f0d req-a87609c3-1625-4d07-947e-574294b2b89b service nova] Acquiring lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:11:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-d44aee4b-61c7-4edc-9575-b977b30a4f0d req-a87609c3-1625-4d07-947e-574294b2b89b service nova] Lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:11:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-d44aee4b-61c7-4edc-9575-b977b30a4f0d req-a87609c3-1625-4d07-947e-574294b2b89b service nova] Lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:11:45 user nova-compute[71113]: DEBUG nova.compute.manager [req-d44aee4b-61c7-4edc-9575-b977b30a4f0d req-a87609c3-1625-4d07-947e-574294b2b89b service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] No waiting events found dispatching network-vif-plugged-85692854-658a-459b-9ab0-f448a6bf83f2 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:11:45 user nova-compute[71113]: WARNING nova.compute.manager [req-d44aee4b-61c7-4edc-9575-b977b30a4f0d req-a87609c3-1625-4d07-947e-574294b2b89b service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Received unexpected event network-vif-plugged-85692854-658a-459b-9ab0-f448a6bf83f2 for instance with vm_state building and task_state spawning.
Jul 31 10:11:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:46 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:46 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:46 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:46 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:47 user nova-compute[71113]: DEBUG nova.compute.manager [req-1fd65230-a5c6-4a92-a88e-6eaeab077fab req-a4f93ae7-55ab-433d-a29b-d1c2b843cdf8 service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Received event network-vif-plugged-85692854-658a-459b-9ab0-f448a6bf83f2 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:11:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1fd65230-a5c6-4a92-a88e-6eaeab077fab req-a4f93ae7-55ab-433d-a29b-d1c2b843cdf8 service nova] Acquiring lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:11:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1fd65230-a5c6-4a92-a88e-6eaeab077fab req-a4f93ae7-55ab-433d-a29b-d1c2b843cdf8 service nova] Lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:11:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1fd65230-a5c6-4a92-a88e-6eaeab077fab req-a4f93ae7-55ab-433d-a29b-d1c2b843cdf8 service nova] Lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:11:47 user nova-compute[71113]: DEBUG nova.compute.manager [req-1fd65230-a5c6-4a92-a88e-6eaeab077fab req-a4f93ae7-55ab-433d-a29b-d1c2b843cdf8 service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] No waiting events found dispatching network-vif-plugged-85692854-658a-459b-9ab0-f448a6bf83f2 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:11:47 user nova-compute[71113]: WARNING nova.compute.manager [req-1fd65230-a5c6-4a92-a88e-6eaeab077fab req-a4f93ae7-55ab-433d-a29b-d1c2b843cdf8 service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Received unexpected event network-vif-plugged-85692854-658a-459b-9ab0-f448a6bf83f2 for instance with vm_state building and task_state spawning.
Jul 31 10:11:47 user nova-compute[71113]: DEBUG nova.compute.manager [req-1fd65230-a5c6-4a92-a88e-6eaeab077fab req-a4f93ae7-55ab-433d-a29b-d1c2b843cdf8 service nova] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Received event network-vif-plugged-1a2da0f9-2fb6-4880-96b5-be8dd9d12574 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:11:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1fd65230-a5c6-4a92-a88e-6eaeab077fab req-a4f93ae7-55ab-433d-a29b-d1c2b843cdf8 service nova] Acquiring lock "8129456b-a22c-46e3-b5db-89fdcec87dec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:11:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1fd65230-a5c6-4a92-a88e-6eaeab077fab req-a4f93ae7-55ab-433d-a29b-d1c2b843cdf8 service nova] Lock "8129456b-a22c-46e3-b5db-89fdcec87dec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:11:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1fd65230-a5c6-4a92-a88e-6eaeab077fab req-a4f93ae7-55ab-433d-a29b-d1c2b843cdf8 service nova] Lock "8129456b-a22c-46e3-b5db-89fdcec87dec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:11:47 user nova-compute[71113]: DEBUG nova.compute.manager [req-1fd65230-a5c6-4a92-a88e-6eaeab077fab req-a4f93ae7-55ab-433d-a29b-d1c2b843cdf8 service nova] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] No waiting events found dispatching network-vif-plugged-1a2da0f9-2fb6-4880-96b5-be8dd9d12574 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:11:47 user nova-compute[71113]: WARNING nova.compute.manager [req-1fd65230-a5c6-4a92-a88e-6eaeab077fab req-a4f93ae7-55ab-433d-a29b-d1c2b843cdf8 service nova] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Received unexpected event network-vif-plugged-1a2da0f9-2fb6-4880-96b5-be8dd9d12574 for instance with vm_state building and task_state spawning.
Jul 31 10:11:47 user nova-compute[71113]: DEBUG nova.compute.manager [req-1fd65230-a5c6-4a92-a88e-6eaeab077fab req-a4f93ae7-55ab-433d-a29b-d1c2b843cdf8 service nova] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Received event network-vif-plugged-1a2da0f9-2fb6-4880-96b5-be8dd9d12574 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:11:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1fd65230-a5c6-4a92-a88e-6eaeab077fab req-a4f93ae7-55ab-433d-a29b-d1c2b843cdf8 service nova] Acquiring lock "8129456b-a22c-46e3-b5db-89fdcec87dec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:11:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1fd65230-a5c6-4a92-a88e-6eaeab077fab req-a4f93ae7-55ab-433d-a29b-d1c2b843cdf8 service nova] Lock "8129456b-a22c-46e3-b5db-89fdcec87dec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:11:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1fd65230-a5c6-4a92-a88e-6eaeab077fab req-a4f93ae7-55ab-433d-a29b-d1c2b843cdf8 service nova] Lock "8129456b-a22c-46e3-b5db-89fdcec87dec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:11:47 user nova-compute[71113]: DEBUG nova.compute.manager [req-1fd65230-a5c6-4a92-a88e-6eaeab077fab req-a4f93ae7-55ab-433d-a29b-d1c2b843cdf8 service nova] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] No waiting events found dispatching network-vif-plugged-1a2da0f9-2fb6-4880-96b5-be8dd9d12574 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:11:47 user nova-compute[71113]: WARNING nova.compute.manager [req-1fd65230-a5c6-4a92-a88e-6eaeab077fab req-a4f93ae7-55ab-433d-a29b-d1c2b843cdf8 service nova] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Received unexpected event network-vif-plugged-1a2da0f9-2fb6-4880-96b5-be8dd9d12574 for instance with vm_state building and task_state spawning.
Jul 31 10:11:48 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690798308.5942476, c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5 => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:11:48 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] VM Resumed (Lifecycle Event)
Jul 31 10:11:48 user nova-compute[71113]: DEBUG nova.compute.manager [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 10:11:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 10:11:48 user nova-compute[71113]: DEBUG nova.compute.manager [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 10:11:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 10:11:48 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Instance spawned successfully.
Jul 31 10:11:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 10:11:48 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Instance spawned successfully.
Jul 31 10:11:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 10:11:48 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:11:48 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:11:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Found default for hw_cdrom_bus of ide {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:11:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Found default for hw_disk_bus of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:11:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Found default for hw_input_bus of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:11:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Found default for hw_pointer_model of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:11:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Found default for hw_video_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:11:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Found default for hw_vif_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:11:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Found default for hw_cdrom_bus of ide {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:11:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Found default for hw_disk_bus of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:11:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Found default for hw_input_bus of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:11:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Found default for hw_pointer_model of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:11:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Found default for hw_video_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:11:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Found default for hw_vif_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:11:48 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 10:11:48 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690798308.5959373, 8129456b-a22c-46e3-b5db-89fdcec87dec => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:11:48 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] VM Resumed (Lifecycle Event)
Jul 31 10:11:48 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:11:48 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:11:48 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 10:11:48 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690798308.5980446, c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5 => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:11:48 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] VM Started (Lifecycle Event)
Jul 31 10:11:48 user nova-compute[71113]: INFO nova.compute.manager [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Took 7.30 seconds to spawn the instance on the hypervisor.
Jul 31 10:11:48 user nova-compute[71113]: DEBUG nova.compute.manager [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:11:48 user nova-compute[71113]: INFO nova.compute.manager [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Took 6.31 seconds to spawn the instance on the hypervisor.
Jul 31 10:11:48 user nova-compute[71113]: DEBUG nova.compute.manager [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:11:48 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:11:48 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:11:48 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 10:11:48 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690798308.5991774, 8129456b-a22c-46e3-b5db-89fdcec87dec => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:11:48 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] VM Started (Lifecycle Event)
Jul 31 10:11:48 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:11:48 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:11:48 user nova-compute[71113]: INFO nova.compute.manager [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Took 7.09 seconds to build instance.
Jul 31 10:11:48 user nova-compute[71113]: INFO nova.compute.manager [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Took 8.12 seconds to build instance.
Jul 31 10:11:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f5f787c6-0f7e-469c-8c35-d03c7e7365d4 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "8129456b-a22c-46e3-b5db-89fdcec87dec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.243s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:11:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5b121739-75df-4e4c-8e5b-c6bffb058505 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.218s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:11:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquiring lock "a9299196-6e9b-4a48-9c90-e1e24243a7b1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:11:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "a9299196-6e9b-4a48-9c90-e1e24243a7b1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:11:53 user nova-compute[71113]: DEBUG nova.compute.manager [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Starting instance... {{(pid=71113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 10:11:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:11:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:11:53 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 10:11:53 user nova-compute[71113]: INFO nova.compute.claims [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Claim successful on node user
Jul 31 10:11:53 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:11:53 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:11:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.318s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:11:53 user nova-compute[71113]: DEBUG nova.compute.manager [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Start building networks asynchronously for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 10:11:53 user nova-compute[71113]: DEBUG nova.compute.manager [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Allocating IP information in the background. {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 10:11:53 user nova-compute[71113]: DEBUG nova.network.neutron [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] allocate_for_instance() {{(pid=71113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 10:11:53 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 10:11:53 user nova-compute[71113]: DEBUG nova.compute.manager [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Start building block device mappings for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 10:11:53 user nova-compute[71113]: DEBUG nova.policy [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd9883a5677fb4852ae031137736a9ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7000d6a2a6b147ddbc38208b316574cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71113) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 10:11:54 user nova-compute[71113]: DEBUG nova.compute.manager [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Start spawning the instance on the hypervisor. {{(pid=71113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 10:11:54 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 10:11:54 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Creating image(s)
Jul 31 10:11:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquiring lock "/opt/stack/data/nova/instances/a9299196-6e9b-4a48-9c90-e1e24243a7b1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:11:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "/opt/stack/data/nova/instances/a9299196-6e9b-4a48-9c90-e1e24243a7b1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:11:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "/opt/stack/data/nova/instances/a9299196-6e9b-4a48-9c90-e1e24243a7b1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:11:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:11:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.151s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:11:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquiring lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:11:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:11:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:11:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.169s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:11:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/a9299196-6e9b-4a48-9c90-e1e24243a7b1/disk 1073741824 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:11:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/a9299196-6e9b-4a48-9c90-e1e24243a7b1/disk 1073741824" returned: 0 in 0.057s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:11:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:11:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:11:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.183s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:11:54 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a9299196-6e9b-4a48-9c90-e1e24243a7b1/disk. size=1073741824 {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 10:11:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9299196-6e9b-4a48-9c90-e1e24243a7b1/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:11:54 user nova-compute[71113]: DEBUG nova.network.neutron [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Successfully created port: 6764da79-a9ff-4470-b3ac-5eb0f8346538 {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 10:11:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9299196-6e9b-4a48-9c90-e1e24243a7b1/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:11:54 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Cannot resize image /opt/stack/data/nova/instances/a9299196-6e9b-4a48-9c90-e1e24243a7b1/disk to a smaller size. {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 10:11:54 user nova-compute[71113]: DEBUG nova.objects.instance [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lazy-loading 'migration_context' on Instance uuid a9299196-6e9b-4a48-9c90-e1e24243a7b1 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:11:54 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Created local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 10:11:54 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Ensure instance console log exists: /opt/stack/data/nova/instances/a9299196-6e9b-4a48-9c90-e1e24243a7b1/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 10:11:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:11:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:11:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:11:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:55 user nova-compute[71113]: DEBUG nova.network.neutron [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Successfully updated port: 6764da79-a9ff-4470-b3ac-5eb0f8346538 {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 10:11:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquiring lock "refresh_cache-a9299196-6e9b-4a48-9c90-e1e24243a7b1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:11:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquired lock "refresh_cache-a9299196-6e9b-4a48-9c90-e1e24243a7b1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:11:55 user nova-compute[71113]: DEBUG nova.network.neutron [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 10:11:55 user nova-compute[71113]: DEBUG nova.compute.manager [req-cf204d52-4092-439b-abd7-8dd78d830707 req-4bbf64e4-1bab-469b-800f-579fad6394db service nova] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Received event network-changed-6764da79-a9ff-4470-b3ac-5eb0f8346538 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:11:55 user nova-compute[71113]: DEBUG nova.compute.manager [req-cf204d52-4092-439b-abd7-8dd78d830707 req-4bbf64e4-1bab-469b-800f-579fad6394db service nova] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Refreshing instance network info cache due to event network-changed-6764da79-a9ff-4470-b3ac-5eb0f8346538. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 10:11:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-cf204d52-4092-439b-abd7-8dd78d830707 req-4bbf64e4-1bab-469b-800f-579fad6394db service nova] Acquiring lock "refresh_cache-a9299196-6e9b-4a48-9c90-e1e24243a7b1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:11:55 user nova-compute[71113]: DEBUG nova.network.neutron [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 10:11:56 user nova-compute[71113]: DEBUG nova.network.neutron [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Updating instance_info_cache with network_info: [{"id": "6764da79-a9ff-4470-b3ac-5eb0f8346538", "address": "fa:16:3e:ef:aa:50", "network": {"id": "4b030626-e3f1-4617-89c2-f6389226652f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441335951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7000d6a2a6b147ddbc38208b316574cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6764da79-a9", "ovs_interfaceid": "6764da79-a9ff-4470-b3ac-5eb0f8346538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:11:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Releasing lock "refresh_cache-a9299196-6e9b-4a48-9c90-e1e24243a7b1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:11:56 user nova-compute[71113]: DEBUG nova.compute.manager [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Instance network_info: |[{"id": "6764da79-a9ff-4470-b3ac-5eb0f8346538", "address": "fa:16:3e:ef:aa:50", "network": {"id": "4b030626-e3f1-4617-89c2-f6389226652f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441335951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7000d6a2a6b147ddbc38208b316574cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6764da79-a9", "ovs_interfaceid": "6764da79-a9ff-4470-b3ac-5eb0f8346538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 10:11:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-cf204d52-4092-439b-abd7-8dd78d830707 req-4bbf64e4-1bab-469b-800f-579fad6394db service nova] Acquired lock "refresh_cache-a9299196-6e9b-4a48-9c90-e1e24243a7b1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:11:56 user nova-compute[71113]: DEBUG nova.network.neutron [req-cf204d52-4092-439b-abd7-8dd78d830707 req-4bbf64e4-1bab-469b-800f-579fad6394db service nova] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Refreshing network info cache for port 6764da79-a9ff-4470-b3ac-5eb0f8346538 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 10:11:56 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Start _get_guest_xml network_info=[{"id": "6764da79-a9ff-4470-b3ac-5eb0f8346538", "address": "fa:16:3e:ef:aa:50", "network": {"id": "4b030626-e3f1-4617-89c2-f6389226652f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441335951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7000d6a2a6b147ddbc38208b316574cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6764da79-a9", "ovs_interfaceid": "6764da79-a9ff-4470-b3ac-5eb0f8346538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'image_id': '078646fe-b504-41ed-a147-61072e903e51'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 10:11:56 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:11:56 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:11:56 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 10:11:56 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 10:11:56 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 10:11:56 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 10:11:56 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 10:11:56 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 10:11:56 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 10:11:56 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 10:11:56 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 10:11:56 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 10:11:56 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 10:11:56 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 10:11:56 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 10:11:56 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 10:11:56 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 10:11:56 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 10:11:56 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:11:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1347479544',display_name='tempest-AttachVolumeNegativeTest-server-1347479544',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1347479544',id=44,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0k1XIU6/yPsYKzRnjxR2i/mLa46OrKYOci1jOf6iqYQ5EUJhh2nxVX/070X8HDwZOC+3odGp3i66eQvMxtsT7eIwaUSBeHkgUSQWRj7rtFbg6pnbZgpcfFCO6QtY+54w==',key_name='tempest-keypair-1410974386',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7000d6a2a6b147ddbc38208b316574cd',ramdisk_id='',reservation_id='r-z240xc48',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2110881646',owner_user_name='tempest-AttachVolumeNegativeTest-2110881646-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T10:11:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9883a5677fb4852ae031137736a9ee4',uuid=a9299196-6e9b-4a48-9c90-e1e24243a7b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6764da79-a9ff-4470-b3ac-5eb0f8346538", "address": "fa:16:3e:ef:aa:50", "network": {"id": "4b030626-e3f1-4617-89c2-f6389226652f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441335951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7000d6a2a6b147ddbc38208b316574cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6764da79-a9", "ovs_interfaceid": "6764da79-a9ff-4470-b3ac-5eb0f8346538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 10:11:56 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Converting VIF {"id": "6764da79-a9ff-4470-b3ac-5eb0f8346538", "address": "fa:16:3e:ef:aa:50", "network": {"id": "4b030626-e3f1-4617-89c2-f6389226652f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441335951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7000d6a2a6b147ddbc38208b316574cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6764da79-a9", "ovs_interfaceid": "6764da79-a9ff-4470-b3ac-5eb0f8346538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:11:56 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:aa:50,bridge_name='br-int',has_traffic_filtering=True,id=6764da79-a9ff-4470-b3ac-5eb0f8346538,network=Network(4b030626-e3f1-4617-89c2-f6389226652f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6764da79-a9') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:11:56 user nova-compute[71113]: DEBUG nova.objects.instance [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lazy-loading 'pci_devices' on Instance uuid a9299196-6e9b-4a48-9c90-e1e24243a7b1 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:11:56 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] End _get_guest_xml xml=<domain type="kvm">
Jul 31 10:11:56 user nova-compute[71113]:   <uuid>a9299196-6e9b-4a48-9c90-e1e24243a7b1</uuid>
Jul 31 10:11:56 user nova-compute[71113]:   <name>instance-0000002c</name>
Jul 31 10:11:56 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 10:11:56 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 10:11:56 user nova-compute[71113]:   <metadata>
Jul 31 10:11:56 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 10:11:56 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 10:11:56 user nova-compute[71113]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1347479544</nova:name>
Jul 31 10:11:56 user nova-compute[71113]:       <nova:creationTime>2023-07-31 10:11:56</nova:creationTime>
Jul 31 10:11:56 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 10:11:56 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 10:11:56 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 10:11:56 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 10:11:56 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 10:11:56 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 10:11:56 user nova-compute[71113]:       </nova:flavor>
Jul 31 10:11:56 user nova-compute[71113]:       <nova:owner>
Jul 31 10:11:56 user nova-compute[71113]:         <nova:user uuid="d9883a5677fb4852ae031137736a9ee4">tempest-AttachVolumeNegativeTest-2110881646-project-member</nova:user>
Jul 31 10:11:56 user nova-compute[71113]:         <nova:project uuid="7000d6a2a6b147ddbc38208b316574cd">tempest-AttachVolumeNegativeTest-2110881646</nova:project>
Jul 31 10:11:56 user nova-compute[71113]:       </nova:owner>
Jul 31 10:11:56 user nova-compute[71113]:       <nova:root type="image" uuid="078646fe-b504-41ed-a147-61072e903e51"/>
Jul 31 10:11:56 user nova-compute[71113]:       <nova:ports>
Jul 31 10:11:56 user nova-compute[71113]:         <nova:port uuid="6764da79-a9ff-4470-b3ac-5eb0f8346538">
Jul 31 10:11:56 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 31 10:11:56 user nova-compute[71113]:         </nova:port>
Jul 31 10:11:56 user nova-compute[71113]:       </nova:ports>
Jul 31 10:11:56 user nova-compute[71113]:     </nova:instance>
Jul 31 10:11:56 user nova-compute[71113]:   </metadata>
Jul 31 10:11:56 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 10:11:56 user nova-compute[71113]:     <system>
Jul 31 10:11:56 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 10:11:56 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 10:11:56 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 10:11:56 user nova-compute[71113]:       <entry name="serial">a9299196-6e9b-4a48-9c90-e1e24243a7b1</entry>
Jul 31 10:11:56 user nova-compute[71113]:       <entry name="uuid">a9299196-6e9b-4a48-9c90-e1e24243a7b1</entry>
Jul 31 10:11:56 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 10:11:56 user nova-compute[71113]:     </system>
Jul 31 10:11:56 user nova-compute[71113]:   </sysinfo>
Jul 31 10:11:56 user nova-compute[71113]:   <os>
Jul 31 10:11:56 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 10:11:56 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 10:11:56 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 10:11:56 user nova-compute[71113]:   </os>
Jul 31 10:11:56 user nova-compute[71113]:   <features>
Jul 31 10:11:56 user nova-compute[71113]:     <acpi/>
Jul 31 10:11:56 user nova-compute[71113]:     <apic/>
Jul 31 10:11:56 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 10:11:56 user nova-compute[71113]:   </features>
Jul 31 10:11:56 user nova-compute[71113]:   <clock offset="utc">
Jul 31 10:11:56 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 10:11:56 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 10:11:56 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 10:11:56 user nova-compute[71113]:   </clock>
Jul 31 10:11:56 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 10:11:56 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 10:11:56 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 10:11:56 user nova-compute[71113]:   </cpu>
Jul 31 10:11:56 user nova-compute[71113]:   <devices>
Jul 31 10:11:56 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 10:11:56 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 10:11:56 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/a9299196-6e9b-4a48-9c90-e1e24243a7b1/disk"/>
Jul 31 10:11:56 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 10:11:56 user nova-compute[71113]:     </disk>
Jul 31 10:11:56 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 10:11:56 user nova-compute[71113]:       <mac address="fa:16:3e:ef:aa:50"/>
Jul 31 10:11:56 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:11:56 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 10:11:56 user nova-compute[71113]:       <target dev="tap6764da79-a9"/>
Jul 31 10:11:56 user nova-compute[71113]:     </interface>
Jul 31 10:11:56 user nova-compute[71113]:     <serial type="pty">
Jul 31 10:11:56 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/a9299196-6e9b-4a48-9c90-e1e24243a7b1/console.log" append="off"/>
Jul 31 10:11:56 user nova-compute[71113]:     </serial>
Jul 31 10:11:56 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 10:11:56 user nova-compute[71113]:     <video>
Jul 31 10:11:56 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:11:56 user nova-compute[71113]:     </video>
Jul 31 10:11:56 user nova-compute[71113]:     <rng model="virtio">
Jul 31 10:11:56 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 10:11:56 user nova-compute[71113]:     </rng>
Jul 31 10:11:56 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 10:11:56 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 10:11:56 user nova-compute[71113]:       <stats period="10"/>
Jul 31 10:11:56 user nova-compute[71113]:     </memballoon>
Jul 31 10:11:56 user nova-compute[71113]:   </devices>
Jul 31 10:11:56 user nova-compute[71113]: </domain>
Jul 31 10:11:56 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 10:11:56 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:11:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1347479544',display_name='tempest-AttachVolumeNegativeTest-server-1347479544',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1347479544',id=44,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0k1XIU6/yPsYKzRnjxR2i/mLa46OrKYOci1jOf6iqYQ5EUJhh2nxVX/070X8HDwZOC+3odGp3i66eQvMxtsT7eIwaUSBeHkgUSQWRj7rtFbg6pnbZgpcfFCO6QtY+54w==',key_name='tempest-keypair-1410974386',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7000d6a2a6b147ddbc38208b316574cd',ramdisk_id='',reservation_id='r-z240xc48',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2110881646',owner_user_name='tempest-AttachVolumeNegativeTest-2110881646-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T10:11:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9883a5677fb4852ae031137736a9ee4',uuid=a9299196-6e9b-4a48-9c90-e1e24243a7b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6764da79-a9ff-4470-b3ac-5eb0f8346538", "address": "fa:16:3e:ef:aa:50", "network": {"id": "4b030626-e3f1-4617-89c2-f6389226652f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441335951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7000d6a2a6b147ddbc38208b316574cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6764da79-a9", "ovs_interfaceid": "6764da79-a9ff-4470-b3ac-5eb0f8346538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 10:11:56 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Converting VIF {"id": "6764da79-a9ff-4470-b3ac-5eb0f8346538", "address": "fa:16:3e:ef:aa:50", "network": {"id": "4b030626-e3f1-4617-89c2-f6389226652f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441335951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7000d6a2a6b147ddbc38208b316574cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6764da79-a9", "ovs_interfaceid": "6764da79-a9ff-4470-b3ac-5eb0f8346538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:11:56 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:aa:50,bridge_name='br-int',has_traffic_filtering=True,id=6764da79-a9ff-4470-b3ac-5eb0f8346538,network=Network(4b030626-e3f1-4617-89c2-f6389226652f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6764da79-a9') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:11:56 user nova-compute[71113]: DEBUG os_vif [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:aa:50,bridge_name='br-int',has_traffic_filtering=True,id=6764da79-a9ff-4470-b3ac-5eb0f8346538,network=Network(4b030626-e3f1-4617-89c2-f6389226652f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6764da79-a9') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 10:11:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:11:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 10:11:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6764da79-a9, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:11:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6764da79-a9, col_values=(('external_ids', {'iface-id': '6764da79-a9ff-4470-b3ac-5eb0f8346538', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:aa:50', 'vm-uuid': 'a9299196-6e9b-4a48-9c90-e1e24243a7b1'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:11:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:11:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:56 user nova-compute[71113]: INFO os_vif [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:aa:50,bridge_name='br-int',has_traffic_filtering=True,id=6764da79-a9ff-4470-b3ac-5eb0f8346538,network=Network(4b030626-e3f1-4617-89c2-f6389226652f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6764da79-a9')
Jul 31 10:11:56 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:11:56 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] No VIF found with MAC fa:16:3e:ef:aa:50, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 10:11:56 user nova-compute[71113]: DEBUG nova.network.neutron [req-cf204d52-4092-439b-abd7-8dd78d830707 req-4bbf64e4-1bab-469b-800f-579fad6394db service nova] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Updated VIF entry in instance network info cache for port 6764da79-a9ff-4470-b3ac-5eb0f8346538. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 10:11:56 user nova-compute[71113]: DEBUG nova.network.neutron [req-cf204d52-4092-439b-abd7-8dd78d830707 req-4bbf64e4-1bab-469b-800f-579fad6394db service nova] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Updating instance_info_cache with network_info: [{"id": "6764da79-a9ff-4470-b3ac-5eb0f8346538", "address": "fa:16:3e:ef:aa:50", "network": {"id": "4b030626-e3f1-4617-89c2-f6389226652f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441335951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7000d6a2a6b147ddbc38208b316574cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6764da79-a9", "ovs_interfaceid": "6764da79-a9ff-4470-b3ac-5eb0f8346538", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:11:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-cf204d52-4092-439b-abd7-8dd78d830707 req-4bbf64e4-1bab-469b-800f-579fad6394db service nova] Releasing lock "refresh_cache-a9299196-6e9b-4a48-9c90-e1e24243a7b1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:11:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:57 user nova-compute[71113]: DEBUG nova.compute.manager [req-172408eb-e167-49df-aa8c-d17da76a5259 req-ef7a5af0-8c53-4e41-a1fe-84ad6c674cea service nova] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Received event network-vif-plugged-6764da79-a9ff-4470-b3ac-5eb0f8346538 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:11:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-172408eb-e167-49df-aa8c-d17da76a5259 req-ef7a5af0-8c53-4e41-a1fe-84ad6c674cea service nova] Acquiring lock "a9299196-6e9b-4a48-9c90-e1e24243a7b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:11:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-172408eb-e167-49df-aa8c-d17da76a5259 req-ef7a5af0-8c53-4e41-a1fe-84ad6c674cea service nova] Lock "a9299196-6e9b-4a48-9c90-e1e24243a7b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:11:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-172408eb-e167-49df-aa8c-d17da76a5259 req-ef7a5af0-8c53-4e41-a1fe-84ad6c674cea service nova] Lock "a9299196-6e9b-4a48-9c90-e1e24243a7b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:11:57 user nova-compute[71113]: DEBUG nova.compute.manager [req-172408eb-e167-49df-aa8c-d17da76a5259 req-ef7a5af0-8c53-4e41-a1fe-84ad6c674cea service nova] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] No waiting events found dispatching network-vif-plugged-6764da79-a9ff-4470-b3ac-5eb0f8346538 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:11:57 user nova-compute[71113]: WARNING nova.compute.manager [req-172408eb-e167-49df-aa8c-d17da76a5259 req-ef7a5af0-8c53-4e41-a1fe-84ad6c674cea service nova] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Received unexpected event network-vif-plugged-6764da79-a9ff-4470-b3ac-5eb0f8346538 for instance with vm_state building and task_state spawning.
Jul 31 10:11:58 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:58 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:58 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:11:59 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690798319.7702086, a9299196-6e9b-4a48-9c90-e1e24243a7b1 => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:11:59 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] VM Resumed (Lifecycle Event)
Jul 31 10:11:59 user nova-compute[71113]: DEBUG nova.compute.manager [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 10:11:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 10:11:59 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Instance spawned successfully.
Jul 31 10:11:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 10:11:59 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:11:59 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:11:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Found default for hw_cdrom_bus of ide {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:11:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Found default for hw_disk_bus of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:11:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Found default for hw_input_bus of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:11:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Found default for hw_pointer_model of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:11:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Found default for hw_video_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:11:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Found default for hw_vif_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:11:59 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 10:11:59 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690798319.774704, a9299196-6e9b-4a48-9c90-e1e24243a7b1 => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:11:59 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] VM Started (Lifecycle Event)
Jul 31 10:11:59 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:11:59 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:11:59 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 10:11:59 user nova-compute[71113]: INFO nova.compute.manager [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Took 5.86 seconds to spawn the instance on the hypervisor.
Jul 31 10:11:59 user nova-compute[71113]: DEBUG nova.compute.manager [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:11:59 user nova-compute[71113]: DEBUG nova.compute.manager [req-479f4020-50a9-479f-8322-57532a12e99e req-0dba1c1f-a421-46c7-a945-017f1f022d63 service nova] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Received event network-vif-plugged-6764da79-a9ff-4470-b3ac-5eb0f8346538 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:11:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-479f4020-50a9-479f-8322-57532a12e99e req-0dba1c1f-a421-46c7-a945-017f1f022d63 service nova] Acquiring lock "a9299196-6e9b-4a48-9c90-e1e24243a7b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:11:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-479f4020-50a9-479f-8322-57532a12e99e req-0dba1c1f-a421-46c7-a945-017f1f022d63 service nova] Lock "a9299196-6e9b-4a48-9c90-e1e24243a7b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:11:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-479f4020-50a9-479f-8322-57532a12e99e req-0dba1c1f-a421-46c7-a945-017f1f022d63 service nova] Lock "a9299196-6e9b-4a48-9c90-e1e24243a7b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:11:59 user nova-compute[71113]: DEBUG nova.compute.manager [req-479f4020-50a9-479f-8322-57532a12e99e req-0dba1c1f-a421-46c7-a945-017f1f022d63 service nova] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] No waiting events found dispatching network-vif-plugged-6764da79-a9ff-4470-b3ac-5eb0f8346538 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:11:59 user nova-compute[71113]: WARNING nova.compute.manager [req-479f4020-50a9-479f-8322-57532a12e99e req-0dba1c1f-a421-46c7-a945-017f1f022d63 service nova] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Received unexpected event network-vif-plugged-6764da79-a9ff-4470-b3ac-5eb0f8346538 for instance with vm_state building and task_state spawning.
Jul 31 10:11:59 user nova-compute[71113]: INFO nova.compute.manager [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Took 6.52 seconds to build instance.
Jul 31 10:12:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-a324c104-7e04-4c50-b19f-0c3436f68900 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "a9299196-6e9b-4a48-9c90-e1e24243a7b1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.626s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:12:00 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:12:01 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:12:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:12:06 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:12:07 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:12:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:12:11 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:12:13 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:12:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:12:15 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:12:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:12:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:12:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:12:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:12:21 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:12:22 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:12:22 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:12:22 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Rebuilding the list of instances to heal {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 10:12:22 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "refresh_cache-be9f0ded-8064-4675-99f7-8620f0fe3dda" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:12:22 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquired lock "refresh_cache-be9f0ded-8064-4675-99f7-8620f0fe3dda" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:12:22 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Forcefully refreshing network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 10:12:22 user nova-compute[71113]: DEBUG nova.objects.instance [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lazy-loading 'info_cache' on Instance uuid be9f0ded-8064-4675-99f7-8620f0fe3dda {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:12:23 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Updating instance_info_cache with network_info: [{"id": "a125e6d6-59a1-4aac-8081-abfbe030359b", "address": "fa:16:3e:61:da:b6", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa125e6d6-59", "ovs_interfaceid": "a125e6d6-59a1-4aac-8081-abfbe030359b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:12:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Releasing lock "refresh_cache-be9f0ded-8064-4675-99f7-8620f0fe3dda" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:12:23 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Updated the network info_cache for instance {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 10:12:23 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:12:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:12:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:12:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:12:23 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:12:23 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:12:23 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:12:23 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:12:23 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:12:23 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9299196-6e9b-4a48-9c90-e1e24243a7b1/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:12:23 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9299196-6e9b-4a48-9c90-e1e24243a7b1/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:12:23 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9299196-6e9b-4a48-9c90-e1e24243a7b1/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:12:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9299196-6e9b-4a48-9c90-e1e24243a7b1/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:12:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:12:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:12:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:12:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:12:24 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 10:12:24 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 10:12:24 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:12:24 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:12:24 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=8196MB free_disk=25.268028259277344GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:12:24 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:12:24 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:12:25 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance be9f0ded-8064-4675-99f7-8620f0fe3dda actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:12:25 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:12:25 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:12:25 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 8129456b-a22c-46e3-b5db-89fdcec87dec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:12:25 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance a9299196-6e9b-4a48-9c90-e1e24243a7b1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:12:25 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:12:25 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:12:25 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Refreshing inventories for resource provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 31 10:12:25 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Updating ProviderTree inventory for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 31 10:12:25 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Updating inventory in ProviderTree for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 31 10:12:25 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Refreshing aggregate associations for resource provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05, aggregates: None {{(pid=71113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 31 10:12:25 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Refreshing trait associations for resource provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE2,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS {{(pid=71113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 31 10:12:25 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:12:25 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:12:25 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:12:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.596s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:12:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:12:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:12:26 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:12:26 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:12:26 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:12:26 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:12:26 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Cleaning up deleted instances {{(pid=71113) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 31 10:12:26 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] There are 0 instances to clean {{(pid=71113) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 31 10:12:27 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:12:29 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:12:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:12:30 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:12:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:12:31 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:12:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:12:38 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:12:39 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:12:39 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71113) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 31 10:12:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:12:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Acquiring lock "6102f0cd-8e00-4b93-86a7-3afeb061cf8a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:12:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Lock "6102f0cd-8e00-4b93-86a7-3afeb061cf8a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:12:45 user nova-compute[71113]: DEBUG nova.compute.manager [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Starting instance... {{(pid=71113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 10:12:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:12:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:12:45 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 10:12:45 user nova-compute[71113]: INFO nova.compute.claims [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Claim successful on node user
Jul 31 10:12:45 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:12:45 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:12:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.317s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:12:45 user nova-compute[71113]: DEBUG nova.compute.manager [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Start building networks asynchronously for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 10:12:46 user nova-compute[71113]: DEBUG nova.compute.manager [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Allocating IP information in the background. {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 10:12:46 user nova-compute[71113]: DEBUG nova.network.neutron [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] allocate_for_instance() {{(pid=71113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 10:12:46 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 10:12:46 user nova-compute[71113]: DEBUG nova.compute.manager [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Start building block device mappings for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 10:12:46 user nova-compute[71113]: DEBUG nova.policy [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd6a9d025eb3946fe85ee306bdc8d633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2fb1d4d5074bf4a7c8365902c9a51a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71113) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 10:12:46 user nova-compute[71113]: DEBUG nova.compute.manager [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Start spawning the instance on the hypervisor. {{(pid=71113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 10:12:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 10:12:46 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Creating image(s)
Jul 31 10:12:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Acquiring lock "/opt/stack/data/nova/instances/6102f0cd-8e00-4b93-86a7-3afeb061cf8a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:12:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Lock "/opt/stack/data/nova/instances/6102f0cd-8e00-4b93-86a7-3afeb061cf8a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:12:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Lock "/opt/stack/data/nova/instances/6102f0cd-8e00-4b93-86a7-3afeb061cf8a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:12:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:12:46 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:12:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.145s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:12:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Acquiring lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:12:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:12:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:12:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.142s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:12:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/6102f0cd-8e00-4b93-86a7-3afeb061cf8a/disk 1073741824 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:12:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/6102f0cd-8e00-4b93-86a7-3afeb061cf8a/disk 1073741824" returned: 0 in 0.051s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:12:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:12:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:12:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.133s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:12:46 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6102f0cd-8e00-4b93-86a7-3afeb061cf8a/disk. size=1073741824 {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 10:12:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6102f0cd-8e00-4b93-86a7-3afeb061cf8a/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:12:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6102f0cd-8e00-4b93-86a7-3afeb061cf8a/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:12:46 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Cannot resize image /opt/stack/data/nova/instances/6102f0cd-8e00-4b93-86a7-3afeb061cf8a/disk to a smaller size. {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 10:12:46 user nova-compute[71113]: DEBUG nova.objects.instance [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Lazy-loading 'migration_context' on Instance uuid 6102f0cd-8e00-4b93-86a7-3afeb061cf8a {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:12:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Created local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 10:12:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Ensure instance console log exists: /opt/stack/data/nova/instances/6102f0cd-8e00-4b93-86a7-3afeb061cf8a/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 10:12:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:12:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:12:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:12:47 user nova-compute[71113]: DEBUG nova.network.neutron [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Successfully created port: 1bf042b5-613f-421e-9dc6-401f6fac52d7 {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 10:12:47 user nova-compute[71113]: DEBUG nova.network.neutron [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Successfully updated port: 1bf042b5-613f-421e-9dc6-401f6fac52d7 {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 10:12:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Acquiring lock "refresh_cache-6102f0cd-8e00-4b93-86a7-3afeb061cf8a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:12:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Acquired lock "refresh_cache-6102f0cd-8e00-4b93-86a7-3afeb061cf8a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:12:47 user nova-compute[71113]: DEBUG nova.network.neutron [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 10:12:47 user nova-compute[71113]: DEBUG nova.network.neutron [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 10:12:47 user nova-compute[71113]: DEBUG nova.compute.manager [req-d20fbbd4-6ecf-40e2-88d8-3ba2c71f6081 req-eb29a69c-b083-45da-8efd-b4a364ed42fd service nova] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Received event network-changed-1bf042b5-613f-421e-9dc6-401f6fac52d7 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:12:47 user nova-compute[71113]: DEBUG nova.compute.manager [req-d20fbbd4-6ecf-40e2-88d8-3ba2c71f6081 req-eb29a69c-b083-45da-8efd-b4a364ed42fd service nova] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Refreshing instance network info cache due to event network-changed-1bf042b5-613f-421e-9dc6-401f6fac52d7. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 10:12:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-d20fbbd4-6ecf-40e2-88d8-3ba2c71f6081 req-eb29a69c-b083-45da-8efd-b4a364ed42fd service nova] Acquiring lock "refresh_cache-6102f0cd-8e00-4b93-86a7-3afeb061cf8a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:12:48 user nova-compute[71113]: DEBUG nova.network.neutron [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Updating instance_info_cache with network_info: [{"id": "1bf042b5-613f-421e-9dc6-401f6fac52d7", "address": "fa:16:3e:68:4e:f5", "network": {"id": "8f121ee0-4c42-403b-84ac-8084df1d49d9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "afca600337e543019324e69e8944cdaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf042b5-61", "ovs_interfaceid": "1bf042b5-613f-421e-9dc6-401f6fac52d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:12:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Releasing lock "refresh_cache-6102f0cd-8e00-4b93-86a7-3afeb061cf8a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:12:48 user nova-compute[71113]: DEBUG nova.compute.manager [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Instance network_info: |[{"id": "1bf042b5-613f-421e-9dc6-401f6fac52d7", "address": "fa:16:3e:68:4e:f5", "network": {"id": "8f121ee0-4c42-403b-84ac-8084df1d49d9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "afca600337e543019324e69e8944cdaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf042b5-61", "ovs_interfaceid": "1bf042b5-613f-421e-9dc6-401f6fac52d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 10:12:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-d20fbbd4-6ecf-40e2-88d8-3ba2c71f6081 req-eb29a69c-b083-45da-8efd-b4a364ed42fd service nova] Acquired lock "refresh_cache-6102f0cd-8e00-4b93-86a7-3afeb061cf8a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:12:48 user nova-compute[71113]: DEBUG nova.network.neutron [req-d20fbbd4-6ecf-40e2-88d8-3ba2c71f6081 req-eb29a69c-b083-45da-8efd-b4a364ed42fd service nova] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Refreshing network info cache for port 1bf042b5-613f-421e-9dc6-401f6fac52d7 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 10:12:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Start _get_guest_xml network_info=[{"id": "1bf042b5-613f-421e-9dc6-401f6fac52d7", "address": "fa:16:3e:68:4e:f5", "network": {"id": "8f121ee0-4c42-403b-84ac-8084df1d49d9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "afca600337e543019324e69e8944cdaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf042b5-61", "ovs_interfaceid": "1bf042b5-613f-421e-9dc6-401f6fac52d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'image_id': '078646fe-b504-41ed-a147-61072e903e51'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 10:12:48 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:12:48 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:12:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 10:12:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 10:12:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 10:12:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 10:12:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 10:12:48 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 10:12:48 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 10:12:48 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 10:12:48 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 10:12:48 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 10:12:48 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 10:12:48 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 10:12:48 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 10:12:48 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 10:12:48 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 10:12:48 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 10:12:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:12:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-919523007',display_name='tempest-VolumesNegativeTest-instance-919523007',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-919523007',id=45,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa2fb1d4d5074bf4a7c8365902c9a51a',ramdisk_id='',reservation_id='r-lmmwk0ts',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1097791982',owner_user_name='tempest-VolumesNegativeTest-1097791982-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T10:12:46Z,user_data=None,user_id='d6a9d025eb3946fe85ee306bdc8d633a',uuid=6102f0cd-8e00-4b93-86a7-3afeb061cf8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1bf042b5-613f-421e-9dc6-401f6fac52d7", "address": "fa:16:3e:68:4e:f5", "network": {"id": "8f121ee0-4c42-403b-84ac-8084df1d49d9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "afca600337e543019324e69e8944cdaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf042b5-61", "ovs_interfaceid": "1bf042b5-613f-421e-9dc6-401f6fac52d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 10:12:48 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Converting VIF {"id": "1bf042b5-613f-421e-9dc6-401f6fac52d7", "address": "fa:16:3e:68:4e:f5", "network": {"id": "8f121ee0-4c42-403b-84ac-8084df1d49d9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "afca600337e543019324e69e8944cdaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf042b5-61", "ovs_interfaceid": "1bf042b5-613f-421e-9dc6-401f6fac52d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:12:48 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:4e:f5,bridge_name='br-int',has_traffic_filtering=True,id=1bf042b5-613f-421e-9dc6-401f6fac52d7,network=Network(8f121ee0-4c42-403b-84ac-8084df1d49d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bf042b5-61') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:12:48 user nova-compute[71113]: DEBUG nova.objects.instance [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Lazy-loading 'pci_devices' on Instance uuid 6102f0cd-8e00-4b93-86a7-3afeb061cf8a {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:12:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] End _get_guest_xml xml=<domain type="kvm">
Jul 31 10:12:48 user nova-compute[71113]:   <uuid>6102f0cd-8e00-4b93-86a7-3afeb061cf8a</uuid>
Jul 31 10:12:48 user nova-compute[71113]:   <name>instance-0000002d</name>
Jul 31 10:12:48 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 10:12:48 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 10:12:48 user nova-compute[71113]:   <metadata>
Jul 31 10:12:48 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 10:12:48 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 10:12:48 user nova-compute[71113]:       <nova:name>tempest-VolumesNegativeTest-instance-919523007</nova:name>
Jul 31 10:12:48 user nova-compute[71113]:       <nova:creationTime>2023-07-31 10:12:48</nova:creationTime>
Jul 31 10:12:48 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 10:12:48 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 10:12:48 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 10:12:48 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 10:12:48 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 10:12:48 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 10:12:48 user nova-compute[71113]:       </nova:flavor>
Jul 31 10:12:48 user nova-compute[71113]:       <nova:owner>
Jul 31 10:12:48 user nova-compute[71113]:         <nova:user uuid="d6a9d025eb3946fe85ee306bdc8d633a">tempest-VolumesNegativeTest-1097791982-project-member</nova:user>
Jul 31 10:12:48 user nova-compute[71113]:         <nova:project uuid="fa2fb1d4d5074bf4a7c8365902c9a51a">tempest-VolumesNegativeTest-1097791982</nova:project>
Jul 31 10:12:48 user nova-compute[71113]:       </nova:owner>
Jul 31 10:12:48 user nova-compute[71113]:       <nova:root type="image" uuid="078646fe-b504-41ed-a147-61072e903e51"/>
Jul 31 10:12:48 user nova-compute[71113]:       <nova:ports>
Jul 31 10:12:48 user nova-compute[71113]:         <nova:port uuid="1bf042b5-613f-421e-9dc6-401f6fac52d7">
Jul 31 10:12:48 user nova-compute[71113]:           <nova:ip type="fixed" address="192.168.233.131" ipVersion="4"/>
Jul 31 10:12:48 user nova-compute[71113]:         </nova:port>
Jul 31 10:12:48 user nova-compute[71113]:       </nova:ports>
Jul 31 10:12:48 user nova-compute[71113]:     </nova:instance>
Jul 31 10:12:48 user nova-compute[71113]:   </metadata>
Jul 31 10:12:48 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 10:12:48 user nova-compute[71113]:     <system>
Jul 31 10:12:48 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 10:12:48 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 10:12:48 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 10:12:48 user nova-compute[71113]:       <entry name="serial">6102f0cd-8e00-4b93-86a7-3afeb061cf8a</entry>
Jul 31 10:12:48 user nova-compute[71113]:       <entry name="uuid">6102f0cd-8e00-4b93-86a7-3afeb061cf8a</entry>
Jul 31 10:12:48 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 10:12:48 user nova-compute[71113]:     </system>
Jul 31 10:12:48 user nova-compute[71113]:   </sysinfo>
Jul 31 10:12:48 user nova-compute[71113]:   <os>
Jul 31 10:12:48 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 10:12:48 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 10:12:48 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 10:12:48 user nova-compute[71113]:   </os>
Jul 31 10:12:48 user nova-compute[71113]:   <features>
Jul 31 10:12:48 user nova-compute[71113]:     <acpi/>
Jul 31 10:12:48 user nova-compute[71113]:     <apic/>
Jul 31 10:12:48 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 10:12:48 user nova-compute[71113]:   </features>
Jul 31 10:12:48 user nova-compute[71113]:   <clock offset="utc">
Jul 31 10:12:48 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 10:12:48 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 10:12:48 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 10:12:48 user nova-compute[71113]:   </clock>
Jul 31 10:12:48 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 10:12:48 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 10:12:48 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 10:12:48 user nova-compute[71113]:   </cpu>
Jul 31 10:12:48 user nova-compute[71113]:   <devices>
Jul 31 10:12:48 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 10:12:48 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 10:12:48 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/6102f0cd-8e00-4b93-86a7-3afeb061cf8a/disk"/>
Jul 31 10:12:48 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 10:12:48 user nova-compute[71113]:     </disk>
Jul 31 10:12:48 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 10:12:48 user nova-compute[71113]:       <mac address="fa:16:3e:68:4e:f5"/>
Jul 31 10:12:48 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:12:48 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 10:12:48 user nova-compute[71113]:       <target dev="tap1bf042b5-61"/>
Jul 31 10:12:48 user nova-compute[71113]:     </interface>
Jul 31 10:12:48 user nova-compute[71113]:     <serial type="pty">
Jul 31 10:12:48 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/6102f0cd-8e00-4b93-86a7-3afeb061cf8a/console.log" append="off"/>
Jul 31 10:12:48 user nova-compute[71113]:     </serial>
Jul 31 10:12:48 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 10:12:48 user nova-compute[71113]:     <video>
Jul 31 10:12:48 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:12:48 user nova-compute[71113]:     </video>
Jul 31 10:12:48 user nova-compute[71113]:     <rng model="virtio">
Jul 31 10:12:48 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 10:12:48 user nova-compute[71113]:     </rng>
Jul 31 10:12:48 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 10:12:48 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 10:12:48 user nova-compute[71113]:       <stats period="10"/>
Jul 31 10:12:48 user nova-compute[71113]:     </memballoon>
Jul 31 10:12:48 user nova-compute[71113]:   </devices>
Jul 31 10:12:48 user nova-compute[71113]: </domain>
Jul 31 10:12:48 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 10:12:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:12:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-919523007',display_name='tempest-VolumesNegativeTest-instance-919523007',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-919523007',id=45,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa2fb1d4d5074bf4a7c8365902c9a51a',ramdisk_id='',reservation_id='r-lmmwk0ts',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1097791982',owner_user_name='tempest-VolumesNegativeTest-1097791982-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T10:12:46Z,user_data=None,user_id='d6a9d025eb3946fe85ee306bdc8d633a',uuid=6102f0cd-8e00-4b93-86a7-3afeb061cf8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1bf042b5-613f-421e-9dc6-401f6fac52d7", "address": "fa:16:3e:68:4e:f5", "network": {"id": "8f121ee0-4c42-403b-84ac-8084df1d49d9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "afca600337e543019324e69e8944cdaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf042b5-61", "ovs_interfaceid": "1bf042b5-613f-421e-9dc6-401f6fac52d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 10:12:48 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Converting VIF {"id": "1bf042b5-613f-421e-9dc6-401f6fac52d7", "address": "fa:16:3e:68:4e:f5", "network": {"id": "8f121ee0-4c42-403b-84ac-8084df1d49d9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "afca600337e543019324e69e8944cdaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf042b5-61", "ovs_interfaceid": "1bf042b5-613f-421e-9dc6-401f6fac52d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:12:48 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:4e:f5,bridge_name='br-int',has_traffic_filtering=True,id=1bf042b5-613f-421e-9dc6-401f6fac52d7,network=Network(8f121ee0-4c42-403b-84ac-8084df1d49d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bf042b5-61') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:12:48 user nova-compute[71113]: DEBUG os_vif [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:4e:f5,bridge_name='br-int',has_traffic_filtering=True,id=1bf042b5-613f-421e-9dc6-401f6fac52d7,network=Network(8f121ee0-4c42-403b-84ac-8084df1d49d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bf042b5-61') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 10:12:48 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:12:48 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:12:48 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 10:12:48 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:12:48 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1bf042b5-61, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:12:48 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1bf042b5-61, col_values=(('external_ids', {'iface-id': '1bf042b5-613f-421e-9dc6-401f6fac52d7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:4e:f5', 'vm-uuid': '6102f0cd-8e00-4b93-86a7-3afeb061cf8a'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:12:48 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:12:48 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:12:48 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:12:48 user nova-compute[71113]: INFO os_vif [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:4e:f5,bridge_name='br-int',has_traffic_filtering=True,id=1bf042b5-613f-421e-9dc6-401f6fac52d7,network=Network(8f121ee0-4c42-403b-84ac-8084df1d49d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bf042b5-61')
Jul 31 10:12:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:12:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] No VIF found with MAC fa:16:3e:68:4e:f5, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 10:12:48 user nova-compute[71113]: DEBUG nova.network.neutron [req-d20fbbd4-6ecf-40e2-88d8-3ba2c71f6081 req-eb29a69c-b083-45da-8efd-b4a364ed42fd service nova] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Updated VIF entry in instance network info cache for port 1bf042b5-613f-421e-9dc6-401f6fac52d7. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 10:12:48 user nova-compute[71113]: DEBUG nova.network.neutron [req-d20fbbd4-6ecf-40e2-88d8-3ba2c71f6081 req-eb29a69c-b083-45da-8efd-b4a364ed42fd service nova] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Updating instance_info_cache with network_info: [{"id": "1bf042b5-613f-421e-9dc6-401f6fac52d7", "address": "fa:16:3e:68:4e:f5", "network": {"id": "8f121ee0-4c42-403b-84ac-8084df1d49d9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "afca600337e543019324e69e8944cdaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf042b5-61", "ovs_interfaceid": "1bf042b5-613f-421e-9dc6-401f6fac52d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:12:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-d20fbbd4-6ecf-40e2-88d8-3ba2c71f6081 req-eb29a69c-b083-45da-8efd-b4a364ed42fd service nova] Releasing lock "refresh_cache-6102f0cd-8e00-4b93-86a7-3afeb061cf8a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:12:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:12:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:12:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:12:49 user nova-compute[71113]: DEBUG nova.compute.manager [req-59708f95-2456-4185-882b-ee8f8f7dfe13 req-b15a13e7-efd2-4983-a826-055e73859772 service nova] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Received event network-vif-plugged-1bf042b5-613f-421e-9dc6-401f6fac52d7 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:12:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-59708f95-2456-4185-882b-ee8f8f7dfe13 req-b15a13e7-efd2-4983-a826-055e73859772 service nova] Acquiring lock "6102f0cd-8e00-4b93-86a7-3afeb061cf8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:12:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-59708f95-2456-4185-882b-ee8f8f7dfe13 req-b15a13e7-efd2-4983-a826-055e73859772 service nova] Lock "6102f0cd-8e00-4b93-86a7-3afeb061cf8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:12:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-59708f95-2456-4185-882b-ee8f8f7dfe13 req-b15a13e7-efd2-4983-a826-055e73859772 service nova] Lock "6102f0cd-8e00-4b93-86a7-3afeb061cf8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:12:49 user nova-compute[71113]: DEBUG nova.compute.manager [req-59708f95-2456-4185-882b-ee8f8f7dfe13 req-b15a13e7-efd2-4983-a826-055e73859772 service nova] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] No waiting events found dispatching network-vif-plugged-1bf042b5-613f-421e-9dc6-401f6fac52d7 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:12:49 user nova-compute[71113]: WARNING nova.compute.manager [req-59708f95-2456-4185-882b-ee8f8f7dfe13 req-b15a13e7-efd2-4983-a826-055e73859772 service nova] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Received unexpected event network-vif-plugged-1bf042b5-613f-421e-9dc6-401f6fac52d7 for instance with vm_state building and task_state spawning.
Jul 31 10:12:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:12:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:12:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:12:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:12:51 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690798371.6485276, 6102f0cd-8e00-4b93-86a7-3afeb061cf8a => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:12:51 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] VM Resumed (Lifecycle Event)
Jul 31 10:12:51 user nova-compute[71113]: DEBUG nova.compute.manager [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 10:12:51 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 10:12:51 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Instance spawned successfully.
Jul 31 10:12:51 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 10:12:51 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:12:51 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:12:51 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Found default for hw_cdrom_bus of ide {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:12:51 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Found default for hw_disk_bus of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:12:51 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Found default for hw_input_bus of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:12:51 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Found default for hw_pointer_model of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:12:51 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Found default for hw_video_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:12:51 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Found default for hw_vif_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:12:51 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 10:12:51 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690798371.6502206, 6102f0cd-8e00-4b93-86a7-3afeb061cf8a => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:12:51 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] VM Started (Lifecycle Event)
Jul 31 10:12:51 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:12:51 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:12:51 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 10:12:51 user nova-compute[71113]: INFO nova.compute.manager [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Took 5.58 seconds to spawn the instance on the hypervisor.
Jul 31 10:12:51 user nova-compute[71113]: DEBUG nova.compute.manager [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:12:51 user nova-compute[71113]: INFO nova.compute.manager [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Took 6.22 seconds to build instance.
Jul 31 10:12:51 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-6498de9b-dd19-4896-a1d9-5194c98ee49b tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Lock "6102f0cd-8e00-4b93-86a7-3afeb061cf8a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.316s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:12:51 user nova-compute[71113]: DEBUG nova.compute.manager [req-f7e5eb19-1c5d-488e-9394-bff5d456c90f req-a9e6d143-256e-42e7-8d52-f8af59bbad7d service nova] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Received event network-vif-plugged-1bf042b5-613f-421e-9dc6-401f6fac52d7 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:12:51 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f7e5eb19-1c5d-488e-9394-bff5d456c90f req-a9e6d143-256e-42e7-8d52-f8af59bbad7d service nova] Acquiring lock "6102f0cd-8e00-4b93-86a7-3afeb061cf8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:12:51 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f7e5eb19-1c5d-488e-9394-bff5d456c90f req-a9e6d143-256e-42e7-8d52-f8af59bbad7d service nova] Lock "6102f0cd-8e00-4b93-86a7-3afeb061cf8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:12:51 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f7e5eb19-1c5d-488e-9394-bff5d456c90f req-a9e6d143-256e-42e7-8d52-f8af59bbad7d service nova] Lock "6102f0cd-8e00-4b93-86a7-3afeb061cf8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:12:51 user nova-compute[71113]: DEBUG nova.compute.manager [req-f7e5eb19-1c5d-488e-9394-bff5d456c90f req-a9e6d143-256e-42e7-8d52-f8af59bbad7d service nova] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] No waiting events found dispatching network-vif-plugged-1bf042b5-613f-421e-9dc6-401f6fac52d7 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:12:51 user nova-compute[71113]: WARNING nova.compute.manager [req-f7e5eb19-1c5d-488e-9394-bff5d456c90f req-a9e6d143-256e-42e7-8d52-f8af59bbad7d service nova] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Received unexpected event network-vif-plugged-1bf042b5-613f-421e-9dc6-401f6fac52d7 for instance with vm_state active and task_state None.
Jul 31 10:12:53 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:12:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:12:58 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:13:03 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:13:03 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:13:03 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:13:03 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:13:03 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:13:03 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:13:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:13:06 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:13:06 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Triggering sync for uuid be9f0ded-8064-4675-99f7-8620f0fe3dda {{(pid=71113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 10:13:06 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Triggering sync for uuid ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0 {{(pid=71113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 10:13:06 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Triggering sync for uuid c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5 {{(pid=71113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 10:13:06 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Triggering sync for uuid 8129456b-a22c-46e3-b5db-89fdcec87dec {{(pid=71113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 10:13:06 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Triggering sync for uuid a9299196-6e9b-4a48-9c90-e1e24243a7b1 {{(pid=71113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 10:13:06 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Triggering sync for uuid 6102f0cd-8e00-4b93-86a7-3afeb061cf8a {{(pid=71113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 10:13:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "be9f0ded-8064-4675-99f7-8620f0fe3dda" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:13:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "be9f0ded-8064-4675-99f7-8620f0fe3dda" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:13:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:13:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:13:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:13:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:13:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "8129456b-a22c-46e3-b5db-89fdcec87dec" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:13:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "8129456b-a22c-46e3-b5db-89fdcec87dec" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:13:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "a9299196-6e9b-4a48-9c90-e1e24243a7b1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:13:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "a9299196-6e9b-4a48-9c90-e1e24243a7b1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:13:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "6102f0cd-8e00-4b93-86a7-3afeb061cf8a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:13:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "6102f0cd-8e00-4b93-86a7-3afeb061cf8a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:13:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "be9f0ded-8064-4675-99f7-8620f0fe3dda" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:13:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:13:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:13:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "8129456b-a22c-46e3-b5db-89fdcec87dec" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:13:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "6102f0cd-8e00-4b93-86a7-3afeb061cf8a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:13:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "a9299196-6e9b-4a48-9c90-e1e24243a7b1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:13:08 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:13:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:13:13 user nova-compute[71113]: DEBUG nova.compute.manager [req-d38e821f-8067-4407-9b4a-384255675d4d req-0aa2e86e-7435-4ee4-95a6-48f25aeec8ff service nova] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Received event network-changed-c062800c-3049-4e28-a410-673e4be25d41 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:13:13 user nova-compute[71113]: DEBUG nova.compute.manager [req-d38e821f-8067-4407-9b4a-384255675d4d req-0aa2e86e-7435-4ee4-95a6-48f25aeec8ff service nova] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Refreshing instance network info cache due to event network-changed-c062800c-3049-4e28-a410-673e4be25d41. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 10:13:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-d38e821f-8067-4407-9b4a-384255675d4d req-0aa2e86e-7435-4ee4-95a6-48f25aeec8ff service nova] Acquiring lock "refresh_cache-ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:13:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-d38e821f-8067-4407-9b4a-384255675d4d req-0aa2e86e-7435-4ee4-95a6-48f25aeec8ff service nova] Acquired lock "refresh_cache-ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:13:13 user nova-compute[71113]: DEBUG nova.network.neutron [req-d38e821f-8067-4407-9b4a-384255675d4d req-0aa2e86e-7435-4ee4-95a6-48f25aeec8ff service nova] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Refreshing network info cache for port c062800c-3049-4e28-a410-673e4be25d41 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 10:13:13 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:13:13 user nova-compute[71113]: DEBUG nova.network.neutron [req-d38e821f-8067-4407-9b4a-384255675d4d req-0aa2e86e-7435-4ee4-95a6-48f25aeec8ff service nova] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Updated VIF entry in instance network info cache for port c062800c-3049-4e28-a410-673e4be25d41. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 10:13:13 user nova-compute[71113]: DEBUG nova.network.neutron [req-d38e821f-8067-4407-9b4a-384255675d4d req-0aa2e86e-7435-4ee4-95a6-48f25aeec8ff service nova] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Updating instance_info_cache with network_info: [{"id": "c062800c-3049-4e28-a410-673e4be25d41", "address": "fa:16:3e:ed:94:5f", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc062800c-30", "ovs_interfaceid": "c062800c-3049-4e28-a410-673e4be25d41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:13:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-d38e821f-8067-4407-9b4a-384255675d4d req-0aa2e86e-7435-4ee4-95a6-48f25aeec8ff service nova] Releasing lock "refresh_cache-ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:13:13 user nova-compute[71113]: DEBUG nova.compute.manager [req-5f77f21b-5a42-486e-89d6-c32bd6e4af6e req-90128571-8ee2-4a66-9487-03449f68a6c1 service nova] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Received event network-changed-c062800c-3049-4e28-a410-673e4be25d41 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:13:13 user nova-compute[71113]: DEBUG nova.compute.manager [req-5f77f21b-5a42-486e-89d6-c32bd6e4af6e req-90128571-8ee2-4a66-9487-03449f68a6c1 service nova] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Refreshing instance network info cache due to event network-changed-c062800c-3049-4e28-a410-673e4be25d41. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 10:13:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-5f77f21b-5a42-486e-89d6-c32bd6e4af6e req-90128571-8ee2-4a66-9487-03449f68a6c1 service nova] Acquiring lock "refresh_cache-ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:13:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-5f77f21b-5a42-486e-89d6-c32bd6e4af6e req-90128571-8ee2-4a66-9487-03449f68a6c1 service nova] Acquired lock "refresh_cache-ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:13:13 user nova-compute[71113]: DEBUG nova.network.neutron [req-5f77f21b-5a42-486e-89d6-c32bd6e4af6e req-90128571-8ee2-4a66-9487-03449f68a6c1 service nova] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Refreshing network info cache for port c062800c-3049-4e28-a410-673e4be25d41 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 10:13:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7fea93f3-9aba-4036-acce-e26e54dc2298 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:13:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7fea93f3-9aba-4036-acce-e26e54dc2298 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:13:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7fea93f3-9aba-4036-acce-e26e54dc2298 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:13:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7fea93f3-9aba-4036-acce-e26e54dc2298 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:13:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7fea93f3-9aba-4036-acce-e26e54dc2298 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:13:14 user nova-compute[71113]: INFO nova.compute.manager [None req-7fea93f3-9aba-4036-acce-e26e54dc2298 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Terminating instance
Jul 31 10:13:14 user nova-compute[71113]: DEBUG nova.compute.manager [None req-7fea93f3-9aba-4036-acce-e26e54dc2298 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Start destroying the instance on the hypervisor. {{(pid=71113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 10:13:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:13:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:13:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:13:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:13:14 user nova-compute[71113]: DEBUG nova.network.neutron [req-5f77f21b-5a42-486e-89d6-c32bd6e4af6e req-90128571-8ee2-4a66-9487-03449f68a6c1 service nova] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Updated VIF entry in instance network info cache for port c062800c-3049-4e28-a410-673e4be25d41. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 10:13:14 user nova-compute[71113]: DEBUG nova.network.neutron [req-5f77f21b-5a42-486e-89d6-c32bd6e4af6e req-90128571-8ee2-4a66-9487-03449f68a6c1 service nova] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Updating instance_info_cache with network_info: [{"id": "c062800c-3049-4e28-a410-673e4be25d41", "address": "fa:16:3e:ed:94:5f", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc062800c-30", "ovs_interfaceid": "c062800c-3049-4e28-a410-673e4be25d41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:13:14 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-5f77f21b-5a42-486e-89d6-c32bd6e4af6e req-90128571-8ee2-4a66-9487-03449f68a6c1 service nova] Releasing lock "refresh_cache-ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:13:14 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Instance destroyed successfully.
Jul 31 10:13:14 user nova-compute[71113]: DEBUG nova.objects.instance [None req-7fea93f3-9aba-4036-acce-e26e54dc2298 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lazy-loading 'resources' on Instance uuid ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:13:14 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-7fea93f3-9aba-4036-acce-e26e54dc2298 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:11:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1715148138',display_name='tempest-TestVolumeBootPattern-server-1715148138',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1715148138',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHyhNSNVW4Lo+ZOw5JhvHTNH16DxMgCVmk57hIQmCoVWxH+PN+/8jM3YwsIxSsGBxRIiU3keHG6Pnt6GG0CTGlGIZ1kKVEix0HYiRgqMpyBqoT4aBeWmvyv0uyNPZ+vFFg==',key_name='tempest-TestVolumeBootPattern-165282511',keypairs=<?>,launch_index=0,launched_at=2023-07-31T10:11:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3aa2add2e2a24b9cb8e48042b06931d3',ramdisk_id='',reservation_id='r-y365ikui',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1754399827',owner_user_name='tempest-TestVolumeBootPattern-1754399827-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T10:11:34Z,user_data=None,user_id='a58fe92488ed47b696fc5d6d990b1acd',uuid=ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c062800c-3049-4e28-a410-673e4be25d41", "address": "fa:16:3e:ed:94:5f", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc062800c-30", "ovs_interfaceid": "c062800c-3049-4e28-a410-673e4be25d41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 10:13:14 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-7fea93f3-9aba-4036-acce-e26e54dc2298 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Converting VIF {"id": "c062800c-3049-4e28-a410-673e4be25d41", "address": "fa:16:3e:ed:94:5f", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc062800c-30", "ovs_interfaceid": "c062800c-3049-4e28-a410-673e4be25d41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:13:14 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-7fea93f3-9aba-4036-acce-e26e54dc2298 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:94:5f,bridge_name='br-int',has_traffic_filtering=True,id=c062800c-3049-4e28-a410-673e4be25d41,network=Network(fa792d7a-ddf6-4a2d-acb9-802f8daf87ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc062800c-30') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:13:14 user nova-compute[71113]: DEBUG os_vif [None req-7fea93f3-9aba-4036-acce-e26e54dc2298 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:94:5f,bridge_name='br-int',has_traffic_filtering=True,id=c062800c-3049-4e28-a410-673e4be25d41,network=Network(fa792d7a-ddf6-4a2d-acb9-802f8daf87ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc062800c-30') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 10:13:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:13:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc062800c-30, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:13:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:13:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:13:14 user nova-compute[71113]: INFO os_vif [None req-7fea93f3-9aba-4036-acce-e26e54dc2298 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:94:5f,bridge_name='br-int',has_traffic_filtering=True,id=c062800c-3049-4e28-a410-673e4be25d41,network=Network(fa792d7a-ddf6-4a2d-acb9-802f8daf87ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc062800c-30')
Jul 31 10:13:14 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fea93f3-9aba-4036-acce-e26e54dc2298 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 10:13:14 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fea93f3-9aba-4036-acce-e26e54dc2298 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:6f4aab43-8b49-4c2a-b588-c9d5ba6d038d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eBqVFOWk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:13:14 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-7fea93f3-9aba-4036-acce-e26e54dc2298 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:13:14 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-7fea93f3-9aba-4036-acce-e26e54dc2298 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:13:14 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-7fea93f3-9aba-4036-acce-e26e54dc2298 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:13:14 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fea93f3-9aba-4036-acce-e26e54dc2298 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f4aab43-8b49-4c2a-b588-c9d5ba6d038d', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 10:13:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:13:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:13:14 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1130a59b-37d6-4bfc-9878-dbac5f902c81]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f4aab43-8b49-4c2a-b588-c9d5ba6d038d\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:13:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:13:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:13:14 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[856a8635-6575-4420-ab30-8be0a649557b]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f4aab43-8b49-4c2a-b588-c9d5ba6d038d (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:13:14 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fea93f3-9aba-4036-acce-e26e54dc2298 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)
Jul 31 10:13:14 user nova-compute[71113]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f4aab43-8b49-4c2a-b588-c9d5ba6d038d (non-flash)
Jul 31 10:13:14 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:13:14 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fea93f3-9aba-4036-acce-e26e54dc2298 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)
Jul 31 10:13:14 user nova-compute[71113]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f4aab43-8b49-4c2a-b588-c9d5ba6d038d (non-flash)
Jul 31 10:13:14 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:13:14 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fea93f3-9aba-4036-acce-e26e54dc2298 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f78f06b2560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f4aab43-8b49-4c2a-b588-c9d5ba6d038d'): ({'sdb'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 10:13:14 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-7fea93f3-9aba-4036-acce-e26e54dc2298 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Removing single pathed devices sdb {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 10:13:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:13:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:13:14 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e591f3f-56fe-4cdb-abc5-849485c06595]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:13:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:13:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:13:14 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae470ae-7f4c-46cd-9cbb-839a980a327b]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:13:14 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-7fea93f3-9aba-4036-acce-e26e54dc2298 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Flushing IO for device /dev/sdb {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 10:13:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:13:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:13:14 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d7b095-f42d-41a4-82b0-545cd3c28803]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:13:14 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-7fea93f3-9aba-4036-acce-e26e54dc2298 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 10:13:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:13:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:13:14 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94450e1-0f54-4856-b552-f087a4521978]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:13:14 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-7fea93f3-9aba-4036-acce-e26e54dc2298 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 10:13:14 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-7fea93f3-9aba-4036-acce-e26e54dc2298 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] SCSI volumes sdb have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 10:13:14 user nova-compute[71113]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO5dc26981-3f7bd6372f43c1ed', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_5dc26981', '/dev/disk/by-id/scsi-23366376264363337') {{(pid=81983) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 31 10:13:14 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf518e6-f0f0-44dc-bb72-b651e2c49960]: (4, None) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:13:14 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fea93f3-9aba-4036-acce-e26e54dc2298 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f4aab43-8b49-4c2a-b588-c9d5ba6d038d')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 10:13:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f4aab43-8b49-4c2a-b588-c9d5ba6d038d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:13:15 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f4aab43-8b49-4c2a-b588-c9d5ba6d038d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:13:15 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8c85e6-313d-4347-8a47-c3bad8210a6c]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:13:15 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fea93f3-9aba-4036-acce-e26e54dc2298 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:13:15 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f4aab43-8b49-4c2a-b588-c9d5ba6d038d -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:13:15 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f4aab43-8b49-4c2a-b588-c9d5ba6d038d -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:13:15 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[02687f23-2b37-4531-a891-2a119ed76c77]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:6f4aab43-8b49-4c2a-b588-c9d5ba6d038d, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:6f4aab43-8b49-4c2a-b588-c9d5ba6d038d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:13:15 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fea93f3-9aba-4036-acce-e26e54dc2298 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:6f4aab43-8b49-4c2a-b588-c9d5ba6d038d, portal: 172.16.0.220,3260]
Jul 31 10:13:15 user nova-compute[71113]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:6f4aab43-8b49-4c2a-b588-c9d5ba6d038d, portal: 172.16.0.220,3260] successful.
Jul 31 10:13:15 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:13:15 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f4aab43-8b49-4c2a-b588-c9d5ba6d038d -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:13:15 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f4aab43-8b49-4c2a-b588-c9d5ba6d038d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:13:15 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[808ef3b0-1a66-4cc7-978a-438772b5c315]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:13:15 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fea93f3-9aba-4036-acce-e26e54dc2298 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:13:15 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-7fea93f3-9aba-4036-acce-e26e54dc2298 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:13:15 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fea93f3-9aba-4036-acce-e26e54dc2298 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] <== disconnect_volume: return (278ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:13:15 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fea93f3-9aba-4036-acce-e26e54dc2298 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 10:13:15 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-7fea93f3-9aba-4036-acce-e26e54dc2298 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Deleting instance files /opt/stack/data/nova/instances/ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0_del
Jul 31 10:13:15 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-7fea93f3-9aba-4036-acce-e26e54dc2298 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Deletion of /opt/stack/data/nova/instances/ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0_del complete
Jul 31 10:13:15 user nova-compute[71113]: INFO nova.compute.manager [None req-7fea93f3-9aba-4036-acce-e26e54dc2298 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Took 1.15 seconds to destroy the instance on the hypervisor.
Jul 31 10:13:15 user nova-compute[71113]: DEBUG oslo.service.loopingcall [None req-7fea93f3-9aba-4036-acce-e26e54dc2298 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71113) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 10:13:15 user nova-compute[71113]: DEBUG nova.compute.manager [-] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Deallocating network for instance {{(pid=71113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 10:13:15 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] deallocate_for_instance() {{(pid=71113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 10:13:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:13:15 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:13:15 user nova-compute[71113]: DEBUG nova.compute.manager [req-aedd52e2-f689-47ef-a597-e3b5cf5889c3 req-ed62b9f5-a7a8-48b0-865f-0793996e0640 service nova] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Received event network-vif-unplugged-c062800c-3049-4e28-a410-673e4be25d41 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:13:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-aedd52e2-f689-47ef-a597-e3b5cf5889c3 req-ed62b9f5-a7a8-48b0-865f-0793996e0640 service nova] Acquiring lock "ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:13:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-aedd52e2-f689-47ef-a597-e3b5cf5889c3 req-ed62b9f5-a7a8-48b0-865f-0793996e0640 service nova] Lock "ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:13:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-aedd52e2-f689-47ef-a597-e3b5cf5889c3 req-ed62b9f5-a7a8-48b0-865f-0793996e0640 service nova] Lock "ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:13:15 user nova-compute[71113]: DEBUG nova.compute.manager [req-aedd52e2-f689-47ef-a597-e3b5cf5889c3 req-ed62b9f5-a7a8-48b0-865f-0793996e0640 service nova] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] No waiting events found dispatching network-vif-unplugged-c062800c-3049-4e28-a410-673e4be25d41 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:13:15 user nova-compute[71113]: DEBUG nova.compute.manager [req-aedd52e2-f689-47ef-a597-e3b5cf5889c3 req-ed62b9f5-a7a8-48b0-865f-0793996e0640 service nova] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Received event network-vif-unplugged-c062800c-3049-4e28-a410-673e4be25d41 for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 10:13:15 user nova-compute[71113]: DEBUG nova.compute.manager [req-aedd52e2-f689-47ef-a597-e3b5cf5889c3 req-ed62b9f5-a7a8-48b0-865f-0793996e0640 service nova] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Received event network-vif-plugged-c062800c-3049-4e28-a410-673e4be25d41 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:13:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-aedd52e2-f689-47ef-a597-e3b5cf5889c3 req-ed62b9f5-a7a8-48b0-865f-0793996e0640 service nova] Acquiring lock "ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:13:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-aedd52e2-f689-47ef-a597-e3b5cf5889c3 req-ed62b9f5-a7a8-48b0-865f-0793996e0640 service nova] Lock "ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:13:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-aedd52e2-f689-47ef-a597-e3b5cf5889c3 req-ed62b9f5-a7a8-48b0-865f-0793996e0640 service nova] Lock "ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:13:15 user nova-compute[71113]: DEBUG nova.compute.manager [req-aedd52e2-f689-47ef-a597-e3b5cf5889c3 req-ed62b9f5-a7a8-48b0-865f-0793996e0640 service nova] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] No waiting events found dispatching network-vif-plugged-c062800c-3049-4e28-a410-673e4be25d41 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:13:15 user nova-compute[71113]: WARNING nova.compute.manager [req-aedd52e2-f689-47ef-a597-e3b5cf5889c3 req-ed62b9f5-a7a8-48b0-865f-0793996e0640 service nova] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Received unexpected event network-vif-plugged-c062800c-3049-4e28-a410-673e4be25d41 for instance with vm_state active and task_state deleting.
Jul 31 10:13:16 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:13:16 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Took 0.89 seconds to deallocate network for instance.
Jul 31 10:13:16 user nova-compute[71113]: DEBUG nova.compute.manager [req-b3a2ab15-8e3a-49db-ad04-69b070b711c1 req-f3913583-2498-4e6d-a957-bdad405e81d5 service nova] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Received event network-vif-deleted-c062800c-3049-4e28-a410-673e4be25d41 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:13:16 user nova-compute[71113]: INFO nova.compute.manager [None req-7fea93f3-9aba-4036-acce-e26e54dc2298 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Took 0.73 seconds to detach 1 volumes for instance.
Jul 31 10:13:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7fea93f3-9aba-4036-acce-e26e54dc2298 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:13:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7fea93f3-9aba-4036-acce-e26e54dc2298 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:13:17 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-7fea93f3-9aba-4036-acce-e26e54dc2298 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:13:17 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-7fea93f3-9aba-4036-acce-e26e54dc2298 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:13:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7fea93f3-9aba-4036-acce-e26e54dc2298 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.231s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:13:17 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-7fea93f3-9aba-4036-acce-e26e54dc2298 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Deleted allocations for instance ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0
Jul 31 10:13:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-7fea93f3-9aba-4036-acce-e26e54dc2298 tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.176s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:13:17 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:13:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:13:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:13:21 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:13:23 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:13:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:13:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:13:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:13:23 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:13:23 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:13:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:13:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:13:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:13:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9299196-6e9b-4a48-9c90-e1e24243a7b1/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:13:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9299196-6e9b-4a48-9c90-e1e24243a7b1/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:13:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9299196-6e9b-4a48-9c90-e1e24243a7b1/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:13:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9299196-6e9b-4a48-9c90-e1e24243a7b1/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:13:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:13:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:13:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:13:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:13:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6102f0cd-8e00-4b93-86a7-3afeb061cf8a/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:13:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:13:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6102f0cd-8e00-4b93-86a7-3afeb061cf8a/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:13:24 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6102f0cd-8e00-4b93-86a7-3afeb061cf8a/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:13:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6102f0cd-8e00-4b93-86a7-3afeb061cf8a/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:13:25 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 10:13:25 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:13:25 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:13:25 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=8203MB free_disk=25.237136840820312GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:13:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:13:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:13:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:13:25 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance be9f0ded-8064-4675-99f7-8620f0fe3dda actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:13:25 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:13:25 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 8129456b-a22c-46e3-b5db-89fdcec87dec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:13:25 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance a9299196-6e9b-4a48-9c90-e1e24243a7b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:13:25 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 6102f0cd-8e00-4b93-86a7-3afeb061cf8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:13:25 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:13:25 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:13:25 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:13:25 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:13:25 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:13:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.309s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:13:26 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:13:26 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:13:26 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "refresh_cache-c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:13:26 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquired lock "refresh_cache-c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:13:26 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Forcefully refreshing network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 10:13:27 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Updating instance_info_cache with network_info: [{"id": "85692854-658a-459b-9ab0-f448a6bf83f2", "address": "fa:16:3e:2b:2c:47", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85692854-65", "ovs_interfaceid": "85692854-658a-459b-9ab0-f448a6bf83f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:13:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Releasing lock "refresh_cache-c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:13:27 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Updated the network info_cache for instance {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 10:13:27 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:13:27 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:13:27 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:13:29 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690798394.7566006, ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0 => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:13:29 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] VM Stopped (Lifecycle Event)
Jul 31 10:13:29 user nova-compute[71113]: DEBUG nova.compute.manager [None req-510a8552-4429-4dc7-98bb-5513b97afd8d None None] [instance: ef5d8fdd-3cad-46aa-9a7f-f5380bd4a9e0] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:13:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:13:30 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:13:31 user nova-compute[71113]: INFO nova.compute.manager [None req-88c7159a-b63c-4c17-b139-d376125db630 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Rescuing
Jul 31 10:13:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-88c7159a-b63c-4c17-b139-d376125db630 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Acquiring lock "refresh_cache-8129456b-a22c-46e3-b5db-89fdcec87dec" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:13:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-88c7159a-b63c-4c17-b139-d376125db630 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Acquired lock "refresh_cache-8129456b-a22c-46e3-b5db-89fdcec87dec" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:13:31 user nova-compute[71113]: DEBUG nova.network.neutron [None req-88c7159a-b63c-4c17-b139-d376125db630 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 10:13:31 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:13:32 user nova-compute[71113]: DEBUG nova.network.neutron [None req-88c7159a-b63c-4c17-b139-d376125db630 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Updating instance_info_cache with network_info: [{"id": "1a2da0f9-2fb6-4880-96b5-be8dd9d12574", "address": "fa:16:3e:fe:2b:04", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a2da0f9-2f", "ovs_interfaceid": "1a2da0f9-2fb6-4880-96b5-be8dd9d12574", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:13:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-88c7159a-b63c-4c17-b139-d376125db630 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Releasing lock "refresh_cache-8129456b-a22c-46e3-b5db-89fdcec87dec" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:13:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:13:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:13:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:13:32 user nova-compute[71113]: DEBUG nova.compute.manager [req-b7604da6-16bb-428a-aad3-7a8ff02473f5 req-341e0d2b-b52a-4603-a5e4-38a5224cd6c4 service nova] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Received event network-vif-unplugged-1a2da0f9-2fb6-4880-96b5-be8dd9d12574 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:13:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-b7604da6-16bb-428a-aad3-7a8ff02473f5 req-341e0d2b-b52a-4603-a5e4-38a5224cd6c4 service nova] Acquiring lock "8129456b-a22c-46e3-b5db-89fdcec87dec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:13:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-b7604da6-16bb-428a-aad3-7a8ff02473f5 req-341e0d2b-b52a-4603-a5e4-38a5224cd6c4 service nova] Lock "8129456b-a22c-46e3-b5db-89fdcec87dec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:13:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-b7604da6-16bb-428a-aad3-7a8ff02473f5 req-341e0d2b-b52a-4603-a5e4-38a5224cd6c4 service nova] Lock "8129456b-a22c-46e3-b5db-89fdcec87dec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:13:32 user nova-compute[71113]: DEBUG nova.compute.manager [req-b7604da6-16bb-428a-aad3-7a8ff02473f5 req-341e0d2b-b52a-4603-a5e4-38a5224cd6c4 service nova] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] No waiting events found dispatching network-vif-unplugged-1a2da0f9-2fb6-4880-96b5-be8dd9d12574 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:13:32 user nova-compute[71113]: WARNING nova.compute.manager [req-b7604da6-16bb-428a-aad3-7a8ff02473f5 req-341e0d2b-b52a-4603-a5e4-38a5224cd6c4 service nova] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Received unexpected event network-vif-unplugged-1a2da0f9-2fb6-4880-96b5-be8dd9d12574 for instance with vm_state active and task_state rescuing.
Jul 31 10:13:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:13:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:13:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:13:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:13:32 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Instance destroyed successfully.
Jul 31 10:13:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:13:32 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-88c7159a-b63c-4c17-b139-d376125db630 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Attempting rescue
Jul 31 10:13:32 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-88c7159a-b63c-4c17-b139-d376125db630 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71113) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 31 10:13:32 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-88c7159a-b63c-4c17-b139-d376125db630 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Instance directory exists: not creating {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 31 10:13:32 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-88c7159a-b63c-4c17-b139-d376125db630 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Creating image(s)
Jul 31 10:13:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-88c7159a-b63c-4c17-b139-d376125db630 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Acquiring lock "/opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:13:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-88c7159a-b63c-4c17-b139-d376125db630 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "/opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:13:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-88c7159a-b63c-4c17-b139-d376125db630 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "/opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:13:32 user nova-compute[71113]: DEBUG nova.objects.instance [None req-88c7159a-b63c-4c17-b139-d376125db630 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8129456b-a22c-46e3-b5db-89fdcec87dec {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:13:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-88c7159a-b63c-4c17-b139-d376125db630 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Acquiring lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:13:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-88c7159a-b63c-4c17-b139-d376125db630 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:13:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-88c7159a-b63c-4c17-b139-d376125db630 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:13:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-88c7159a-b63c-4c17-b139-d376125db630 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.142s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:13:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-88c7159a-b63c-4c17-b139-d376125db630 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:13:33 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:13:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-88c7159a-b63c-4c17-b139-d376125db630 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue" returned: 0 in 0.061s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:13:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-88c7159a-b63c-4c17-b139-d376125db630 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.209s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:13:33 user nova-compute[71113]: DEBUG nova.objects.instance [None req-88c7159a-b63c-4c17-b139-d376125db630 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lazy-loading 'migration_context' on Instance uuid 8129456b-a22c-46e3-b5db-89fdcec87dec {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:13:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-88c7159a-b63c-4c17-b139-d376125db630 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Created local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 10:13:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-88c7159a-b63c-4c17-b139-d376125db630 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Start _get_guest_xml network_info=[{"id": "1a2da0f9-2fb6-4880-96b5-be8dd9d12574", "address": "fa:16:3e:fe:2b:04", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "vif_mac": "fa:16:3e:fe:2b:04"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a2da0f9-2f", "ovs_interfaceid": "1a2da0f9-2fb6-4880-96b5-be8dd9d12574", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '078646fe-b504-41ed-a147-61072e903e51', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 10:13:33 user nova-compute[71113]: DEBUG nova.objects.instance [None req-88c7159a-b63c-4c17-b139-d376125db630 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lazy-loading 'resources' on Instance uuid 8129456b-a22c-46e3-b5db-89fdcec87dec {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:13:33 user nova-compute[71113]: DEBUG nova.objects.instance [None req-88c7159a-b63c-4c17-b139-d376125db630 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lazy-loading 'numa_topology' on Instance uuid 8129456b-a22c-46e3-b5db-89fdcec87dec {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:13:33 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-88c7159a-b63c-4c17-b139-d376125db630 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:13:33 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-88c7159a-b63c-4c17-b139-d376125db630 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:13:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-88c7159a-b63c-4c17-b139-d376125db630 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 10:13:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-88c7159a-b63c-4c17-b139-d376125db630 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 10:13:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-88c7159a-b63c-4c17-b139-d376125db630 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 10:13:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-88c7159a-b63c-4c17-b139-d376125db630 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 10:13:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-88c7159a-b63c-4c17-b139-d376125db630 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 10:13:33 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-88c7159a-b63c-4c17-b139-d376125db630 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 10:13:33 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-88c7159a-b63c-4c17-b139-d376125db630 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 10:13:33 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-88c7159a-b63c-4c17-b139-d376125db630 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 10:13:33 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-88c7159a-b63c-4c17-b139-d376125db630 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 10:13:33 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-88c7159a-b63c-4c17-b139-d376125db630 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 10:13:33 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-88c7159a-b63c-4c17-b139-d376125db630 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 10:13:33 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-88c7159a-b63c-4c17-b139-d376125db630 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 10:13:33 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-88c7159a-b63c-4c17-b139-d376125db630 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 10:13:33 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-88c7159a-b63c-4c17-b139-d376125db630 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 10:13:33 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-88c7159a-b63c-4c17-b139-d376125db630 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 10:13:33 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-88c7159a-b63c-4c17-b139-d376125db630 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 10:13:33 user nova-compute[71113]: DEBUG nova.objects.instance [None req-88c7159a-b63c-4c17-b139-d376125db630 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8129456b-a22c-46e3-b5db-89fdcec87dec {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:13:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-88c7159a-b63c-4c17-b139-d376125db630 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:11:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-271752726',display_name='tempest-ServerRescueNegativeTestJSON-server-271752726',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-271752726',id=43,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T10:11:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='938c4f5af8a347cf9d700c8cdb5df356',ramdisk_id='',reservation_id='r-10x57duk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-549904406',owner_user_name='tempest-ServerRescueNegativeTestJSON-549904406-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T10:11:49Z,user_data=None,user_id='6023b7c67c0941d3975fa9c25140684f',uuid=8129456b-a22c-46e3-b5db-89fdcec87dec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1a2da0f9-2fb6-4880-96b5-be8dd9d12574", "address": "fa:16:3e:fe:2b:04", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "vif_mac": "fa:16:3e:fe:2b:04"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a2da0f9-2f", "ovs_interfaceid": "1a2da0f9-2fb6-4880-96b5-be8dd9d12574", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 10:13:33 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-88c7159a-b63c-4c17-b139-d376125db630 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Converting VIF {"id": "1a2da0f9-2fb6-4880-96b5-be8dd9d12574", "address": "fa:16:3e:fe:2b:04", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "vif_mac": "fa:16:3e:fe:2b:04"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a2da0f9-2f", "ovs_interfaceid": "1a2da0f9-2fb6-4880-96b5-be8dd9d12574", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:13:33 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-88c7159a-b63c-4c17-b139-d376125db630 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:2b:04,bridge_name='br-int',has_traffic_filtering=True,id=1a2da0f9-2fb6-4880-96b5-be8dd9d12574,network=Network(328e0f8b-5788-457c-afc6-7fe314ca8b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a2da0f9-2f') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:13:33 user nova-compute[71113]: DEBUG nova.objects.instance [None req-88c7159a-b63c-4c17-b139-d376125db630 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lazy-loading 'pci_devices' on Instance uuid 8129456b-a22c-46e3-b5db-89fdcec87dec {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:13:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-88c7159a-b63c-4c17-b139-d376125db630 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] End _get_guest_xml xml=<domain type="kvm">
Jul 31 10:13:33 user nova-compute[71113]:   <uuid>8129456b-a22c-46e3-b5db-89fdcec87dec</uuid>
Jul 31 10:13:33 user nova-compute[71113]:   <name>instance-0000002b</name>
Jul 31 10:13:33 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 10:13:33 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 10:13:33 user nova-compute[71113]:   <metadata>
Jul 31 10:13:33 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 10:13:33 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 10:13:33 user nova-compute[71113]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-271752726</nova:name>
Jul 31 10:13:33 user nova-compute[71113]:       <nova:creationTime>2023-07-31 10:13:33</nova:creationTime>
Jul 31 10:13:33 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 10:13:33 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 10:13:33 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 10:13:33 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 10:13:33 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 10:13:33 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 10:13:33 user nova-compute[71113]:       </nova:flavor>
Jul 31 10:13:33 user nova-compute[71113]:       <nova:owner>
Jul 31 10:13:33 user nova-compute[71113]:         <nova:user uuid="6023b7c67c0941d3975fa9c25140684f">tempest-ServerRescueNegativeTestJSON-549904406-project-member</nova:user>
Jul 31 10:13:33 user nova-compute[71113]:         <nova:project uuid="938c4f5af8a347cf9d700c8cdb5df356">tempest-ServerRescueNegativeTestJSON-549904406</nova:project>
Jul 31 10:13:33 user nova-compute[71113]:       </nova:owner>
Jul 31 10:13:33 user nova-compute[71113]:       <nova:root type="image" uuid="078646fe-b504-41ed-a147-61072e903e51"/>
Jul 31 10:13:33 user nova-compute[71113]:       <nova:ports>
Jul 31 10:13:33 user nova-compute[71113]:         <nova:port uuid="1a2da0f9-2fb6-4880-96b5-be8dd9d12574">
Jul 31 10:13:33 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 31 10:13:33 user nova-compute[71113]:         </nova:port>
Jul 31 10:13:33 user nova-compute[71113]:       </nova:ports>
Jul 31 10:13:33 user nova-compute[71113]:     </nova:instance>
Jul 31 10:13:33 user nova-compute[71113]:   </metadata>
Jul 31 10:13:33 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 10:13:33 user nova-compute[71113]:     <system>
Jul 31 10:13:33 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 10:13:33 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 10:13:33 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 10:13:33 user nova-compute[71113]:       <entry name="serial">8129456b-a22c-46e3-b5db-89fdcec87dec</entry>
Jul 31 10:13:33 user nova-compute[71113]:       <entry name="uuid">8129456b-a22c-46e3-b5db-89fdcec87dec</entry>
Jul 31 10:13:33 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 10:13:33 user nova-compute[71113]:     </system>
Jul 31 10:13:33 user nova-compute[71113]:   </sysinfo>
Jul 31 10:13:33 user nova-compute[71113]:   <os>
Jul 31 10:13:33 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 10:13:33 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 10:13:33 user nova-compute[71113]:   </os>
Jul 31 10:13:33 user nova-compute[71113]:   <features>
Jul 31 10:13:33 user nova-compute[71113]:     <acpi/>
Jul 31 10:13:33 user nova-compute[71113]:     <apic/>
Jul 31 10:13:33 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 10:13:33 user nova-compute[71113]:   </features>
Jul 31 10:13:33 user nova-compute[71113]:   <clock offset="utc">
Jul 31 10:13:33 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 10:13:33 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 10:13:33 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 10:13:33 user nova-compute[71113]:   </clock>
Jul 31 10:13:33 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 10:13:33 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 10:13:33 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 10:13:33 user nova-compute[71113]:   </cpu>
Jul 31 10:13:33 user nova-compute[71113]:   <devices>
Jul 31 10:13:33 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 10:13:33 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 10:13:33 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue"/>
Jul 31 10:13:33 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 10:13:33 user nova-compute[71113]:     </disk>
Jul 31 10:13:33 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 10:13:33 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 10:13:33 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk"/>
Jul 31 10:13:33 user nova-compute[71113]:       <target dev="vdb" bus="virtio"/>
Jul 31 10:13:33 user nova-compute[71113]:     </disk>
Jul 31 10:13:33 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 10:13:33 user nova-compute[71113]:       <mac address="fa:16:3e:fe:2b:04"/>
Jul 31 10:13:33 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:13:33 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 10:13:33 user nova-compute[71113]:       <target dev="tap1a2da0f9-2f"/>
Jul 31 10:13:33 user nova-compute[71113]:     </interface>
Jul 31 10:13:33 user nova-compute[71113]:     <serial type="pty">
Jul 31 10:13:33 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/console.log" append="off"/>
Jul 31 10:13:33 user nova-compute[71113]:     </serial>
Jul 31 10:13:33 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 10:13:33 user nova-compute[71113]:     <video>
Jul 31 10:13:33 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:13:33 user nova-compute[71113]:     </video>
Jul 31 10:13:33 user nova-compute[71113]:     <rng model="virtio">
Jul 31 10:13:33 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 10:13:33 user nova-compute[71113]:     </rng>
Jul 31 10:13:33 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 10:13:33 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 10:13:33 user nova-compute[71113]:       <stats period="10"/>
Jul 31 10:13:33 user nova-compute[71113]:     </memballoon>
Jul 31 10:13:33 user nova-compute[71113]:   </devices>
Jul 31 10:13:33 user nova-compute[71113]: </domain>
Jul 31 10:13:33 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 10:13:33 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Instance destroyed successfully.
Jul 31 10:13:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-88c7159a-b63c-4c17-b139-d376125db630 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:13:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-88c7159a-b63c-4c17-b139-d376125db630 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:13:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-88c7159a-b63c-4c17-b139-d376125db630 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] No VIF found with MAC fa:16:3e:fe:2b:04, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 10:13:33 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:13:33 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:13:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:13:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:13:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:13:34 user nova-compute[71113]: DEBUG nova.compute.manager [req-efafb7bb-72a1-4b4a-9889-24bd3540cd09 req-c89b11ae-facc-427d-bf24-25771c4fef6b service nova] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Received event network-vif-plugged-1a2da0f9-2fb6-4880-96b5-be8dd9d12574 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:13:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-efafb7bb-72a1-4b4a-9889-24bd3540cd09 req-c89b11ae-facc-427d-bf24-25771c4fef6b service nova] Acquiring lock "8129456b-a22c-46e3-b5db-89fdcec87dec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:13:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-efafb7bb-72a1-4b4a-9889-24bd3540cd09 req-c89b11ae-facc-427d-bf24-25771c4fef6b service nova] Lock "8129456b-a22c-46e3-b5db-89fdcec87dec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:13:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-efafb7bb-72a1-4b4a-9889-24bd3540cd09 req-c89b11ae-facc-427d-bf24-25771c4fef6b service nova] Lock "8129456b-a22c-46e3-b5db-89fdcec87dec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:13:34 user nova-compute[71113]: DEBUG nova.compute.manager [req-efafb7bb-72a1-4b4a-9889-24bd3540cd09 req-c89b11ae-facc-427d-bf24-25771c4fef6b service nova] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] No waiting events found dispatching network-vif-plugged-1a2da0f9-2fb6-4880-96b5-be8dd9d12574 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:13:34 user nova-compute[71113]: WARNING nova.compute.manager [req-efafb7bb-72a1-4b4a-9889-24bd3540cd09 req-c89b11ae-facc-427d-bf24-25771c4fef6b service nova] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Received unexpected event network-vif-plugged-1a2da0f9-2fb6-4880-96b5-be8dd9d12574 for instance with vm_state active and task_state rescuing.
Jul 31 10:13:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:13:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:13:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:13:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:13:36 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Removed pending event for 8129456b-a22c-46e3-b5db-89fdcec87dec due to event {{(pid=71113) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 31 10:13:36 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690798416.628232, 8129456b-a22c-46e3-b5db-89fdcec87dec => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:13:36 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] VM Resumed (Lifecycle Event)
Jul 31 10:13:36 user nova-compute[71113]: DEBUG nova.compute.manager [None req-88c7159a-b63c-4c17-b139-d376125db630 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:13:36 user nova-compute[71113]: DEBUG nova.compute.manager [req-1df44a1d-768f-49a8-a55d-d07e22928622 req-d8adb8f4-7972-494e-b94d-d87ae4f6b2e9 service nova] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Received event network-vif-plugged-1a2da0f9-2fb6-4880-96b5-be8dd9d12574 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:13:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1df44a1d-768f-49a8-a55d-d07e22928622 req-d8adb8f4-7972-494e-b94d-d87ae4f6b2e9 service nova] Acquiring lock "8129456b-a22c-46e3-b5db-89fdcec87dec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:13:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1df44a1d-768f-49a8-a55d-d07e22928622 req-d8adb8f4-7972-494e-b94d-d87ae4f6b2e9 service nova] Lock "8129456b-a22c-46e3-b5db-89fdcec87dec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:13:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1df44a1d-768f-49a8-a55d-d07e22928622 req-d8adb8f4-7972-494e-b94d-d87ae4f6b2e9 service nova] Lock "8129456b-a22c-46e3-b5db-89fdcec87dec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:13:36 user nova-compute[71113]: DEBUG nova.compute.manager [req-1df44a1d-768f-49a8-a55d-d07e22928622 req-d8adb8f4-7972-494e-b94d-d87ae4f6b2e9 service nova] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] No waiting events found dispatching network-vif-plugged-1a2da0f9-2fb6-4880-96b5-be8dd9d12574 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:13:36 user nova-compute[71113]: WARNING nova.compute.manager [req-1df44a1d-768f-49a8-a55d-d07e22928622 req-d8adb8f4-7972-494e-b94d-d87ae4f6b2e9 service nova] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Received unexpected event network-vif-plugged-1a2da0f9-2fb6-4880-96b5-be8dd9d12574 for instance with vm_state active and task_state rescuing.
Jul 31 10:13:36 user nova-compute[71113]: DEBUG nova.compute.manager [req-1df44a1d-768f-49a8-a55d-d07e22928622 req-d8adb8f4-7972-494e-b94d-d87ae4f6b2e9 service nova] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Received event network-vif-plugged-1a2da0f9-2fb6-4880-96b5-be8dd9d12574 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:13:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1df44a1d-768f-49a8-a55d-d07e22928622 req-d8adb8f4-7972-494e-b94d-d87ae4f6b2e9 service nova] Acquiring lock "8129456b-a22c-46e3-b5db-89fdcec87dec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:13:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1df44a1d-768f-49a8-a55d-d07e22928622 req-d8adb8f4-7972-494e-b94d-d87ae4f6b2e9 service nova] Lock "8129456b-a22c-46e3-b5db-89fdcec87dec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:13:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1df44a1d-768f-49a8-a55d-d07e22928622 req-d8adb8f4-7972-494e-b94d-d87ae4f6b2e9 service nova] Lock "8129456b-a22c-46e3-b5db-89fdcec87dec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:13:36 user nova-compute[71113]: DEBUG nova.compute.manager [req-1df44a1d-768f-49a8-a55d-d07e22928622 req-d8adb8f4-7972-494e-b94d-d87ae4f6b2e9 service nova] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] No waiting events found dispatching network-vif-plugged-1a2da0f9-2fb6-4880-96b5-be8dd9d12574 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:13:36 user nova-compute[71113]: WARNING nova.compute.manager [req-1df44a1d-768f-49a8-a55d-d07e22928622 req-d8adb8f4-7972-494e-b94d-d87ae4f6b2e9 service nova] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Received unexpected event network-vif-plugged-1a2da0f9-2fb6-4880-96b5-be8dd9d12574 for instance with vm_state active and task_state rescuing.
Jul 31 10:13:36 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:13:36 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:13:36 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 31 10:13:36 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690798416.6295888, 8129456b-a22c-46e3-b5db-89fdcec87dec => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:13:36 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] VM Started (Lifecycle Event)
Jul 31 10:13:36 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:13:36 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:13:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:13:44 user nova-compute[71113]: DEBUG nova.compute.manager [req-de59c261-53e5-4a5c-a1a7-5e9b3b078e44 req-be5bb103-d421-41f7-b866-1b850f5f525e service nova] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Received event network-changed-6764da79-a9ff-4470-b3ac-5eb0f8346538 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:13:44 user nova-compute[71113]: DEBUG nova.compute.manager [req-de59c261-53e5-4a5c-a1a7-5e9b3b078e44 req-be5bb103-d421-41f7-b866-1b850f5f525e service nova] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Refreshing instance network info cache due to event network-changed-6764da79-a9ff-4470-b3ac-5eb0f8346538. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 10:13:44 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-de59c261-53e5-4a5c-a1a7-5e9b3b078e44 req-be5bb103-d421-41f7-b866-1b850f5f525e service nova] Acquiring lock "refresh_cache-a9299196-6e9b-4a48-9c90-e1e24243a7b1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:13:44 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-de59c261-53e5-4a5c-a1a7-5e9b3b078e44 req-be5bb103-d421-41f7-b866-1b850f5f525e service nova] Acquired lock "refresh_cache-a9299196-6e9b-4a48-9c90-e1e24243a7b1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:13:44 user nova-compute[71113]: DEBUG nova.network.neutron [req-de59c261-53e5-4a5c-a1a7-5e9b3b078e44 req-be5bb103-d421-41f7-b866-1b850f5f525e service nova] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Refreshing network info cache for port 6764da79-a9ff-4470-b3ac-5eb0f8346538 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 10:13:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:13:45 user nova-compute[71113]: DEBUG nova.network.neutron [req-de59c261-53e5-4a5c-a1a7-5e9b3b078e44 req-be5bb103-d421-41f7-b866-1b850f5f525e service nova] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Updated VIF entry in instance network info cache for port 6764da79-a9ff-4470-b3ac-5eb0f8346538. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 10:13:45 user nova-compute[71113]: DEBUG nova.network.neutron [req-de59c261-53e5-4a5c-a1a7-5e9b3b078e44 req-be5bb103-d421-41f7-b866-1b850f5f525e service nova] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Updating instance_info_cache with network_info: [{"id": "6764da79-a9ff-4470-b3ac-5eb0f8346538", "address": "fa:16:3e:ef:aa:50", "network": {"id": "4b030626-e3f1-4617-89c2-f6389226652f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441335951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7000d6a2a6b147ddbc38208b316574cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6764da79-a9", "ovs_interfaceid": "6764da79-a9ff-4470-b3ac-5eb0f8346538", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:13:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-de59c261-53e5-4a5c-a1a7-5e9b3b078e44 req-be5bb103-d421-41f7-b866-1b850f5f525e service nova] Releasing lock "refresh_cache-a9299196-6e9b-4a48-9c90-e1e24243a7b1" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:13:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:13:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0ae0a087-8998-48b4-85f2-905e78fba21f tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquiring lock "a9299196-6e9b-4a48-9c90-e1e24243a7b1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:13:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0ae0a087-8998-48b4-85f2-905e78fba21f tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "a9299196-6e9b-4a48-9c90-e1e24243a7b1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:13:48 user nova-compute[71113]: DEBUG nova.objects.instance [None req-0ae0a087-8998-48b4-85f2-905e78fba21f tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lazy-loading 'flavor' on Instance uuid a9299196-6e9b-4a48-9c90-e1e24243a7b1 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:13:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0ae0a087-8998-48b4-85f2-905e78fba21f tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "a9299196-6e9b-4a48-9c90-e1e24243a7b1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:13:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0ae0a087-8998-48b4-85f2-905e78fba21f tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquiring lock "a9299196-6e9b-4a48-9c90-e1e24243a7b1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:13:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0ae0a087-8998-48b4-85f2-905e78fba21f tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "a9299196-6e9b-4a48-9c90-e1e24243a7b1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:13:48 user nova-compute[71113]: INFO nova.compute.manager [None req-0ae0a087-8998-48b4-85f2-905e78fba21f tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Attaching volume 1e4f8c13-915f-4311-9094-ecb9ca9bad15 to /dev/vdb
Jul 31 10:13:48 user nova-compute[71113]: DEBUG os_brick.utils [None req-0ae0a087-8998-48b4-85f2-905e78fba21f tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:13:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:13:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:13:48 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb258a2-ea8e-4fc2-9c5f-94bed0c6d548]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:13:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:13:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:13:48 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4e3a0e-b900-421f-a69e-547a09e0d03f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:13:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:13:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:13:48 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[404ee4b0-d8e4-4297-b005-1098fffe8f55]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:13:48 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2f1993-39db-4ad7-9177-7cc39c762ccc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:13:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0ae0a087-8998-48b4-85f2-905e78fba21f tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:13:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0ae0a087-8998-48b4-85f2-905e78fba21f tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 10:13:48 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0ae0a087-8998-48b4-85f2-905e78fba21f tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 10:13:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:13:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 10:13:48 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 10:13:48 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[70788495-6ddc-422f-b1bc-77194b3f469c]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:13:48 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-0ae0a087-8998-48b4-85f2-905e78fba21f tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 10:13:48 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-0ae0a087-8998-48b4-85f2-905e78fba21f tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 10:13:48 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-0ae0a087-8998-48b4-85f2-905e78fba21f tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 10:13:48 user nova-compute[71113]: DEBUG os_brick.utils [None req-0ae0a087-8998-48b4-85f2-905e78fba21f tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:13:48 user nova-compute[71113]: DEBUG nova.virt.block_device [None req-0ae0a087-8998-48b4-85f2-905e78fba21f tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Updating existing volume attachment record: eadfc198-e124-4c10-b064-ce87c3e15319 {{(pid=71113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 10:13:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:13:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:13:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:13:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:13:55 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ae0a087-8998-48b4-85f2-905e78fba21f tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 10:13:55 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae0a087-8998-48b4-85f2-905e78fba21f tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1e4f8c13-915f-4311-9094-ecb9ca9bad15'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ELSCblYm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:13:55 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-0ae0a087-8998-48b4-85f2-905e78fba21f tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:13:55 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-0ae0a087-8998-48b4-85f2-905e78fba21f tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:13:55 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-0ae0a087-8998-48b4-85f2-905e78fba21f tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:13:55 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-0ae0a087-8998-48b4-85f2-905e78fba21f tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:13:55 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-0ae0a087-8998-48b4-85f2-905e78fba21f tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e4f8c13-915f-4311-9094-ecb9ca9bad15" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:13:55 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-0ae0a087-8998-48b4-85f2-905e78fba21f tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e4f8c13-915f-4311-9094-ecb9ca9bad15" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:13:55 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-0ae0a087-8998-48b4-85f2-905e78fba21f tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 10:13:55 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e4f8c13-915f-4311-9094-ecb9ca9bad15 -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:13:55 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e4f8c13-915f-4311-9094-ecb9ca9bad15 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:13:55 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c7413a-f9fc-40f2-a62a-32bbb2435190]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:13:55 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae0a087-8998-48b4-85f2-905e78fba21f tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 10:13:55 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:13:55 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e4f8c13-915f-4311-9094-ecb9ca9bad15 -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:13:55 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e4f8c13-915f-4311-9094-ecb9ca9bad15 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:13:55 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[318c71b1-059b-476f-b6e2-6eed58af30da]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e4f8c13-915f-4311-9094-ecb9ca9bad15] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:13:55 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae0a087-8998-48b4-85f2-905e78fba21f tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e4f8c13-915f-4311-9094-ecb9ca9bad15] added
Jul 31 10:13:55 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:13:55 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e4f8c13-915f-4311-9094-ecb9ca9bad15 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:13:55 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e4f8c13-915f-4311-9094-ecb9ca9bad15 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:13:55 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe2b1e0-5675-4074-a9cf-f0f5b87d3207]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:13:55 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae0a087-8998-48b4-85f2-905e78fba21f tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:13:55 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e4f8c13-915f-4311-9094-ecb9ca9bad15 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:13:55 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e4f8c13-915f-4311-9094-ecb9ca9bad15 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:13:55 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3c1de6-2d15-40dd-b6c0-da0d3f181c6d]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:13:55 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae0a087-8998-48b4-85f2-905e78fba21f tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:13:55 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e4f8c13-915f-4311-9094-ecb9ca9bad15 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ELSCblYm {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:13:55 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e4f8c13-915f-4311-9094-ecb9ca9bad15 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ELSCblYm" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:13:55 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f56220-37e8-4c3b-9894-c54c4e018227]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:13:55 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae0a087-8998-48b4-85f2-905e78fba21f tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ELSCblYm'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:13:55 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e4f8c13-915f-4311-9094-ecb9ca9bad15 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:13:55 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e4f8c13-915f-4311-9094-ecb9ca9bad15 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:13:55 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37097a4-7471-467e-936f-2dbbd64dbef3]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:13:55 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae0a087-8998-48b4-85f2-905e78fba21f tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:13:55 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:13:55 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:13:55 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11b5917-6c8b-45e9-a93f-8ac3db4d3b9a]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:13:55 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae0a087-8998-48b4-85f2-905e78fba21f tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)
Jul 31 10:13:55 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:13:55 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae0a087-8998-48b4-85f2-905e78fba21f tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)
Jul 31 10:13:55 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:13:55 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e4f8c13-915f-4311-9094-ecb9ca9bad15 -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:13:56 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e4f8c13-915f-4311-9094-ecb9ca9bad15 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:13:56 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7215bfe-d5fd-48a1-84b5-2f6f0e3639ec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e4f8c13-915f-4311-9094-ecb9ca9bad15, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1e4f8c13-915f-4311-9094-ecb9ca9bad15, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:13:56 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae0a087-8998-48b4-85f2-905e78fba21f tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e4f8c13-915f-4311-9094-ecb9ca9bad15, portal: 172.16.0.220,3260]
Jul 31 10:13:56 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:1e4f8c13-915f-4311-9094-ecb9ca9bad15, portal: 172.16.0.220,3260] successful.
Jul 31 10:13:56 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:13:56 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e4f8c13-915f-4311-9094-ecb9ca9bad15 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:13:56 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e4f8c13-915f-4311-9094-ecb9ca9bad15 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:13:56 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4107a686-8ac7-427e-8aba-3a616263d7ad]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:13:56 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae0a087-8998-48b4-85f2-905e78fba21f tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:13:56 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:13:56 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:13:56 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23df296-e1aa-462a-af49-f277e8befee7]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e4f8c13-915f-4311-9094-ecb9ca9bad15 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:13:56 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae0a087-8998-48b4-85f2-905e78fba21f tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)
Jul 31 10:13:56 user nova-compute[71113]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e4f8c13-915f-4311-9094-ecb9ca9bad15 (non-flash)
Jul 31 10:13:56 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:13:56 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae0a087-8998-48b4-85f2-905e78fba21f tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)
Jul 31 10:13:56 user nova-compute[71113]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e4f8c13-915f-4311-9094-ecb9ca9bad15 (non-flash)
Jul 31 10:13:56 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:13:56 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-0ae0a087-8998-48b4-85f2-905e78fba21f tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e4f8c13-915f-4311-9094-ecb9ca9bad15" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:13:56 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae0a087-8998-48b4-85f2-905e78fba21f tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 10:13:56 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-0ae0a087-8998-48b4-85f2-905e78fba21f tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 10:13:56 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-0ae0a087-8998-48b4-85f2-905e78fba21f tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 10:13:56 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:13:56 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:13:56 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[22682e92-52eb-4d64-8f85-78f12122e62a]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:13:56 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-0ae0a087-8998-48b4-85f2-905e78fba21f tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 10:13:56 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae0a087-8998-48b4-85f2-905e78fba21f tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ELSCblYm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 10:13:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-0ae0a087-8998-48b4-85f2-905e78fba21f tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:13:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae0a087-8998-48b4-85f2-905e78fba21f tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '26636626134643963', 'path': '/dev/sdb'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:13:57 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ae0a087-8998-48b4-85f2-905e78fba21f tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636626134643963', 'path': '/dev/sdb'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 10:13:57 user nova-compute[71113]: DEBUG nova.objects.instance [None req-0ae0a087-8998-48b4-85f2-905e78fba21f tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lazy-loading 'flavor' on Instance uuid a9299196-6e9b-4a48-9c90-e1e24243a7b1 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:13:57 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-0ae0a087-8998-48b4-85f2-905e78fba21f tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 10:13:57 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:13:57 user nova-compute[71113]:   <source dev="/dev/sdb"/>
Jul 31 10:13:57 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 10:13:57 user nova-compute[71113]:   <serial>1e4f8c13-915f-4311-9094-ecb9ca9bad15</serial>
Jul 31 10:13:57 user nova-compute[71113]: </disk>
Jul 31 10:13:57 user nova-compute[71113]:  {{(pid=71113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 10:13:57 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0ae0a087-8998-48b4-85f2-905e78fba21f tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:13:57 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0ae0a087-8998-48b4-85f2-905e78fba21f tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:13:57 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0ae0a087-8998-48b4-85f2-905e78fba21f tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] No VIF found with MAC fa:16:3e:ef:aa:50, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 10:13:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0ae0a087-8998-48b4-85f2-905e78fba21f tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "a9299196-6e9b-4a48-9c90-e1e24243a7b1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.030s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:13:58 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-27ffb3b3-e0d2-42cb-9329-def5f4bd08a5 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquiring lock "a9299196-6e9b-4a48-9c90-e1e24243a7b1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:13:58 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-27ffb3b3-e0d2-42cb-9329-def5f4bd08a5 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "a9299196-6e9b-4a48-9c90-e1e24243a7b1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:13:58 user nova-compute[71113]: INFO nova.compute.manager [None req-27ffb3b3-e0d2-42cb-9329-def5f4bd08a5 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Detaching volume 1e4f8c13-915f-4311-9094-ecb9ca9bad15
Jul 31 10:13:58 user nova-compute[71113]: INFO nova.virt.block_device [None req-27ffb3b3-e0d2-42cb-9329-def5f4bd08a5 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Attempting to driver detach volume 1e4f8c13-915f-4311-9094-ecb9ca9bad15 from mountpoint /dev/vdb
Jul 31 10:13:58 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-27ffb3b3-e0d2-42cb-9329-def5f4bd08a5 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Attempting to detach device vdb from instance a9299196-6e9b-4a48-9c90-e1e24243a7b1 from the persistent domain config. {{(pid=71113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 10:13:58 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-27ffb3b3-e0d2-42cb-9329-def5f4bd08a5 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 10:13:58 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:13:58 user nova-compute[71113]:   <source dev="/dev/sdb"/>
Jul 31 10:13:58 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 10:13:58 user nova-compute[71113]:   <serial>1e4f8c13-915f-4311-9094-ecb9ca9bad15</serial>
Jul 31 10:13:58 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 10:13:58 user nova-compute[71113]: </disk>
Jul 31 10:13:58 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 10:13:58 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-27ffb3b3-e0d2-42cb-9329-def5f4bd08a5 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Successfully detached device vdb from instance a9299196-6e9b-4a48-9c90-e1e24243a7b1 from the persistent domain config.
Jul 31 10:13:58 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-27ffb3b3-e0d2-42cb-9329-def5f4bd08a5 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a9299196-6e9b-4a48-9c90-e1e24243a7b1 from the live domain config. {{(pid=71113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 10:13:58 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-27ffb3b3-e0d2-42cb-9329-def5f4bd08a5 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 10:13:58 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:13:58 user nova-compute[71113]:   <source dev="/dev/sdb"/>
Jul 31 10:13:58 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 10:13:58 user nova-compute[71113]:   <serial>1e4f8c13-915f-4311-9094-ecb9ca9bad15</serial>
Jul 31 10:13:58 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 10:13:58 user nova-compute[71113]: </disk>
Jul 31 10:13:58 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 10:13:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Received event <DeviceRemovedEvent: 1690798439.3016539, a9299196-6e9b-4a48-9c90-e1e24243a7b1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71113) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 10:13:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-27ffb3b3-e0d2-42cb-9329-def5f4bd08a5 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a9299196-6e9b-4a48-9c90-e1e24243a7b1 {{(pid=71113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 10:13:59 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-27ffb3b3-e0d2-42cb-9329-def5f4bd08a5 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Successfully detached device vdb from instance a9299196-6e9b-4a48-9c90-e1e24243a7b1 from the live domain config.
Jul 31 10:13:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27ffb3b3-e0d2-42cb-9329-def5f4bd08a5 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 10:13:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ffb3b3-e0d2-42cb-9329-def5f4bd08a5 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:1e4f8c13-915f-4311-9094-ecb9ca9bad15'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ELSCblYm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:13:59 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-27ffb3b3-e0d2-42cb-9329-def5f4bd08a5 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:13:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-27ffb3b3-e0d2-42cb-9329-def5f4bd08a5 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:13:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-27ffb3b3-e0d2-42cb-9329-def5f4bd08a5 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:13:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ffb3b3-e0d2-42cb-9329-def5f4bd08a5 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e4f8c13-915f-4311-9094-ecb9ca9bad15', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 10:13:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:13:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:13:59 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[fedbee19-91a2-4187-8d2b-91afa9aa8574]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e4f8c13-915f-4311-9094-ecb9ca9bad15\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:13:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:13:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:13:59 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62cb10e-e9e6-4a29-b8e6-477499afc7e1]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e4f8c13-915f-4311-9094-ecb9ca9bad15 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:13:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ffb3b3-e0d2-42cb-9329-def5f4bd08a5 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)
Jul 31 10:13:59 user nova-compute[71113]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e4f8c13-915f-4311-9094-ecb9ca9bad15 (non-flash)
Jul 31 10:13:59 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:13:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ffb3b3-e0d2-42cb-9329-def5f4bd08a5 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)
Jul 31 10:13:59 user nova-compute[71113]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e4f8c13-915f-4311-9094-ecb9ca9bad15 (non-flash)
Jul 31 10:13:59 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:13:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ffb3b3-e0d2-42cb-9329-def5f4bd08a5 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f78f02de7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e4f8c13-915f-4311-9094-ecb9ca9bad15'): ({'sdb'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 10:13:59 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-27ffb3b3-e0d2-42cb-9329-def5f4bd08a5 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Removing single pathed devices sdb {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 10:13:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:13:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:13:59 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f8c52b-d0e3-450e-8389-24c2fe4d11a8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:13:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:13:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:13:59 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3aeb42f-8a64-46cf-9f31-18aabb076b54]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:13:59 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-27ffb3b3-e0d2-42cb-9329-def5f4bd08a5 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Flushing IO for device /dev/sdb {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 10:13:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:13:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:13:59 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5642a42-b673-40a5-836f-c7b454942a51]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:13:59 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-27ffb3b3-e0d2-42cb-9329-def5f4bd08a5 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 10:13:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:13:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:13:59 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c47b308-d77a-41e2-8d8e-c2923ca9367b]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:13:59 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-27ffb3b3-e0d2-42cb-9329-def5f4bd08a5 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 10:13:59 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-27ffb3b3-e0d2-42cb-9329-def5f4bd08a5 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] SCSI volumes sdb have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 10:13:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ffb3b3-e0d2-42cb-9329-def5f4bd08a5 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e4f8c13-915f-4311-9094-ecb9ca9bad15')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 10:13:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e4f8c13-915f-4311-9094-ecb9ca9bad15 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:13:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e4f8c13-915f-4311-9094-ecb9ca9bad15 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:13:59 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab301d21-e5d7-4349-9149-e7267d5fb976]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:13:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ffb3b3-e0d2-42cb-9329-def5f4bd08a5 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:13:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e4f8c13-915f-4311-9094-ecb9ca9bad15 -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:13:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e4f8c13-915f-4311-9094-ecb9ca9bad15 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:13:59 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d8a5ad-d781-48ac-ad35-609c7de8d6ea]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:1e4f8c13-915f-4311-9094-ecb9ca9bad15, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:1e4f8c13-915f-4311-9094-ecb9ca9bad15, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:13:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ffb3b3-e0d2-42cb-9329-def5f4bd08a5 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:1e4f8c13-915f-4311-9094-ecb9ca9bad15, portal: 172.16.0.220,3260]
Jul 31 10:13:59 user nova-compute[71113]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:1e4f8c13-915f-4311-9094-ecb9ca9bad15, portal: 172.16.0.220,3260] successful.
Jul 31 10:13:59 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:13:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e4f8c13-915f-4311-9094-ecb9ca9bad15 -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:13:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e4f8c13-915f-4311-9094-ecb9ca9bad15 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:13:59 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5458629-cd16-4266-9296-029e5fc1395a]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:13:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ffb3b3-e0d2-42cb-9329-def5f4bd08a5 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:13:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-27ffb3b3-e0d2-42cb-9329-def5f4bd08a5 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:13:59 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ffb3b3-e0d2-42cb-9329-def5f4bd08a5 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] <== disconnect_volume: return (281ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:13:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27ffb3b3-e0d2-42cb-9329-def5f4bd08a5 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 10:13:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:14:00 user nova-compute[71113]: DEBUG nova.objects.instance [None req-27ffb3b3-e0d2-42cb-9329-def5f4bd08a5 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lazy-loading 'flavor' on Instance uuid a9299196-6e9b-4a48-9c90-e1e24243a7b1 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:14:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-27ffb3b3-e0d2-42cb-9329-def5f4bd08a5 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "a9299196-6e9b-4a48-9c90-e1e24243a7b1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.576s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:14:00 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:14:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:14:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:14:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:14:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:14:12 user nova-compute[71113]: DEBUG nova.compute.manager [req-336be5ba-bc56-4a9d-b06d-f697f6434e97 req-fffe1160-0200-4f2e-8a4a-fa878d0be6a7 service nova] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Received event network-changed-a125e6d6-59a1-4aac-8081-abfbe030359b {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:14:12 user nova-compute[71113]: DEBUG nova.compute.manager [req-336be5ba-bc56-4a9d-b06d-f697f6434e97 req-fffe1160-0200-4f2e-8a4a-fa878d0be6a7 service nova] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Refreshing instance network info cache due to event network-changed-a125e6d6-59a1-4aac-8081-abfbe030359b. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 10:14:12 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-336be5ba-bc56-4a9d-b06d-f697f6434e97 req-fffe1160-0200-4f2e-8a4a-fa878d0be6a7 service nova] Acquiring lock "refresh_cache-be9f0ded-8064-4675-99f7-8620f0fe3dda" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:14:12 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-336be5ba-bc56-4a9d-b06d-f697f6434e97 req-fffe1160-0200-4f2e-8a4a-fa878d0be6a7 service nova] Acquired lock "refresh_cache-be9f0ded-8064-4675-99f7-8620f0fe3dda" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:14:12 user nova-compute[71113]: DEBUG nova.network.neutron [req-336be5ba-bc56-4a9d-b06d-f697f6434e97 req-fffe1160-0200-4f2e-8a4a-fa878d0be6a7 service nova] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Refreshing network info cache for port a125e6d6-59a1-4aac-8081-abfbe030359b {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 10:14:12 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5d092d4f-d66d-4837-b369-cae72b851b7f tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "be9f0ded-8064-4675-99f7-8620f0fe3dda" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:14:12 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5d092d4f-d66d-4837-b369-cae72b851b7f tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "be9f0ded-8064-4675-99f7-8620f0fe3dda" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:14:12 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5d092d4f-d66d-4837-b369-cae72b851b7f tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "be9f0ded-8064-4675-99f7-8620f0fe3dda-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:14:12 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5d092d4f-d66d-4837-b369-cae72b851b7f tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "be9f0ded-8064-4675-99f7-8620f0fe3dda-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:14:12 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5d092d4f-d66d-4837-b369-cae72b851b7f tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "be9f0ded-8064-4675-99f7-8620f0fe3dda-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:14:12 user nova-compute[71113]: INFO nova.compute.manager [None req-5d092d4f-d66d-4837-b369-cae72b851b7f tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Terminating instance
Jul 31 10:14:12 user nova-compute[71113]: DEBUG nova.compute.manager [None req-5d092d4f-d66d-4837-b369-cae72b851b7f tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Start destroying the instance on the hypervisor. {{(pid=71113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 10:14:12 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:14:12 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:14:12 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:14:12 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:14:12 user nova-compute[71113]: DEBUG nova.compute.manager [req-2f5d343d-1c8b-4be4-a64c-4467c0ab4b95 req-77092b99-c4c3-4b36-b86f-fdd6cef581e7 service nova] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Received event network-vif-unplugged-a125e6d6-59a1-4aac-8081-abfbe030359b {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:14:12 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-2f5d343d-1c8b-4be4-a64c-4467c0ab4b95 req-77092b99-c4c3-4b36-b86f-fdd6cef581e7 service nova] Acquiring lock "be9f0ded-8064-4675-99f7-8620f0fe3dda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:14:12 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-2f5d343d-1c8b-4be4-a64c-4467c0ab4b95 req-77092b99-c4c3-4b36-b86f-fdd6cef581e7 service nova] Lock "be9f0ded-8064-4675-99f7-8620f0fe3dda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:14:12 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-2f5d343d-1c8b-4be4-a64c-4467c0ab4b95 req-77092b99-c4c3-4b36-b86f-fdd6cef581e7 service nova] Lock "be9f0ded-8064-4675-99f7-8620f0fe3dda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:14:12 user nova-compute[71113]: DEBUG nova.compute.manager [req-2f5d343d-1c8b-4be4-a64c-4467c0ab4b95 req-77092b99-c4c3-4b36-b86f-fdd6cef581e7 service nova] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] No waiting events found dispatching network-vif-unplugged-a125e6d6-59a1-4aac-8081-abfbe030359b {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:14:12 user nova-compute[71113]: DEBUG nova.compute.manager [req-2f5d343d-1c8b-4be4-a64c-4467c0ab4b95 req-77092b99-c4c3-4b36-b86f-fdd6cef581e7 service nova] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Received event network-vif-unplugged-a125e6d6-59a1-4aac-8081-abfbe030359b for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:14:13 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Instance destroyed successfully.
Jul 31 10:14:13 user nova-compute[71113]: DEBUG nova.objects.instance [None req-5d092d4f-d66d-4837-b369-cae72b851b7f tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lazy-loading 'resources' on Instance uuid be9f0ded-8064-4675-99f7-8620f0fe3dda {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-5d092d4f-d66d-4837-b369-cae72b851b7f tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:09:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-264888098',display_name='tempest-TestVolumeBootPattern-server-264888098',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-264888098',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHyhNSNVW4Lo+ZOw5JhvHTNH16DxMgCVmk57hIQmCoVWxH+PN+/8jM3YwsIxSsGBxRIiU3keHG6Pnt6GG0CTGlGIZ1kKVEix0HYiRgqMpyBqoT4aBeWmvyv0uyNPZ+vFFg==',key_name='tempest-TestVolumeBootPattern-165282511',keypairs=<?>,launch_index=0,launched_at=2023-07-31T10:09:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3aa2add2e2a24b9cb8e48042b06931d3',ramdisk_id='',reservation_id='r-0xxbdtbk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1754399827',owner_user_name='tempest-TestVolumeBootPattern-1754399827-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T10:09:34Z,user_data=None,user_id='a58fe92488ed47b696fc5d6d990b1acd',uuid=be9f0ded-8064-4675-99f7-8620f0fe3dda,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a125e6d6-59a1-4aac-8081-abfbe030359b", "address": "fa:16:3e:61:da:b6", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa125e6d6-59", "ovs_interfaceid": "a125e6d6-59a1-4aac-8081-abfbe030359b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-5d092d4f-d66d-4837-b369-cae72b851b7f tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Converting VIF {"id": "a125e6d6-59a1-4aac-8081-abfbe030359b", "address": "fa:16:3e:61:da:b6", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa125e6d6-59", "ovs_interfaceid": "a125e6d6-59a1-4aac-8081-abfbe030359b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-5d092d4f-d66d-4837-b369-cae72b851b7f tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:da:b6,bridge_name='br-int',has_traffic_filtering=True,id=a125e6d6-59a1-4aac-8081-abfbe030359b,network=Network(fa792d7a-ddf6-4a2d-acb9-802f8daf87ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa125e6d6-59') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG os_vif [None req-5d092d4f-d66d-4837-b369-cae72b851b7f tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:da:b6,bridge_name='br-int',has_traffic_filtering=True,id=a125e6d6-59a1-4aac-8081-abfbe030359b,network=Network(fa792d7a-ddf6-4a2d-acb9-802f8daf87ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa125e6d6-59') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa125e6d6-59, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:14:13 user nova-compute[71113]: INFO os_vif [None req-5d092d4f-d66d-4837-b369-cae72b851b7f tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:da:b6,bridge_name='br-int',has_traffic_filtering=True,id=a125e6d6-59a1-4aac-8081-abfbe030359b,network=Network(fa792d7a-ddf6-4a2d-acb9-802f8daf87ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa125e6d6-59')
Jul 31 10:14:13 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d092d4f-d66d-4837-b369-cae72b851b7f tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d092d4f-d66d-4837-b369-cae72b851b7f tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cYTyAjsO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:14:13 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-5d092d4f-d66d-4837-b369-cae72b851b7f tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:14:13 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-5d092d4f-d66d-4837-b369-cae72b851b7f tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-5d092d4f-d66d-4837-b369-cae72b851b7f tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d092d4f-d66d-4837-b369-cae72b851b7f tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4f64f2-7ffd-4861-a158-7dc6f28a01cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06e601a-e35e-4f91-919a-bfb29ef42f2d]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d092d4f-d66d-4837-b369-cae72b851b7f tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)
Jul 31 10:14:13 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d092d4f-d66d-4837-b369-cae72b851b7f tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 (non-flash)
Jul 31 10:14:13 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d092d4f-d66d-4837-b369-cae72b851b7f tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f78f0792dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3'): ({'sdc'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-5d092d4f-d66d-4837-b369-cae72b851b7f tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Removing single pathed devices sdc {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[906994ea-fe3e-47d0-a41f-8decbc32cafa]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[718a9ad8-1756-44ee-9818-47c3eff8a847]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-5d092d4f-d66d-4837-b369-cae72b851b7f tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Flushing IO for device /dev/sdc {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7531ea0-71a5-4700-9e50-a987bc7949b3]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-5d092d4f-d66d-4837-b369-cae72b851b7f tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ce76b4-a56a-40c3-a301-cdbd34e6cf24]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-5d092d4f-d66d-4837-b369-cae72b851b7f tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-5d092d4f-d66d-4837-b369-cae72b851b7f tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] SCSI volumes sdc have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOf63b9d32-f672ee9b4d9f2b69', '/dev/disk/by-id/scsi-26636373265653962', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f63b9d32') {{(pid=81983) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c191ca5-3acd-4d45-970f-fa453073e3de]: (4, None) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d092d4f-d66d-4837-b369-cae72b851b7f tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ef12e1-824a-4af4-8b22-a40ec38286b7]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d092d4f-d66d-4837-b369-cae72b851b7f tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG nova.network.neutron [req-336be5ba-bc56-4a9d-b06d-f697f6434e97 req-fffe1160-0200-4f2e-8a4a-fa878d0be6a7 service nova] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Updated VIF entry in instance network info cache for port a125e6d6-59a1-4aac-8081-abfbe030359b. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG nova.network.neutron [req-336be5ba-bc56-4a9d-b06d-f697f6434e97 req-fffe1160-0200-4f2e-8a4a-fa878d0be6a7 service nova] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Updating instance_info_cache with network_info: [{"id": "a125e6d6-59a1-4aac-8081-abfbe030359b", "address": "fa:16:3e:61:da:b6", "network": {"id": "fa792d7a-ddf6-4a2d-acb9-802f8daf87ac", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1338099898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa2add2e2a24b9cb8e48042b06931d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa125e6d6-59", "ovs_interfaceid": "a125e6d6-59a1-4aac-8081-abfbe030359b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-336be5ba-bc56-4a9d-b06d-f697f6434e97 req-fffe1160-0200-4f2e-8a4a-fa878d0be6a7 service nova] Releasing lock "refresh_cache-be9f0ded-8064-4675-99f7-8620f0fe3dda" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[94decd26-2a5e-437b-9a62-94c36cf8f45f]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d092d4f-d66d-4837-b369-cae72b851b7f tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3, portal: 172.16.0.220,3260]
Jul 31 10:14:13 user nova-compute[71113]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3, portal: 172.16.0.220,3260] successful.
Jul 31 10:14:13 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:393f83a1-d2bd-43b9-a499-cee6c4f93fb3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[980c45c0-66ba-4182-a6da-f2e7a26ee92d]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d092d4f-d66d-4837-b369-cae72b851b7f tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-5d092d4f-d66d-4837-b369-cae72b851b7f tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d092d4f-d66d-4837-b369-cae72b851b7f tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] <== disconnect_volume: return (277ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d092d4f-d66d-4837-b369-cae72b851b7f tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 10:14:13 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-5d092d4f-d66d-4837-b369-cae72b851b7f tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Deleting instance files /opt/stack/data/nova/instances/be9f0ded-8064-4675-99f7-8620f0fe3dda_del
Jul 31 10:14:13 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-5d092d4f-d66d-4837-b369-cae72b851b7f tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Deletion of /opt/stack/data/nova/instances/be9f0ded-8064-4675-99f7-8620f0fe3dda_del complete
Jul 31 10:14:13 user nova-compute[71113]: INFO nova.compute.manager [None req-5d092d4f-d66d-4837-b369-cae72b851b7f tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Took 1.14 seconds to destroy the instance on the hypervisor.
Jul 31 10:14:13 user nova-compute[71113]: DEBUG oslo.service.loopingcall [None req-5d092d4f-d66d-4837-b369-cae72b851b7f tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71113) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG nova.compute.manager [-] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Deallocating network for instance {{(pid=71113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 10:14:13 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] deallocate_for_instance() {{(pid=71113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 10:14:14 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:14:14 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Took 0.43 seconds to deallocate network for instance.
Jul 31 10:14:14 user nova-compute[71113]: DEBUG nova.compute.manager [req-893fee0d-41d2-4d57-9a4f-a8dcd2f2fbd6 req-a84d565b-ea41-47cf-8f23-eebb363c173b service nova] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Received event network-vif-deleted-a125e6d6-59a1-4aac-8081-abfbe030359b {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:14:14 user nova-compute[71113]: INFO nova.compute.manager [None req-5d092d4f-d66d-4837-b369-cae72b851b7f tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Took 0.71 seconds to detach 1 volumes for instance.
Jul 31 10:14:15 user nova-compute[71113]: DEBUG nova.compute.manager [req-edc239db-7092-4306-b3be-515a2a309115 req-0ecee53a-107e-4ccc-9aa7-898d9b483b1d service nova] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Received event network-vif-plugged-a125e6d6-59a1-4aac-8081-abfbe030359b {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:14:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-edc239db-7092-4306-b3be-515a2a309115 req-0ecee53a-107e-4ccc-9aa7-898d9b483b1d service nova] Acquiring lock "be9f0ded-8064-4675-99f7-8620f0fe3dda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:14:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-edc239db-7092-4306-b3be-515a2a309115 req-0ecee53a-107e-4ccc-9aa7-898d9b483b1d service nova] Lock "be9f0ded-8064-4675-99f7-8620f0fe3dda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:14:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-edc239db-7092-4306-b3be-515a2a309115 req-0ecee53a-107e-4ccc-9aa7-898d9b483b1d service nova] Lock "be9f0ded-8064-4675-99f7-8620f0fe3dda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:14:15 user nova-compute[71113]: DEBUG nova.compute.manager [req-edc239db-7092-4306-b3be-515a2a309115 req-0ecee53a-107e-4ccc-9aa7-898d9b483b1d service nova] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] No waiting events found dispatching network-vif-plugged-a125e6d6-59a1-4aac-8081-abfbe030359b {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:14:15 user nova-compute[71113]: WARNING nova.compute.manager [req-edc239db-7092-4306-b3be-515a2a309115 req-0ecee53a-107e-4ccc-9aa7-898d9b483b1d service nova] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Received unexpected event network-vif-plugged-a125e6d6-59a1-4aac-8081-abfbe030359b for instance with vm_state active and task_state deleting.
Jul 31 10:14:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5d092d4f-d66d-4837-b369-cae72b851b7f tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:14:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5d092d4f-d66d-4837-b369-cae72b851b7f tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:14:15 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-5d092d4f-d66d-4837-b369-cae72b851b7f tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:14:15 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-5d092d4f-d66d-4837-b369-cae72b851b7f tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:14:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5d092d4f-d66d-4837-b369-cae72b851b7f tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.211s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:14:15 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-5d092d4f-d66d-4837-b369-cae72b851b7f tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Deleted allocations for instance be9f0ded-8064-4675-99f7-8620f0fe3dda
Jul 31 10:14:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-5d092d4f-d66d-4837-b369-cae72b851b7f tempest-TestVolumeBootPattern-1754399827 tempest-TestVolumeBootPattern-1754399827-project-member] Lock "be9f0ded-8064-4675-99f7-8620f0fe3dda" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.674s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:14:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:14:16 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:14:18 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:14:19 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:14:23 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:14:23 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:14:25 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:14:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:14:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:14:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:14:25 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:14:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:14:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:14:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:14:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:14:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9299196-6e9b-4a48-9c90-e1e24243a7b1/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:14:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9299196-6e9b-4a48-9c90-e1e24243a7b1/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:14:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9299196-6e9b-4a48-9c90-e1e24243a7b1/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:14:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9299196-6e9b-4a48-9c90-e1e24243a7b1/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:14:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:14:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:14:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:14:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:14:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:14:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:14:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:14:27 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:14:27 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6102f0cd-8e00-4b93-86a7-3afeb061cf8a/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:14:27 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6102f0cd-8e00-4b93-86a7-3afeb061cf8a/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:14:27 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6102f0cd-8e00-4b93-86a7-3afeb061cf8a/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:14:27 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6102f0cd-8e00-4b93-86a7-3afeb061cf8a/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:14:27 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:14:27 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:14:27 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=8358MB free_disk=25.218746185302734GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:14:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:14:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:14:27 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:14:27 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 8129456b-a22c-46e3-b5db-89fdcec87dec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:14:27 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance a9299196-6e9b-4a48-9c90-e1e24243a7b1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:14:27 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 6102f0cd-8e00-4b93-86a7-3afeb061cf8a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:14:27 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:14:27 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:14:27 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:14:27 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:14:27 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:14:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.302s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:14:28 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690798453.471208, be9f0ded-8064-4675-99f7-8620f0fe3dda => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:14:28 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] VM Stopped (Lifecycle Event)
Jul 31 10:14:28 user nova-compute[71113]: DEBUG nova.compute.manager [None req-cb03bed5-1b70-44b8-b68b-1f7cf7fbb2f2 None None] [instance: be9f0ded-8064-4675-99f7-8620f0fe3dda] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:14:28 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:14:28 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:14:29 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:14:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "refresh_cache-8129456b-a22c-46e3-b5db-89fdcec87dec" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:14:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquired lock "refresh_cache-8129456b-a22c-46e3-b5db-89fdcec87dec" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:14:29 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Forcefully refreshing network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 10:14:29 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Updating instance_info_cache with network_info: [{"id": "1a2da0f9-2fb6-4880-96b5-be8dd9d12574", "address": "fa:16:3e:fe:2b:04", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a2da0f9-2f", "ovs_interfaceid": "1a2da0f9-2fb6-4880-96b5-be8dd9d12574", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:14:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Releasing lock "refresh_cache-8129456b-a22c-46e3-b5db-89fdcec87dec" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:14:29 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Updated the network info_cache for instance {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 10:14:29 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:14:29 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:14:29 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:14:32 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:14:32 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:14:33 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:14:35 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-02f7394f-49e9-42cf-951e-45e517cfdc40 tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Acquiring lock "6102f0cd-8e00-4b93-86a7-3afeb061cf8a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:14:35 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-02f7394f-49e9-42cf-951e-45e517cfdc40 tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Lock "6102f0cd-8e00-4b93-86a7-3afeb061cf8a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:14:35 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-02f7394f-49e9-42cf-951e-45e517cfdc40 tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Acquiring lock "6102f0cd-8e00-4b93-86a7-3afeb061cf8a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:14:35 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-02f7394f-49e9-42cf-951e-45e517cfdc40 tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Lock "6102f0cd-8e00-4b93-86a7-3afeb061cf8a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:14:35 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-02f7394f-49e9-42cf-951e-45e517cfdc40 tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Lock "6102f0cd-8e00-4b93-86a7-3afeb061cf8a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:14:35 user nova-compute[71113]: INFO nova.compute.manager [None req-02f7394f-49e9-42cf-951e-45e517cfdc40 tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Terminating instance
Jul 31 10:14:35 user nova-compute[71113]: DEBUG nova.compute.manager [None req-02f7394f-49e9-42cf-951e-45e517cfdc40 tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Start destroying the instance on the hypervisor. {{(pid=71113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 10:14:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:14:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:14:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:14:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:14:36 user nova-compute[71113]: DEBUG nova.compute.manager [req-9c9117cd-7c9e-41bb-b622-07681db8c07e req-2a9e3c67-3a73-4b46-828b-f4220a37a7e1 service nova] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Received event network-vif-unplugged-1bf042b5-613f-421e-9dc6-401f6fac52d7 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:14:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9c9117cd-7c9e-41bb-b622-07681db8c07e req-2a9e3c67-3a73-4b46-828b-f4220a37a7e1 service nova] Acquiring lock "6102f0cd-8e00-4b93-86a7-3afeb061cf8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:14:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9c9117cd-7c9e-41bb-b622-07681db8c07e req-2a9e3c67-3a73-4b46-828b-f4220a37a7e1 service nova] Lock "6102f0cd-8e00-4b93-86a7-3afeb061cf8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:14:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9c9117cd-7c9e-41bb-b622-07681db8c07e req-2a9e3c67-3a73-4b46-828b-f4220a37a7e1 service nova] Lock "6102f0cd-8e00-4b93-86a7-3afeb061cf8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:14:36 user nova-compute[71113]: DEBUG nova.compute.manager [req-9c9117cd-7c9e-41bb-b622-07681db8c07e req-2a9e3c67-3a73-4b46-828b-f4220a37a7e1 service nova] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] No waiting events found dispatching network-vif-unplugged-1bf042b5-613f-421e-9dc6-401f6fac52d7 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:14:36 user nova-compute[71113]: DEBUG nova.compute.manager [req-9c9117cd-7c9e-41bb-b622-07681db8c07e req-2a9e3c67-3a73-4b46-828b-f4220a37a7e1 service nova] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Received event network-vif-unplugged-1bf042b5-613f-421e-9dc6-401f6fac52d7 for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 10:14:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:14:36 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Instance destroyed successfully.
Jul 31 10:14:36 user nova-compute[71113]: DEBUG nova.objects.instance [None req-02f7394f-49e9-42cf-951e-45e517cfdc40 tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Lazy-loading 'resources' on Instance uuid 6102f0cd-8e00-4b93-86a7-3afeb061cf8a {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:14:36 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-02f7394f-49e9-42cf-951e-45e517cfdc40 tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:12:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-919523007',display_name='tempest-VolumesNegativeTest-instance-919523007',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-919523007',id=45,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T10:12:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fa2fb1d4d5074bf4a7c8365902c9a51a',ramdisk_id='',reservation_id='r-lmmwk0ts',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1097791982',owner_user_name='tempest-VolumesNegativeTest-1097791982-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T10:12:52Z,user_data=None,user_id='d6a9d025eb3946fe85ee306bdc8d633a',uuid=6102f0cd-8e00-4b93-86a7-3afeb061cf8a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1bf042b5-613f-421e-9dc6-401f6fac52d7", "address": "fa:16:3e:68:4e:f5", "network": {"id": "8f121ee0-4c42-403b-84ac-8084df1d49d9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "afca600337e543019324e69e8944cdaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf042b5-61", "ovs_interfaceid": "1bf042b5-613f-421e-9dc6-401f6fac52d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 10:14:36 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-02f7394f-49e9-42cf-951e-45e517cfdc40 tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Converting VIF {"id": "1bf042b5-613f-421e-9dc6-401f6fac52d7", "address": "fa:16:3e:68:4e:f5", "network": {"id": "8f121ee0-4c42-403b-84ac-8084df1d49d9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "afca600337e543019324e69e8944cdaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bf042b5-61", "ovs_interfaceid": "1bf042b5-613f-421e-9dc6-401f6fac52d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:14:36 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-02f7394f-49e9-42cf-951e-45e517cfdc40 tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:4e:f5,bridge_name='br-int',has_traffic_filtering=True,id=1bf042b5-613f-421e-9dc6-401f6fac52d7,network=Network(8f121ee0-4c42-403b-84ac-8084df1d49d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bf042b5-61') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:14:36 user nova-compute[71113]: DEBUG os_vif [None req-02f7394f-49e9-42cf-951e-45e517cfdc40 tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:4e:f5,bridge_name='br-int',has_traffic_filtering=True,id=1bf042b5-613f-421e-9dc6-401f6fac52d7,network=Network(8f121ee0-4c42-403b-84ac-8084df1d49d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bf042b5-61') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 10:14:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:14:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1bf042b5-61, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:14:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:14:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:14:36 user nova-compute[71113]: INFO os_vif [None req-02f7394f-49e9-42cf-951e-45e517cfdc40 tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:4e:f5,bridge_name='br-int',has_traffic_filtering=True,id=1bf042b5-613f-421e-9dc6-401f6fac52d7,network=Network(8f121ee0-4c42-403b-84ac-8084df1d49d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bf042b5-61')
Jul 31 10:14:36 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-02f7394f-49e9-42cf-951e-45e517cfdc40 tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Deleting instance files /opt/stack/data/nova/instances/6102f0cd-8e00-4b93-86a7-3afeb061cf8a_del
Jul 31 10:14:36 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-02f7394f-49e9-42cf-951e-45e517cfdc40 tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Deletion of /opt/stack/data/nova/instances/6102f0cd-8e00-4b93-86a7-3afeb061cf8a_del complete
Jul 31 10:14:36 user nova-compute[71113]: INFO nova.compute.manager [None req-02f7394f-49e9-42cf-951e-45e517cfdc40 tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Took 0.88 seconds to destroy the instance on the hypervisor.
Jul 31 10:14:36 user nova-compute[71113]: DEBUG oslo.service.loopingcall [None req-02f7394f-49e9-42cf-951e-45e517cfdc40 tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71113) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 10:14:36 user nova-compute[71113]: DEBUG nova.compute.manager [-] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Deallocating network for instance {{(pid=71113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 10:14:36 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] deallocate_for_instance() {{(pid=71113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 10:14:36 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:14:37 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:14:37 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Took 0.47 seconds to deallocate network for instance.
Jul 31 10:14:37 user nova-compute[71113]: DEBUG nova.compute.manager [req-24c2b538-e180-4da9-9ba0-ad182358eb66 req-2ce13118-654f-4bce-986c-0fff5026755b service nova] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Received event network-vif-deleted-1bf042b5-613f-421e-9dc6-401f6fac52d7 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:14:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-02f7394f-49e9-42cf-951e-45e517cfdc40 tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:14:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-02f7394f-49e9-42cf-951e-45e517cfdc40 tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:14:37 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-02f7394f-49e9-42cf-951e-45e517cfdc40 tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:14:37 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-02f7394f-49e9-42cf-951e-45e517cfdc40 tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:14:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-02f7394f-49e9-42cf-951e-45e517cfdc40 tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.177s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:14:37 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-02f7394f-49e9-42cf-951e-45e517cfdc40 tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Deleted allocations for instance 6102f0cd-8e00-4b93-86a7-3afeb061cf8a
Jul 31 10:14:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-02f7394f-49e9-42cf-951e-45e517cfdc40 tempest-VolumesNegativeTest-1097791982 tempest-VolumesNegativeTest-1097791982-project-member] Lock "6102f0cd-8e00-4b93-86a7-3afeb061cf8a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.715s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:14:38 user nova-compute[71113]: DEBUG nova.compute.manager [req-8acd6823-21d4-4d12-a547-dd5aa80201fa req-c2161843-17ff-4ad7-a99e-386d04f0e560 service nova] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Received event network-vif-plugged-1bf042b5-613f-421e-9dc6-401f6fac52d7 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:14:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8acd6823-21d4-4d12-a547-dd5aa80201fa req-c2161843-17ff-4ad7-a99e-386d04f0e560 service nova] Acquiring lock "6102f0cd-8e00-4b93-86a7-3afeb061cf8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:14:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8acd6823-21d4-4d12-a547-dd5aa80201fa req-c2161843-17ff-4ad7-a99e-386d04f0e560 service nova] Lock "6102f0cd-8e00-4b93-86a7-3afeb061cf8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:14:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8acd6823-21d4-4d12-a547-dd5aa80201fa req-c2161843-17ff-4ad7-a99e-386d04f0e560 service nova] Lock "6102f0cd-8e00-4b93-86a7-3afeb061cf8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:14:38 user nova-compute[71113]: DEBUG nova.compute.manager [req-8acd6823-21d4-4d12-a547-dd5aa80201fa req-c2161843-17ff-4ad7-a99e-386d04f0e560 service nova] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] No waiting events found dispatching network-vif-plugged-1bf042b5-613f-421e-9dc6-401f6fac52d7 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:14:38 user nova-compute[71113]: WARNING nova.compute.manager [req-8acd6823-21d4-4d12-a547-dd5aa80201fa req-c2161843-17ff-4ad7-a99e-386d04f0e560 service nova] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Received unexpected event network-vif-plugged-1bf042b5-613f-421e-9dc6-401f6fac52d7 for instance with vm_state deleted and task_state None.
Jul 31 10:14:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:14:46 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:14:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-d31c92ae-6563-4721-9dd8-7e1a88f59645 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquiring lock "a9299196-6e9b-4a48-9c90-e1e24243a7b1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:14:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-d31c92ae-6563-4721-9dd8-7e1a88f59645 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "a9299196-6e9b-4a48-9c90-e1e24243a7b1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:14:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-d31c92ae-6563-4721-9dd8-7e1a88f59645 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquiring lock "a9299196-6e9b-4a48-9c90-e1e24243a7b1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:14:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-d31c92ae-6563-4721-9dd8-7e1a88f59645 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "a9299196-6e9b-4a48-9c90-e1e24243a7b1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:14:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-d31c92ae-6563-4721-9dd8-7e1a88f59645 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "a9299196-6e9b-4a48-9c90-e1e24243a7b1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:14:49 user nova-compute[71113]: INFO nova.compute.manager [None req-d31c92ae-6563-4721-9dd8-7e1a88f59645 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Terminating instance
Jul 31 10:14:49 user nova-compute[71113]: DEBUG nova.compute.manager [None req-d31c92ae-6563-4721-9dd8-7e1a88f59645 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Start destroying the instance on the hypervisor. {{(pid=71113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 10:14:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:14:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:14:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:14:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:14:49 user nova-compute[71113]: DEBUG nova.compute.manager [req-d27911a2-8486-4461-aad9-380e401b3eb0 req-5b2d8a96-3663-4b33-ba2b-ed888faf68f0 service nova] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Received event network-vif-unplugged-6764da79-a9ff-4470-b3ac-5eb0f8346538 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:14:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-d27911a2-8486-4461-aad9-380e401b3eb0 req-5b2d8a96-3663-4b33-ba2b-ed888faf68f0 service nova] Acquiring lock "a9299196-6e9b-4a48-9c90-e1e24243a7b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:14:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-d27911a2-8486-4461-aad9-380e401b3eb0 req-5b2d8a96-3663-4b33-ba2b-ed888faf68f0 service nova] Lock "a9299196-6e9b-4a48-9c90-e1e24243a7b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:14:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-d27911a2-8486-4461-aad9-380e401b3eb0 req-5b2d8a96-3663-4b33-ba2b-ed888faf68f0 service nova] Lock "a9299196-6e9b-4a48-9c90-e1e24243a7b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:14:49 user nova-compute[71113]: DEBUG nova.compute.manager [req-d27911a2-8486-4461-aad9-380e401b3eb0 req-5b2d8a96-3663-4b33-ba2b-ed888faf68f0 service nova] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] No waiting events found dispatching network-vif-unplugged-6764da79-a9ff-4470-b3ac-5eb0f8346538 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:14:49 user nova-compute[71113]: DEBUG nova.compute.manager [req-d27911a2-8486-4461-aad9-380e401b3eb0 req-5b2d8a96-3663-4b33-ba2b-ed888faf68f0 service nova] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Received event network-vif-unplugged-6764da79-a9ff-4470-b3ac-5eb0f8346538 for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 10:14:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:14:49 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Instance destroyed successfully.
Jul 31 10:14:49 user nova-compute[71113]: DEBUG nova.objects.instance [None req-d31c92ae-6563-4721-9dd8-7e1a88f59645 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lazy-loading 'resources' on Instance uuid a9299196-6e9b-4a48-9c90-e1e24243a7b1 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:14:49 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-d31c92ae-6563-4721-9dd8-7e1a88f59645 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:11:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1347479544',display_name='tempest-AttachVolumeNegativeTest-server-1347479544',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1347479544',id=44,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0k1XIU6/yPsYKzRnjxR2i/mLa46OrKYOci1jOf6iqYQ5EUJhh2nxVX/070X8HDwZOC+3odGp3i66eQvMxtsT7eIwaUSBeHkgUSQWRj7rtFbg6pnbZgpcfFCO6QtY+54w==',key_name='tempest-keypair-1410974386',keypairs=<?>,launch_index=0,launched_at=2023-07-31T10:11:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7000d6a2a6b147ddbc38208b316574cd',ramdisk_id='',reservation_id='r-z240xc48',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2110881646',owner_user_name='tempest-AttachVolumeNegativeTest-2110881646-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T10:12:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9883a5677fb4852ae031137736a9ee4',uuid=a9299196-6e9b-4a48-9c90-e1e24243a7b1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6764da79-a9ff-4470-b3ac-5eb0f8346538", "address": "fa:16:3e:ef:aa:50", "network": {"id": "4b030626-e3f1-4617-89c2-f6389226652f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441335951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7000d6a2a6b147ddbc38208b316574cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6764da79-a9", "ovs_interfaceid": "6764da79-a9ff-4470-b3ac-5eb0f8346538", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 10:14:49 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-d31c92ae-6563-4721-9dd8-7e1a88f59645 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Converting VIF {"id": "6764da79-a9ff-4470-b3ac-5eb0f8346538", "address": "fa:16:3e:ef:aa:50", "network": {"id": "4b030626-e3f1-4617-89c2-f6389226652f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441335951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7000d6a2a6b147ddbc38208b316574cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6764da79-a9", "ovs_interfaceid": "6764da79-a9ff-4470-b3ac-5eb0f8346538", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:14:49 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-d31c92ae-6563-4721-9dd8-7e1a88f59645 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:aa:50,bridge_name='br-int',has_traffic_filtering=True,id=6764da79-a9ff-4470-b3ac-5eb0f8346538,network=Network(4b030626-e3f1-4617-89c2-f6389226652f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6764da79-a9') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:14:49 user nova-compute[71113]: DEBUG os_vif [None req-d31c92ae-6563-4721-9dd8-7e1a88f59645 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:aa:50,bridge_name='br-int',has_traffic_filtering=True,id=6764da79-a9ff-4470-b3ac-5eb0f8346538,network=Network(4b030626-e3f1-4617-89c2-f6389226652f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6764da79-a9') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 10:14:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:14:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6764da79-a9, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:14:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:14:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:14:49 user nova-compute[71113]: INFO os_vif [None req-d31c92ae-6563-4721-9dd8-7e1a88f59645 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:aa:50,bridge_name='br-int',has_traffic_filtering=True,id=6764da79-a9ff-4470-b3ac-5eb0f8346538,network=Network(4b030626-e3f1-4617-89c2-f6389226652f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6764da79-a9')
Jul 31 10:14:49 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-d31c92ae-6563-4721-9dd8-7e1a88f59645 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Deleting instance files /opt/stack/data/nova/instances/a9299196-6e9b-4a48-9c90-e1e24243a7b1_del
Jul 31 10:14:49 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-d31c92ae-6563-4721-9dd8-7e1a88f59645 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Deletion of /opt/stack/data/nova/instances/a9299196-6e9b-4a48-9c90-e1e24243a7b1_del complete
Jul 31 10:14:49 user nova-compute[71113]: INFO nova.compute.manager [None req-d31c92ae-6563-4721-9dd8-7e1a88f59645 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Took 0.87 seconds to destroy the instance on the hypervisor.
Jul 31 10:14:49 user nova-compute[71113]: DEBUG oslo.service.loopingcall [None req-d31c92ae-6563-4721-9dd8-7e1a88f59645 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71113) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 10:14:49 user nova-compute[71113]: DEBUG nova.compute.manager [-] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Deallocating network for instance {{(pid=71113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 10:14:49 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] deallocate_for_instance() {{(pid=71113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 10:14:50 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:14:50 user nova-compute[71113]: DEBUG nova.compute.manager [req-f2aef205-8360-4bdb-9c7d-13dfaee1170c req-0f80f81b-e47f-4c04-ab97-dc0edfdc3bca service nova] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Received event network-vif-deleted-6764da79-a9ff-4470-b3ac-5eb0f8346538 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:14:50 user nova-compute[71113]: INFO nova.compute.manager [req-f2aef205-8360-4bdb-9c7d-13dfaee1170c req-0f80f81b-e47f-4c04-ab97-dc0edfdc3bca service nova] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Neutron deleted interface 6764da79-a9ff-4470-b3ac-5eb0f8346538; detaching it from the instance and deleting it from the info cache
Jul 31 10:14:50 user nova-compute[71113]: DEBUG nova.network.neutron [req-f2aef205-8360-4bdb-9c7d-13dfaee1170c req-0f80f81b-e47f-4c04-ab97-dc0edfdc3bca service nova] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:14:50 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Took 0.85 seconds to deallocate network for instance.
Jul 31 10:14:50 user nova-compute[71113]: DEBUG nova.compute.manager [req-f2aef205-8360-4bdb-9c7d-13dfaee1170c req-0f80f81b-e47f-4c04-ab97-dc0edfdc3bca service nova] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Detach interface failed, port_id=6764da79-a9ff-4470-b3ac-5eb0f8346538, reason: Instance a9299196-6e9b-4a48-9c90-e1e24243a7b1 could not be found. {{(pid=71113) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 10:14:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-d31c92ae-6563-4721-9dd8-7e1a88f59645 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:14:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-d31c92ae-6563-4721-9dd8-7e1a88f59645 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:14:51 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-d31c92ae-6563-4721-9dd8-7e1a88f59645 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:14:51 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-d31c92ae-6563-4721-9dd8-7e1a88f59645 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:14:51 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-d31c92ae-6563-4721-9dd8-7e1a88f59645 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.327s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:14:51 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-d31c92ae-6563-4721-9dd8-7e1a88f59645 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Deleted allocations for instance a9299196-6e9b-4a48-9c90-e1e24243a7b1
Jul 31 10:14:51 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-d31c92ae-6563-4721-9dd8-7e1a88f59645 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "a9299196-6e9b-4a48-9c90-e1e24243a7b1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.214s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:14:51 user nova-compute[71113]: DEBUG nova.compute.manager [req-94c96a3b-c98e-4c24-8333-22e3917b0998 req-d4f3d637-c1f7-4a34-9459-51593f95ea76 service nova] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Received event network-vif-plugged-6764da79-a9ff-4470-b3ac-5eb0f8346538 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:14:51 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-94c96a3b-c98e-4c24-8333-22e3917b0998 req-d4f3d637-c1f7-4a34-9459-51593f95ea76 service nova] Acquiring lock "a9299196-6e9b-4a48-9c90-e1e24243a7b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:14:51 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-94c96a3b-c98e-4c24-8333-22e3917b0998 req-d4f3d637-c1f7-4a34-9459-51593f95ea76 service nova] Lock "a9299196-6e9b-4a48-9c90-e1e24243a7b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:14:51 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-94c96a3b-c98e-4c24-8333-22e3917b0998 req-d4f3d637-c1f7-4a34-9459-51593f95ea76 service nova] Lock "a9299196-6e9b-4a48-9c90-e1e24243a7b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:14:51 user nova-compute[71113]: DEBUG nova.compute.manager [req-94c96a3b-c98e-4c24-8333-22e3917b0998 req-d4f3d637-c1f7-4a34-9459-51593f95ea76 service nova] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] No waiting events found dispatching network-vif-plugged-6764da79-a9ff-4470-b3ac-5eb0f8346538 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:14:51 user nova-compute[71113]: WARNING nova.compute.manager [req-94c96a3b-c98e-4c24-8333-22e3917b0998 req-d4f3d637-c1f7-4a34-9459-51593f95ea76 service nova] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Received unexpected event network-vif-plugged-6764da79-a9ff-4470-b3ac-5eb0f8346538 for instance with vm_state deleted and task_state None.
Jul 31 10:14:51 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690798476.5010643, 6102f0cd-8e00-4b93-86a7-3afeb061cf8a => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:14:51 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] VM Stopped (Lifecycle Event)
Jul 31 10:14:51 user nova-compute[71113]: DEBUG nova.compute.manager [None req-88483570-d792-41b5-9b22-c2e61cf2401b None None] [instance: 6102f0cd-8e00-4b93-86a7-3afeb061cf8a] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:14:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:14:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:15:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:15:04 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690798489.783419, a9299196-6e9b-4a48-9c90-e1e24243a7b1 => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:15:04 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] VM Stopped (Lifecycle Event)
Jul 31 10:15:04 user nova-compute[71113]: DEBUG nova.compute.manager [None req-4d5c0cda-8bfd-43d0-9c38-0f19a53bc005 None None] [instance: a9299196-6e9b-4a48-9c90-e1e24243a7b1] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:15:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:15:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:15:11 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:15:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:15:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:15:18 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:15:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:15:21 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:15:23 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:15:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:15:27 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:15:27 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:15:27 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Didn't find any instances for network info cache update. {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 10:15:27 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:15:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:15:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:15:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:15:27 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:15:27 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:15:28 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:15:28 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:15:28 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:15:28 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:15:28 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:15:28 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:15:28 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:15:28 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:15:28 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:15:28 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:15:28 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:15:29 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:15:29 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:15:29 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=8644MB free_disk=25.272411346435547GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:15:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:15:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:15:29 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:15:29 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 8129456b-a22c-46e3-b5db-89fdcec87dec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:15:29 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:15:29 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:15:29 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:15:29 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:15:29 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:15:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.218s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:15:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:15:30 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:15:30 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:15:30 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:15:32 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:15:33 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:15:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:15:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:15:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:15:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:15:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:15:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:15:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:15:42 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquiring lock "d3a41634-a30c-47f8-b44d-8db3571358ef" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:15:42 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "d3a41634-a30c-47f8-b44d-8db3571358ef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:15:42 user nova-compute[71113]: DEBUG nova.compute.manager [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Starting instance... {{(pid=71113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 10:15:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:15:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:15:43 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 10:15:43 user nova-compute[71113]: INFO nova.compute.claims [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Claim successful on node user
Jul 31 10:15:43 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:15:43 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:15:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.247s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:15:43 user nova-compute[71113]: DEBUG nova.compute.manager [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Start building networks asynchronously for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 10:15:43 user nova-compute[71113]: DEBUG nova.compute.manager [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Allocating IP information in the background. {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 10:15:43 user nova-compute[71113]: DEBUG nova.network.neutron [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] allocate_for_instance() {{(pid=71113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 10:15:43 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 10:15:43 user nova-compute[71113]: DEBUG nova.policy [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd9883a5677fb4852ae031137736a9ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7000d6a2a6b147ddbc38208b316574cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71113) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 10:15:43 user nova-compute[71113]: DEBUG nova.compute.manager [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Start building block device mappings for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 10:15:43 user nova-compute[71113]: DEBUG nova.compute.manager [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Start spawning the instance on the hypervisor. {{(pid=71113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 10:15:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 10:15:43 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Creating image(s)
Jul 31 10:15:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquiring lock "/opt/stack/data/nova/instances/d3a41634-a30c-47f8-b44d-8db3571358ef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:15:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "/opt/stack/data/nova/instances/d3a41634-a30c-47f8-b44d-8db3571358ef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:15:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "/opt/stack/data/nova/instances/d3a41634-a30c-47f8-b44d-8db3571358ef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:15:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:15:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.148s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:15:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquiring lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:15:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:15:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:15:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.140s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:15:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/d3a41634-a30c-47f8-b44d-8db3571358ef/disk 1073741824 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:15:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/d3a41634-a30c-47f8-b44d-8db3571358ef/disk 1073741824" returned: 0 in 0.057s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:15:44 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:15:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:15:44 user nova-compute[71113]: DEBUG nova.network.neutron [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Successfully created port: 595b2c06-06c0-43cf-9749-07f63e9a8e25 {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 10:15:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.142s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:15:44 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d3a41634-a30c-47f8-b44d-8db3571358ef/disk. size=1073741824 {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 10:15:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3a41634-a30c-47f8-b44d-8db3571358ef/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:15:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3a41634-a30c-47f8-b44d-8db3571358ef/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:15:44 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Cannot resize image /opt/stack/data/nova/instances/d3a41634-a30c-47f8-b44d-8db3571358ef/disk to a smaller size. {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 10:15:44 user nova-compute[71113]: DEBUG nova.objects.instance [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lazy-loading 'migration_context' on Instance uuid d3a41634-a30c-47f8-b44d-8db3571358ef {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:15:44 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Created local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 10:15:44 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Ensure instance console log exists: /opt/stack/data/nova/instances/d3a41634-a30c-47f8-b44d-8db3571358ef/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 10:15:44 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:15:44 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:15:44 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:15:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:15:44 user nova-compute[71113]: DEBUG nova.network.neutron [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Successfully updated port: 595b2c06-06c0-43cf-9749-07f63e9a8e25 {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 10:15:44 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquiring lock "refresh_cache-d3a41634-a30c-47f8-b44d-8db3571358ef" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:15:44 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquired lock "refresh_cache-d3a41634-a30c-47f8-b44d-8db3571358ef" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:15:44 user nova-compute[71113]: DEBUG nova.network.neutron [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 10:15:44 user nova-compute[71113]: DEBUG nova.compute.manager [req-0c165fe9-1db8-4c17-ad09-1a340f4a908e req-0d065c92-66d4-4cf4-8a6b-3ece975b545d service nova] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Received event network-changed-595b2c06-06c0-43cf-9749-07f63e9a8e25 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:15:44 user nova-compute[71113]: DEBUG nova.compute.manager [req-0c165fe9-1db8-4c17-ad09-1a340f4a908e req-0d065c92-66d4-4cf4-8a6b-3ece975b545d service nova] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Refreshing instance network info cache due to event network-changed-595b2c06-06c0-43cf-9749-07f63e9a8e25. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 10:15:44 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-0c165fe9-1db8-4c17-ad09-1a340f4a908e req-0d065c92-66d4-4cf4-8a6b-3ece975b545d service nova] Acquiring lock "refresh_cache-d3a41634-a30c-47f8-b44d-8db3571358ef" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:15:45 user nova-compute[71113]: DEBUG nova.network.neutron [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 10:15:45 user nova-compute[71113]: DEBUG nova.network.neutron [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Updating instance_info_cache with network_info: [{"id": "595b2c06-06c0-43cf-9749-07f63e9a8e25", "address": "fa:16:3e:cd:4d:52", "network": {"id": "4b030626-e3f1-4617-89c2-f6389226652f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441335951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7000d6a2a6b147ddbc38208b316574cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap595b2c06-06", "ovs_interfaceid": "595b2c06-06c0-43cf-9749-07f63e9a8e25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:15:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Releasing lock "refresh_cache-d3a41634-a30c-47f8-b44d-8db3571358ef" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:15:45 user nova-compute[71113]: DEBUG nova.compute.manager [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Instance network_info: |[{"id": "595b2c06-06c0-43cf-9749-07f63e9a8e25", "address": "fa:16:3e:cd:4d:52", "network": {"id": "4b030626-e3f1-4617-89c2-f6389226652f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441335951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7000d6a2a6b147ddbc38208b316574cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap595b2c06-06", "ovs_interfaceid": "595b2c06-06c0-43cf-9749-07f63e9a8e25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 10:15:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-0c165fe9-1db8-4c17-ad09-1a340f4a908e req-0d065c92-66d4-4cf4-8a6b-3ece975b545d service nova] Acquired lock "refresh_cache-d3a41634-a30c-47f8-b44d-8db3571358ef" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:15:45 user nova-compute[71113]: DEBUG nova.network.neutron [req-0c165fe9-1db8-4c17-ad09-1a340f4a908e req-0d065c92-66d4-4cf4-8a6b-3ece975b545d service nova] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Refreshing network info cache for port 595b2c06-06c0-43cf-9749-07f63e9a8e25 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 10:15:45 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Start _get_guest_xml network_info=[{"id": "595b2c06-06c0-43cf-9749-07f63e9a8e25", "address": "fa:16:3e:cd:4d:52", "network": {"id": "4b030626-e3f1-4617-89c2-f6389226652f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441335951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7000d6a2a6b147ddbc38208b316574cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap595b2c06-06", "ovs_interfaceid": "595b2c06-06c0-43cf-9749-07f63e9a8e25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'image_id': '078646fe-b504-41ed-a147-61072e903e51'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 10:15:45 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:15:45 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:15:45 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 10:15:45 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 10:15:45 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 10:15:45 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 10:15:45 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 10:15:45 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 10:15:45 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 10:15:45 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 10:15:45 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 10:15:45 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 10:15:45 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 10:15:45 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 10:15:45 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 10:15:45 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 10:15:45 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 10:15:45 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 10:15:45 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:15:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1232366544',display_name='tempest-AttachVolumeNegativeTest-server-1232366544',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1232366544',id=46,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKaG/whoFc06ZxgGymHTuNDkn0lhdZCou+Z4H5Laaj5kiT9KoBWnbpgTMq3hXCjSMRteGFbQ50eb8O26WfS5tErjOgXpt3ZmVmCT1GcJjWY7A8l1dnu3sGcmRqllh/EVuA==',key_name='tempest-keypair-1325829023',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7000d6a2a6b147ddbc38208b316574cd',ramdisk_id='',reservation_id='r-v4j0popm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2110881646',owner_user_name='tempest-AttachVolumeNegativeTest-2110881646-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T10:15:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9883a5677fb4852ae031137736a9ee4',uuid=d3a41634-a30c-47f8-b44d-8db3571358ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "595b2c06-06c0-43cf-9749-07f63e9a8e25", "address": "fa:16:3e:cd:4d:52", "network": {"id": "4b030626-e3f1-4617-89c2-f6389226652f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441335951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7000d6a2a6b147ddbc38208b316574cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap595b2c06-06", "ovs_interfaceid": "595b2c06-06c0-43cf-9749-07f63e9a8e25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 10:15:45 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Converting VIF {"id": "595b2c06-06c0-43cf-9749-07f63e9a8e25", "address": "fa:16:3e:cd:4d:52", "network": {"id": "4b030626-e3f1-4617-89c2-f6389226652f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441335951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7000d6a2a6b147ddbc38208b316574cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap595b2c06-06", "ovs_interfaceid": "595b2c06-06c0-43cf-9749-07f63e9a8e25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:15:45 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:4d:52,bridge_name='br-int',has_traffic_filtering=True,id=595b2c06-06c0-43cf-9749-07f63e9a8e25,network=Network(4b030626-e3f1-4617-89c2-f6389226652f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap595b2c06-06') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:15:45 user nova-compute[71113]: DEBUG nova.objects.instance [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lazy-loading 'pci_devices' on Instance uuid d3a41634-a30c-47f8-b44d-8db3571358ef {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:15:45 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] End _get_guest_xml xml=<domain type="kvm">
Jul 31 10:15:45 user nova-compute[71113]:   <uuid>d3a41634-a30c-47f8-b44d-8db3571358ef</uuid>
Jul 31 10:15:45 user nova-compute[71113]:   <name>instance-0000002e</name>
Jul 31 10:15:45 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 10:15:45 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 10:15:45 user nova-compute[71113]:   <metadata>
Jul 31 10:15:45 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 10:15:45 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 10:15:45 user nova-compute[71113]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1232366544</nova:name>
Jul 31 10:15:45 user nova-compute[71113]:       <nova:creationTime>2023-07-31 10:15:45</nova:creationTime>
Jul 31 10:15:45 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 10:15:45 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 10:15:45 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 10:15:45 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 10:15:45 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 10:15:45 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 10:15:45 user nova-compute[71113]:       </nova:flavor>
Jul 31 10:15:45 user nova-compute[71113]:       <nova:owner>
Jul 31 10:15:45 user nova-compute[71113]:         <nova:user uuid="d9883a5677fb4852ae031137736a9ee4">tempest-AttachVolumeNegativeTest-2110881646-project-member</nova:user>
Jul 31 10:15:45 user nova-compute[71113]:         <nova:project uuid="7000d6a2a6b147ddbc38208b316574cd">tempest-AttachVolumeNegativeTest-2110881646</nova:project>
Jul 31 10:15:45 user nova-compute[71113]:       </nova:owner>
Jul 31 10:15:45 user nova-compute[71113]:       <nova:root type="image" uuid="078646fe-b504-41ed-a147-61072e903e51"/>
Jul 31 10:15:45 user nova-compute[71113]:       <nova:ports>
Jul 31 10:15:45 user nova-compute[71113]:         <nova:port uuid="595b2c06-06c0-43cf-9749-07f63e9a8e25">
Jul 31 10:15:45 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 31 10:15:45 user nova-compute[71113]:         </nova:port>
Jul 31 10:15:45 user nova-compute[71113]:       </nova:ports>
Jul 31 10:15:45 user nova-compute[71113]:     </nova:instance>
Jul 31 10:15:45 user nova-compute[71113]:   </metadata>
Jul 31 10:15:45 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 10:15:45 user nova-compute[71113]:     <system>
Jul 31 10:15:45 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 10:15:45 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 10:15:45 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 10:15:45 user nova-compute[71113]:       <entry name="serial">d3a41634-a30c-47f8-b44d-8db3571358ef</entry>
Jul 31 10:15:45 user nova-compute[71113]:       <entry name="uuid">d3a41634-a30c-47f8-b44d-8db3571358ef</entry>
Jul 31 10:15:45 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 10:15:45 user nova-compute[71113]:     </system>
Jul 31 10:15:45 user nova-compute[71113]:   </sysinfo>
Jul 31 10:15:45 user nova-compute[71113]:   <os>
Jul 31 10:15:45 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 10:15:45 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 10:15:45 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 10:15:45 user nova-compute[71113]:   </os>
Jul 31 10:15:45 user nova-compute[71113]:   <features>
Jul 31 10:15:45 user nova-compute[71113]:     <acpi/>
Jul 31 10:15:45 user nova-compute[71113]:     <apic/>
Jul 31 10:15:45 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 10:15:45 user nova-compute[71113]:   </features>
Jul 31 10:15:45 user nova-compute[71113]:   <clock offset="utc">
Jul 31 10:15:45 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 10:15:45 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 10:15:45 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 10:15:45 user nova-compute[71113]:   </clock>
Jul 31 10:15:45 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 10:15:45 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 10:15:45 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 10:15:45 user nova-compute[71113]:   </cpu>
Jul 31 10:15:45 user nova-compute[71113]:   <devices>
Jul 31 10:15:45 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 10:15:45 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 10:15:45 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/d3a41634-a30c-47f8-b44d-8db3571358ef/disk"/>
Jul 31 10:15:45 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 10:15:45 user nova-compute[71113]:     </disk>
Jul 31 10:15:45 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 10:15:45 user nova-compute[71113]:       <mac address="fa:16:3e:cd:4d:52"/>
Jul 31 10:15:45 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:15:45 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 10:15:45 user nova-compute[71113]:       <target dev="tap595b2c06-06"/>
Jul 31 10:15:45 user nova-compute[71113]:     </interface>
Jul 31 10:15:45 user nova-compute[71113]:     <serial type="pty">
Jul 31 10:15:45 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/d3a41634-a30c-47f8-b44d-8db3571358ef/console.log" append="off"/>
Jul 31 10:15:45 user nova-compute[71113]:     </serial>
Jul 31 10:15:45 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 10:15:45 user nova-compute[71113]:     <video>
Jul 31 10:15:45 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:15:45 user nova-compute[71113]:     </video>
Jul 31 10:15:45 user nova-compute[71113]:     <rng model="virtio">
Jul 31 10:15:45 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 10:15:45 user nova-compute[71113]:     </rng>
Jul 31 10:15:45 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 10:15:45 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 10:15:45 user nova-compute[71113]:       <stats period="10"/>
Jul 31 10:15:45 user nova-compute[71113]:     </memballoon>
Jul 31 10:15:45 user nova-compute[71113]:   </devices>
Jul 31 10:15:45 user nova-compute[71113]: </domain>
Jul 31 10:15:45 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 10:15:45 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:15:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1232366544',display_name='tempest-AttachVolumeNegativeTest-server-1232366544',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1232366544',id=46,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKaG/whoFc06ZxgGymHTuNDkn0lhdZCou+Z4H5Laaj5kiT9KoBWnbpgTMq3hXCjSMRteGFbQ50eb8O26WfS5tErjOgXpt3ZmVmCT1GcJjWY7A8l1dnu3sGcmRqllh/EVuA==',key_name='tempest-keypair-1325829023',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7000d6a2a6b147ddbc38208b316574cd',ramdisk_id='',reservation_id='r-v4j0popm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2110881646',owner_user_name='tempest-AttachVolumeNegativeTest-2110881646-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T10:15:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9883a5677fb4852ae031137736a9ee4',uuid=d3a41634-a30c-47f8-b44d-8db3571358ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "595b2c06-06c0-43cf-9749-07f63e9a8e25", "address": "fa:16:3e:cd:4d:52", "network": {"id": "4b030626-e3f1-4617-89c2-f6389226652f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441335951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7000d6a2a6b147ddbc38208b316574cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap595b2c06-06", "ovs_interfaceid": "595b2c06-06c0-43cf-9749-07f63e9a8e25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 10:15:45 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Converting VIF {"id": "595b2c06-06c0-43cf-9749-07f63e9a8e25", "address": "fa:16:3e:cd:4d:52", "network": {"id": "4b030626-e3f1-4617-89c2-f6389226652f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441335951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7000d6a2a6b147ddbc38208b316574cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap595b2c06-06", "ovs_interfaceid": "595b2c06-06c0-43cf-9749-07f63e9a8e25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:15:45 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:4d:52,bridge_name='br-int',has_traffic_filtering=True,id=595b2c06-06c0-43cf-9749-07f63e9a8e25,network=Network(4b030626-e3f1-4617-89c2-f6389226652f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap595b2c06-06') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:15:45 user nova-compute[71113]: DEBUG os_vif [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:4d:52,bridge_name='br-int',has_traffic_filtering=True,id=595b2c06-06c0-43cf-9749-07f63e9a8e25,network=Network(4b030626-e3f1-4617-89c2-f6389226652f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap595b2c06-06') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 10:15:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:15:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:15:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 10:15:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:15:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap595b2c06-06, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:15:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap595b2c06-06, col_values=(('external_ids', {'iface-id': '595b2c06-06c0-43cf-9749-07f63e9a8e25', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:4d:52', 'vm-uuid': 'd3a41634-a30c-47f8-b44d-8db3571358ef'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:15:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:15:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:15:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:15:45 user nova-compute[71113]: INFO os_vif [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:4d:52,bridge_name='br-int',has_traffic_filtering=True,id=595b2c06-06c0-43cf-9749-07f63e9a8e25,network=Network(4b030626-e3f1-4617-89c2-f6389226652f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap595b2c06-06')
Jul 31 10:15:45 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:15:45 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] No VIF found with MAC fa:16:3e:cd:4d:52, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 10:15:46 user nova-compute[71113]: DEBUG nova.network.neutron [req-0c165fe9-1db8-4c17-ad09-1a340f4a908e req-0d065c92-66d4-4cf4-8a6b-3ece975b545d service nova] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Updated VIF entry in instance network info cache for port 595b2c06-06c0-43cf-9749-07f63e9a8e25. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 10:15:46 user nova-compute[71113]: DEBUG nova.network.neutron [req-0c165fe9-1db8-4c17-ad09-1a340f4a908e req-0d065c92-66d4-4cf4-8a6b-3ece975b545d service nova] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Updating instance_info_cache with network_info: [{"id": "595b2c06-06c0-43cf-9749-07f63e9a8e25", "address": "fa:16:3e:cd:4d:52", "network": {"id": "4b030626-e3f1-4617-89c2-f6389226652f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441335951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7000d6a2a6b147ddbc38208b316574cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap595b2c06-06", "ovs_interfaceid": "595b2c06-06c0-43cf-9749-07f63e9a8e25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:15:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-0c165fe9-1db8-4c17-ad09-1a340f4a908e req-0d065c92-66d4-4cf4-8a6b-3ece975b545d service nova] Releasing lock "refresh_cache-d3a41634-a30c-47f8-b44d-8db3571358ef" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:15:46 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:15:46 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:15:46 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:15:46 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:15:47 user nova-compute[71113]: DEBUG nova.compute.manager [req-bf7f9891-9f44-420b-a9ac-0edea747e8c3 req-252c57ac-a791-49ba-baf6-0d15ee6fd126 service nova] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Received event network-vif-plugged-595b2c06-06c0-43cf-9749-07f63e9a8e25 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:15:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-bf7f9891-9f44-420b-a9ac-0edea747e8c3 req-252c57ac-a791-49ba-baf6-0d15ee6fd126 service nova] Acquiring lock "d3a41634-a30c-47f8-b44d-8db3571358ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:15:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-bf7f9891-9f44-420b-a9ac-0edea747e8c3 req-252c57ac-a791-49ba-baf6-0d15ee6fd126 service nova] Lock "d3a41634-a30c-47f8-b44d-8db3571358ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:15:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-bf7f9891-9f44-420b-a9ac-0edea747e8c3 req-252c57ac-a791-49ba-baf6-0d15ee6fd126 service nova] Lock "d3a41634-a30c-47f8-b44d-8db3571358ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:15:47 user nova-compute[71113]: DEBUG nova.compute.manager [req-bf7f9891-9f44-420b-a9ac-0edea747e8c3 req-252c57ac-a791-49ba-baf6-0d15ee6fd126 service nova] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] No waiting events found dispatching network-vif-plugged-595b2c06-06c0-43cf-9749-07f63e9a8e25 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:15:47 user nova-compute[71113]: WARNING nova.compute.manager [req-bf7f9891-9f44-420b-a9ac-0edea747e8c3 req-252c57ac-a791-49ba-baf6-0d15ee6fd126 service nova] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Received unexpected event network-vif-plugged-595b2c06-06c0-43cf-9749-07f63e9a8e25 for instance with vm_state building and task_state spawning.
Jul 31 10:15:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:15:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:15:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:15:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:15:48 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690798548.879686, d3a41634-a30c-47f8-b44d-8db3571358ef => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:15:48 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] VM Resumed (Lifecycle Event)
Jul 31 10:15:48 user nova-compute[71113]: DEBUG nova.compute.manager [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 10:15:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 10:15:48 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Instance spawned successfully.
Jul 31 10:15:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 10:15:48 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:15:48 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:15:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Found default for hw_cdrom_bus of ide {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:15:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Found default for hw_disk_bus of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:15:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Found default for hw_input_bus of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:15:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Found default for hw_pointer_model of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:15:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Found default for hw_video_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:15:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Found default for hw_vif_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:15:48 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 10:15:48 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690798548.881852, d3a41634-a30c-47f8-b44d-8db3571358ef => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:15:48 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] VM Started (Lifecycle Event)
Jul 31 10:15:48 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:15:48 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:15:48 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 10:15:49 user nova-compute[71113]: INFO nova.compute.manager [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Took 5.26 seconds to spawn the instance on the hypervisor.
Jul 31 10:15:49 user nova-compute[71113]: DEBUG nova.compute.manager [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:15:49 user nova-compute[71113]: INFO nova.compute.manager [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Took 6.02 seconds to build instance.
Jul 31 10:15:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-675edf53-5f62-4028-9644-fabfa40b1112 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "d3a41634-a30c-47f8-b44d-8db3571358ef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.130s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:15:49 user nova-compute[71113]: DEBUG nova.compute.manager [req-2524f9bb-3736-43b1-921c-70ec582c2f17 req-a78bc948-b6c0-4251-a273-b29ea75ce910 service nova] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Received event network-vif-plugged-595b2c06-06c0-43cf-9749-07f63e9a8e25 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:15:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-2524f9bb-3736-43b1-921c-70ec582c2f17 req-a78bc948-b6c0-4251-a273-b29ea75ce910 service nova] Acquiring lock "d3a41634-a30c-47f8-b44d-8db3571358ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:15:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-2524f9bb-3736-43b1-921c-70ec582c2f17 req-a78bc948-b6c0-4251-a273-b29ea75ce910 service nova] Lock "d3a41634-a30c-47f8-b44d-8db3571358ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:15:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-2524f9bb-3736-43b1-921c-70ec582c2f17 req-a78bc948-b6c0-4251-a273-b29ea75ce910 service nova] Lock "d3a41634-a30c-47f8-b44d-8db3571358ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:15:49 user nova-compute[71113]: DEBUG nova.compute.manager [req-2524f9bb-3736-43b1-921c-70ec582c2f17 req-a78bc948-b6c0-4251-a273-b29ea75ce910 service nova] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] No waiting events found dispatching network-vif-plugged-595b2c06-06c0-43cf-9749-07f63e9a8e25 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:15:49 user nova-compute[71113]: WARNING nova.compute.manager [req-2524f9bb-3736-43b1-921c-70ec582c2f17 req-a78bc948-b6c0-4251-a273-b29ea75ce910 service nova] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Received unexpected event network-vif-plugged-595b2c06-06c0-43cf-9749-07f63e9a8e25 for instance with vm_state active and task_state None.
Jul 31 10:15:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:15:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:15:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:16:00 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:16:01 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:16:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:16:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:16:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:16:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:16:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:16:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:16:12 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:16:13 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:16:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:16:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:16:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Acquiring lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:16:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:16:17 user nova-compute[71113]: DEBUG nova.compute.manager [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Starting instance... {{(pid=71113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 10:16:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:16:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:16:17 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 10:16:17 user nova-compute[71113]: INFO nova.compute.claims [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Claim successful on node user
Jul 31 10:16:17 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:16:17 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:16:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.275s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:16:17 user nova-compute[71113]: DEBUG nova.compute.manager [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Start building networks asynchronously for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 10:16:17 user nova-compute[71113]: DEBUG nova.compute.manager [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Allocating IP information in the background. {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 10:16:17 user nova-compute[71113]: DEBUG nova.network.neutron [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] allocate_for_instance() {{(pid=71113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 10:16:17 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 10:16:17 user nova-compute[71113]: DEBUG nova.compute.manager [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Start building block device mappings for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 10:16:18 user nova-compute[71113]: DEBUG nova.policy [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '912dd0384f654cf1bc555a9b1643476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc32f92126b46439c2be05fc24def8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71113) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 10:16:18 user nova-compute[71113]: DEBUG nova.compute.manager [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Start spawning the instance on the hypervisor. {{(pid=71113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 10:16:18 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 10:16:18 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Creating image(s)
Jul 31 10:16:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Acquiring lock "/opt/stack/data/nova/instances/b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:16:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "/opt/stack/data/nova/instances/b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:16:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "/opt/stack/data/nova/instances/b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:16:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:16:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.133s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:16:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Acquiring lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:16:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:16:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:16:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.144s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:16:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb/disk 1073741824 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:16:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb/disk 1073741824" returned: 0 in 0.056s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:16:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:16:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:16:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.148s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:16:18 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb/disk. size=1073741824 {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 10:16:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:16:18 user nova-compute[71113]: DEBUG nova.network.neutron [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Successfully created port: 900a119c-0bab-4d30-b9a9-83cdd3b5c7a2 {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 10:16:18 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:16:18 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:16:18 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Cannot resize image /opt/stack/data/nova/instances/b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb/disk to a smaller size. {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 10:16:18 user nova-compute[71113]: DEBUG nova.objects.instance [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lazy-loading 'migration_context' on Instance uuid b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:16:18 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Created local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 10:16:18 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Ensure instance console log exists: /opt/stack/data/nova/instances/b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 10:16:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:16:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:16:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:16:19 user nova-compute[71113]: DEBUG nova.network.neutron [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Successfully updated port: 900a119c-0bab-4d30-b9a9-83cdd3b5c7a2 {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 10:16:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Acquiring lock "refresh_cache-b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:16:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Acquired lock "refresh_cache-b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:16:19 user nova-compute[71113]: DEBUG nova.network.neutron [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 10:16:19 user nova-compute[71113]: DEBUG nova.compute.manager [req-34973319-b77a-4979-9459-c655a75f4500 req-f9dba25d-0d98-4f20-896a-844e094e45f2 service nova] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Received event network-changed-900a119c-0bab-4d30-b9a9-83cdd3b5c7a2 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:16:19 user nova-compute[71113]: DEBUG nova.compute.manager [req-34973319-b77a-4979-9459-c655a75f4500 req-f9dba25d-0d98-4f20-896a-844e094e45f2 service nova] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Refreshing instance network info cache due to event network-changed-900a119c-0bab-4d30-b9a9-83cdd3b5c7a2. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 10:16:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-34973319-b77a-4979-9459-c655a75f4500 req-f9dba25d-0d98-4f20-896a-844e094e45f2 service nova] Acquiring lock "refresh_cache-b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:16:19 user nova-compute[71113]: DEBUG nova.network.neutron [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 10:16:19 user nova-compute[71113]: DEBUG nova.network.neutron [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Updating instance_info_cache with network_info: [{"id": "900a119c-0bab-4d30-b9a9-83cdd3b5c7a2", "address": "fa:16:3e:47:cb:d2", "network": {"id": "e555f641-77a4-4097-b894-059fd7706d51", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-992856525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffc32f92126b46439c2be05fc24def8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap900a119c-0b", "ovs_interfaceid": "900a119c-0bab-4d30-b9a9-83cdd3b5c7a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:16:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Releasing lock "refresh_cache-b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:16:19 user nova-compute[71113]: DEBUG nova.compute.manager [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Instance network_info: |[{"id": "900a119c-0bab-4d30-b9a9-83cdd3b5c7a2", "address": "fa:16:3e:47:cb:d2", "network": {"id": "e555f641-77a4-4097-b894-059fd7706d51", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-992856525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffc32f92126b46439c2be05fc24def8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap900a119c-0b", "ovs_interfaceid": "900a119c-0bab-4d30-b9a9-83cdd3b5c7a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 10:16:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-34973319-b77a-4979-9459-c655a75f4500 req-f9dba25d-0d98-4f20-896a-844e094e45f2 service nova] Acquired lock "refresh_cache-b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:16:19 user nova-compute[71113]: DEBUG nova.network.neutron [req-34973319-b77a-4979-9459-c655a75f4500 req-f9dba25d-0d98-4f20-896a-844e094e45f2 service nova] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Refreshing network info cache for port 900a119c-0bab-4d30-b9a9-83cdd3b5c7a2 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 10:16:19 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Start _get_guest_xml network_info=[{"id": "900a119c-0bab-4d30-b9a9-83cdd3b5c7a2", "address": "fa:16:3e:47:cb:d2", "network": {"id": "e555f641-77a4-4097-b894-059fd7706d51", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-992856525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffc32f92126b46439c2be05fc24def8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap900a119c-0b", "ovs_interfaceid": "900a119c-0bab-4d30-b9a9-83cdd3b5c7a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'image_id': '078646fe-b504-41ed-a147-61072e903e51'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 10:16:19 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:16:19 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:16:19 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 10:16:19 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 10:16:19 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 10:16:19 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 10:16:19 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 10:16:19 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 10:16:19 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 10:16:19 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 10:16:19 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 10:16:19 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 10:16:19 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 10:16:19 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 10:16:19 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 10:16:19 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 10:16:19 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 10:16:19 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 10:16:19 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:16:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-345230251',display_name='tempest-SnapshotDataIntegrityTests-server-345230251',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-345230251',id=47,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUcH5JUMTJlZmbMvXk4UVoSMt58yVHVNoxhzq1VQI8lzwQC4YzqAXfAPvmvXudMgWDguSe3pU65Mz0OH9FHPBt8lEZ0eztLC4VdBwSrHioYW3rsrThlsJ81fUPVdzQZcA==',key_name='tempest-keypair-1347244460',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ffc32f92126b46439c2be05fc24def8e',ramdisk_id='',reservation_id='r-8lawef5j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1481072249',owner_user_name='tempest-SnapshotDataIntegrityTests-1481072249-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T10:16:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='912dd0384f654cf1bc555a9b1643476f',uuid=b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "900a119c-0bab-4d30-b9a9-83cdd3b5c7a2", "address": "fa:16:3e:47:cb:d2", "network": {"id": "e555f641-77a4-4097-b894-059fd7706d51", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-992856525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffc32f92126b46439c2be05fc24def8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap900a119c-0b", "ovs_interfaceid": "900a119c-0bab-4d30-b9a9-83cdd3b5c7a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 10:16:19 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Converting VIF {"id": "900a119c-0bab-4d30-b9a9-83cdd3b5c7a2", "address": "fa:16:3e:47:cb:d2", "network": {"id": "e555f641-77a4-4097-b894-059fd7706d51", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-992856525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffc32f92126b46439c2be05fc24def8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap900a119c-0b", "ovs_interfaceid": "900a119c-0bab-4d30-b9a9-83cdd3b5c7a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:16:19 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:cb:d2,bridge_name='br-int',has_traffic_filtering=True,id=900a119c-0bab-4d30-b9a9-83cdd3b5c7a2,network=Network(e555f641-77a4-4097-b894-059fd7706d51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap900a119c-0b') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:16:19 user nova-compute[71113]: DEBUG nova.objects.instance [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lazy-loading 'pci_devices' on Instance uuid b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:16:19 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] End _get_guest_xml xml=<domain type="kvm">
Jul 31 10:16:19 user nova-compute[71113]:   <uuid>b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb</uuid>
Jul 31 10:16:19 user nova-compute[71113]:   <name>instance-0000002f</name>
Jul 31 10:16:19 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 10:16:19 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 10:16:19 user nova-compute[71113]:   <metadata>
Jul 31 10:16:19 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 10:16:19 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 10:16:19 user nova-compute[71113]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-345230251</nova:name>
Jul 31 10:16:19 user nova-compute[71113]:       <nova:creationTime>2023-07-31 10:16:19</nova:creationTime>
Jul 31 10:16:19 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 10:16:19 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 10:16:19 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 10:16:19 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 10:16:19 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 10:16:19 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 10:16:19 user nova-compute[71113]:       </nova:flavor>
Jul 31 10:16:19 user nova-compute[71113]:       <nova:owner>
Jul 31 10:16:19 user nova-compute[71113]:         <nova:user uuid="912dd0384f654cf1bc555a9b1643476f">tempest-SnapshotDataIntegrityTests-1481072249-project-member</nova:user>
Jul 31 10:16:19 user nova-compute[71113]:         <nova:project uuid="ffc32f92126b46439c2be05fc24def8e">tempest-SnapshotDataIntegrityTests-1481072249</nova:project>
Jul 31 10:16:19 user nova-compute[71113]:       </nova:owner>
Jul 31 10:16:19 user nova-compute[71113]:       <nova:root type="image" uuid="078646fe-b504-41ed-a147-61072e903e51"/>
Jul 31 10:16:19 user nova-compute[71113]:       <nova:ports>
Jul 31 10:16:19 user nova-compute[71113]:         <nova:port uuid="900a119c-0bab-4d30-b9a9-83cdd3b5c7a2">
Jul 31 10:16:19 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 31 10:16:19 user nova-compute[71113]:         </nova:port>
Jul 31 10:16:19 user nova-compute[71113]:       </nova:ports>
Jul 31 10:16:19 user nova-compute[71113]:     </nova:instance>
Jul 31 10:16:19 user nova-compute[71113]:   </metadata>
Jul 31 10:16:19 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 10:16:19 user nova-compute[71113]:     <system>
Jul 31 10:16:19 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 10:16:19 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 10:16:19 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 10:16:19 user nova-compute[71113]:       <entry name="serial">b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb</entry>
Jul 31 10:16:19 user nova-compute[71113]:       <entry name="uuid">b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb</entry>
Jul 31 10:16:19 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 10:16:19 user nova-compute[71113]:     </system>
Jul 31 10:16:19 user nova-compute[71113]:   </sysinfo>
Jul 31 10:16:19 user nova-compute[71113]:   <os>
Jul 31 10:16:19 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 10:16:19 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 10:16:19 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 10:16:19 user nova-compute[71113]:   </os>
Jul 31 10:16:19 user nova-compute[71113]:   <features>
Jul 31 10:16:19 user nova-compute[71113]:     <acpi/>
Jul 31 10:16:19 user nova-compute[71113]:     <apic/>
Jul 31 10:16:19 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 10:16:19 user nova-compute[71113]:   </features>
Jul 31 10:16:19 user nova-compute[71113]:   <clock offset="utc">
Jul 31 10:16:19 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 10:16:19 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 10:16:19 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 10:16:19 user nova-compute[71113]:   </clock>
Jul 31 10:16:19 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 10:16:19 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 10:16:19 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 10:16:19 user nova-compute[71113]:   </cpu>
Jul 31 10:16:19 user nova-compute[71113]:   <devices>
Jul 31 10:16:19 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 10:16:19 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 10:16:19 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb/disk"/>
Jul 31 10:16:19 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 10:16:19 user nova-compute[71113]:     </disk>
Jul 31 10:16:19 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 10:16:19 user nova-compute[71113]:       <mac address="fa:16:3e:47:cb:d2"/>
Jul 31 10:16:19 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:16:19 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 10:16:19 user nova-compute[71113]:       <target dev="tap900a119c-0b"/>
Jul 31 10:16:19 user nova-compute[71113]:     </interface>
Jul 31 10:16:19 user nova-compute[71113]:     <serial type="pty">
Jul 31 10:16:19 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb/console.log" append="off"/>
Jul 31 10:16:19 user nova-compute[71113]:     </serial>
Jul 31 10:16:19 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 10:16:19 user nova-compute[71113]:     <video>
Jul 31 10:16:19 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:16:19 user nova-compute[71113]:     </video>
Jul 31 10:16:19 user nova-compute[71113]:     <rng model="virtio">
Jul 31 10:16:19 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 10:16:19 user nova-compute[71113]:     </rng>
Jul 31 10:16:19 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 10:16:19 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 10:16:19 user nova-compute[71113]:       <stats period="10"/>
Jul 31 10:16:19 user nova-compute[71113]:     </memballoon>
Jul 31 10:16:19 user nova-compute[71113]:   </devices>
Jul 31 10:16:19 user nova-compute[71113]: </domain>
Jul 31 10:16:19 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 10:16:19 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:16:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-345230251',display_name='tempest-SnapshotDataIntegrityTests-server-345230251',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-345230251',id=47,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUcH5JUMTJlZmbMvXk4UVoSMt58yVHVNoxhzq1VQI8lzwQC4YzqAXfAPvmvXudMgWDguSe3pU65Mz0OH9FHPBt8lEZ0eztLC4VdBwSrHioYW3rsrThlsJ81fUPVdzQZcA==',key_name='tempest-keypair-1347244460',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ffc32f92126b46439c2be05fc24def8e',ramdisk_id='',reservation_id='r-8lawef5j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1481072249',owner_user_name='tempest-SnapshotDataIntegrityTests-1481072249-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T10:16:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='912dd0384f654cf1bc555a9b1643476f',uuid=b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "900a119c-0bab-4d30-b9a9-83cdd3b5c7a2", "address": "fa:16:3e:47:cb:d2", "network": {"id": "e555f641-77a4-4097-b894-059fd7706d51", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-992856525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffc32f92126b46439c2be05fc24def8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap900a119c-0b", "ovs_interfaceid": "900a119c-0bab-4d30-b9a9-83cdd3b5c7a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 10:16:19 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Converting VIF {"id": "900a119c-0bab-4d30-b9a9-83cdd3b5c7a2", "address": "fa:16:3e:47:cb:d2", "network": {"id": "e555f641-77a4-4097-b894-059fd7706d51", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-992856525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffc32f92126b46439c2be05fc24def8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap900a119c-0b", "ovs_interfaceid": "900a119c-0bab-4d30-b9a9-83cdd3b5c7a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:16:19 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:cb:d2,bridge_name='br-int',has_traffic_filtering=True,id=900a119c-0bab-4d30-b9a9-83cdd3b5c7a2,network=Network(e555f641-77a4-4097-b894-059fd7706d51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap900a119c-0b') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:16:19 user nova-compute[71113]: DEBUG os_vif [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:cb:d2,bridge_name='br-int',has_traffic_filtering=True,id=900a119c-0bab-4d30-b9a9-83cdd3b5c7a2,network=Network(e555f641-77a4-4097-b894-059fd7706d51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap900a119c-0b') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 10:16:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:16:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:16:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 10:16:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:16:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap900a119c-0b, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:16:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap900a119c-0b, col_values=(('external_ids', {'iface-id': '900a119c-0bab-4d30-b9a9-83cdd3b5c7a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:cb:d2', 'vm-uuid': 'b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:16:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:16:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:16:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:16:19 user nova-compute[71113]: INFO os_vif [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:cb:d2,bridge_name='br-int',has_traffic_filtering=True,id=900a119c-0bab-4d30-b9a9-83cdd3b5c7a2,network=Network(e555f641-77a4-4097-b894-059fd7706d51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap900a119c-0b')
Jul 31 10:16:19 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:16:19 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] No VIF found with MAC fa:16:3e:47:cb:d2, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 10:16:20 user nova-compute[71113]: DEBUG nova.network.neutron [req-34973319-b77a-4979-9459-c655a75f4500 req-f9dba25d-0d98-4f20-896a-844e094e45f2 service nova] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Updated VIF entry in instance network info cache for port 900a119c-0bab-4d30-b9a9-83cdd3b5c7a2. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 10:16:20 user nova-compute[71113]: DEBUG nova.network.neutron [req-34973319-b77a-4979-9459-c655a75f4500 req-f9dba25d-0d98-4f20-896a-844e094e45f2 service nova] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Updating instance_info_cache with network_info: [{"id": "900a119c-0bab-4d30-b9a9-83cdd3b5c7a2", "address": "fa:16:3e:47:cb:d2", "network": {"id": "e555f641-77a4-4097-b894-059fd7706d51", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-992856525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffc32f92126b46439c2be05fc24def8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap900a119c-0b", "ovs_interfaceid": "900a119c-0bab-4d30-b9a9-83cdd3b5c7a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:16:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-34973319-b77a-4979-9459-c655a75f4500 req-f9dba25d-0d98-4f20-896a-844e094e45f2 service nova] Releasing lock "refresh_cache-b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:16:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:16:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:16:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:16:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:16:21 user nova-compute[71113]: DEBUG nova.compute.manager [req-f633d09a-187b-4354-b9a1-7be325fd58b7 req-d2d018a7-36d1-470f-8b79-ae03ab8bc99c service nova] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Received event network-vif-plugged-900a119c-0bab-4d30-b9a9-83cdd3b5c7a2 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:16:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f633d09a-187b-4354-b9a1-7be325fd58b7 req-d2d018a7-36d1-470f-8b79-ae03ab8bc99c service nova] Acquiring lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:16:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f633d09a-187b-4354-b9a1-7be325fd58b7 req-d2d018a7-36d1-470f-8b79-ae03ab8bc99c service nova] Lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:16:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f633d09a-187b-4354-b9a1-7be325fd58b7 req-d2d018a7-36d1-470f-8b79-ae03ab8bc99c service nova] Lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:16:21 user nova-compute[71113]: DEBUG nova.compute.manager [req-f633d09a-187b-4354-b9a1-7be325fd58b7 req-d2d018a7-36d1-470f-8b79-ae03ab8bc99c service nova] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] No waiting events found dispatching network-vif-plugged-900a119c-0bab-4d30-b9a9-83cdd3b5c7a2 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:16:21 user nova-compute[71113]: WARNING nova.compute.manager [req-f633d09a-187b-4354-b9a1-7be325fd58b7 req-d2d018a7-36d1-470f-8b79-ae03ab8bc99c service nova] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Received unexpected event network-vif-plugged-900a119c-0bab-4d30-b9a9-83cdd3b5c7a2 for instance with vm_state building and task_state spawning.
Jul 31 10:16:21 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:16:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:16:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:16:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:16:23 user nova-compute[71113]: DEBUG nova.compute.manager [req-d6e6994f-d809-4da2-b22f-689f23205f47 req-6107496b-d188-406a-a464-17d80b786944 service nova] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Received event network-vif-plugged-900a119c-0bab-4d30-b9a9-83cdd3b5c7a2 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:16:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-d6e6994f-d809-4da2-b22f-689f23205f47 req-6107496b-d188-406a-a464-17d80b786944 service nova] Acquiring lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:16:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-d6e6994f-d809-4da2-b22f-689f23205f47 req-6107496b-d188-406a-a464-17d80b786944 service nova] Lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:16:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-d6e6994f-d809-4da2-b22f-689f23205f47 req-6107496b-d188-406a-a464-17d80b786944 service nova] Lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:16:23 user nova-compute[71113]: DEBUG nova.compute.manager [req-d6e6994f-d809-4da2-b22f-689f23205f47 req-6107496b-d188-406a-a464-17d80b786944 service nova] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] No waiting events found dispatching network-vif-plugged-900a119c-0bab-4d30-b9a9-83cdd3b5c7a2 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:16:23 user nova-compute[71113]: WARNING nova.compute.manager [req-d6e6994f-d809-4da2-b22f-689f23205f47 req-6107496b-d188-406a-a464-17d80b786944 service nova] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Received unexpected event network-vif-plugged-900a119c-0bab-4d30-b9a9-83cdd3b5c7a2 for instance with vm_state building and task_state spawning.
Jul 31 10:16:23 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690798583.6252465, b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:16:23 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] VM Resumed (Lifecycle Event)
Jul 31 10:16:23 user nova-compute[71113]: DEBUG nova.compute.manager [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 10:16:23 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 10:16:23 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Instance spawned successfully.
Jul 31 10:16:23 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 10:16:23 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:16:23 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Found default for hw_cdrom_bus of ide {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:16:23 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Found default for hw_disk_bus of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:16:23 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Found default for hw_input_bus of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:16:23 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Found default for hw_pointer_model of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:16:23 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Found default for hw_video_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:16:23 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Found default for hw_vif_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:16:23 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:16:23 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 10:16:23 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690798583.626509, b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:16:23 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] VM Started (Lifecycle Event)
Jul 31 10:16:23 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:16:23 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:16:23 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:16:23 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 10:16:23 user nova-compute[71113]: INFO nova.compute.manager [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Took 5.63 seconds to spawn the instance on the hypervisor.
Jul 31 10:16:23 user nova-compute[71113]: DEBUG nova.compute.manager [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:16:23 user nova-compute[71113]: INFO nova.compute.manager [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Took 6.31 seconds to build instance.
Jul 31 10:16:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-cdede640-52c5-436f-830b-e9e0770721b3 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.413s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:16:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:16:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:16:26 user nova-compute[71113]: INFO nova.compute.manager [None req-d65bbb8e-5925-4957-8351-038aacc3b2e5 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Rescuing
Jul 31 10:16:26 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-d65bbb8e-5925-4957-8351-038aacc3b2e5 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Acquiring lock "refresh_cache-c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:16:26 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-d65bbb8e-5925-4957-8351-038aacc3b2e5 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Acquired lock "refresh_cache-c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:16:26 user nova-compute[71113]: DEBUG nova.network.neutron [None req-d65bbb8e-5925-4957-8351-038aacc3b2e5 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 10:16:27 user nova-compute[71113]: DEBUG nova.network.neutron [None req-d65bbb8e-5925-4957-8351-038aacc3b2e5 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Updating instance_info_cache with network_info: [{"id": "85692854-658a-459b-9ab0-f448a6bf83f2", "address": "fa:16:3e:2b:2c:47", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85692854-65", "ovs_interfaceid": "85692854-658a-459b-9ab0-f448a6bf83f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:16:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-d65bbb8e-5925-4957-8351-038aacc3b2e5 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Releasing lock "refresh_cache-c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:16:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:16:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:16:27 user nova-compute[71113]: DEBUG nova.compute.manager [req-45bc43ef-9310-4d50-b413-486731a63cc8 req-a63b1614-a3d5-42ea-b6e3-97334cbc3daa service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Received event network-vif-unplugged-85692854-658a-459b-9ab0-f448a6bf83f2 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:16:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-45bc43ef-9310-4d50-b413-486731a63cc8 req-a63b1614-a3d5-42ea-b6e3-97334cbc3daa service nova] Acquiring lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:16:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-45bc43ef-9310-4d50-b413-486731a63cc8 req-a63b1614-a3d5-42ea-b6e3-97334cbc3daa service nova] Lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:16:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-45bc43ef-9310-4d50-b413-486731a63cc8 req-a63b1614-a3d5-42ea-b6e3-97334cbc3daa service nova] Lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:16:27 user nova-compute[71113]: DEBUG nova.compute.manager [req-45bc43ef-9310-4d50-b413-486731a63cc8 req-a63b1614-a3d5-42ea-b6e3-97334cbc3daa service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] No waiting events found dispatching network-vif-unplugged-85692854-658a-459b-9ab0-f448a6bf83f2 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:16:27 user nova-compute[71113]: WARNING nova.compute.manager [req-45bc43ef-9310-4d50-b413-486731a63cc8 req-a63b1614-a3d5-42ea-b6e3-97334cbc3daa service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Received unexpected event network-vif-unplugged-85692854-658a-459b-9ab0-f448a6bf83f2 for instance with vm_state active and task_state rescuing.
Jul 31 10:16:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:16:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:16:27 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:16:27 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:16:27 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Rebuilding the list of instances to heal {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 10:16:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "refresh_cache-c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:16:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquired lock "refresh_cache-c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:16:27 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Forcefully refreshing network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 10:16:27 user nova-compute[71113]: DEBUG nova.objects.instance [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lazy-loading 'info_cache' on Instance uuid c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:16:27 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Instance destroyed successfully.
Jul 31 10:16:27 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-d65bbb8e-5925-4957-8351-038aacc3b2e5 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Attempting rescue
Jul 31 10:16:27 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-d65bbb8e-5925-4957-8351-038aacc3b2e5 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71113) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 31 10:16:27 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-d65bbb8e-5925-4957-8351-038aacc3b2e5 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Instance directory exists: not creating {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 31 10:16:27 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-d65bbb8e-5925-4957-8351-038aacc3b2e5 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Creating image(s)
Jul 31 10:16:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-d65bbb8e-5925-4957-8351-038aacc3b2e5 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Acquiring lock "/opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:16:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-d65bbb8e-5925-4957-8351-038aacc3b2e5 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "/opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:16:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-d65bbb8e-5925-4957-8351-038aacc3b2e5 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "/opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:16:27 user nova-compute[71113]: DEBUG nova.objects.instance [None req-d65bbb8e-5925-4957-8351-038aacc3b2e5 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lazy-loading 'trusted_certs' on Instance uuid c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:16:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-d65bbb8e-5925-4957-8351-038aacc3b2e5 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Acquiring lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:16:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-d65bbb8e-5925-4957-8351-038aacc3b2e5 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:16:28 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-d65bbb8e-5925-4957-8351-038aacc3b2e5 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:16:28 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-d65bbb8e-5925-4957-8351-038aacc3b2e5 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.147s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:16:28 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-d65bbb8e-5925-4957-8351-038aacc3b2e5 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk.rescue {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:16:28 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-d65bbb8e-5925-4957-8351-038aacc3b2e5 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk.rescue" returned: 0 in 0.067s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:16:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-d65bbb8e-5925-4957-8351-038aacc3b2e5 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:16:28 user nova-compute[71113]: DEBUG nova.objects.instance [None req-d65bbb8e-5925-4957-8351-038aacc3b2e5 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lazy-loading 'migration_context' on Instance uuid c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:16:28 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-d65bbb8e-5925-4957-8351-038aacc3b2e5 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Created local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 10:16:28 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-d65bbb8e-5925-4957-8351-038aacc3b2e5 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Start _get_guest_xml network_info=[{"id": "85692854-658a-459b-9ab0-f448a6bf83f2", "address": "fa:16:3e:2b:2c:47", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "vif_mac": "fa:16:3e:2b:2c:47"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85692854-65", "ovs_interfaceid": "85692854-658a-459b-9ab0-f448a6bf83f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '078646fe-b504-41ed-a147-61072e903e51', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 10:16:28 user nova-compute[71113]: DEBUG nova.objects.instance [None req-d65bbb8e-5925-4957-8351-038aacc3b2e5 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lazy-loading 'resources' on Instance uuid c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:16:28 user nova-compute[71113]: DEBUG nova.objects.instance [None req-d65bbb8e-5925-4957-8351-038aacc3b2e5 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lazy-loading 'numa_topology' on Instance uuid c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:16:28 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-d65bbb8e-5925-4957-8351-038aacc3b2e5 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:16:28 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-d65bbb8e-5925-4957-8351-038aacc3b2e5 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:16:28 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Updating instance_info_cache with network_info: [{"id": "85692854-658a-459b-9ab0-f448a6bf83f2", "address": "fa:16:3e:2b:2c:47", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85692854-65", "ovs_interfaceid": "85692854-658a-459b-9ab0-f448a6bf83f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:16:28 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-d65bbb8e-5925-4957-8351-038aacc3b2e5 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 10:16:28 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-d65bbb8e-5925-4957-8351-038aacc3b2e5 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 10:16:28 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-d65bbb8e-5925-4957-8351-038aacc3b2e5 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 10:16:28 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-d65bbb8e-5925-4957-8351-038aacc3b2e5 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 10:16:28 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-d65bbb8e-5925-4957-8351-038aacc3b2e5 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 10:16:28 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-d65bbb8e-5925-4957-8351-038aacc3b2e5 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 10:16:28 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-d65bbb8e-5925-4957-8351-038aacc3b2e5 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 10:16:28 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-d65bbb8e-5925-4957-8351-038aacc3b2e5 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 10:16:28 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-d65bbb8e-5925-4957-8351-038aacc3b2e5 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 10:16:28 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-d65bbb8e-5925-4957-8351-038aacc3b2e5 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 10:16:28 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-d65bbb8e-5925-4957-8351-038aacc3b2e5 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 10:16:28 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-d65bbb8e-5925-4957-8351-038aacc3b2e5 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 10:16:28 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-d65bbb8e-5925-4957-8351-038aacc3b2e5 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 10:16:28 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-d65bbb8e-5925-4957-8351-038aacc3b2e5 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 10:16:28 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-d65bbb8e-5925-4957-8351-038aacc3b2e5 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 10:16:28 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-d65bbb8e-5925-4957-8351-038aacc3b2e5 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 10:16:28 user nova-compute[71113]: DEBUG nova.objects.instance [None req-d65bbb8e-5925-4957-8351-038aacc3b2e5 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lazy-loading 'vcpu_model' on Instance uuid c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:16:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Releasing lock "refresh_cache-c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:16:28 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Updated the network info_cache for instance {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 10:16:28 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-d65bbb8e-5925-4957-8351-038aacc3b2e5 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:11:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-206616969',display_name='tempest-ServerRescueNegativeTestJSON-server-206616969',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-206616969',id=42,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T10:11:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='938c4f5af8a347cf9d700c8cdb5df356',ramdisk_id='',reservation_id='r-80w6skid',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-549904406',owner_user_name='tempest-ServerRescueNegativeTestJSON-549904406-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T10:11:49Z,user_data=None,user_id='6023b7c67c0941d3975fa9c25140684f',uuid=c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85692854-658a-459b-9ab0-f448a6bf83f2", "address": "fa:16:3e:2b:2c:47", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "vif_mac": "fa:16:3e:2b:2c:47"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85692854-65", "ovs_interfaceid": "85692854-658a-459b-9ab0-f448a6bf83f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 10:16:28 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-d65bbb8e-5925-4957-8351-038aacc3b2e5 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Converting VIF {"id": "85692854-658a-459b-9ab0-f448a6bf83f2", "address": "fa:16:3e:2b:2c:47", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "vif_mac": "fa:16:3e:2b:2c:47"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85692854-65", "ovs_interfaceid": "85692854-658a-459b-9ab0-f448a6bf83f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:16:28 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-d65bbb8e-5925-4957-8351-038aacc3b2e5 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:2c:47,bridge_name='br-int',has_traffic_filtering=True,id=85692854-658a-459b-9ab0-f448a6bf83f2,network=Network(328e0f8b-5788-457c-afc6-7fe314ca8b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85692854-65') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:16:28 user nova-compute[71113]: DEBUG nova.objects.instance [None req-d65bbb8e-5925-4957-8351-038aacc3b2e5 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lazy-loading 'pci_devices' on Instance uuid c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:16:28 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-d65bbb8e-5925-4957-8351-038aacc3b2e5 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] End _get_guest_xml xml=<domain type="kvm">
Jul 31 10:16:28 user nova-compute[71113]:   <uuid>c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5</uuid>
Jul 31 10:16:28 user nova-compute[71113]:   <name>instance-0000002a</name>
Jul 31 10:16:28 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 10:16:28 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 10:16:28 user nova-compute[71113]:   <metadata>
Jul 31 10:16:28 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 10:16:28 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 10:16:28 user nova-compute[71113]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-206616969</nova:name>
Jul 31 10:16:28 user nova-compute[71113]:       <nova:creationTime>2023-07-31 10:16:28</nova:creationTime>
Jul 31 10:16:28 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 10:16:28 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 10:16:28 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 10:16:28 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 10:16:28 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 10:16:28 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 10:16:28 user nova-compute[71113]:       </nova:flavor>
Jul 31 10:16:28 user nova-compute[71113]:       <nova:owner>
Jul 31 10:16:28 user nova-compute[71113]:         <nova:user uuid="6023b7c67c0941d3975fa9c25140684f">tempest-ServerRescueNegativeTestJSON-549904406-project-member</nova:user>
Jul 31 10:16:28 user nova-compute[71113]:         <nova:project uuid="938c4f5af8a347cf9d700c8cdb5df356">tempest-ServerRescueNegativeTestJSON-549904406</nova:project>
Jul 31 10:16:28 user nova-compute[71113]:       </nova:owner>
Jul 31 10:16:28 user nova-compute[71113]:       <nova:root type="image" uuid="078646fe-b504-41ed-a147-61072e903e51"/>
Jul 31 10:16:28 user nova-compute[71113]:       <nova:ports>
Jul 31 10:16:28 user nova-compute[71113]:         <nova:port uuid="85692854-658a-459b-9ab0-f448a6bf83f2">
Jul 31 10:16:28 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 31 10:16:28 user nova-compute[71113]:         </nova:port>
Jul 31 10:16:28 user nova-compute[71113]:       </nova:ports>
Jul 31 10:16:28 user nova-compute[71113]:     </nova:instance>
Jul 31 10:16:28 user nova-compute[71113]:   </metadata>
Jul 31 10:16:28 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 10:16:28 user nova-compute[71113]:     <system>
Jul 31 10:16:28 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 10:16:28 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 10:16:28 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 10:16:28 user nova-compute[71113]:       <entry name="serial">c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5</entry>
Jul 31 10:16:28 user nova-compute[71113]:       <entry name="uuid">c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5</entry>
Jul 31 10:16:28 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 10:16:28 user nova-compute[71113]:     </system>
Jul 31 10:16:28 user nova-compute[71113]:   </sysinfo>
Jul 31 10:16:28 user nova-compute[71113]:   <os>
Jul 31 10:16:28 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 10:16:28 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 10:16:28 user nova-compute[71113]:   </os>
Jul 31 10:16:28 user nova-compute[71113]:   <features>
Jul 31 10:16:28 user nova-compute[71113]:     <acpi/>
Jul 31 10:16:28 user nova-compute[71113]:     <apic/>
Jul 31 10:16:28 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 10:16:28 user nova-compute[71113]:   </features>
Jul 31 10:16:28 user nova-compute[71113]:   <clock offset="utc">
Jul 31 10:16:28 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 10:16:28 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 10:16:28 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 10:16:28 user nova-compute[71113]:   </clock>
Jul 31 10:16:28 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 10:16:28 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 10:16:28 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 10:16:28 user nova-compute[71113]:   </cpu>
Jul 31 10:16:28 user nova-compute[71113]:   <devices>
Jul 31 10:16:28 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 10:16:28 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 10:16:28 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk.rescue"/>
Jul 31 10:16:28 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 10:16:28 user nova-compute[71113]:     </disk>
Jul 31 10:16:28 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 10:16:28 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 10:16:28 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk"/>
Jul 31 10:16:28 user nova-compute[71113]:       <target dev="vdb" bus="virtio"/>
Jul 31 10:16:28 user nova-compute[71113]:     </disk>
Jul 31 10:16:28 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 10:16:28 user nova-compute[71113]:       <mac address="fa:16:3e:2b:2c:47"/>
Jul 31 10:16:28 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:16:28 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 10:16:28 user nova-compute[71113]:       <target dev="tap85692854-65"/>
Jul 31 10:16:28 user nova-compute[71113]:     </interface>
Jul 31 10:16:28 user nova-compute[71113]:     <serial type="pty">
Jul 31 10:16:28 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/console.log" append="off"/>
Jul 31 10:16:28 user nova-compute[71113]:     </serial>
Jul 31 10:16:28 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 10:16:28 user nova-compute[71113]:     <video>
Jul 31 10:16:28 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:16:28 user nova-compute[71113]:     </video>
Jul 31 10:16:28 user nova-compute[71113]:     <rng model="virtio">
Jul 31 10:16:28 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 10:16:28 user nova-compute[71113]:     </rng>
Jul 31 10:16:28 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 10:16:28 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 10:16:28 user nova-compute[71113]:       <stats period="10"/>
Jul 31 10:16:28 user nova-compute[71113]:     </memballoon>
Jul 31 10:16:28 user nova-compute[71113]:   </devices>
Jul 31 10:16:28 user nova-compute[71113]: </domain>
Jul 31 10:16:28 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 10:16:28 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Instance destroyed successfully.
Jul 31 10:16:28 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-d65bbb8e-5925-4957-8351-038aacc3b2e5 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:16:28 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-d65bbb8e-5925-4957-8351-038aacc3b2e5 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:16:28 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-d65bbb8e-5925-4957-8351-038aacc3b2e5 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] No VIF found with MAC fa:16:3e:2b:2c:47, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 10:16:28 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:16:28 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:16:29 user nova-compute[71113]: DEBUG nova.compute.manager [req-2df7aa4c-1815-4b90-b685-c4f582e18396 req-218f9d75-ab44-4dbd-a21d-eda8184cd1c2 service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Received event network-vif-plugged-85692854-658a-459b-9ab0-f448a6bf83f2 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:16:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-2df7aa4c-1815-4b90-b685-c4f582e18396 req-218f9d75-ab44-4dbd-a21d-eda8184cd1c2 service nova] Acquiring lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:16:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-2df7aa4c-1815-4b90-b685-c4f582e18396 req-218f9d75-ab44-4dbd-a21d-eda8184cd1c2 service nova] Lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:16:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-2df7aa4c-1815-4b90-b685-c4f582e18396 req-218f9d75-ab44-4dbd-a21d-eda8184cd1c2 service nova] Lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:16:29 user nova-compute[71113]: DEBUG nova.compute.manager [req-2df7aa4c-1815-4b90-b685-c4f582e18396 req-218f9d75-ab44-4dbd-a21d-eda8184cd1c2 service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] No waiting events found dispatching network-vif-plugged-85692854-658a-459b-9ab0-f448a6bf83f2 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:16:29 user nova-compute[71113]: WARNING nova.compute.manager [req-2df7aa4c-1815-4b90-b685-c4f582e18396 req-218f9d75-ab44-4dbd-a21d-eda8184cd1c2 service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Received unexpected event network-vif-plugged-85692854-658a-459b-9ab0-f448a6bf83f2 for instance with vm_state active and task_state rescuing.
Jul 31 10:16:29 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:16:29 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:16:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:16:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:16:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:16:29 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:16:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:16:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:16:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:16:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:16:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk.rescue --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:16:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:16:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk.rescue --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:16:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:16:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:16:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:16:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:16:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:16:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:16:31 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3a41634-a30c-47f8-b44d-8db3571358ef/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:16:31 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3a41634-a30c-47f8-b44d-8db3571358ef/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:16:31 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3a41634-a30c-47f8-b44d-8db3571358ef/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:16:31 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3a41634-a30c-47f8-b44d-8db3571358ef/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:16:31 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:16:31 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:16:31 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:16:31 user nova-compute[71113]: DEBUG nova.compute.manager [req-cb2ef529-4e97-4013-9e84-d1399fc0d577 req-4ba4a74d-0b78-4186-9e24-899884341fde service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Received event network-vif-plugged-85692854-658a-459b-9ab0-f448a6bf83f2 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:16:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-cb2ef529-4e97-4013-9e84-d1399fc0d577 req-4ba4a74d-0b78-4186-9e24-899884341fde service nova] Acquiring lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:16:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-cb2ef529-4e97-4013-9e84-d1399fc0d577 req-4ba4a74d-0b78-4186-9e24-899884341fde service nova] Lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:16:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-cb2ef529-4e97-4013-9e84-d1399fc0d577 req-4ba4a74d-0b78-4186-9e24-899884341fde service nova] Lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:16:31 user nova-compute[71113]: DEBUG nova.compute.manager [req-cb2ef529-4e97-4013-9e84-d1399fc0d577 req-4ba4a74d-0b78-4186-9e24-899884341fde service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] No waiting events found dispatching network-vif-plugged-85692854-658a-459b-9ab0-f448a6bf83f2 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:16:31 user nova-compute[71113]: WARNING nova.compute.manager [req-cb2ef529-4e97-4013-9e84-d1399fc0d577 req-4ba4a74d-0b78-4186-9e24-899884341fde service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Received unexpected event network-vif-plugged-85692854-658a-459b-9ab0-f448a6bf83f2 for instance with vm_state active and task_state rescuing.
Jul 31 10:16:31 user nova-compute[71113]: DEBUG nova.compute.manager [req-cb2ef529-4e97-4013-9e84-d1399fc0d577 req-4ba4a74d-0b78-4186-9e24-899884341fde service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Received event network-vif-plugged-85692854-658a-459b-9ab0-f448a6bf83f2 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:16:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-cb2ef529-4e97-4013-9e84-d1399fc0d577 req-4ba4a74d-0b78-4186-9e24-899884341fde service nova] Acquiring lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:16:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-cb2ef529-4e97-4013-9e84-d1399fc0d577 req-4ba4a74d-0b78-4186-9e24-899884341fde service nova] Lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:16:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-cb2ef529-4e97-4013-9e84-d1399fc0d577 req-4ba4a74d-0b78-4186-9e24-899884341fde service nova] Lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:16:31 user nova-compute[71113]: DEBUG nova.compute.manager [req-cb2ef529-4e97-4013-9e84-d1399fc0d577 req-4ba4a74d-0b78-4186-9e24-899884341fde service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] No waiting events found dispatching network-vif-plugged-85692854-658a-459b-9ab0-f448a6bf83f2 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:16:31 user nova-compute[71113]: WARNING nova.compute.manager [req-cb2ef529-4e97-4013-9e84-d1399fc0d577 req-4ba4a74d-0b78-4186-9e24-899884341fde service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Received unexpected event network-vif-plugged-85692854-658a-459b-9ab0-f448a6bf83f2 for instance with vm_state active and task_state rescuing.
Jul 31 10:16:31 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue --force-share --output=json" returned: 0 in 0.153s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:16:31 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:16:31 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:16:31 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:16:31 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:16:31 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:16:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:16:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:16:32 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Removed pending event for c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5 due to event {{(pid=71113) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 31 10:16:32 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690798592.1142845, c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5 => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:16:32 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] VM Resumed (Lifecycle Event)
Jul 31 10:16:32 user nova-compute[71113]: DEBUG nova.compute.manager [None req-d65bbb8e-5925-4957-8351-038aacc3b2e5 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:16:32 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:16:32 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:16:32 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 31 10:16:32 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690798592.1162016, c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5 => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:16:32 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] VM Started (Lifecycle Event)
Jul 31 10:16:32 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:16:32 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:16:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:16:32 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:16:32 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:16:32 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=8421MB free_disk=25.230453491210938GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:16:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:16:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:16:32 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:16:32 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 8129456b-a22c-46e3-b5db-89fdcec87dec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:16:32 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance d3a41634-a30c-47f8-b44d-8db3571358ef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:16:32 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:16:32 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:16:32 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:16:33 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:16:33 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:16:33 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:16:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.317s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:16:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:16:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:16:38 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:16:38 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:16:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:16:40 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:16:40 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:16:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:16:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:16:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:16:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:16:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:16:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:16:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:17:00 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:17:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:17:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:17:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:17:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:17:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:17:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:17:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:17:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:17:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:17:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:17:20 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:17:23 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:17:23 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:17:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:17:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:17:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:17:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:17:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:17:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:17:27 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:17:27 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:17:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "refresh_cache-8129456b-a22c-46e3-b5db-89fdcec87dec" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:17:27 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquired lock "refresh_cache-8129456b-a22c-46e3-b5db-89fdcec87dec" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:17:27 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Forcefully refreshing network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 10:17:28 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Updating instance_info_cache with network_info: [{"id": "1a2da0f9-2fb6-4880-96b5-be8dd9d12574", "address": "fa:16:3e:fe:2b:04", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a2da0f9-2f", "ovs_interfaceid": "1a2da0f9-2fb6-4880-96b5-be8dd9d12574", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:17:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Releasing lock "refresh_cache-8129456b-a22c-46e3-b5db-89fdcec87dec" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:17:28 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Updated the network info_cache for instance {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 10:17:28 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:17:28 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:17:29 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:17:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:17:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:17:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:17:29 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:17:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk.rescue --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:17:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:17:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:17:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk.rescue --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:17:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:17:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:17:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:17:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:17:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:17:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3a41634-a30c-47f8-b44d-8db3571358ef/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:17:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3a41634-a30c-47f8-b44d-8db3571358ef/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:17:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3a41634-a30c-47f8-b44d-8db3571358ef/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:17:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3a41634-a30c-47f8-b44d-8db3571358ef/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:17:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:17:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:17:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:17:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:17:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:17:31 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:17:31 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:17:31 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:17:31 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:17:31 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:17:31 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:17:31 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:17:31 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:17:31 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:17:31 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=8413MB free_disk=25.200450897216797GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:17:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:17:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:17:32 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:17:32 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 8129456b-a22c-46e3-b5db-89fdcec87dec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:17:32 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance d3a41634-a30c-47f8-b44d-8db3571358ef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:17:32 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:17:32 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:17:32 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:17:32 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Refreshing inventories for resource provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 31 10:17:32 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Updating ProviderTree inventory for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 31 10:17:32 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Updating inventory in ProviderTree for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 31 10:17:32 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Refreshing aggregate associations for resource provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05, aggregates: None {{(pid=71113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 31 10:17:32 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Refreshing trait associations for resource provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE2,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS {{(pid=71113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 31 10:17:32 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:17:32 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:17:32 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:17:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.498s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:17:32 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:17:32 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Cleaning up deleted instances {{(pid=71113) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 31 10:17:32 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] There are 0 instances to clean {{(pid=71113) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 31 10:17:34 user nova-compute[71113]: DEBUG nova.compute.manager [req-2a0781fa-f766-44ee-8e08-46dd0ad1b42b req-975969e1-6c67-44d1-8609-f6f6a573cb00 service nova] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Received event network-changed-595b2c06-06c0-43cf-9749-07f63e9a8e25 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:17:34 user nova-compute[71113]: DEBUG nova.compute.manager [req-2a0781fa-f766-44ee-8e08-46dd0ad1b42b req-975969e1-6c67-44d1-8609-f6f6a573cb00 service nova] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Refreshing instance network info cache due to event network-changed-595b2c06-06c0-43cf-9749-07f63e9a8e25. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 10:17:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-2a0781fa-f766-44ee-8e08-46dd0ad1b42b req-975969e1-6c67-44d1-8609-f6f6a573cb00 service nova] Acquiring lock "refresh_cache-d3a41634-a30c-47f8-b44d-8db3571358ef" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:17:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-2a0781fa-f766-44ee-8e08-46dd0ad1b42b req-975969e1-6c67-44d1-8609-f6f6a573cb00 service nova] Acquired lock "refresh_cache-d3a41634-a30c-47f8-b44d-8db3571358ef" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:17:34 user nova-compute[71113]: DEBUG nova.network.neutron [req-2a0781fa-f766-44ee-8e08-46dd0ad1b42b req-975969e1-6c67-44d1-8609-f6f6a573cb00 service nova] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Refreshing network info cache for port 595b2c06-06c0-43cf-9749-07f63e9a8e25 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 10:17:34 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:17:34 user nova-compute[71113]: DEBUG nova.network.neutron [req-2a0781fa-f766-44ee-8e08-46dd0ad1b42b req-975969e1-6c67-44d1-8609-f6f6a573cb00 service nova] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Updated VIF entry in instance network info cache for port 595b2c06-06c0-43cf-9749-07f63e9a8e25. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 10:17:34 user nova-compute[71113]: DEBUG nova.network.neutron [req-2a0781fa-f766-44ee-8e08-46dd0ad1b42b req-975969e1-6c67-44d1-8609-f6f6a573cb00 service nova] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Updating instance_info_cache with network_info: [{"id": "595b2c06-06c0-43cf-9749-07f63e9a8e25", "address": "fa:16:3e:cd:4d:52", "network": {"id": "4b030626-e3f1-4617-89c2-f6389226652f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441335951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7000d6a2a6b147ddbc38208b316574cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap595b2c06-06", "ovs_interfaceid": "595b2c06-06c0-43cf-9749-07f63e9a8e25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:17:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-2a0781fa-f766-44ee-8e08-46dd0ad1b42b req-975969e1-6c67-44d1-8609-f6f6a573cb00 service nova] Releasing lock "refresh_cache-d3a41634-a30c-47f8-b44d-8db3571358ef" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:17:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:17:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:17:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:17:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:17:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:17:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:17:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:17:35 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:17:35 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:17:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-63437444-8e9d-4af4-89d5-7a4ed2c5651c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquiring lock "d3a41634-a30c-47f8-b44d-8db3571358ef" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:17:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-63437444-8e9d-4af4-89d5-7a4ed2c5651c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "d3a41634-a30c-47f8-b44d-8db3571358ef" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:17:38 user nova-compute[71113]: DEBUG nova.objects.instance [None req-63437444-8e9d-4af4-89d5-7a4ed2c5651c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lazy-loading 'flavor' on Instance uuid d3a41634-a30c-47f8-b44d-8db3571358ef {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:17:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-63437444-8e9d-4af4-89d5-7a4ed2c5651c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "d3a41634-a30c-47f8-b44d-8db3571358ef" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:17:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-63437444-8e9d-4af4-89d5-7a4ed2c5651c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquiring lock "d3a41634-a30c-47f8-b44d-8db3571358ef" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:17:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-63437444-8e9d-4af4-89d5-7a4ed2c5651c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "d3a41634-a30c-47f8-b44d-8db3571358ef" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:17:38 user nova-compute[71113]: INFO nova.compute.manager [None req-63437444-8e9d-4af4-89d5-7a4ed2c5651c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Attaching volume 43e25b31-868a-4a99-869a-8639096de1b0 to /dev/vdb
Jul 31 10:17:38 user nova-compute[71113]: DEBUG os_brick.utils [None req-63437444-8e9d-4af4-89d5-7a4ed2c5651c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:17:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:17:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:17:38 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d25232-28ad-4f95-8117-32e56d3f7bea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:17:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:17:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:17:38 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3d746e-868a-46be-ad64-089420e49021]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:17:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:17:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:17:38 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4ddeb1-a23b-4ae6-b177-6bbb124be6e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:17:38 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad885a7-9441-451b-8e82-f4fd0d453afc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:17:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-63437444-8e9d-4af4-89d5-7a4ed2c5651c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:17:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-63437444-8e9d-4af4-89d5-7a4ed2c5651c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 10:17:38 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-63437444-8e9d-4af4-89d5-7a4ed2c5651c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 10:17:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:17:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 10:17:38 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 10:17:38 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b78764e-14e9-45a0-b6d3-d28d86e85d4d]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:17:38 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-63437444-8e9d-4af4-89d5-7a4ed2c5651c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 10:17:38 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-63437444-8e9d-4af4-89d5-7a4ed2c5651c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 10:17:38 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-63437444-8e9d-4af4-89d5-7a4ed2c5651c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 10:17:38 user nova-compute[71113]: DEBUG os_brick.utils [None req-63437444-8e9d-4af4-89d5-7a4ed2c5651c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:17:38 user nova-compute[71113]: DEBUG nova.virt.block_device [None req-63437444-8e9d-4af4-89d5-7a4ed2c5651c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Updating existing volume attachment record: 0e335895-f0cf-4f0c-87e2-f894f73c17cb {{(pid=71113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 10:17:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:17:40 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:17:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:17:45 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63437444-8e9d-4af4-89d5-7a4ed2c5651c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 10:17:45 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-63437444-8e9d-4af4-89d5-7a4ed2c5651c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:43e25b31-868a-4a99-869a-8639096de1b0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OARYxBzS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:17:45 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-63437444-8e9d-4af4-89d5-7a4ed2c5651c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:17:45 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-63437444-8e9d-4af4-89d5-7a4ed2c5651c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:17:45 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-63437444-8e9d-4af4-89d5-7a4ed2c5651c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:17:45 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-63437444-8e9d-4af4-89d5-7a4ed2c5651c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:17:45 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-63437444-8e9d-4af4-89d5-7a4ed2c5651c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43e25b31-868a-4a99-869a-8639096de1b0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:17:45 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-63437444-8e9d-4af4-89d5-7a4ed2c5651c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43e25b31-868a-4a99-869a-8639096de1b0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:17:45 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-63437444-8e9d-4af4-89d5-7a4ed2c5651c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 10:17:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43e25b31-868a-4a99-869a-8639096de1b0 -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:17:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43e25b31-868a-4a99-869a-8639096de1b0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:17:45 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6f94c1-19d1-43c3-a688-16963c2ab7ca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:17:45 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-63437444-8e9d-4af4-89d5-7a4ed2c5651c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 10:17:45 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:17:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43e25b31-868a-4a99-869a-8639096de1b0 -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:17:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43e25b31-868a-4a99-869a-8639096de1b0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:17:45 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0297e544-ef01-4d15-aa94-e0cadfcf0986]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43e25b31-868a-4a99-869a-8639096de1b0] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:17:45 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-63437444-8e9d-4af4-89d5-7a4ed2c5651c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43e25b31-868a-4a99-869a-8639096de1b0] added
Jul 31 10:17:45 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:17:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43e25b31-868a-4a99-869a-8639096de1b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:17:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43e25b31-868a-4a99-869a-8639096de1b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:17:45 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c824780-834e-4dd9-b8e6-22db9ac191fd]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:17:45 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-63437444-8e9d-4af4-89d5-7a4ed2c5651c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:17:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43e25b31-868a-4a99-869a-8639096de1b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:17:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43e25b31-868a-4a99-869a-8639096de1b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:17:45 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[61cad7bc-8193-425e-a1e1-0fd638a36673]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:17:45 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-63437444-8e9d-4af4-89d5-7a4ed2c5651c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:17:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43e25b31-868a-4a99-869a-8639096de1b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OARYxBzS {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:17:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:17:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43e25b31-868a-4a99-869a-8639096de1b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OARYxBzS" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:17:45 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5656e6-d143-46dd-9936-696f12963c91]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:17:45 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-63437444-8e9d-4af4-89d5-7a4ed2c5651c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OARYxBzS'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:17:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43e25b31-868a-4a99-869a-8639096de1b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:17:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43e25b31-868a-4a99-869a-8639096de1b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:17:45 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[00add679-7b32-4471-a065-694ee86ef195]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:17:45 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-63437444-8e9d-4af4-89d5-7a4ed2c5651c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:17:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:17:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:17:45 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a45d06d-eee6-47e4-bab4-0dbceb63fc5d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:17:45 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-63437444-8e9d-4af4-89d5-7a4ed2c5651c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 31 10:17:45 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:17:45 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-63437444-8e9d-4af4-89d5-7a4ed2c5651c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 31 10:17:45 user nova-compute[71113]:  {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:17:45 user nova-compute[71113]: WARNING os_brick.initiator.connectors.iscsi [None req-63437444-8e9d-4af4-89d5-7a4ed2c5651c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 31 10:17:45 user nova-compute[71113]: 
Jul 31 10:17:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43e25b31-868a-4a99-869a-8639096de1b0 -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:17:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43e25b31-868a-4a99-869a-8639096de1b0 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:17:45 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[396fdc40-7fa3-4094-9261-a526dbae8c07]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:43e25b31-868a-4a99-869a-8639096de1b0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:43e25b31-868a-4a99-869a-8639096de1b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:17:45 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-63437444-8e9d-4af4-89d5-7a4ed2c5651c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:43e25b31-868a-4a99-869a-8639096de1b0, portal: 172.16.0.220,3260]
Jul 31 10:17:45 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:43e25b31-868a-4a99-869a-8639096de1b0, portal: 172.16.0.220,3260] successful.
Jul 31 10:17:45 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:17:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43e25b31-868a-4a99-869a-8639096de1b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:17:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43e25b31-868a-4a99-869a-8639096de1b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:17:45 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f32d29-9bda-444c-bf3a-80dc970abba9]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:17:45 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-63437444-8e9d-4af4-89d5-7a4ed2c5651c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:17:45 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:17:45 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71113) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 31 10:17:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:17:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:17:45 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1213fc13-5e67-4abe-9a68-3f67d75d3db0]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e25b31-868a-4a99-869a-8639096de1b0 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:17:45 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-63437444-8e9d-4af4-89d5-7a4ed2c5651c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e25b31-868a-4a99-869a-8639096de1b0 (non-flash)
Jul 31 10:17:45 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:17:45 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-63437444-8e9d-4af4-89d5-7a4ed2c5651c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e25b31-868a-4a99-869a-8639096de1b0 (non-flash)
Jul 31 10:17:45 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:17:45 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-63437444-8e9d-4af4-89d5-7a4ed2c5651c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43e25b31-868a-4a99-869a-8639096de1b0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:17:45 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-63437444-8e9d-4af4-89d5-7a4ed2c5651c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 10:17:45 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-63437444-8e9d-4af4-89d5-7a4ed2c5651c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 10:17:45 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-63437444-8e9d-4af4-89d5-7a4ed2c5651c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 10:17:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:17:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:17:45 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4ce378-a6c3-4256-9c3a-de1e429f388d]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:17:45 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-63437444-8e9d-4af4-89d5-7a4ed2c5651c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 10:17:45 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-63437444-8e9d-4af4-89d5-7a4ed2c5651c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OARYxBzS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 10:17:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-63437444-8e9d-4af4-89d5-7a4ed2c5651c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:17:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-63437444-8e9d-4af4-89d5-7a4ed2c5651c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '23533336235323637', 'path': '/dev/sdb'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:17:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63437444-8e9d-4af4-89d5-7a4ed2c5651c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533336235323637', 'path': '/dev/sdb'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 10:17:46 user nova-compute[71113]: DEBUG nova.objects.instance [None req-63437444-8e9d-4af4-89d5-7a4ed2c5651c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lazy-loading 'flavor' on Instance uuid d3a41634-a30c-47f8-b44d-8db3571358ef {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:17:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-63437444-8e9d-4af4-89d5-7a4ed2c5651c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 10:17:46 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:17:46 user nova-compute[71113]:   <source dev="/dev/sdb"/>
Jul 31 10:17:46 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 10:17:46 user nova-compute[71113]:   <serial>43e25b31-868a-4a99-869a-8639096de1b0</serial>
Jul 31 10:17:46 user nova-compute[71113]: </disk>
Jul 31 10:17:46 user nova-compute[71113]:  {{(pid=71113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 10:17:47 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-63437444-8e9d-4af4-89d5-7a4ed2c5651c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:17:47 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-63437444-8e9d-4af4-89d5-7a4ed2c5651c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:17:47 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-63437444-8e9d-4af4-89d5-7a4ed2c5651c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] No VIF found with MAC fa:16:3e:cd:4d:52, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 10:17:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-63437444-8e9d-4af4-89d5-7a4ed2c5651c tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "d3a41634-a30c-47f8-b44d-8db3571358ef" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.061s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:17:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ef7d11f4-5ccb-4b6a-a39f-e69a29c29263 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquiring lock "d3a41634-a30c-47f8-b44d-8db3571358ef" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:17:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ef7d11f4-5ccb-4b6a-a39f-e69a29c29263 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "d3a41634-a30c-47f8-b44d-8db3571358ef" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:17:48 user nova-compute[71113]: INFO nova.compute.manager [None req-ef7d11f4-5ccb-4b6a-a39f-e69a29c29263 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Detaching volume 43e25b31-868a-4a99-869a-8639096de1b0
Jul 31 10:17:48 user nova-compute[71113]: INFO nova.virt.block_device [None req-ef7d11f4-5ccb-4b6a-a39f-e69a29c29263 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Attempting to driver detach volume 43e25b31-868a-4a99-869a-8639096de1b0 from mountpoint /dev/vdb
Jul 31 10:17:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ef7d11f4-5ccb-4b6a-a39f-e69a29c29263 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Attempting to detach device vdb from instance d3a41634-a30c-47f8-b44d-8db3571358ef from the persistent domain config. {{(pid=71113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 10:17:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-ef7d11f4-5ccb-4b6a-a39f-e69a29c29263 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 10:17:48 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:17:48 user nova-compute[71113]:   <source dev="/dev/sdb"/>
Jul 31 10:17:48 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 10:17:48 user nova-compute[71113]:   <serial>43e25b31-868a-4a99-869a-8639096de1b0</serial>
Jul 31 10:17:48 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 10:17:48 user nova-compute[71113]: </disk>
Jul 31 10:17:48 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 10:17:48 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-ef7d11f4-5ccb-4b6a-a39f-e69a29c29263 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Successfully detached device vdb from instance d3a41634-a30c-47f8-b44d-8db3571358ef from the persistent domain config.
Jul 31 10:17:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ef7d11f4-5ccb-4b6a-a39f-e69a29c29263 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d3a41634-a30c-47f8-b44d-8db3571358ef from the live domain config. {{(pid=71113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 10:17:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-ef7d11f4-5ccb-4b6a-a39f-e69a29c29263 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 10:17:48 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:17:48 user nova-compute[71113]:   <source dev="/dev/sdb"/>
Jul 31 10:17:48 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 10:17:48 user nova-compute[71113]:   <serial>43e25b31-868a-4a99-869a-8639096de1b0</serial>
Jul 31 10:17:48 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 10:17:48 user nova-compute[71113]: </disk>
Jul 31 10:17:48 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 10:17:48 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:17:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Received event <DeviceRemovedEvent: 1690798668.7920768, d3a41634-a30c-47f8-b44d-8db3571358ef => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71113) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 10:17:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ef7d11f4-5ccb-4b6a-a39f-e69a29c29263 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d3a41634-a30c-47f8-b44d-8db3571358ef {{(pid=71113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 10:17:48 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-ef7d11f4-5ccb-4b6a-a39f-e69a29c29263 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Successfully detached device vdb from instance d3a41634-a30c-47f8-b44d-8db3571358ef from the live domain config.
Jul 31 10:17:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef7d11f4-5ccb-4b6a-a39f-e69a29c29263 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 10:17:48 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7d11f4-5ccb-4b6a-a39f-e69a29c29263 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:43e25b31-868a-4a99-869a-8639096de1b0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OARYxBzS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:17:48 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-ef7d11f4-5ccb-4b6a-a39f-e69a29c29263 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:17:48 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-ef7d11f4-5ccb-4b6a-a39f-e69a29c29263 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:17:48 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-ef7d11f4-5ccb-4b6a-a39f-e69a29c29263 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:17:48 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7d11f4-5ccb-4b6a-a39f-e69a29c29263 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43e25b31-868a-4a99-869a-8639096de1b0', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 10:17:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:17:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:17:48 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90aba5c-c8c7-4820-9232-28327aba90d0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43e25b31-868a-4a99-869a-8639096de1b0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:17:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:17:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:17:48 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[894b7d14-f448-42d1-b9ed-f2cf5d41730c]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e25b31-868a-4a99-869a-8639096de1b0 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:17:48 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7d11f4-5ccb-4b6a-a39f-e69a29c29263 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e25b31-868a-4a99-869a-8639096de1b0 (non-flash)
Jul 31 10:17:48 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:17:48 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7d11f4-5ccb-4b6a-a39f-e69a29c29263 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e25b31-868a-4a99-869a-8639096de1b0 (non-flash)
Jul 31 10:17:48 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:17:48 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7d11f4-5ccb-4b6a-a39f-e69a29c29263 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f79082c71c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43e25b31-868a-4a99-869a-8639096de1b0'): ({'sdb'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 10:17:48 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-ef7d11f4-5ccb-4b6a-a39f-e69a29c29263 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Removing single pathed devices sdb {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 10:17:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:17:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:17:48 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ac005a-ce4b-470e-b724-3a6f8752deec]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:17:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:17:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:17:48 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c58af2-09bf-4829-9384-285a64dea8f3]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:17:48 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-ef7d11f4-5ccb-4b6a-a39f-e69a29c29263 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Flushing IO for device /dev/sdb {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 10:17:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:17:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:17:48 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[624e3a12-ab01-4651-ba93-f28b0c4a4a4d]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:17:48 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-ef7d11f4-5ccb-4b6a-a39f-e69a29c29263 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 10:17:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:17:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:17:48 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2293872d-bd29-4244-aaef-6fb33a0a6a03]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:17:48 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-ef7d11f4-5ccb-4b6a-a39f-e69a29c29263 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 10:17:48 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-ef7d11f4-5ccb-4b6a-a39f-e69a29c29263 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] SCSI volumes sdb have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 10:17:48 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7d11f4-5ccb-4b6a-a39f-e69a29c29263 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43e25b31-868a-4a99-869a-8639096de1b0')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 10:17:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43e25b31-868a-4a99-869a-8639096de1b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:17:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43e25b31-868a-4a99-869a-8639096de1b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:17:48 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7be293-b648-4da4-b1d7-bcb3a23adc13]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:17:48 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7d11f4-5ccb-4b6a-a39f-e69a29c29263 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:17:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43e25b31-868a-4a99-869a-8639096de1b0 -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:17:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43e25b31-868a-4a99-869a-8639096de1b0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:17:49 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e91a125-339a-498a-b819-127c5075e06e]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:43e25b31-868a-4a99-869a-8639096de1b0, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:43e25b31-868a-4a99-869a-8639096de1b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:17:49 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7d11f4-5ccb-4b6a-a39f-e69a29c29263 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:43e25b31-868a-4a99-869a-8639096de1b0, portal: 172.16.0.220,3260]
Jul 31 10:17:49 user nova-compute[71113]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:43e25b31-868a-4a99-869a-8639096de1b0, portal: 172.16.0.220,3260] successful.
Jul 31 10:17:49 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:17:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43e25b31-868a-4a99-869a-8639096de1b0 -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:17:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43e25b31-868a-4a99-869a-8639096de1b0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:17:49 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d059ab-9cb6-4f6d-8ead-d024df6596c2]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:17:49 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7d11f4-5ccb-4b6a-a39f-e69a29c29263 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:17:49 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-ef7d11f4-5ccb-4b6a-a39f-e69a29c29263 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.247s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:17:49 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef7d11f4-5ccb-4b6a-a39f-e69a29c29263 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] <== disconnect_volume: return (249ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:17:49 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef7d11f4-5ccb-4b6a-a39f-e69a29c29263 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 10:17:49 user nova-compute[71113]: DEBUG nova.objects.instance [None req-ef7d11f4-5ccb-4b6a-a39f-e69a29c29263 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lazy-loading 'flavor' on Instance uuid d3a41634-a30c-47f8-b44d-8db3571358ef {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:17:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ef7d11f4-5ccb-4b6a-a39f-e69a29c29263 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "d3a41634-a30c-47f8-b44d-8db3571358ef" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.496s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:17:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:17:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:17:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:17:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:17:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:17:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:17:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:17:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:17:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:18:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:18:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:18:08 user nova-compute[71113]: DEBUG nova.compute.manager [req-6b8a03c5-ee23-423c-a6c7-7f715e02ca2e req-b78740fa-72c5-424a-80a5-aa856b43d32b service nova] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Received event network-changed-900a119c-0bab-4d30-b9a9-83cdd3b5c7a2 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:18:08 user nova-compute[71113]: DEBUG nova.compute.manager [req-6b8a03c5-ee23-423c-a6c7-7f715e02ca2e req-b78740fa-72c5-424a-80a5-aa856b43d32b service nova] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Refreshing instance network info cache due to event network-changed-900a119c-0bab-4d30-b9a9-83cdd3b5c7a2. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 10:18:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-6b8a03c5-ee23-423c-a6c7-7f715e02ca2e req-b78740fa-72c5-424a-80a5-aa856b43d32b service nova] Acquiring lock "refresh_cache-b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:18:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-6b8a03c5-ee23-423c-a6c7-7f715e02ca2e req-b78740fa-72c5-424a-80a5-aa856b43d32b service nova] Acquired lock "refresh_cache-b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:18:08 user nova-compute[71113]: DEBUG nova.network.neutron [req-6b8a03c5-ee23-423c-a6c7-7f715e02ca2e req-b78740fa-72c5-424a-80a5-aa856b43d32b service nova] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Refreshing network info cache for port 900a119c-0bab-4d30-b9a9-83cdd3b5c7a2 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 10:18:09 user nova-compute[71113]: DEBUG nova.network.neutron [req-6b8a03c5-ee23-423c-a6c7-7f715e02ca2e req-b78740fa-72c5-424a-80a5-aa856b43d32b service nova] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Updated VIF entry in instance network info cache for port 900a119c-0bab-4d30-b9a9-83cdd3b5c7a2. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 10:18:09 user nova-compute[71113]: DEBUG nova.network.neutron [req-6b8a03c5-ee23-423c-a6c7-7f715e02ca2e req-b78740fa-72c5-424a-80a5-aa856b43d32b service nova] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Updating instance_info_cache with network_info: [{"id": "900a119c-0bab-4d30-b9a9-83cdd3b5c7a2", "address": "fa:16:3e:47:cb:d2", "network": {"id": "e555f641-77a4-4097-b894-059fd7706d51", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-992856525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffc32f92126b46439c2be05fc24def8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap900a119c-0b", "ovs_interfaceid": "900a119c-0bab-4d30-b9a9-83cdd3b5c7a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:18:09 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-6b8a03c5-ee23-423c-a6c7-7f715e02ca2e req-b78740fa-72c5-424a-80a5-aa856b43d32b service nova] Releasing lock "refresh_cache-b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:18:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:18:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:18:14 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-2de43420-290a-483e-9236-b0f00085d6fd tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Acquiring lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:18:14 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-2de43420-290a-483e-9236-b0f00085d6fd tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:18:14 user nova-compute[71113]: DEBUG nova.objects.instance [None req-2de43420-290a-483e-9236-b0f00085d6fd tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lazy-loading 'flavor' on Instance uuid b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:18:14 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-2de43420-290a-483e-9236-b0f00085d6fd tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:18:14 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-2de43420-290a-483e-9236-b0f00085d6fd tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Acquiring lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:18:14 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-2de43420-290a-483e-9236-b0f00085d6fd tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:18:14 user nova-compute[71113]: INFO nova.compute.manager [None req-2de43420-290a-483e-9236-b0f00085d6fd tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Attaching volume f932e9b8-2a39-4091-b8e3-f50896f3a854 to /dev/vdb
Jul 31 10:18:14 user nova-compute[71113]: DEBUG os_brick.utils [None req-2de43420-290a-483e-9236-b0f00085d6fd tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:18:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:18:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:18:14 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9a6fea-f37d-451f-bab3-ae45b32160c8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:18:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:18:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:18:14 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[916e0224-4a59-465b-b5ed-b9de1742f1f0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:18:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:18:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:18:14 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2725fa2a-5d5a-404f-b3f0-fae2e93efd3d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:18:14 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae73272-392a-451c-a7fa-70b55477e29d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:18:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-2de43420-290a-483e-9236-b0f00085d6fd tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:18:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-2de43420-290a-483e-9236-b0f00085d6fd tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 10:18:14 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2de43420-290a-483e-9236-b0f00085d6fd tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 10:18:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:18:14 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 10:18:14 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 10:18:14 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c083f2-a6a1-418a-84d2-87504950f750]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:18:14 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-2de43420-290a-483e-9236-b0f00085d6fd tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 10:18:14 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-2de43420-290a-483e-9236-b0f00085d6fd tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 10:18:14 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-2de43420-290a-483e-9236-b0f00085d6fd tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 10:18:14 user nova-compute[71113]: DEBUG os_brick.utils [None req-2de43420-290a-483e-9236-b0f00085d6fd tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:18:14 user nova-compute[71113]: DEBUG nova.virt.block_device [None req-2de43420-290a-483e-9236-b0f00085d6fd tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Updating existing volume attachment record: 3de76021-2ab4-46d9-8d51-5c1696aacf91 {{(pid=71113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 10:18:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:18:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:18:17 user nova-compute[71113]: INFO nova.compute.manager [None req-8b4db285-25fe-4433-bf12-0c963cd90adb tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Unrescuing
Jul 31 10:18:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8b4db285-25fe-4433-bf12-0c963cd90adb tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Acquiring lock "refresh_cache-c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:18:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8b4db285-25fe-4433-bf12-0c963cd90adb tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Acquired lock "refresh_cache-c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:18:17 user nova-compute[71113]: DEBUG nova.network.neutron [None req-8b4db285-25fe-4433-bf12-0c963cd90adb tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 10:18:17 user nova-compute[71113]: DEBUG nova.network.neutron [None req-8b4db285-25fe-4433-bf12-0c963cd90adb tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Updating instance_info_cache with network_info: [{"id": "85692854-658a-459b-9ab0-f448a6bf83f2", "address": "fa:16:3e:2b:2c:47", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85692854-65", "ovs_interfaceid": "85692854-658a-459b-9ab0-f448a6bf83f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:18:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8b4db285-25fe-4433-bf12-0c963cd90adb tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Releasing lock "refresh_cache-c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:18:17 user nova-compute[71113]: DEBUG nova.objects.instance [None req-8b4db285-25fe-4433-bf12-0c963cd90adb tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lazy-loading 'flavor' on Instance uuid c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:18:18 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:18:18 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:18:18 user nova-compute[71113]: DEBUG nova.compute.manager [req-c6239f1d-b4da-44a8-bf60-ab183f80eac2 req-8d6f9e81-9f12-4cf1-a07e-b626132b4fd0 service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Received event network-vif-unplugged-85692854-658a-459b-9ab0-f448a6bf83f2 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:18:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-c6239f1d-b4da-44a8-bf60-ab183f80eac2 req-8d6f9e81-9f12-4cf1-a07e-b626132b4fd0 service nova] Acquiring lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:18:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-c6239f1d-b4da-44a8-bf60-ab183f80eac2 req-8d6f9e81-9f12-4cf1-a07e-b626132b4fd0 service nova] Lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:18:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-c6239f1d-b4da-44a8-bf60-ab183f80eac2 req-8d6f9e81-9f12-4cf1-a07e-b626132b4fd0 service nova] Lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:18:18 user nova-compute[71113]: DEBUG nova.compute.manager [req-c6239f1d-b4da-44a8-bf60-ab183f80eac2 req-8d6f9e81-9f12-4cf1-a07e-b626132b4fd0 service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] No waiting events found dispatching network-vif-unplugged-85692854-658a-459b-9ab0-f448a6bf83f2 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:18:18 user nova-compute[71113]: WARNING nova.compute.manager [req-c6239f1d-b4da-44a8-bf60-ab183f80eac2 req-8d6f9e81-9f12-4cf1-a07e-b626132b4fd0 service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Received unexpected event network-vif-unplugged-85692854-658a-459b-9ab0-f448a6bf83f2 for instance with vm_state rescued and task_state unrescuing.
Jul 31 10:18:18 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:18:18 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:18:18 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:18:18 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:18:18 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Instance destroyed successfully.
Jul 31 10:18:18 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:18:18 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:18:18 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:18:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:18:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:18:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:18:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:18:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:18:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:18:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:18:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:18:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:18:20 user nova-compute[71113]: DEBUG nova.compute.manager [req-3de95890-cd52-44cc-9c71-f3574716fca8 req-8a930317-e590-43ec-9c38-37f6df4c766e service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Received event network-vif-plugged-85692854-658a-459b-9ab0-f448a6bf83f2 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:18:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3de95890-cd52-44cc-9c71-f3574716fca8 req-8a930317-e590-43ec-9c38-37f6df4c766e service nova] Acquiring lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:18:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3de95890-cd52-44cc-9c71-f3574716fca8 req-8a930317-e590-43ec-9c38-37f6df4c766e service nova] Lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:18:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3de95890-cd52-44cc-9c71-f3574716fca8 req-8a930317-e590-43ec-9c38-37f6df4c766e service nova] Lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:18:20 user nova-compute[71113]: DEBUG nova.compute.manager [req-3de95890-cd52-44cc-9c71-f3574716fca8 req-8a930317-e590-43ec-9c38-37f6df4c766e service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] No waiting events found dispatching network-vif-plugged-85692854-658a-459b-9ab0-f448a6bf83f2 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:18:20 user nova-compute[71113]: WARNING nova.compute.manager [req-3de95890-cd52-44cc-9c71-f3574716fca8 req-8a930317-e590-43ec-9c38-37f6df4c766e service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Received unexpected event network-vif-plugged-85692854-658a-459b-9ab0-f448a6bf83f2 for instance with vm_state rescued and task_state unrescuing.
Jul 31 10:18:20 user nova-compute[71113]: DEBUG nova.compute.manager [req-3de95890-cd52-44cc-9c71-f3574716fca8 req-8a930317-e590-43ec-9c38-37f6df4c766e service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Received event network-vif-plugged-85692854-658a-459b-9ab0-f448a6bf83f2 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:18:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3de95890-cd52-44cc-9c71-f3574716fca8 req-8a930317-e590-43ec-9c38-37f6df4c766e service nova] Acquiring lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:18:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3de95890-cd52-44cc-9c71-f3574716fca8 req-8a930317-e590-43ec-9c38-37f6df4c766e service nova] Lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:18:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3de95890-cd52-44cc-9c71-f3574716fca8 req-8a930317-e590-43ec-9c38-37f6df4c766e service nova] Lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:18:20 user nova-compute[71113]: DEBUG nova.compute.manager [req-3de95890-cd52-44cc-9c71-f3574716fca8 req-8a930317-e590-43ec-9c38-37f6df4c766e service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] No waiting events found dispatching network-vif-plugged-85692854-658a-459b-9ab0-f448a6bf83f2 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:18:20 user nova-compute[71113]: WARNING nova.compute.manager [req-3de95890-cd52-44cc-9c71-f3574716fca8 req-8a930317-e590-43ec-9c38-37f6df4c766e service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Received unexpected event network-vif-plugged-85692854-658a-459b-9ab0-f448a6bf83f2 for instance with vm_state rescued and task_state unrescuing.
Jul 31 10:18:20 user nova-compute[71113]: DEBUG nova.compute.manager [req-3de95890-cd52-44cc-9c71-f3574716fca8 req-8a930317-e590-43ec-9c38-37f6df4c766e service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Received event network-vif-plugged-85692854-658a-459b-9ab0-f448a6bf83f2 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:18:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3de95890-cd52-44cc-9c71-f3574716fca8 req-8a930317-e590-43ec-9c38-37f6df4c766e service nova] Acquiring lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:18:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3de95890-cd52-44cc-9c71-f3574716fca8 req-8a930317-e590-43ec-9c38-37f6df4c766e service nova] Lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:18:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3de95890-cd52-44cc-9c71-f3574716fca8 req-8a930317-e590-43ec-9c38-37f6df4c766e service nova] Lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:18:20 user nova-compute[71113]: DEBUG nova.compute.manager [req-3de95890-cd52-44cc-9c71-f3574716fca8 req-8a930317-e590-43ec-9c38-37f6df4c766e service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] No waiting events found dispatching network-vif-plugged-85692854-658a-459b-9ab0-f448a6bf83f2 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:18:20 user nova-compute[71113]: WARNING nova.compute.manager [req-3de95890-cd52-44cc-9c71-f3574716fca8 req-8a930317-e590-43ec-9c38-37f6df4c766e service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Received unexpected event network-vif-plugged-85692854-658a-459b-9ab0-f448a6bf83f2 for instance with vm_state rescued and task_state unrescuing.
Jul 31 10:18:20 user nova-compute[71113]: DEBUG nova.compute.manager [req-3de95890-cd52-44cc-9c71-f3574716fca8 req-8a930317-e590-43ec-9c38-37f6df4c766e service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Received event network-vif-unplugged-85692854-658a-459b-9ab0-f448a6bf83f2 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:18:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3de95890-cd52-44cc-9c71-f3574716fca8 req-8a930317-e590-43ec-9c38-37f6df4c766e service nova] Acquiring lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:18:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3de95890-cd52-44cc-9c71-f3574716fca8 req-8a930317-e590-43ec-9c38-37f6df4c766e service nova] Lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:18:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3de95890-cd52-44cc-9c71-f3574716fca8 req-8a930317-e590-43ec-9c38-37f6df4c766e service nova] Lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:18:20 user nova-compute[71113]: DEBUG nova.compute.manager [req-3de95890-cd52-44cc-9c71-f3574716fca8 req-8a930317-e590-43ec-9c38-37f6df4c766e service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] No waiting events found dispatching network-vif-unplugged-85692854-658a-459b-9ab0-f448a6bf83f2 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:18:20 user nova-compute[71113]: WARNING nova.compute.manager [req-3de95890-cd52-44cc-9c71-f3574716fca8 req-8a930317-e590-43ec-9c38-37f6df4c766e service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Received unexpected event network-vif-unplugged-85692854-658a-459b-9ab0-f448a6bf83f2 for instance with vm_state rescued and task_state unrescuing.
Jul 31 10:18:20 user nova-compute[71113]: DEBUG nova.compute.manager [req-3de95890-cd52-44cc-9c71-f3574716fca8 req-8a930317-e590-43ec-9c38-37f6df4c766e service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Received event network-vif-plugged-85692854-658a-459b-9ab0-f448a6bf83f2 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:18:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3de95890-cd52-44cc-9c71-f3574716fca8 req-8a930317-e590-43ec-9c38-37f6df4c766e service nova] Acquiring lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:18:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3de95890-cd52-44cc-9c71-f3574716fca8 req-8a930317-e590-43ec-9c38-37f6df4c766e service nova] Lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:18:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3de95890-cd52-44cc-9c71-f3574716fca8 req-8a930317-e590-43ec-9c38-37f6df4c766e service nova] Lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:18:20 user nova-compute[71113]: DEBUG nova.compute.manager [req-3de95890-cd52-44cc-9c71-f3574716fca8 req-8a930317-e590-43ec-9c38-37f6df4c766e service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] No waiting events found dispatching network-vif-plugged-85692854-658a-459b-9ab0-f448a6bf83f2 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:18:20 user nova-compute[71113]: WARNING nova.compute.manager [req-3de95890-cd52-44cc-9c71-f3574716fca8 req-8a930317-e590-43ec-9c38-37f6df4c766e service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Received unexpected event network-vif-plugged-85692854-658a-459b-9ab0-f448a6bf83f2 for instance with vm_state rescued and task_state unrescuing.
Jul 31 10:18:20 user nova-compute[71113]: DEBUG nova.compute.manager [req-3de95890-cd52-44cc-9c71-f3574716fca8 req-8a930317-e590-43ec-9c38-37f6df4c766e service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Received event network-vif-plugged-85692854-658a-459b-9ab0-f448a6bf83f2 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:18:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3de95890-cd52-44cc-9c71-f3574716fca8 req-8a930317-e590-43ec-9c38-37f6df4c766e service nova] Acquiring lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:18:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3de95890-cd52-44cc-9c71-f3574716fca8 req-8a930317-e590-43ec-9c38-37f6df4c766e service nova] Lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:18:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3de95890-cd52-44cc-9c71-f3574716fca8 req-8a930317-e590-43ec-9c38-37f6df4c766e service nova] Lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:18:20 user nova-compute[71113]: DEBUG nova.compute.manager [req-3de95890-cd52-44cc-9c71-f3574716fca8 req-8a930317-e590-43ec-9c38-37f6df4c766e service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] No waiting events found dispatching network-vif-plugged-85692854-658a-459b-9ab0-f448a6bf83f2 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:18:20 user nova-compute[71113]: WARNING nova.compute.manager [req-3de95890-cd52-44cc-9c71-f3574716fca8 req-8a930317-e590-43ec-9c38-37f6df4c766e service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Received unexpected event network-vif-plugged-85692854-658a-459b-9ab0-f448a6bf83f2 for instance with vm_state rescued and task_state unrescuing.
Jul 31 10:18:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2de43420-290a-483e-9236-b0f00085d6fd tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de43420-290a-483e-9236-b0f00085d6fd tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f932e9b8-2a39-4091-b8e3-f50896f3a854'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xZrsFgHq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:18:21 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-2de43420-290a-483e-9236-b0f00085d6fd tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:18:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-2de43420-290a-483e-9236-b0f00085d6fd tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-2de43420-290a-483e-9236-b0f00085d6fd tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:18:21 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-2de43420-290a-483e-9236-b0f00085d6fd tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:18:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-2de43420-290a-483e-9236-b0f00085d6fd tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f932e9b8-2a39-4091-b8e3-f50896f3a854" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-2de43420-290a-483e-9236-b0f00085d6fd tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f932e9b8-2a39-4091-b8e3-f50896f3a854" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:18:21 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-2de43420-290a-483e-9236-b0f00085d6fd tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 10:18:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f932e9b8-2a39-4091-b8e3-f50896f3a854 -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f932e9b8-2a39-4091-b8e3-f50896f3a854 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b082a0e-ea19-4eca-a026-192081c6fa03]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de43420-290a-483e-9236-b0f00085d6fd tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 10:18:21 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f932e9b8-2a39-4091-b8e3-f50896f3a854 -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f932e9b8-2a39-4091-b8e3-f50896f3a854 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1243cac0-3875-4d19-ae90-3adf37efee07]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f932e9b8-2a39-4091-b8e3-f50896f3a854] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de43420-290a-483e-9236-b0f00085d6fd tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f932e9b8-2a39-4091-b8e3-f50896f3a854] added
Jul 31 10:18:21 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f932e9b8-2a39-4091-b8e3-f50896f3a854 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f932e9b8-2a39-4091-b8e3-f50896f3a854 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[484a9eac-8623-490d-9509-bc6a874fdf06]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de43420-290a-483e-9236-b0f00085d6fd tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f932e9b8-2a39-4091-b8e3-f50896f3a854 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f932e9b8-2a39-4091-b8e3-f50896f3a854 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[232655c8-82e7-4bfd-b684-feb9f3fe8c08]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de43420-290a-483e-9236-b0f00085d6fd tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f932e9b8-2a39-4091-b8e3-f50896f3a854 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xZrsFgHq {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f932e9b8-2a39-4091-b8e3-f50896f3a854 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xZrsFgHq" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aee2a31-0f84-4773-a6cf-741b397288ad]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de43420-290a-483e-9236-b0f00085d6fd tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xZrsFgHq'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f932e9b8-2a39-4091-b8e3-f50896f3a854 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f932e9b8-2a39-4091-b8e3-f50896f3a854 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8a6071-c2c0-4b12-bbfe-ee79b976d64f]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de43420-290a-483e-9236-b0f00085d6fd tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d03d202-d421-422c-b049-4adef9cc61f9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de43420-290a-483e-9236-b0f00085d6fd tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 31 10:18:21 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de43420-290a-483e-9236-b0f00085d6fd tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 31 10:18:21 user nova-compute[71113]:  {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:18:21 user nova-compute[71113]: WARNING os_brick.initiator.connectors.iscsi [None req-2de43420-290a-483e-9236-b0f00085d6fd tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 31 10:18:21 user nova-compute[71113]: 
Jul 31 10:18:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f932e9b8-2a39-4091-b8e3-f50896f3a854 -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f932e9b8-2a39-4091-b8e3-f50896f3a854 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca98c09-b3df-4aef-ab0c-4eb3b914cf5d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f932e9b8-2a39-4091-b8e3-f50896f3a854, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f932e9b8-2a39-4091-b8e3-f50896f3a854, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de43420-290a-483e-9236-b0f00085d6fd tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f932e9b8-2a39-4091-b8e3-f50896f3a854, portal: 172.16.0.220,3260]
Jul 31 10:18:21 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:f932e9b8-2a39-4091-b8e3-f50896f3a854, portal: 172.16.0.220,3260] successful.
Jul 31 10:18:21 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f932e9b8-2a39-4091-b8e3-f50896f3a854 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f932e9b8-2a39-4091-b8e3-f50896f3a854 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe075835-3713-4114-af61-79e9cb36680f]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de43420-290a-483e-9236-b0f00085d6fd tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1fe03b-09d7-4f77-bb32-00ab28c0d368]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f932e9b8-2a39-4091-b8e3-f50896f3a854 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de43420-290a-483e-9236-b0f00085d6fd tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f932e9b8-2a39-4091-b8e3-f50896f3a854 (non-flash)
Jul 31 10:18:21 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de43420-290a-483e-9236-b0f00085d6fd tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f932e9b8-2a39-4091-b8e3-f50896f3a854 (non-flash)
Jul 31 10:18:21 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-2de43420-290a-483e-9236-b0f00085d6fd tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f932e9b8-2a39-4091-b8e3-f50896f3a854" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de43420-290a-483e-9236-b0f00085d6fd tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-2de43420-290a-483e-9236-b0f00085d6fd tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-2de43420-290a-483e-9236-b0f00085d6fd tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85c318a-06c6-4155-bc3f-c3d4ce768d94]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-2de43420-290a-483e-9236-b0f00085d6fd tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de43420-290a-483e-9236-b0f00085d6fd tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xZrsFgHq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Removed pending event for c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5 due to event {{(pid=71113) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690798701.9464936, c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5 => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:18:21 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] VM Resumed (Lifecycle Event)
Jul 31 10:18:21 user nova-compute[71113]: DEBUG nova.compute.manager [None req-8b4db285-25fe-4433-bf12-0c963cd90adb tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:18:21 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:18:21 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 31 10:18:21 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690798701.947717, c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5 => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:18:21 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] VM Started (Lifecycle Event)
Jul 31 10:18:22 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:18:22 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:18:22 user nova-compute[71113]: DEBUG nova.compute.manager [req-1bb9bf51-38cd-4975-a40f-bc7f8b99e3b0 req-28fd645c-9876-43a4-a2a5-c6b629222e7d service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Received event network-vif-plugged-85692854-658a-459b-9ab0-f448a6bf83f2 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:18:22 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1bb9bf51-38cd-4975-a40f-bc7f8b99e3b0 req-28fd645c-9876-43a4-a2a5-c6b629222e7d service nova] Acquiring lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:18:22 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1bb9bf51-38cd-4975-a40f-bc7f8b99e3b0 req-28fd645c-9876-43a4-a2a5-c6b629222e7d service nova] Lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:18:22 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1bb9bf51-38cd-4975-a40f-bc7f8b99e3b0 req-28fd645c-9876-43a4-a2a5-c6b629222e7d service nova] Lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:18:22 user nova-compute[71113]: DEBUG nova.compute.manager [req-1bb9bf51-38cd-4975-a40f-bc7f8b99e3b0 req-28fd645c-9876-43a4-a2a5-c6b629222e7d service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] No waiting events found dispatching network-vif-plugged-85692854-658a-459b-9ab0-f448a6bf83f2 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:18:22 user nova-compute[71113]: WARNING nova.compute.manager [req-1bb9bf51-38cd-4975-a40f-bc7f8b99e3b0 req-28fd645c-9876-43a4-a2a5-c6b629222e7d service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Received unexpected event network-vif-plugged-85692854-658a-459b-9ab0-f448a6bf83f2 for instance with vm_state active and task_state None.
Jul 31 10:18:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-2de43420-290a-483e-9236-b0f00085d6fd tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:18:22 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-2de43420-290a-483e-9236-b0f00085d6fd tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23664346639323232', 'path': '/dev/sdb'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:18:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2de43420-290a-483e-9236-b0f00085d6fd tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664346639323232', 'path': '/dev/sdb'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 10:18:22 user nova-compute[71113]: DEBUG nova.objects.instance [None req-2de43420-290a-483e-9236-b0f00085d6fd tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lazy-loading 'flavor' on Instance uuid b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:18:22 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-2de43420-290a-483e-9236-b0f00085d6fd tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 10:18:22 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:18:22 user nova-compute[71113]:   <source dev="/dev/sdb"/>
Jul 31 10:18:22 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 10:18:22 user nova-compute[71113]:   <serial>f932e9b8-2a39-4091-b8e3-f50896f3a854</serial>
Jul 31 10:18:22 user nova-compute[71113]: </disk>
Jul 31 10:18:22 user nova-compute[71113]:  {{(pid=71113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 10:18:22 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:18:23 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-2de43420-290a-483e-9236-b0f00085d6fd tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:18:23 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-2de43420-290a-483e-9236-b0f00085d6fd tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:18:23 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-2de43420-290a-483e-9236-b0f00085d6fd tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] No VIF found with MAC fa:16:3e:47:cb:d2, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 10:18:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-2de43420-290a-483e-9236-b0f00085d6fd tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.904s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:18:23 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:18:23 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:18:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:18:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:18:28 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:18:28 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:18:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "refresh_cache-d3a41634-a30c-47f8-b44d-8db3571358ef" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:18:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquired lock "refresh_cache-d3a41634-a30c-47f8-b44d-8db3571358ef" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:18:28 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Forcefully refreshing network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 10:18:29 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Updating instance_info_cache with network_info: [{"id": "595b2c06-06c0-43cf-9749-07f63e9a8e25", "address": "fa:16:3e:cd:4d:52", "network": {"id": "4b030626-e3f1-4617-89c2-f6389226652f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441335951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7000d6a2a6b147ddbc38208b316574cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap595b2c06-06", "ovs_interfaceid": "595b2c06-06c0-43cf-9749-07f63e9a8e25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:18:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Releasing lock "refresh_cache-d3a41634-a30c-47f8-b44d-8db3571358ef" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:18:29 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Updated the network info_cache for instance {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 10:18:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:18:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:18:30 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:18:30 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:18:31 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:18:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:18:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:18:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:18:31 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:18:31 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:18:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:18:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:18:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:18:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3a41634-a30c-47f8-b44d-8db3571358ef/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:18:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3a41634-a30c-47f8-b44d-8db3571358ef/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:18:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3a41634-a30c-47f8-b44d-8db3571358ef/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:18:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3a41634-a30c-47f8-b44d-8db3571358ef/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:18:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:18:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:18:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:18:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:18:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:18:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:18:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:18:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:18:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:18:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:18:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:18:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:18:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 10:18:33 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:18:33 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:18:33 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=8431MB free_disk=25.190414428710938GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:18:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:18:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:18:33 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:18:33 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 8129456b-a22c-46e3-b5db-89fdcec87dec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:18:33 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance d3a41634-a30c-47f8-b44d-8db3571358ef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:18:33 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:18:33 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:18:33 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:18:34 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:18:34 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:18:34 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:18:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.319s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:18:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:18:35 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:18:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:18:35 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:18:37 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:18:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-69051eb8-fda9-4df2-8c5f-20804f1ad6e3 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquiring lock "d3a41634-a30c-47f8-b44d-8db3571358ef" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:18:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-69051eb8-fda9-4df2-8c5f-20804f1ad6e3 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "d3a41634-a30c-47f8-b44d-8db3571358ef" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:18:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-69051eb8-fda9-4df2-8c5f-20804f1ad6e3 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquiring lock "d3a41634-a30c-47f8-b44d-8db3571358ef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:18:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-69051eb8-fda9-4df2-8c5f-20804f1ad6e3 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "d3a41634-a30c-47f8-b44d-8db3571358ef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:18:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-69051eb8-fda9-4df2-8c5f-20804f1ad6e3 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "d3a41634-a30c-47f8-b44d-8db3571358ef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:18:38 user nova-compute[71113]: INFO nova.compute.manager [None req-69051eb8-fda9-4df2-8c5f-20804f1ad6e3 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Terminating instance
Jul 31 10:18:38 user nova-compute[71113]: DEBUG nova.compute.manager [None req-69051eb8-fda9-4df2-8c5f-20804f1ad6e3 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Start destroying the instance on the hypervisor. {{(pid=71113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 10:18:38 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:18:38 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:18:38 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:18:38 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:18:39 user nova-compute[71113]: DEBUG nova.compute.manager [req-cb491a6d-2d62-4f60-9b83-f7865f8f0c00 req-2deb6a68-bdcc-421e-85a6-2078ca357028 service nova] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Received event network-vif-unplugged-595b2c06-06c0-43cf-9749-07f63e9a8e25 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:18:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-cb491a6d-2d62-4f60-9b83-f7865f8f0c00 req-2deb6a68-bdcc-421e-85a6-2078ca357028 service nova] Acquiring lock "d3a41634-a30c-47f8-b44d-8db3571358ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:18:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-cb491a6d-2d62-4f60-9b83-f7865f8f0c00 req-2deb6a68-bdcc-421e-85a6-2078ca357028 service nova] Lock "d3a41634-a30c-47f8-b44d-8db3571358ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:18:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-cb491a6d-2d62-4f60-9b83-f7865f8f0c00 req-2deb6a68-bdcc-421e-85a6-2078ca357028 service nova] Lock "d3a41634-a30c-47f8-b44d-8db3571358ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:18:39 user nova-compute[71113]: DEBUG nova.compute.manager [req-cb491a6d-2d62-4f60-9b83-f7865f8f0c00 req-2deb6a68-bdcc-421e-85a6-2078ca357028 service nova] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] No waiting events found dispatching network-vif-unplugged-595b2c06-06c0-43cf-9749-07f63e9a8e25 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:18:39 user nova-compute[71113]: DEBUG nova.compute.manager [req-cb491a6d-2d62-4f60-9b83-f7865f8f0c00 req-2deb6a68-bdcc-421e-85a6-2078ca357028 service nova] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Received event network-vif-unplugged-595b2c06-06c0-43cf-9749-07f63e9a8e25 for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 10:18:39 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Instance destroyed successfully.
Jul 31 10:18:39 user nova-compute[71113]: DEBUG nova.objects.instance [None req-69051eb8-fda9-4df2-8c5f-20804f1ad6e3 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lazy-loading 'resources' on Instance uuid d3a41634-a30c-47f8-b44d-8db3571358ef {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:18:39 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-69051eb8-fda9-4df2-8c5f-20804f1ad6e3 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:15:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1232366544',display_name='tempest-AttachVolumeNegativeTest-server-1232366544',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1232366544',id=46,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKaG/whoFc06ZxgGymHTuNDkn0lhdZCou+Z4H5Laaj5kiT9KoBWnbpgTMq3hXCjSMRteGFbQ50eb8O26WfS5tErjOgXpt3ZmVmCT1GcJjWY7A8l1dnu3sGcmRqllh/EVuA==',key_name='tempest-keypair-1325829023',keypairs=<?>,launch_index=0,launched_at=2023-07-31T10:15:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7000d6a2a6b147ddbc38208b316574cd',ramdisk_id='',reservation_id='r-v4j0popm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2110881646',owner_user_name='tempest-AttachVolumeNegativeTest-2110881646-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T10:15:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9883a5677fb4852ae031137736a9ee4',uuid=d3a41634-a30c-47f8-b44d-8db3571358ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "595b2c06-06c0-43cf-9749-07f63e9a8e25", "address": "fa:16:3e:cd:4d:52", "network": {"id": "4b030626-e3f1-4617-89c2-f6389226652f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441335951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7000d6a2a6b147ddbc38208b316574cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap595b2c06-06", "ovs_interfaceid": "595b2c06-06c0-43cf-9749-07f63e9a8e25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 10:18:39 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-69051eb8-fda9-4df2-8c5f-20804f1ad6e3 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Converting VIF {"id": "595b2c06-06c0-43cf-9749-07f63e9a8e25", "address": "fa:16:3e:cd:4d:52", "network": {"id": "4b030626-e3f1-4617-89c2-f6389226652f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-441335951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7000d6a2a6b147ddbc38208b316574cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap595b2c06-06", "ovs_interfaceid": "595b2c06-06c0-43cf-9749-07f63e9a8e25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:18:39 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-69051eb8-fda9-4df2-8c5f-20804f1ad6e3 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:4d:52,bridge_name='br-int',has_traffic_filtering=True,id=595b2c06-06c0-43cf-9749-07f63e9a8e25,network=Network(4b030626-e3f1-4617-89c2-f6389226652f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap595b2c06-06') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:18:39 user nova-compute[71113]: DEBUG os_vif [None req-69051eb8-fda9-4df2-8c5f-20804f1ad6e3 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:4d:52,bridge_name='br-int',has_traffic_filtering=True,id=595b2c06-06c0-43cf-9749-07f63e9a8e25,network=Network(4b030626-e3f1-4617-89c2-f6389226652f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap595b2c06-06') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 10:18:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:18:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap595b2c06-06, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:18:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:18:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:18:39 user nova-compute[71113]: INFO os_vif [None req-69051eb8-fda9-4df2-8c5f-20804f1ad6e3 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:4d:52,bridge_name='br-int',has_traffic_filtering=True,id=595b2c06-06c0-43cf-9749-07f63e9a8e25,network=Network(4b030626-e3f1-4617-89c2-f6389226652f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap595b2c06-06')
Jul 31 10:18:39 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-69051eb8-fda9-4df2-8c5f-20804f1ad6e3 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Deleting instance files /opt/stack/data/nova/instances/d3a41634-a30c-47f8-b44d-8db3571358ef_del
Jul 31 10:18:39 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-69051eb8-fda9-4df2-8c5f-20804f1ad6e3 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Deletion of /opt/stack/data/nova/instances/d3a41634-a30c-47f8-b44d-8db3571358ef_del complete
Jul 31 10:18:39 user nova-compute[71113]: INFO nova.compute.manager [None req-69051eb8-fda9-4df2-8c5f-20804f1ad6e3 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Took 0.88 seconds to destroy the instance on the hypervisor.
Jul 31 10:18:39 user nova-compute[71113]: DEBUG oslo.service.loopingcall [None req-69051eb8-fda9-4df2-8c5f-20804f1ad6e3 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71113) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 10:18:39 user nova-compute[71113]: DEBUG nova.compute.manager [-] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Deallocating network for instance {{(pid=71113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 10:18:39 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] deallocate_for_instance() {{(pid=71113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 10:18:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8485d40c-567c-48b3-89a5-e07e4609a1da tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Acquiring lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:18:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8485d40c-567c-48b3-89a5-e07e4609a1da tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:18:40 user nova-compute[71113]: INFO nova.compute.manager [None req-8485d40c-567c-48b3-89a5-e07e4609a1da tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Detaching volume f932e9b8-2a39-4091-b8e3-f50896f3a854
Jul 31 10:18:40 user nova-compute[71113]: INFO nova.virt.block_device [None req-8485d40c-567c-48b3-89a5-e07e4609a1da tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Attempting to driver detach volume f932e9b8-2a39-4091-b8e3-f50896f3a854 from mountpoint /dev/vdb
Jul 31 10:18:40 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-8485d40c-567c-48b3-89a5-e07e4609a1da tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Attempting to detach device vdb from instance b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb from the persistent domain config. {{(pid=71113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 10:18:40 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-8485d40c-567c-48b3-89a5-e07e4609a1da tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 10:18:40 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:18:40 user nova-compute[71113]:   <source dev="/dev/sdb"/>
Jul 31 10:18:40 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 10:18:40 user nova-compute[71113]:   <serial>f932e9b8-2a39-4091-b8e3-f50896f3a854</serial>
Jul 31 10:18:40 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 10:18:40 user nova-compute[71113]: </disk>
Jul 31 10:18:40 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 10:18:40 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-8485d40c-567c-48b3-89a5-e07e4609a1da tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Successfully detached device vdb from instance b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb from the persistent domain config.
Jul 31 10:18:40 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-8485d40c-567c-48b3-89a5-e07e4609a1da tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb from the live domain config. {{(pid=71113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 10:18:40 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-8485d40c-567c-48b3-89a5-e07e4609a1da tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 10:18:40 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:18:40 user nova-compute[71113]:   <source dev="/dev/sdb"/>
Jul 31 10:18:40 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 10:18:40 user nova-compute[71113]:   <serial>f932e9b8-2a39-4091-b8e3-f50896f3a854</serial>
Jul 31 10:18:40 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 10:18:40 user nova-compute[71113]: </disk>
Jul 31 10:18:40 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 10:18:40 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:18:40 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Took 0.93 seconds to deallocate network for instance.
Jul 31 10:18:40 user nova-compute[71113]: DEBUG nova.compute.manager [req-a8d0a850-1246-405b-bb4c-31b42aa66347 req-d0051266-597f-4ad2-bf63-a6f86fd5c3ee service nova] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Received event network-vif-deleted-595b2c06-06c0-43cf-9749-07f63e9a8e25 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:18:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-69051eb8-fda9-4df2-8c5f-20804f1ad6e3 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:18:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-69051eb8-fda9-4df2-8c5f-20804f1ad6e3 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:18:40 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:18:40 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-69051eb8-fda9-4df2-8c5f-20804f1ad6e3 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:18:40 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-69051eb8-fda9-4df2-8c5f-20804f1ad6e3 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:18:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-69051eb8-fda9-4df2-8c5f-20804f1ad6e3 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.185s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:18:40 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-69051eb8-fda9-4df2-8c5f-20804f1ad6e3 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Deleted allocations for instance d3a41634-a30c-47f8-b44d-8db3571358ef
Jul 31 10:18:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-69051eb8-fda9-4df2-8c5f-20804f1ad6e3 tempest-AttachVolumeNegativeTest-2110881646 tempest-AttachVolumeNegativeTest-2110881646-project-member] Lock "d3a41634-a30c-47f8-b44d-8db3571358ef" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.182s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:18:40 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Received event <DeviceRemovedEvent: 1690798720.827847, b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71113) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 10:18:40 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-8485d40c-567c-48b3-89a5-e07e4609a1da tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb {{(pid=71113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 10:18:40 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-8485d40c-567c-48b3-89a5-e07e4609a1da tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Successfully detached device vdb from instance b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb from the live domain config.
Jul 31 10:18:40 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8485d40c-567c-48b3-89a5-e07e4609a1da tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 10:18:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8485d40c-567c-48b3-89a5-e07e4609a1da tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:f932e9b8-2a39-4091-b8e3-f50896f3a854'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xZrsFgHq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:18:40 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-8485d40c-567c-48b3-89a5-e07e4609a1da tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:18:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-8485d40c-567c-48b3-89a5-e07e4609a1da tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:18:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-8485d40c-567c-48b3-89a5-e07e4609a1da tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:18:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8485d40c-567c-48b3-89a5-e07e4609a1da tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f932e9b8-2a39-4091-b8e3-f50896f3a854', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 10:18:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:18:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:18:40 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d98fdf8-3314-4397-913f-93dd2d18d4db]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f932e9b8-2a39-4091-b8e3-f50896f3a854\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:18:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:18:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:18:40 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a9dc96-1318-4307-abf1-1f5fc9e07d00]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f932e9b8-2a39-4091-b8e3-f50896f3a854 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:18:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8485d40c-567c-48b3-89a5-e07e4609a1da tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f932e9b8-2a39-4091-b8e3-f50896f3a854 (non-flash)
Jul 31 10:18:40 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:18:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8485d40c-567c-48b3-89a5-e07e4609a1da tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f932e9b8-2a39-4091-b8e3-f50896f3a854 (non-flash)
Jul 31 10:18:40 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:18:40 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8485d40c-567c-48b3-89a5-e07e4609a1da tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7908392440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f932e9b8-2a39-4091-b8e3-f50896f3a854'): ({'sdb'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 10:18:40 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-8485d40c-567c-48b3-89a5-e07e4609a1da tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Removing single pathed devices sdb {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 10:18:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:18:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:18:40 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d18890-cd51-465c-ae56-978873a15293]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:18:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:18:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:18:40 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[90106c23-289c-446d-8e36-45b5764e899c]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:18:40 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-8485d40c-567c-48b3-89a5-e07e4609a1da tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Flushing IO for device /dev/sdb {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 10:18:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:18:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:18:40 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c539fc5b-2ec7-468e-9c53-1fd7587b815d]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:18:40 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-8485d40c-567c-48b3-89a5-e07e4609a1da tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 10:18:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:18:41 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:18:41 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1d5a64-34ba-4941-8b83-f593364fb853]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:18:41 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-8485d40c-567c-48b3-89a5-e07e4609a1da tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 10:18:41 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-8485d40c-567c-48b3-89a5-e07e4609a1da tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] SCSI volumes sdb have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 10:18:41 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8485d40c-567c-48b3-89a5-e07e4609a1da tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f932e9b8-2a39-4091-b8e3-f50896f3a854')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 10:18:41 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f932e9b8-2a39-4091-b8e3-f50896f3a854 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:18:41 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f932e9b8-2a39-4091-b8e3-f50896f3a854 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:18:41 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ab0c2b-c501-4557-9a50-7919757521a7]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:18:41 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8485d40c-567c-48b3-89a5-e07e4609a1da tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:18:41 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f932e9b8-2a39-4091-b8e3-f50896f3a854 -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:18:41 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f932e9b8-2a39-4091-b8e3-f50896f3a854 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:18:41 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7f49db-1d44-4d00-92ab-acf1c08fa731]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:f932e9b8-2a39-4091-b8e3-f50896f3a854, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:f932e9b8-2a39-4091-b8e3-f50896f3a854, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:18:41 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8485d40c-567c-48b3-89a5-e07e4609a1da tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:f932e9b8-2a39-4091-b8e3-f50896f3a854, portal: 172.16.0.220,3260]
Jul 31 10:18:41 user nova-compute[71113]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:f932e9b8-2a39-4091-b8e3-f50896f3a854, portal: 172.16.0.220,3260] successful.
Jul 31 10:18:41 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:18:41 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f932e9b8-2a39-4091-b8e3-f50896f3a854 -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:18:41 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f932e9b8-2a39-4091-b8e3-f50896f3a854 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:18:41 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d0d4a2-3c9e-45e3-9f52-21f2c1eee6e5]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:18:41 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8485d40c-567c-48b3-89a5-e07e4609a1da tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:18:41 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-8485d40c-567c-48b3-89a5-e07e4609a1da tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.265s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:18:41 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-8485d40c-567c-48b3-89a5-e07e4609a1da tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] <== disconnect_volume: return (266ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:18:41 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8485d40c-567c-48b3-89a5-e07e4609a1da tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 10:18:41 user nova-compute[71113]: DEBUG nova.compute.manager [req-b8df0f9c-8f78-40ee-8e4f-067d57108de3 req-2352d0ad-6e82-4a04-984a-8d40a5acb65a service nova] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Received event network-vif-plugged-595b2c06-06c0-43cf-9749-07f63e9a8e25 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:18:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-b8df0f9c-8f78-40ee-8e4f-067d57108de3 req-2352d0ad-6e82-4a04-984a-8d40a5acb65a service nova] Acquiring lock "d3a41634-a30c-47f8-b44d-8db3571358ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:18:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-b8df0f9c-8f78-40ee-8e4f-067d57108de3 req-2352d0ad-6e82-4a04-984a-8d40a5acb65a service nova] Lock "d3a41634-a30c-47f8-b44d-8db3571358ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:18:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-b8df0f9c-8f78-40ee-8e4f-067d57108de3 req-2352d0ad-6e82-4a04-984a-8d40a5acb65a service nova] Lock "d3a41634-a30c-47f8-b44d-8db3571358ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:18:41 user nova-compute[71113]: DEBUG nova.compute.manager [req-b8df0f9c-8f78-40ee-8e4f-067d57108de3 req-2352d0ad-6e82-4a04-984a-8d40a5acb65a service nova] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] No waiting events found dispatching network-vif-plugged-595b2c06-06c0-43cf-9749-07f63e9a8e25 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:18:41 user nova-compute[71113]: WARNING nova.compute.manager [req-b8df0f9c-8f78-40ee-8e4f-067d57108de3 req-2352d0ad-6e82-4a04-984a-8d40a5acb65a service nova] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Received unexpected event network-vif-plugged-595b2c06-06c0-43cf-9749-07f63e9a8e25 for instance with vm_state deleted and task_state None.
Jul 31 10:18:41 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:18:41 user nova-compute[71113]: DEBUG nova.objects.instance [None req-8485d40c-567c-48b3-89a5-e07e4609a1da tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lazy-loading 'flavor' on Instance uuid b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:18:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8485d40c-567c-48b3-89a5-e07e4609a1da tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.612s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:18:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:18:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:18:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:18:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:18:54 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690798719.3697758, d3a41634-a30c-47f8-b44d-8db3571358ef => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:18:54 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] VM Stopped (Lifecycle Event)
Jul 31 10:18:54 user nova-compute[71113]: DEBUG nova.compute.manager [None req-611099f9-bbe2-4e26-999a-87d95c71c0d5 None None] [instance: d3a41634-a30c-47f8-b44d-8db3571358ef] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:18:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:18:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:18:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:19:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:19:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:19:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:19:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:19:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:19:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:19:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:19:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:19:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:19:23 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:19:23 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:19:23 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:19:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:19:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:19:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:19:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:19:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:19:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:19:29 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:19:29 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:19:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "refresh_cache-b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:19:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquired lock "refresh_cache-b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:19:29 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Forcefully refreshing network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 10:19:30 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Updating instance_info_cache with network_info: [{"id": "900a119c-0bab-4d30-b9a9-83cdd3b5c7a2", "address": "fa:16:3e:47:cb:d2", "network": {"id": "e555f641-77a4-4097-b894-059fd7706d51", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-992856525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffc32f92126b46439c2be05fc24def8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap900a119c-0b", "ovs_interfaceid": "900a119c-0bab-4d30-b9a9-83cdd3b5c7a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:19:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Releasing lock "refresh_cache-b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:19:30 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Updated the network info_cache for instance {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 10:19:31 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:19:31 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:19:32 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:19:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:19:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:19:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:19:32 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:19:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:19:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:19:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:19:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:19:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:19:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:19:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:19:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:19:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:19:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:19:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:19:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:19:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:19:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:19:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:19:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:19:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:19:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1a76eeba-09cd-4d4c-8aa2-3568791ca6ff tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Acquiring lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:19:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1a76eeba-09cd-4d4c-8aa2-3568791ca6ff tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:19:34 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:19:34 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:19:34 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=8590MB free_disk=25.21689224243164GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:19:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:19:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:19:34 user nova-compute[71113]: DEBUG nova.objects.instance [None req-1a76eeba-09cd-4d4c-8aa2-3568791ca6ff tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lazy-loading 'flavor' on Instance uuid b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:19:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1a76eeba-09cd-4d4c-8aa2-3568791ca6ff tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:19:34 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:19:34 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 8129456b-a22c-46e3-b5db-89fdcec87dec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:19:34 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:19:34 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:19:34 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:19:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1a76eeba-09cd-4d4c-8aa2-3568791ca6ff tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Acquiring lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:19:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1a76eeba-09cd-4d4c-8aa2-3568791ca6ff tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:19:34 user nova-compute[71113]: INFO nova.compute.manager [None req-1a76eeba-09cd-4d4c-8aa2-3568791ca6ff tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Attaching volume d647b5a7-3a88-48a5-9331-80c00a6afa87 to /dev/vdb
Jul 31 10:19:34 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:19:34 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:19:34 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:19:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.278s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:19:34 user nova-compute[71113]: DEBUG os_brick.utils [None req-1a76eeba-09cd-4d4c-8aa2-3568791ca6ff tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:19:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:19:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:19:34 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50291d7-b88c-4f3d-945a-77e282bbc922]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:19:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:19:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:19:34 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8f95ad-ecdd-4fd1-b743-30e9a8172c0e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:19:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:19:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:19:34 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[75dcbc2a-f241-4357-82a5-cba4afd37b41]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:19:34 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d626f3-de4f-439c-bac1-fb1f8640c475]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:19:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-1a76eeba-09cd-4d4c-8aa2-3568791ca6ff tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:19:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-1a76eeba-09cd-4d4c-8aa2-3568791ca6ff tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 10:19:34 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1a76eeba-09cd-4d4c-8aa2-3568791ca6ff tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 10:19:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:19:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 10:19:34 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 10:19:34 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6246df82-bb38-44b2-b4f4-d0002ebdfea8]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:19:34 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-1a76eeba-09cd-4d4c-8aa2-3568791ca6ff tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 10:19:34 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-1a76eeba-09cd-4d4c-8aa2-3568791ca6ff tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 10:19:34 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-1a76eeba-09cd-4d4c-8aa2-3568791ca6ff tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 10:19:34 user nova-compute[71113]: DEBUG os_brick.utils [None req-1a76eeba-09cd-4d4c-8aa2-3568791ca6ff tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:19:34 user nova-compute[71113]: DEBUG nova.virt.block_device [None req-1a76eeba-09cd-4d4c-8aa2-3568791ca6ff tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Updating existing volume attachment record: 49430afc-18c3-4f50-89f2-e7cc3561c0b0 {{(pid=71113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 10:19:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:19:36 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:19:36 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:19:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:19:39 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:19:41 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a76eeba-09cd-4d4c-8aa2-3568791ca6ff tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 10:19:41 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a76eeba-09cd-4d4c-8aa2-3568791ca6ff tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d647b5a7-3a88-48a5-9331-80c00a6afa87'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UseWKMzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:19:41 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-1a76eeba-09cd-4d4c-8aa2-3568791ca6ff tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:19:41 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-1a76eeba-09cd-4d4c-8aa2-3568791ca6ff tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:19:41 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-1a76eeba-09cd-4d4c-8aa2-3568791ca6ff tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:19:41 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-1a76eeba-09cd-4d4c-8aa2-3568791ca6ff tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:19:41 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-1a76eeba-09cd-4d4c-8aa2-3568791ca6ff tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d647b5a7-3a88-48a5-9331-80c00a6afa87" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:19:41 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-1a76eeba-09cd-4d4c-8aa2-3568791ca6ff tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d647b5a7-3a88-48a5-9331-80c00a6afa87" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:19:41 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-1a76eeba-09cd-4d4c-8aa2-3568791ca6ff tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 10:19:41 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d647b5a7-3a88-48a5-9331-80c00a6afa87 -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:19:41 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d647b5a7-3a88-48a5-9331-80c00a6afa87 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:19:41 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a466b16b-cfe5-47d2-ab5e-8e0f22801330]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:19:41 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a76eeba-09cd-4d4c-8aa2-3568791ca6ff tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 10:19:41 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:19:41 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d647b5a7-3a88-48a5-9331-80c00a6afa87 -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:19:41 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d647b5a7-3a88-48a5-9331-80c00a6afa87 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:19:41 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9943872a-11cd-43d6-a29e-c215b368e01c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d647b5a7-3a88-48a5-9331-80c00a6afa87] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:19:41 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a76eeba-09cd-4d4c-8aa2-3568791ca6ff tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d647b5a7-3a88-48a5-9331-80c00a6afa87] added
Jul 31 10:19:41 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:19:41 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d647b5a7-3a88-48a5-9331-80c00a6afa87 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:19:41 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d647b5a7-3a88-48a5-9331-80c00a6afa87 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:19:41 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ec4916-8550-45f9-9ee9-34eb30a6c463]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:19:41 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a76eeba-09cd-4d4c-8aa2-3568791ca6ff tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:19:41 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d647b5a7-3a88-48a5-9331-80c00a6afa87 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:19:41 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d647b5a7-3a88-48a5-9331-80c00a6afa87 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:19:41 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b8a8c2-c8d8-4a29-8ade-730b25ac3858]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:19:41 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a76eeba-09cd-4d4c-8aa2-3568791ca6ff tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:19:41 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d647b5a7-3a88-48a5-9331-80c00a6afa87 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UseWKMzx {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:19:41 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d647b5a7-3a88-48a5-9331-80c00a6afa87 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UseWKMzx" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:19:41 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28b90be-1c6a-4a7e-85b4-6db926a1a0fa]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:19:41 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a76eeba-09cd-4d4c-8aa2-3568791ca6ff tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UseWKMzx'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:19:41 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d647b5a7-3a88-48a5-9331-80c00a6afa87 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:19:41 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d647b5a7-3a88-48a5-9331-80c00a6afa87 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.086s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:19:41 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43056b5-96bf-4aa1-8e7a-bb3924627525]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:19:41 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a76eeba-09cd-4d4c-8aa2-3568791ca6ff tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:19:41 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:19:41 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:19:41 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5bd206e-26c3-4152-8c06-325a90e2de26]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:19:41 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a76eeba-09cd-4d4c-8aa2-3568791ca6ff tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 31 10:19:41 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:19:41 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a76eeba-09cd-4d4c-8aa2-3568791ca6ff tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 31 10:19:41 user nova-compute[71113]:  {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:19:41 user nova-compute[71113]: WARNING os_brick.initiator.connectors.iscsi [None req-1a76eeba-09cd-4d4c-8aa2-3568791ca6ff tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 31 10:19:41 user nova-compute[71113]: 
Jul 31 10:19:41 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d647b5a7-3a88-48a5-9331-80c00a6afa87 -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:19:41 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d647b5a7-3a88-48a5-9331-80c00a6afa87 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:19:41 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbbda364-1f7b-433e-a4d6-6efa0d302cfd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d647b5a7-3a88-48a5-9331-80c00a6afa87, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d647b5a7-3a88-48a5-9331-80c00a6afa87, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:19:41 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a76eeba-09cd-4d4c-8aa2-3568791ca6ff tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d647b5a7-3a88-48a5-9331-80c00a6afa87, portal: 172.16.0.220,3260]
Jul 31 10:19:41 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:d647b5a7-3a88-48a5-9331-80c00a6afa87, portal: 172.16.0.220,3260] successful.
Jul 31 10:19:41 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:19:41 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d647b5a7-3a88-48a5-9331-80c00a6afa87 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:19:41 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d647b5a7-3a88-48a5-9331-80c00a6afa87 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:19:41 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de33be4-2bf3-4133-adb5-a7cd28b6a496]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:19:41 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a76eeba-09cd-4d4c-8aa2-3568791ca6ff tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:19:41 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:19:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:19:42 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7345d4f6-770c-4254-a0b4-a5105929f93c]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d647b5a7-3a88-48a5-9331-80c00a6afa87 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:19:42 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a76eeba-09cd-4d4c-8aa2-3568791ca6ff tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d647b5a7-3a88-48a5-9331-80c00a6afa87 (non-flash)
Jul 31 10:19:42 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:19:42 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a76eeba-09cd-4d4c-8aa2-3568791ca6ff tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d647b5a7-3a88-48a5-9331-80c00a6afa87 (non-flash)
Jul 31 10:19:42 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:19:42 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-1a76eeba-09cd-4d4c-8aa2-3568791ca6ff tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d647b5a7-3a88-48a5-9331-80c00a6afa87" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:19:42 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a76eeba-09cd-4d4c-8aa2-3568791ca6ff tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 10:19:42 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-1a76eeba-09cd-4d4c-8aa2-3568791ca6ff tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 10:19:42 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-1a76eeba-09cd-4d4c-8aa2-3568791ca6ff tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 10:19:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:19:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:19:42 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b782b24b-5514-40ea-9fbb-e0a16cd08470]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:19:42 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-1a76eeba-09cd-4d4c-8aa2-3568791ca6ff tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: None {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 10:19:43 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-1a76eeba-09cd-4d4c-8aa2-3568791ca6ff tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 10:19:43 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a76eeba-09cd-4d4c-8aa2-3568791ca6ff tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UseWKMzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 10:19:43 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-1a76eeba-09cd-4d4c-8aa2-3568791ca6ff tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:19:43 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a76eeba-09cd-4d4c-8aa2-3568791ca6ff tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '23666323065663264', 'path': '/dev/sdb'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:19:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a76eeba-09cd-4d4c-8aa2-3568791ca6ff tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666323065663264', 'path': '/dev/sdb'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 10:19:43 user nova-compute[71113]: DEBUG nova.objects.instance [None req-1a76eeba-09cd-4d4c-8aa2-3568791ca6ff tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lazy-loading 'flavor' on Instance uuid b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:19:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-1a76eeba-09cd-4d4c-8aa2-3568791ca6ff tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 10:19:43 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:19:43 user nova-compute[71113]:   <source dev="/dev/sdb"/>
Jul 31 10:19:43 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 10:19:43 user nova-compute[71113]:   <serial>d647b5a7-3a88-48a5-9331-80c00a6afa87</serial>
Jul 31 10:19:43 user nova-compute[71113]: </disk>
Jul 31 10:19:43 user nova-compute[71113]:  {{(pid=71113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 10:19:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-1a76eeba-09cd-4d4c-8aa2-3568791ca6ff tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:19:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-1a76eeba-09cd-4d4c-8aa2-3568791ca6ff tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:19:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-1a76eeba-09cd-4d4c-8aa2-3568791ca6ff tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] No VIF found with MAC fa:16:3e:47:cb:d2, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 10:19:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1a76eeba-09cd-4d4c-8aa2-3568791ca6ff tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.928s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:19:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:19:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:19:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:19:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:19:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:19:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:19:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:19:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:19:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c22520e5-c62d-4f3f-b4e1-e3cab80e3dd8 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Acquiring lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:19:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c22520e5-c62d-4f3f-b4e1-e3cab80e3dd8 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:19:45 user nova-compute[71113]: INFO nova.compute.manager [None req-c22520e5-c62d-4f3f-b4e1-e3cab80e3dd8 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Detaching volume d647b5a7-3a88-48a5-9331-80c00a6afa87
Jul 31 10:19:46 user nova-compute[71113]: INFO nova.virt.block_device [None req-c22520e5-c62d-4f3f-b4e1-e3cab80e3dd8 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Attempting to driver detach volume d647b5a7-3a88-48a5-9331-80c00a6afa87 from mountpoint /dev/vdb
Jul 31 10:19:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-c22520e5-c62d-4f3f-b4e1-e3cab80e3dd8 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Attempting to detach device vdb from instance b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb from the persistent domain config. {{(pid=71113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 10:19:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-c22520e5-c62d-4f3f-b4e1-e3cab80e3dd8 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 10:19:46 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:19:46 user nova-compute[71113]:   <source dev="/dev/sdb"/>
Jul 31 10:19:46 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 10:19:46 user nova-compute[71113]:   <serial>d647b5a7-3a88-48a5-9331-80c00a6afa87</serial>
Jul 31 10:19:46 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 10:19:46 user nova-compute[71113]: </disk>
Jul 31 10:19:46 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 10:19:46 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-c22520e5-c62d-4f3f-b4e1-e3cab80e3dd8 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Successfully detached device vdb from instance b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb from the persistent domain config.
Jul 31 10:19:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-c22520e5-c62d-4f3f-b4e1-e3cab80e3dd8 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb from the live domain config. {{(pid=71113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 10:19:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-c22520e5-c62d-4f3f-b4e1-e3cab80e3dd8 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 10:19:46 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:19:46 user nova-compute[71113]:   <source dev="/dev/sdb"/>
Jul 31 10:19:46 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 10:19:46 user nova-compute[71113]:   <serial>d647b5a7-3a88-48a5-9331-80c00a6afa87</serial>
Jul 31 10:19:46 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 10:19:46 user nova-compute[71113]: </disk>
Jul 31 10:19:46 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 10:19:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Received event <DeviceRemovedEvent: 1690798786.5084383, b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71113) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 10:19:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-c22520e5-c62d-4f3f-b4e1-e3cab80e3dd8 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb {{(pid=71113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 10:19:46 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-c22520e5-c62d-4f3f-b4e1-e3cab80e3dd8 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Successfully detached device vdb from instance b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb from the live domain config.
Jul 31 10:19:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c22520e5-c62d-4f3f-b4e1-e3cab80e3dd8 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 10:19:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22520e5-c62d-4f3f-b4e1-e3cab80e3dd8 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:d647b5a7-3a88-48a5-9331-80c00a6afa87'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UseWKMzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:19:46 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-c22520e5-c62d-4f3f-b4e1-e3cab80e3dd8 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:19:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-c22520e5-c62d-4f3f-b4e1-e3cab80e3dd8 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:19:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-c22520e5-c62d-4f3f-b4e1-e3cab80e3dd8 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:19:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22520e5-c62d-4f3f-b4e1-e3cab80e3dd8 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d647b5a7-3a88-48a5-9331-80c00a6afa87', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 10:19:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:19:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:19:46 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5351725-deab-41e7-8a21-ea5318c147d1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d647b5a7-3a88-48a5-9331-80c00a6afa87\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:19:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:19:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:19:46 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71df3e4-66d0-42fe-8bd7-06a494663963]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d647b5a7-3a88-48a5-9331-80c00a6afa87 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:19:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22520e5-c62d-4f3f-b4e1-e3cab80e3dd8 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d647b5a7-3a88-48a5-9331-80c00a6afa87 (non-flash)
Jul 31 10:19:46 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:19:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22520e5-c62d-4f3f-b4e1-e3cab80e3dd8 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d647b5a7-3a88-48a5-9331-80c00a6afa87 (non-flash)
Jul 31 10:19:46 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:19:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22520e5-c62d-4f3f-b4e1-e3cab80e3dd8 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7911776ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d647b5a7-3a88-48a5-9331-80c00a6afa87'): ({'sdb'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 10:19:46 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-c22520e5-c62d-4f3f-b4e1-e3cab80e3dd8 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Removing single pathed devices sdb {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 10:19:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:19:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:19:46 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9556b534-9c32-418f-800d-662fa7dc2bda]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:19:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:19:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:19:46 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[30cc2964-90b5-4431-bce2-1c9851a0dfb9]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:19:46 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-c22520e5-c62d-4f3f-b4e1-e3cab80e3dd8 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Flushing IO for device /dev/sdb {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 10:19:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:19:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:19:46 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ff9fc6-d254-4125-a21a-2c0191a17082]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:19:46 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-c22520e5-c62d-4f3f-b4e1-e3cab80e3dd8 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 10:19:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:19:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:19:46 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1525631-393b-4733-b9d9-8a4183dd4ed7]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:19:46 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-c22520e5-c62d-4f3f-b4e1-e3cab80e3dd8 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 10:19:46 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-c22520e5-c62d-4f3f-b4e1-e3cab80e3dd8 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] SCSI volumes sdb have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 10:19:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22520e5-c62d-4f3f-b4e1-e3cab80e3dd8 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d647b5a7-3a88-48a5-9331-80c00a6afa87')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 10:19:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d647b5a7-3a88-48a5-9331-80c00a6afa87 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:19:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d647b5a7-3a88-48a5-9331-80c00a6afa87 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:19:46 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1307039-1703-432b-a5ba-69132ecff08e]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:19:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22520e5-c62d-4f3f-b4e1-e3cab80e3dd8 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:19:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d647b5a7-3a88-48a5-9331-80c00a6afa87 -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:19:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d647b5a7-3a88-48a5-9331-80c00a6afa87 -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:19:46 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[cecd20e8-324c-46b8-aab2-6ed5cac798ae]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:d647b5a7-3a88-48a5-9331-80c00a6afa87, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:d647b5a7-3a88-48a5-9331-80c00a6afa87, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:19:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22520e5-c62d-4f3f-b4e1-e3cab80e3dd8 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:d647b5a7-3a88-48a5-9331-80c00a6afa87, portal: 172.16.0.220,3260]
Jul 31 10:19:46 user nova-compute[71113]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:d647b5a7-3a88-48a5-9331-80c00a6afa87, portal: 172.16.0.220,3260] successful.
Jul 31 10:19:46 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:19:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d647b5a7-3a88-48a5-9331-80c00a6afa87 -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:19:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d647b5a7-3a88-48a5-9331-80c00a6afa87 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:19:46 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb9a678-d6f4-4b87-86b7-08dcc9d78a26]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:19:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22520e5-c62d-4f3f-b4e1-e3cab80e3dd8 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:19:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-c22520e5-c62d-4f3f-b4e1-e3cab80e3dd8 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.257s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:19:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22520e5-c62d-4f3f-b4e1-e3cab80e3dd8 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] <== disconnect_volume: return (261ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:19:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c22520e5-c62d-4f3f-b4e1-e3cab80e3dd8 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 10:19:47 user nova-compute[71113]: DEBUG nova.objects.instance [None req-c22520e5-c62d-4f3f-b4e1-e3cab80e3dd8 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lazy-loading 'flavor' on Instance uuid b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:19:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c22520e5-c62d-4f3f-b4e1-e3cab80e3dd8 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.619s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:19:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:19:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:19:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:19:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:19:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:19:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:19:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:19:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:19:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:19:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:20:02 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:20:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:20:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:20:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:20:08 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:20:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:20:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:20:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:20:13 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:20:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:20:14 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Acquiring lock "1ca22313-39ec-4366-abe0-fa40247dfa3b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:20:14 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "1ca22313-39ec-4366-abe0-fa40247dfa3b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:20:14 user nova-compute[71113]: DEBUG nova.compute.manager [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Starting instance... {{(pid=71113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 10:20:14 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:20:14 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:20:14 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 10:20:14 user nova-compute[71113]: INFO nova.compute.claims [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Claim successful on node user
Jul 31 10:20:15 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:20:15 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:20:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.274s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:20:15 user nova-compute[71113]: DEBUG nova.compute.manager [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Start building networks asynchronously for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 10:20:15 user nova-compute[71113]: DEBUG nova.compute.manager [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Allocating IP information in the background. {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 10:20:15 user nova-compute[71113]: DEBUG nova.network.neutron [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] allocate_for_instance() {{(pid=71113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 10:20:15 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 10:20:15 user nova-compute[71113]: DEBUG nova.compute.manager [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Start building block device mappings for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 10:20:15 user nova-compute[71113]: DEBUG nova.policy [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6023b7c67c0941d3975fa9c25140684f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938c4f5af8a347cf9d700c8cdb5df356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71113) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 10:20:15 user nova-compute[71113]: DEBUG nova.compute.manager [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Start spawning the instance on the hypervisor. {{(pid=71113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 10:20:15 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 10:20:15 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Creating image(s)
Jul 31 10:20:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Acquiring lock "/opt/stack/data/nova/instances/1ca22313-39ec-4366-abe0-fa40247dfa3b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:20:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "/opt/stack/data/nova/instances/1ca22313-39ec-4366-abe0-fa40247dfa3b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:20:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "/opt/stack/data/nova/instances/1ca22313-39ec-4366-abe0-fa40247dfa3b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:20:15 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:20:15 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.137s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:20:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Acquiring lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:20:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:20:15 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:20:15 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.144s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:20:15 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/1ca22313-39ec-4366-abe0-fa40247dfa3b/disk 1073741824 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:20:15 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/1ca22313-39ec-4366-abe0-fa40247dfa3b/disk 1073741824" returned: 0 in 0.062s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:20:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:20:15 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:20:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:20:15 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.136s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:20:15 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1ca22313-39ec-4366-abe0-fa40247dfa3b/disk. size=1073741824 {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 10:20:15 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ca22313-39ec-4366-abe0-fa40247dfa3b/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:20:15 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ca22313-39ec-4366-abe0-fa40247dfa3b/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:20:15 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Cannot resize image /opt/stack/data/nova/instances/1ca22313-39ec-4366-abe0-fa40247dfa3b/disk to a smaller size. {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 10:20:15 user nova-compute[71113]: DEBUG nova.objects.instance [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lazy-loading 'migration_context' on Instance uuid 1ca22313-39ec-4366-abe0-fa40247dfa3b {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:20:15 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Created local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 10:20:15 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Ensure instance console log exists: /opt/stack/data/nova/instances/1ca22313-39ec-4366-abe0-fa40247dfa3b/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 10:20:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:20:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:20:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:20:16 user nova-compute[71113]: DEBUG nova.network.neutron [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Successfully created port: aa0481c2-d383-47ac-aaca-8830e727b0fd {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 10:20:17 user nova-compute[71113]: DEBUG nova.network.neutron [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Successfully updated port: aa0481c2-d383-47ac-aaca-8830e727b0fd {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 10:20:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Acquiring lock "refresh_cache-1ca22313-39ec-4366-abe0-fa40247dfa3b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:20:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Acquired lock "refresh_cache-1ca22313-39ec-4366-abe0-fa40247dfa3b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:20:17 user nova-compute[71113]: DEBUG nova.network.neutron [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 10:20:17 user nova-compute[71113]: DEBUG nova.compute.manager [req-303a80b5-e731-4429-8ac5-92e5392f70aa req-34f6984a-29ff-4fb6-ab7e-6c634d6f0706 service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Received event network-changed-aa0481c2-d383-47ac-aaca-8830e727b0fd {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:20:17 user nova-compute[71113]: DEBUG nova.compute.manager [req-303a80b5-e731-4429-8ac5-92e5392f70aa req-34f6984a-29ff-4fb6-ab7e-6c634d6f0706 service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Refreshing instance network info cache due to event network-changed-aa0481c2-d383-47ac-aaca-8830e727b0fd. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 10:20:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-303a80b5-e731-4429-8ac5-92e5392f70aa req-34f6984a-29ff-4fb6-ab7e-6c634d6f0706 service nova] Acquiring lock "refresh_cache-1ca22313-39ec-4366-abe0-fa40247dfa3b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:20:17 user nova-compute[71113]: DEBUG nova.network.neutron [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 10:20:17 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:20:17 user nova-compute[71113]: DEBUG nova.network.neutron [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Updating instance_info_cache with network_info: [{"id": "aa0481c2-d383-47ac-aaca-8830e727b0fd", "address": "fa:16:3e:3a:ac:a2", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa0481c2-d3", "ovs_interfaceid": "aa0481c2-d383-47ac-aaca-8830e727b0fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:20:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Releasing lock "refresh_cache-1ca22313-39ec-4366-abe0-fa40247dfa3b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:20:17 user nova-compute[71113]: DEBUG nova.compute.manager [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Instance network_info: |[{"id": "aa0481c2-d383-47ac-aaca-8830e727b0fd", "address": "fa:16:3e:3a:ac:a2", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa0481c2-d3", "ovs_interfaceid": "aa0481c2-d383-47ac-aaca-8830e727b0fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 10:20:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-303a80b5-e731-4429-8ac5-92e5392f70aa req-34f6984a-29ff-4fb6-ab7e-6c634d6f0706 service nova] Acquired lock "refresh_cache-1ca22313-39ec-4366-abe0-fa40247dfa3b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:20:17 user nova-compute[71113]: DEBUG nova.network.neutron [req-303a80b5-e731-4429-8ac5-92e5392f70aa req-34f6984a-29ff-4fb6-ab7e-6c634d6f0706 service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Refreshing network info cache for port aa0481c2-d383-47ac-aaca-8830e727b0fd {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 10:20:17 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Start _get_guest_xml network_info=[{"id": "aa0481c2-d383-47ac-aaca-8830e727b0fd", "address": "fa:16:3e:3a:ac:a2", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa0481c2-d3", "ovs_interfaceid": "aa0481c2-d383-47ac-aaca-8830e727b0fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'image_id': '078646fe-b504-41ed-a147-61072e903e51'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 10:20:17 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:20:17 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:20:17 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 10:20:17 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 10:20:17 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 10:20:17 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 10:20:17 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 10:20:17 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 10:20:17 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 10:20:17 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 10:20:17 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 10:20:17 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 10:20:17 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 10:20:17 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 10:20:17 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 10:20:17 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 10:20:17 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 10:20:17 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 10:20:17 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:20:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1923872530',display_name='tempest-ServerRescueNegativeTestJSON-server-1923872530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1923872530',id=48,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJYvScQMfs8bEpk0VjLb5yaNQU2cjc57kgHjVsVxKMOMYpMVc3RLCFV+tPuzRX2ZCcaPda03wbVcYWV0e22ylplzcU7e9BPDTnYIfC1NUaS2h4na+MPEQwy55tUq3ZGyHQ==',key_name='tempest-keypair-592677638',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='938c4f5af8a347cf9d700c8cdb5df356',ramdisk_id='',reservation_id='r-jy0mnt32',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-549904406',owner_user_name='tempest-ServerRescueNegativeTestJSON-549904406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T10:20:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6023b7c67c0941d3975fa9c25140684f',uuid=1ca22313-39ec-4366-abe0-fa40247dfa3b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa0481c2-d383-47ac-aaca-8830e727b0fd", "address": "fa:16:3e:3a:ac:a2", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa0481c2-d3", "ovs_interfaceid": "aa0481c2-d383-47ac-aaca-8830e727b0fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 10:20:17 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Converting VIF {"id": "aa0481c2-d383-47ac-aaca-8830e727b0fd", "address": "fa:16:3e:3a:ac:a2", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa0481c2-d3", "ovs_interfaceid": "aa0481c2-d383-47ac-aaca-8830e727b0fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:20:17 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ac:a2,bridge_name='br-int',has_traffic_filtering=True,id=aa0481c2-d383-47ac-aaca-8830e727b0fd,network=Network(328e0f8b-5788-457c-afc6-7fe314ca8b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa0481c2-d3') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:20:17 user nova-compute[71113]: DEBUG nova.objects.instance [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lazy-loading 'pci_devices' on Instance uuid 1ca22313-39ec-4366-abe0-fa40247dfa3b {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:20:17 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] End _get_guest_xml xml=<domain type="kvm">
Jul 31 10:20:17 user nova-compute[71113]:   <uuid>1ca22313-39ec-4366-abe0-fa40247dfa3b</uuid>
Jul 31 10:20:17 user nova-compute[71113]:   <name>instance-00000030</name>
Jul 31 10:20:17 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 10:20:17 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 10:20:17 user nova-compute[71113]:   <metadata>
Jul 31 10:20:17 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 10:20:17 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 10:20:17 user nova-compute[71113]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1923872530</nova:name>
Jul 31 10:20:17 user nova-compute[71113]:       <nova:creationTime>2023-07-31 10:20:17</nova:creationTime>
Jul 31 10:20:17 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 10:20:17 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 10:20:17 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 10:20:17 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 10:20:17 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 10:20:17 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 10:20:17 user nova-compute[71113]:       </nova:flavor>
Jul 31 10:20:17 user nova-compute[71113]:       <nova:owner>
Jul 31 10:20:17 user nova-compute[71113]:         <nova:user uuid="6023b7c67c0941d3975fa9c25140684f">tempest-ServerRescueNegativeTestJSON-549904406-project-member</nova:user>
Jul 31 10:20:17 user nova-compute[71113]:         <nova:project uuid="938c4f5af8a347cf9d700c8cdb5df356">tempest-ServerRescueNegativeTestJSON-549904406</nova:project>
Jul 31 10:20:17 user nova-compute[71113]:       </nova:owner>
Jul 31 10:20:17 user nova-compute[71113]:       <nova:root type="image" uuid="078646fe-b504-41ed-a147-61072e903e51"/>
Jul 31 10:20:17 user nova-compute[71113]:       <nova:ports>
Jul 31 10:20:17 user nova-compute[71113]:         <nova:port uuid="aa0481c2-d383-47ac-aaca-8830e727b0fd">
Jul 31 10:20:17 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 31 10:20:17 user nova-compute[71113]:         </nova:port>
Jul 31 10:20:17 user nova-compute[71113]:       </nova:ports>
Jul 31 10:20:17 user nova-compute[71113]:     </nova:instance>
Jul 31 10:20:17 user nova-compute[71113]:   </metadata>
Jul 31 10:20:17 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 10:20:17 user nova-compute[71113]:     <system>
Jul 31 10:20:17 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 10:20:17 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 10:20:17 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 10:20:17 user nova-compute[71113]:       <entry name="serial">1ca22313-39ec-4366-abe0-fa40247dfa3b</entry>
Jul 31 10:20:17 user nova-compute[71113]:       <entry name="uuid">1ca22313-39ec-4366-abe0-fa40247dfa3b</entry>
Jul 31 10:20:17 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 10:20:17 user nova-compute[71113]:     </system>
Jul 31 10:20:17 user nova-compute[71113]:   </sysinfo>
Jul 31 10:20:17 user nova-compute[71113]:   <os>
Jul 31 10:20:17 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 10:20:17 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 10:20:17 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 10:20:17 user nova-compute[71113]:   </os>
Jul 31 10:20:17 user nova-compute[71113]:   <features>
Jul 31 10:20:17 user nova-compute[71113]:     <acpi/>
Jul 31 10:20:17 user nova-compute[71113]:     <apic/>
Jul 31 10:20:17 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 10:20:17 user nova-compute[71113]:   </features>
Jul 31 10:20:17 user nova-compute[71113]:   <clock offset="utc">
Jul 31 10:20:17 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 10:20:17 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 10:20:17 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 10:20:17 user nova-compute[71113]:   </clock>
Jul 31 10:20:17 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 10:20:17 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 10:20:17 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 10:20:17 user nova-compute[71113]:   </cpu>
Jul 31 10:20:17 user nova-compute[71113]:   <devices>
Jul 31 10:20:17 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 10:20:17 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 10:20:17 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/1ca22313-39ec-4366-abe0-fa40247dfa3b/disk"/>
Jul 31 10:20:17 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 10:20:17 user nova-compute[71113]:     </disk>
Jul 31 10:20:17 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 10:20:17 user nova-compute[71113]:       <mac address="fa:16:3e:3a:ac:a2"/>
Jul 31 10:20:17 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:20:17 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 10:20:17 user nova-compute[71113]:       <target dev="tapaa0481c2-d3"/>
Jul 31 10:20:17 user nova-compute[71113]:     </interface>
Jul 31 10:20:17 user nova-compute[71113]:     <serial type="pty">
Jul 31 10:20:17 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/1ca22313-39ec-4366-abe0-fa40247dfa3b/console.log" append="off"/>
Jul 31 10:20:17 user nova-compute[71113]:     </serial>
Jul 31 10:20:17 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 10:20:17 user nova-compute[71113]:     <video>
Jul 31 10:20:17 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:20:17 user nova-compute[71113]:     </video>
Jul 31 10:20:17 user nova-compute[71113]:     <rng model="virtio">
Jul 31 10:20:17 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 10:20:17 user nova-compute[71113]:     </rng>
Jul 31 10:20:17 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 10:20:17 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 10:20:17 user nova-compute[71113]:       <stats period="10"/>
Jul 31 10:20:17 user nova-compute[71113]:     </memballoon>
Jul 31 10:20:17 user nova-compute[71113]:   </devices>
Jul 31 10:20:17 user nova-compute[71113]: </domain>
Jul 31 10:20:17 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 10:20:17 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:20:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1923872530',display_name='tempest-ServerRescueNegativeTestJSON-server-1923872530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1923872530',id=48,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJYvScQMfs8bEpk0VjLb5yaNQU2cjc57kgHjVsVxKMOMYpMVc3RLCFV+tPuzRX2ZCcaPda03wbVcYWV0e22ylplzcU7e9BPDTnYIfC1NUaS2h4na+MPEQwy55tUq3ZGyHQ==',key_name='tempest-keypair-592677638',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='938c4f5af8a347cf9d700c8cdb5df356',ramdisk_id='',reservation_id='r-jy0mnt32',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-549904406',owner_user_name='tempest-ServerRescueNegativeTestJSON-549904406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T10:20:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6023b7c67c0941d3975fa9c25140684f',uuid=1ca22313-39ec-4366-abe0-fa40247dfa3b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa0481c2-d383-47ac-aaca-8830e727b0fd", "address": "fa:16:3e:3a:ac:a2", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa0481c2-d3", "ovs_interfaceid": "aa0481c2-d383-47ac-aaca-8830e727b0fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 10:20:17 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Converting VIF {"id": "aa0481c2-d383-47ac-aaca-8830e727b0fd", "address": "fa:16:3e:3a:ac:a2", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa0481c2-d3", "ovs_interfaceid": "aa0481c2-d383-47ac-aaca-8830e727b0fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:20:17 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ac:a2,bridge_name='br-int',has_traffic_filtering=True,id=aa0481c2-d383-47ac-aaca-8830e727b0fd,network=Network(328e0f8b-5788-457c-afc6-7fe314ca8b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa0481c2-d3') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:20:17 user nova-compute[71113]: DEBUG os_vif [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ac:a2,bridge_name='br-int',has_traffic_filtering=True,id=aa0481c2-d383-47ac-aaca-8830e727b0fd,network=Network(328e0f8b-5788-457c-afc6-7fe314ca8b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa0481c2-d3') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 10:20:17 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:20:17 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:20:17 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 10:20:17 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:20:17 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaa0481c2-d3, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:20:17 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaa0481c2-d3, col_values=(('external_ids', {'iface-id': 'aa0481c2-d383-47ac-aaca-8830e727b0fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:ac:a2', 'vm-uuid': '1ca22313-39ec-4366-abe0-fa40247dfa3b'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:20:17 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:20:17 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:20:17 user nova-compute[71113]: INFO os_vif [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ac:a2,bridge_name='br-int',has_traffic_filtering=True,id=aa0481c2-d383-47ac-aaca-8830e727b0fd,network=Network(328e0f8b-5788-457c-afc6-7fe314ca8b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa0481c2-d3')
Jul 31 10:20:17 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:20:17 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] No VIF found with MAC fa:16:3e:3a:ac:a2, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 10:20:18 user nova-compute[71113]: DEBUG nova.network.neutron [req-303a80b5-e731-4429-8ac5-92e5392f70aa req-34f6984a-29ff-4fb6-ab7e-6c634d6f0706 service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Updated VIF entry in instance network info cache for port aa0481c2-d383-47ac-aaca-8830e727b0fd. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 10:20:18 user nova-compute[71113]: DEBUG nova.network.neutron [req-303a80b5-e731-4429-8ac5-92e5392f70aa req-34f6984a-29ff-4fb6-ab7e-6c634d6f0706 service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Updating instance_info_cache with network_info: [{"id": "aa0481c2-d383-47ac-aaca-8830e727b0fd", "address": "fa:16:3e:3a:ac:a2", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa0481c2-d3", "ovs_interfaceid": "aa0481c2-d383-47ac-aaca-8830e727b0fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:20:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-303a80b5-e731-4429-8ac5-92e5392f70aa req-34f6984a-29ff-4fb6-ab7e-6c634d6f0706 service nova] Releasing lock "refresh_cache-1ca22313-39ec-4366-abe0-fa40247dfa3b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:20:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:20:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:20:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:20:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:20:19 user nova-compute[71113]: DEBUG nova.compute.manager [req-e2ce015a-8024-4cfa-a1ba-f2d745c75850 req-dca969f0-633a-4908-a4e2-9e1bdf98b8e4 service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Received event network-vif-plugged-aa0481c2-d383-47ac-aaca-8830e727b0fd {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:20:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e2ce015a-8024-4cfa-a1ba-f2d745c75850 req-dca969f0-633a-4908-a4e2-9e1bdf98b8e4 service nova] Acquiring lock "1ca22313-39ec-4366-abe0-fa40247dfa3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:20:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e2ce015a-8024-4cfa-a1ba-f2d745c75850 req-dca969f0-633a-4908-a4e2-9e1bdf98b8e4 service nova] Lock "1ca22313-39ec-4366-abe0-fa40247dfa3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:20:19 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e2ce015a-8024-4cfa-a1ba-f2d745c75850 req-dca969f0-633a-4908-a4e2-9e1bdf98b8e4 service nova] Lock "1ca22313-39ec-4366-abe0-fa40247dfa3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:20:19 user nova-compute[71113]: DEBUG nova.compute.manager [req-e2ce015a-8024-4cfa-a1ba-f2d745c75850 req-dca969f0-633a-4908-a4e2-9e1bdf98b8e4 service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] No waiting events found dispatching network-vif-plugged-aa0481c2-d383-47ac-aaca-8830e727b0fd {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:20:19 user nova-compute[71113]: WARNING nova.compute.manager [req-e2ce015a-8024-4cfa-a1ba-f2d745c75850 req-dca969f0-633a-4908-a4e2-9e1bdf98b8e4 service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Received unexpected event network-vif-plugged-aa0481c2-d383-47ac-aaca-8830e727b0fd for instance with vm_state building and task_state spawning.
Jul 31 10:20:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:20:21 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690798821.2001595, 1ca22313-39ec-4366-abe0-fa40247dfa3b => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:20:21 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] VM Resumed (Lifecycle Event)
Jul 31 10:20:21 user nova-compute[71113]: DEBUG nova.compute.manager [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 10:20:21 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 10:20:21 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Instance spawned successfully.
Jul 31 10:20:21 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 10:20:21 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:20:21 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:20:21 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Found default for hw_cdrom_bus of ide {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:20:21 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Found default for hw_disk_bus of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:20:21 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Found default for hw_input_bus of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:20:21 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Found default for hw_pointer_model of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:20:21 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Found default for hw_video_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:20:21 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Found default for hw_vif_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:20:21 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 10:20:21 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690798821.2042925, 1ca22313-39ec-4366-abe0-fa40247dfa3b => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:20:21 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] VM Started (Lifecycle Event)
Jul 31 10:20:21 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:20:21 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:20:21 user nova-compute[71113]: INFO nova.compute.manager [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Took 6.04 seconds to spawn the instance on the hypervisor.
Jul 31 10:20:21 user nova-compute[71113]: DEBUG nova.compute.manager [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:20:21 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 10:20:21 user nova-compute[71113]: INFO nova.compute.manager [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Took 6.65 seconds to build instance.
Jul 31 10:20:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c0cc77c9-d285-4060-a85d-c4a6a041d19e tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "1ca22313-39ec-4366-abe0-fa40247dfa3b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.762s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:20:21 user nova-compute[71113]: DEBUG nova.compute.manager [req-ad3e9858-218b-4b6e-83aa-fefc6467aa87 req-5ae286c1-b4af-4e09-830a-fec91bbea3cf service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Received event network-vif-plugged-aa0481c2-d383-47ac-aaca-8830e727b0fd {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:20:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ad3e9858-218b-4b6e-83aa-fefc6467aa87 req-5ae286c1-b4af-4e09-830a-fec91bbea3cf service nova] Acquiring lock "1ca22313-39ec-4366-abe0-fa40247dfa3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:20:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ad3e9858-218b-4b6e-83aa-fefc6467aa87 req-5ae286c1-b4af-4e09-830a-fec91bbea3cf service nova] Lock "1ca22313-39ec-4366-abe0-fa40247dfa3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:20:21 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ad3e9858-218b-4b6e-83aa-fefc6467aa87 req-5ae286c1-b4af-4e09-830a-fec91bbea3cf service nova] Lock "1ca22313-39ec-4366-abe0-fa40247dfa3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:20:21 user nova-compute[71113]: DEBUG nova.compute.manager [req-ad3e9858-218b-4b6e-83aa-fefc6467aa87 req-5ae286c1-b4af-4e09-830a-fec91bbea3cf service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] No waiting events found dispatching network-vif-plugged-aa0481c2-d383-47ac-aaca-8830e727b0fd {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:20:21 user nova-compute[71113]: WARNING nova.compute.manager [req-ad3e9858-218b-4b6e-83aa-fefc6467aa87 req-5ae286c1-b4af-4e09-830a-fec91bbea3cf service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Received unexpected event network-vif-plugged-aa0481c2-d383-47ac-aaca-8830e727b0fd for instance with vm_state active and task_state None.
Jul 31 10:20:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:20:23 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:20:23 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:20:25 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:20:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:20:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:20:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:20:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:20:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:20:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:20:30 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:20:30 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:20:30 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Rebuilding the list of instances to heal {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 10:20:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "refresh_cache-c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:20:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquired lock "refresh_cache-c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:20:30 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Forcefully refreshing network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 10:20:30 user nova-compute[71113]: DEBUG nova.objects.instance [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lazy-loading 'info_cache' on Instance uuid c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:20:31 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Updating instance_info_cache with network_info: [{"id": "85692854-658a-459b-9ab0-f448a6bf83f2", "address": "fa:16:3e:2b:2c:47", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85692854-65", "ovs_interfaceid": "85692854-658a-459b-9ab0-f448a6bf83f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:20:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Releasing lock "refresh_cache-c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:20:31 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Updated the network info_cache for instance {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 10:20:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:20:32 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:20:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:20:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:20:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:20:32 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:20:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:20:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:20:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:20:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:20:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:20:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:20:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:20:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:20:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:20:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:20:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:20:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:20:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:20:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:20:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:20:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:20:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ca22313-39ec-4366-abe0-fa40247dfa3b/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:20:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ca22313-39ec-4366-abe0-fa40247dfa3b/disk --force-share --output=json" returned: 0 in 0.330s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:20:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ca22313-39ec-4366-abe0-fa40247dfa3b/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:20:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ca22313-39ec-4366-abe0-fa40247dfa3b/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:20:34 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:20:34 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:20:34 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=8420MB free_disk=25.21234130859375GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:20:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:20:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:20:35 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:20:35 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 8129456b-a22c-46e3-b5db-89fdcec87dec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:20:35 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:20:35 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 1ca22313-39ec-4366-abe0-fa40247dfa3b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:20:35 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:20:35 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:20:35 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:20:35 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:20:35 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:20:35 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.288s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:20:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:20:36 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:20:36 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:20:36 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:20:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:20:38 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:20:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9cc8939a-3c6c-4794-85eb-fa50cad1e9d2 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Acquiring lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:20:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9cc8939a-3c6c-4794-85eb-fa50cad1e9d2 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:20:39 user nova-compute[71113]: DEBUG nova.objects.instance [None req-9cc8939a-3c6c-4794-85eb-fa50cad1e9d2 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lazy-loading 'flavor' on Instance uuid b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:20:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9cc8939a-3c6c-4794-85eb-fa50cad1e9d2 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:20:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9cc8939a-3c6c-4794-85eb-fa50cad1e9d2 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Acquiring lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:20:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9cc8939a-3c6c-4794-85eb-fa50cad1e9d2 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:20:39 user nova-compute[71113]: INFO nova.compute.manager [None req-9cc8939a-3c6c-4794-85eb-fa50cad1e9d2 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Attaching volume 609977c4-f6c6-403f-88e1-4e5853082d56 to /dev/vdb
Jul 31 10:20:39 user nova-compute[71113]: DEBUG os_brick.utils [None req-9cc8939a-3c6c-4794-85eb-fa50cad1e9d2 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:20:39 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:20:39 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:20:39 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[650f03b2-6003-4b66-b5df-29c7ca1da220]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:20:39 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:20:39 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:20:39 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d968c1d5-9d65-4eb7-8242-b27eb0c13bd6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:20:39 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:20:39 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:20:39 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb28024-262c-40da-8227-2f536a713e33]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:20:39 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[15fdaeb1-f530-4185-a0d7-5a6f686f3a9e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:20:39 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-9cc8939a-3c6c-4794-85eb-fa50cad1e9d2 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:20:39 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-9cc8939a-3c6c-4794-85eb-fa50cad1e9d2 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 10:20:39 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9cc8939a-3c6c-4794-85eb-fa50cad1e9d2 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 10:20:39 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:20:39 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 10:20:39 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 10:20:39 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a337ef-1109-49c5-b532-5dfdc5d134b6]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:20:39 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-9cc8939a-3c6c-4794-85eb-fa50cad1e9d2 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 10:20:39 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-9cc8939a-3c6c-4794-85eb-fa50cad1e9d2 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 10:20:39 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-9cc8939a-3c6c-4794-85eb-fa50cad1e9d2 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 10:20:39 user nova-compute[71113]: DEBUG os_brick.utils [None req-9cc8939a-3c6c-4794-85eb-fa50cad1e9d2 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:20:39 user nova-compute[71113]: DEBUG nova.virt.block_device [None req-9cc8939a-3c6c-4794-85eb-fa50cad1e9d2 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Updating existing volume attachment record: 89d99f21-db94-434a-9f39-d622d01d8126 {{(pid=71113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 10:20:40 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:20:41 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:20:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:20:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:20:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cc8939a-3c6c-4794-85eb-fa50cad1e9d2 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 10:20:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc8939a-3c6c-4794-85eb-fa50cad1e9d2 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:609977c4-f6c6-403f-88e1-4e5853082d56'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HwLOkMXC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:20:46 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-9cc8939a-3c6c-4794-85eb-fa50cad1e9d2 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:20:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-9cc8939a-3c6c-4794-85eb-fa50cad1e9d2 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:20:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-9cc8939a-3c6c-4794-85eb-fa50cad1e9d2 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:20:46 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-9cc8939a-3c6c-4794-85eb-fa50cad1e9d2 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:20:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-9cc8939a-3c6c-4794-85eb-fa50cad1e9d2 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:609977c4-f6c6-403f-88e1-4e5853082d56" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:20:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-9cc8939a-3c6c-4794-85eb-fa50cad1e9d2 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:609977c4-f6c6-403f-88e1-4e5853082d56" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:20:46 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-9cc8939a-3c6c-4794-85eb-fa50cad1e9d2 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 10:20:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609977c4-f6c6-403f-88e1-4e5853082d56 -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:20:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609977c4-f6c6-403f-88e1-4e5853082d56 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:20:46 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[90aec488-c6d6-438c-ba06-ee8ec964ede5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:20:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc8939a-3c6c-4794-85eb-fa50cad1e9d2 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 10:20:46 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:20:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609977c4-f6c6-403f-88e1-4e5853082d56 -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:20:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609977c4-f6c6-403f-88e1-4e5853082d56 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:20:46 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[79274464-dc2e-4667-ba94-0b0e3b280cf5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:609977c4-f6c6-403f-88e1-4e5853082d56] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:20:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc8939a-3c6c-4794-85eb-fa50cad1e9d2 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:609977c4-f6c6-403f-88e1-4e5853082d56] added
Jul 31 10:20:46 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:20:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609977c4-f6c6-403f-88e1-4e5853082d56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:20:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609977c4-f6c6-403f-88e1-4e5853082d56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:20:46 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f7fe7d-5f8b-485e-acf4-f0c720a28976]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:20:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc8939a-3c6c-4794-85eb-fa50cad1e9d2 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:20:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609977c4-f6c6-403f-88e1-4e5853082d56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:20:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609977c4-f6c6-403f-88e1-4e5853082d56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:20:46 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[365897b5-1493-416d-9c15-24f8ef5709e4]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:20:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc8939a-3c6c-4794-85eb-fa50cad1e9d2 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:20:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609977c4-f6c6-403f-88e1-4e5853082d56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HwLOkMXC {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:20:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609977c4-f6c6-403f-88e1-4e5853082d56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HwLOkMXC" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:20:46 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c32b15-a7ed-47b3-9953-a50bc5fc911f]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:20:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc8939a-3c6c-4794-85eb-fa50cad1e9d2 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HwLOkMXC'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:20:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609977c4-f6c6-403f-88e1-4e5853082d56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:20:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609977c4-f6c6-403f-88e1-4e5853082d56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:20:46 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[25caac44-f1ff-4fa8-a784-8ee2961f0033]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:20:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc8939a-3c6c-4794-85eb-fa50cad1e9d2 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:20:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:20:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:20:46 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[83cd9fc4-3680-4ad4-a83c-a608a12376bb]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:20:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc8939a-3c6c-4794-85eb-fa50cad1e9d2 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 31 10:20:46 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:20:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc8939a-3c6c-4794-85eb-fa50cad1e9d2 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 31 10:20:46 user nova-compute[71113]:  {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:20:46 user nova-compute[71113]: WARNING os_brick.initiator.connectors.iscsi [None req-9cc8939a-3c6c-4794-85eb-fa50cad1e9d2 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 31 10:20:46 user nova-compute[71113]: 
Jul 31 10:20:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609977c4-f6c6-403f-88e1-4e5853082d56 -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:20:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609977c4-f6c6-403f-88e1-4e5853082d56 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:20:46 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a624398-6a5a-45c8-a29a-1f6323cdd315]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:609977c4-f6c6-403f-88e1-4e5853082d56, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:609977c4-f6c6-403f-88e1-4e5853082d56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:20:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc8939a-3c6c-4794-85eb-fa50cad1e9d2 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:609977c4-f6c6-403f-88e1-4e5853082d56, portal: 172.16.0.220,3260]
Jul 31 10:20:46 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:609977c4-f6c6-403f-88e1-4e5853082d56, portal: 172.16.0.220,3260] successful.
Jul 31 10:20:46 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:20:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609977c4-f6c6-403f-88e1-4e5853082d56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:20:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609977c4-f6c6-403f-88e1-4e5853082d56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:20:46 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf5e67d-f600-4648-9b12-f7ee2d6fc1e4]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:20:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc8939a-3c6c-4794-85eb-fa50cad1e9d2 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:20:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:20:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:20:46 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef41fa3c-6c3e-425f-85c5-4005794bfe3c]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609977c4-f6c6-403f-88e1-4e5853082d56 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:20:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc8939a-3c6c-4794-85eb-fa50cad1e9d2 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609977c4-f6c6-403f-88e1-4e5853082d56 (non-flash)
Jul 31 10:20:46 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:20:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc8939a-3c6c-4794-85eb-fa50cad1e9d2 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609977c4-f6c6-403f-88e1-4e5853082d56 (non-flash)
Jul 31 10:20:46 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:20:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-9cc8939a-3c6c-4794-85eb-fa50cad1e9d2 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:609977c4-f6c6-403f-88e1-4e5853082d56" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:20:46 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc8939a-3c6c-4794-85eb-fa50cad1e9d2 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 10:20:46 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-9cc8939a-3c6c-4794-85eb-fa50cad1e9d2 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 10:20:46 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-9cc8939a-3c6c-4794-85eb-fa50cad1e9d2 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 10:20:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:20:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:20:46 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[293ed368-51b4-4531-a239-435971800644]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:20:46 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-9cc8939a-3c6c-4794-85eb-fa50cad1e9d2 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: None {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 10:20:46 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:20:47 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-9cc8939a-3c6c-4794-85eb-fa50cad1e9d2 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 10:20:47 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc8939a-3c6c-4794-85eb-fa50cad1e9d2 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HwLOkMXC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 10:20:47 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-9cc8939a-3c6c-4794-85eb-fa50cad1e9d2 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:20:47 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc8939a-3c6c-4794-85eb-fa50cad1e9d2 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '26135326437373835', 'path': '/dev/sdb'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:20:47 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cc8939a-3c6c-4794-85eb-fa50cad1e9d2 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135326437373835', 'path': '/dev/sdb'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 10:20:47 user nova-compute[71113]: DEBUG nova.objects.instance [None req-9cc8939a-3c6c-4794-85eb-fa50cad1e9d2 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lazy-loading 'flavor' on Instance uuid b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:20:47 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-9cc8939a-3c6c-4794-85eb-fa50cad1e9d2 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 10:20:47 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:20:47 user nova-compute[71113]:   <source dev="/dev/sdb"/>
Jul 31 10:20:47 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 10:20:47 user nova-compute[71113]:   <serial>609977c4-f6c6-403f-88e1-4e5853082d56</serial>
Jul 31 10:20:47 user nova-compute[71113]: </disk>
Jul 31 10:20:47 user nova-compute[71113]:  {{(pid=71113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 10:20:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:20:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-9cc8939a-3c6c-4794-85eb-fa50cad1e9d2 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:20:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-9cc8939a-3c6c-4794-85eb-fa50cad1e9d2 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:20:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-9cc8939a-3c6c-4794-85eb-fa50cad1e9d2 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] No VIF found with MAC fa:16:3e:47:cb:d2, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 10:20:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9cc8939a-3c6c-4794-85eb-fa50cad1e9d2 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.958s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:20:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-416b5aa7-25f0-403e-87df-1a9b1836efa1 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Acquiring lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:20:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-416b5aa7-25f0-403e-87df-1a9b1836efa1 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:20:50 user nova-compute[71113]: INFO nova.compute.manager [None req-416b5aa7-25f0-403e-87df-1a9b1836efa1 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Detaching volume 609977c4-f6c6-403f-88e1-4e5853082d56
Jul 31 10:20:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:20:50 user nova-compute[71113]: INFO nova.virt.block_device [None req-416b5aa7-25f0-403e-87df-1a9b1836efa1 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Attempting to driver detach volume 609977c4-f6c6-403f-88e1-4e5853082d56 from mountpoint /dev/vdb
Jul 31 10:20:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-416b5aa7-25f0-403e-87df-1a9b1836efa1 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Attempting to detach device vdb from instance b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb from the persistent domain config. {{(pid=71113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 10:20:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-416b5aa7-25f0-403e-87df-1a9b1836efa1 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 10:20:50 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:20:50 user nova-compute[71113]:   <source dev="/dev/sdb"/>
Jul 31 10:20:50 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 10:20:50 user nova-compute[71113]:   <serial>609977c4-f6c6-403f-88e1-4e5853082d56</serial>
Jul 31 10:20:50 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 10:20:50 user nova-compute[71113]: </disk>
Jul 31 10:20:50 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 10:20:50 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-416b5aa7-25f0-403e-87df-1a9b1836efa1 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Successfully detached device vdb from instance b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb from the persistent domain config.
Jul 31 10:20:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-416b5aa7-25f0-403e-87df-1a9b1836efa1 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb from the live domain config. {{(pid=71113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 10:20:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-416b5aa7-25f0-403e-87df-1a9b1836efa1 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 10:20:50 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:20:50 user nova-compute[71113]:   <source dev="/dev/sdb"/>
Jul 31 10:20:50 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 10:20:50 user nova-compute[71113]:   <serial>609977c4-f6c6-403f-88e1-4e5853082d56</serial>
Jul 31 10:20:50 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 10:20:50 user nova-compute[71113]: </disk>
Jul 31 10:20:50 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 10:20:51 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Received event <DeviceRemovedEvent: 1690798851.2504046, b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71113) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 10:20:51 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-416b5aa7-25f0-403e-87df-1a9b1836efa1 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb {{(pid=71113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 10:20:51 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-416b5aa7-25f0-403e-87df-1a9b1836efa1 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Successfully detached device vdb from instance b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb from the live domain config.
Jul 31 10:20:51 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-416b5aa7-25f0-403e-87df-1a9b1836efa1 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 10:20:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-416b5aa7-25f0-403e-87df-1a9b1836efa1 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:609977c4-f6c6-403f-88e1-4e5853082d56'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HwLOkMXC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:20:51 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-416b5aa7-25f0-403e-87df-1a9b1836efa1 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:20:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-416b5aa7-25f0-403e-87df-1a9b1836efa1 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:20:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-416b5aa7-25f0-403e-87df-1a9b1836efa1 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:20:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-416b5aa7-25f0-403e-87df-1a9b1836efa1 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:609977c4-f6c6-403f-88e1-4e5853082d56', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 10:20:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:20:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:20:51 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec47d299-fa67-4a87-94ed-b75288a2b3bf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:609977c4-f6c6-403f-88e1-4e5853082d56\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:20:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:20:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:20:51 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a007ef-4e44-43ec-907b-83284e0ac058]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609977c4-f6c6-403f-88e1-4e5853082d56 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:20:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-416b5aa7-25f0-403e-87df-1a9b1836efa1 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609977c4-f6c6-403f-88e1-4e5853082d56 (non-flash)
Jul 31 10:20:51 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:20:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-416b5aa7-25f0-403e-87df-1a9b1836efa1 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:609977c4-f6c6-403f-88e1-4e5853082d56 (non-flash)
Jul 31 10:20:51 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:20:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-416b5aa7-25f0-403e-87df-1a9b1836efa1 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f78cc799750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:609977c4-f6c6-403f-88e1-4e5853082d56'): ({'sdb'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 10:20:51 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-416b5aa7-25f0-403e-87df-1a9b1836efa1 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Removing single pathed devices sdb {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 10:20:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:20:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.034s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:20:51 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[93dd80ec-f4ec-4ac0-a680-77a6d5bd149a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:20:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:20:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:20:51 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[42957722-41e5-487a-94dc-6df629707b94]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:20:51 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-416b5aa7-25f0-403e-87df-1a9b1836efa1 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Flushing IO for device /dev/sdb {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 10:20:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:20:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:20:51 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d3f764-cd92-4caf-9a0c-c07d73b767fa]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:20:51 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-416b5aa7-25f0-403e-87df-1a9b1836efa1 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 10:20:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:20:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:20:51 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c177c6e0-e3d7-4d04-b9fc-707634b1dc79]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:20:51 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-416b5aa7-25f0-403e-87df-1a9b1836efa1 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 10:20:51 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-416b5aa7-25f0-403e-87df-1a9b1836efa1 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] SCSI volumes sdb have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 10:20:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-416b5aa7-25f0-403e-87df-1a9b1836efa1 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:609977c4-f6c6-403f-88e1-4e5853082d56')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 10:20:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609977c4-f6c6-403f-88e1-4e5853082d56 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:20:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609977c4-f6c6-403f-88e1-4e5853082d56 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:20:51 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc478bf3-db9b-4795-b8d8-348669fb243d]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:20:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-416b5aa7-25f0-403e-87df-1a9b1836efa1 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:20:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609977c4-f6c6-403f-88e1-4e5853082d56 -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:20:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609977c4-f6c6-403f-88e1-4e5853082d56 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:20:51 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4242090-d80d-4286-98a4-e3601729ca1d]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:609977c4-f6c6-403f-88e1-4e5853082d56, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:609977c4-f6c6-403f-88e1-4e5853082d56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:20:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-416b5aa7-25f0-403e-87df-1a9b1836efa1 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:609977c4-f6c6-403f-88e1-4e5853082d56, portal: 172.16.0.220,3260]
Jul 31 10:20:51 user nova-compute[71113]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:609977c4-f6c6-403f-88e1-4e5853082d56, portal: 172.16.0.220,3260] successful.
Jul 31 10:20:51 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:20:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:609977c4-f6c6-403f-88e1-4e5853082d56 -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:20:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:609977c4-f6c6-403f-88e1-4e5853082d56 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:20:51 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6e7d12-559f-4f20-a443-bf56f862b25a]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:20:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-416b5aa7-25f0-403e-87df-1a9b1836efa1 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:20:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-416b5aa7-25f0-403e-87df-1a9b1836efa1 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:20:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-416b5aa7-25f0-403e-87df-1a9b1836efa1 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] <== disconnect_volume: return (296ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:20:51 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-416b5aa7-25f0-403e-87df-1a9b1836efa1 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 10:20:52 user nova-compute[71113]: DEBUG nova.objects.instance [None req-416b5aa7-25f0-403e-87df-1a9b1836efa1 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lazy-loading 'flavor' on Instance uuid b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:20:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-416b5aa7-25f0-403e-87df-1a9b1836efa1 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.632s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:20:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:20:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:20:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:20:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:20:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:20:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:20:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:21:02 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:21:07 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:21:07 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:21:07 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:21:07 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:21:07 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:21:07 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:21:11 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:21:12 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:21:17 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:21:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:21:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:21:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:21:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:21:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:21:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:21:25 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:21:25 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:21:26 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:21:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:21:30 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:21:30 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:21:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "refresh_cache-8129456b-a22c-46e3-b5db-89fdcec87dec" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:21:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquired lock "refresh_cache-8129456b-a22c-46e3-b5db-89fdcec87dec" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:21:31 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Forcefully refreshing network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 10:21:31 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Updating instance_info_cache with network_info: [{"id": "1a2da0f9-2fb6-4880-96b5-be8dd9d12574", "address": "fa:16:3e:fe:2b:04", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a2da0f9-2f", "ovs_interfaceid": "1a2da0f9-2fb6-4880-96b5-be8dd9d12574", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:21:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Releasing lock "refresh_cache-8129456b-a22c-46e3-b5db-89fdcec87dec" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:21:31 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Updated the network info_cache for instance {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 10:21:32 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:21:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:21:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:21:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:21:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:21:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:21:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:21:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:21:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:21:32 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:21:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:21:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:21:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:21:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:21:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:21:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:21:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:21:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:21:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:21:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:21:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:21:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:21:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:21:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:21:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:21:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:21:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:21:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ca22313-39ec-4366-abe0-fa40247dfa3b/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:21:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ca22313-39ec-4366-abe0-fa40247dfa3b/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:21:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ca22313-39ec-4366-abe0-fa40247dfa3b/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:21:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ca22313-39ec-4366-abe0-fa40247dfa3b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:21:34 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:21:34 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:21:34 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=8526MB free_disk=25.17452621459961GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:21:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:21:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:21:34 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:21:34 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 8129456b-a22c-46e3-b5db-89fdcec87dec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:21:34 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:21:34 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 1ca22313-39ec-4366-abe0-fa40247dfa3b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:21:34 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:21:34 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:21:34 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:21:34 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:21:34 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:21:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.278s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:21:35 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:21:35 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:21:36 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:21:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4992-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:21:39 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:21:41 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:21:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:21:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:21:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:21:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:21:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:21:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:21:44 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-78b4d769-2985-44cd-9531-7c1535175f29 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Acquiring lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:21:44 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-78b4d769-2985-44cd-9531-7c1535175f29 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:21:44 user nova-compute[71113]: DEBUG nova.objects.instance [None req-78b4d769-2985-44cd-9531-7c1535175f29 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lazy-loading 'flavor' on Instance uuid b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:21:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-78b4d769-2985-44cd-9531-7c1535175f29 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:21:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-78b4d769-2985-44cd-9531-7c1535175f29 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Acquiring lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:21:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-78b4d769-2985-44cd-9531-7c1535175f29 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:21:45 user nova-compute[71113]: INFO nova.compute.manager [None req-78b4d769-2985-44cd-9531-7c1535175f29 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Attaching volume 8d6b5056-c07e-4278-aeb5-3069dd0f4bb8 to /dev/vdb
Jul 31 10:21:45 user nova-compute[71113]: DEBUG os_brick.utils [None req-78b4d769-2985-44cd-9531-7c1535175f29 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:21:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:21:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:21:45 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[bacf21d3-0f73-46b7-9c61-2ffa48cc76c9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:21:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:21:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:21:45 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d210739-a0b5-43d4-9060-b6d18ab7bda8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:21:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:21:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:21:45 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1422008d-4033-4ae0-940f-1672f77938ab]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:21:45 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a64c365-b7b8-44cf-9770-4a2647cbc899]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:21:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-78b4d769-2985-44cd-9531-7c1535175f29 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:21:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-78b4d769-2985-44cd-9531-7c1535175f29 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 10:21:45 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-78b4d769-2985-44cd-9531-7c1535175f29 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 10:21:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:21:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 10:21:45 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 10:21:45 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7a6bd4-7e0f-4fb4-b377-1c0c02be9606]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:21:45 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-78b4d769-2985-44cd-9531-7c1535175f29 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 10:21:45 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-78b4d769-2985-44cd-9531-7c1535175f29 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 10:21:45 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-78b4d769-2985-44cd-9531-7c1535175f29 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 10:21:45 user nova-compute[71113]: DEBUG os_brick.utils [None req-78b4d769-2985-44cd-9531-7c1535175f29 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:21:45 user nova-compute[71113]: DEBUG nova.virt.block_device [None req-78b4d769-2985-44cd-9531-7c1535175f29 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Updating existing volume attachment record: b8cc67f6-ff73-411c-a3b3-480f445befb5 {{(pid=71113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 10:21:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:21:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78b4d769-2985-44cd-9531-7c1535175f29 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-78b4d769-2985-44cd-9531-7c1535175f29 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8d6b5056-c07e-4278-aeb5-3069dd0f4bb8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DhEvJRgG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:21:52 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-78b4d769-2985-44cd-9531-7c1535175f29 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:21:52 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-78b4d769-2985-44cd-9531-7c1535175f29 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-78b4d769-2985-44cd-9531-7c1535175f29 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:21:52 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-78b4d769-2985-44cd-9531-7c1535175f29 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:21:52 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-78b4d769-2985-44cd-9531-7c1535175f29 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d6b5056-c07e-4278-aeb5-3069dd0f4bb8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-78b4d769-2985-44cd-9531-7c1535175f29 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d6b5056-c07e-4278-aeb5-3069dd0f4bb8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:21:52 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-78b4d769-2985-44cd-9531-7c1535175f29 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 10:21:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d6b5056-c07e-4278-aeb5-3069dd0f4bb8 -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d6b5056-c07e-4278-aeb5-3069dd0f4bb8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6a113e-1604-420a-bca0-4a440b75ad0b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-78b4d769-2985-44cd-9531-7c1535175f29 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 10:21:52 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d6b5056-c07e-4278-aeb5-3069dd0f4bb8 -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d6b5056-c07e-4278-aeb5-3069dd0f4bb8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e3c241-721e-44e2-94cf-2286ad1f01ca]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d6b5056-c07e-4278-aeb5-3069dd0f4bb8] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-78b4d769-2985-44cd-9531-7c1535175f29 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d6b5056-c07e-4278-aeb5-3069dd0f4bb8] added
Jul 31 10:21:52 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d6b5056-c07e-4278-aeb5-3069dd0f4bb8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d6b5056-c07e-4278-aeb5-3069dd0f4bb8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62bd280-8238-465f-88bc-ac2b8d39b868]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-78b4d769-2985-44cd-9531-7c1535175f29 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d6b5056-c07e-4278-aeb5-3069dd0f4bb8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d6b5056-c07e-4278-aeb5-3069dd0f4bb8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e94588f-4ddb-43e0-ac04-967234544ed4]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-78b4d769-2985-44cd-9531-7c1535175f29 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d6b5056-c07e-4278-aeb5-3069dd0f4bb8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DhEvJRgG {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d6b5056-c07e-4278-aeb5-3069dd0f4bb8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DhEvJRgG" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8bd4ffd-258c-475c-8744-f727a19458df]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-78b4d769-2985-44cd-9531-7c1535175f29 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DhEvJRgG'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d6b5056-c07e-4278-aeb5-3069dd0f4bb8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d6b5056-c07e-4278-aeb5-3069dd0f4bb8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0af954e-d103-4d71-92de-ac16364a75bc]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-78b4d769-2985-44cd-9531-7c1535175f29 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0e69a7-a09e-4427-81f0-16f96315f1e2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-78b4d769-2985-44cd-9531-7c1535175f29 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 31 10:21:52 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-78b4d769-2985-44cd-9531-7c1535175f29 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 31 10:21:52 user nova-compute[71113]:  {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:21:52 user nova-compute[71113]: WARNING os_brick.initiator.connectors.iscsi [None req-78b4d769-2985-44cd-9531-7c1535175f29 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 31 10:21:52 user nova-compute[71113]: 
Jul 31 10:21:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d6b5056-c07e-4278-aeb5-3069dd0f4bb8 -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d6b5056-c07e-4278-aeb5-3069dd0f4bb8 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e9087b-4544-4743-a81b-aa1e75b56e17]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d6b5056-c07e-4278-aeb5-3069dd0f4bb8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8d6b5056-c07e-4278-aeb5-3069dd0f4bb8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-78b4d769-2985-44cd-9531-7c1535175f29 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d6b5056-c07e-4278-aeb5-3069dd0f4bb8, portal: 172.16.0.220,3260]
Jul 31 10:21:52 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:8d6b5056-c07e-4278-aeb5-3069dd0f4bb8, portal: 172.16.0.220,3260] successful.
Jul 31 10:21:52 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d6b5056-c07e-4278-aeb5-3069dd0f4bb8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d6b5056-c07e-4278-aeb5-3069dd0f4bb8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b56a089-f6de-4a91-8afb-a37f60c39698]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-78b4d769-2985-44cd-9531-7c1535175f29 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8663bd04-c9f2-4f0b-ab16-674aa920def0]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d6b5056-c07e-4278-aeb5-3069dd0f4bb8 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-78b4d769-2985-44cd-9531-7c1535175f29 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d6b5056-c07e-4278-aeb5-3069dd0f4bb8 (non-flash)
Jul 31 10:21:52 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-78b4d769-2985-44cd-9531-7c1535175f29 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d6b5056-c07e-4278-aeb5-3069dd0f4bb8 (non-flash)
Jul 31 10:21:52 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-78b4d769-2985-44cd-9531-7c1535175f29 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d6b5056-c07e-4278-aeb5-3069dd0f4bb8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-78b4d769-2985-44cd-9531-7c1535175f29 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-78b4d769-2985-44cd-9531-7c1535175f29 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-78b4d769-2985-44cd-9531-7c1535175f29 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c604e70-8bac-41da-9a97-433a9d0a46b6]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-78b4d769-2985-44cd-9531-7c1535175f29 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-78b4d769-2985-44cd-9531-7c1535175f29 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DhEvJRgG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:21:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:21:53 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-78b4d769-2985-44cd-9531-7c1535175f29 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.272s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:21:53 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-78b4d769-2985-44cd-9531-7c1535175f29 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] <== connect_volume: return (1275ms) {'type': 'block', 'scsi_wwn': '26238306661343236', 'path': '/dev/sdb'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:21:53 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78b4d769-2985-44cd-9531-7c1535175f29 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26238306661343236', 'path': '/dev/sdb'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 10:21:53 user nova-compute[71113]: DEBUG nova.objects.instance [None req-78b4d769-2985-44cd-9531-7c1535175f29 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lazy-loading 'flavor' on Instance uuid b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:21:53 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-78b4d769-2985-44cd-9531-7c1535175f29 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 10:21:53 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:21:53 user nova-compute[71113]:   <source dev="/dev/sdb"/>
Jul 31 10:21:53 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 10:21:53 user nova-compute[71113]:   <serial>8d6b5056-c07e-4278-aeb5-3069dd0f4bb8</serial>
Jul 31 10:21:53 user nova-compute[71113]: </disk>
Jul 31 10:21:53 user nova-compute[71113]:  {{(pid=71113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 10:21:53 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-78b4d769-2985-44cd-9531-7c1535175f29 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:21:53 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-78b4d769-2985-44cd-9531-7c1535175f29 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:21:53 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-78b4d769-2985-44cd-9531-7c1535175f29 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] No VIF found with MAC fa:16:3e:47:cb:d2, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 10:21:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-78b4d769-2985-44cd-9531-7c1535175f29 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.695s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:21:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:21:55 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:21:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:21:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:21:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:21:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:21:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:21:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:21:55 user nova-compute[71113]: DEBUG nova.virt.libvirt.imagecache [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Verify base images {{(pid=71113) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Jul 31 10:21:55 user nova-compute[71113]: DEBUG nova.virt.libvirt.imagecache [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Image id 078646fe-b504-41ed-a147-61072e903e51 yields fingerprint 1a23da102527e12ce1165c0fe070d85f45ada2d9 {{(pid=71113) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Jul 31 10:21:55 user nova-compute[71113]: INFO nova.virt.libvirt.imagecache [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] image 078646fe-b504-41ed-a147-61072e903e51 at (/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9): checking
Jul 31 10:21:55 user nova-compute[71113]: DEBUG nova.virt.libvirt.imagecache [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] image 078646fe-b504-41ed-a147-61072e903e51 at (/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9): image is in use {{(pid=71113) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Jul 31 10:21:55 user nova-compute[71113]: DEBUG nova.virt.libvirt.imagecache [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=71113) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Jul 31 10:21:55 user nova-compute[71113]: DEBUG nova.virt.libvirt.imagecache [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5 is a valid instance name {{(pid=71113) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Jul 31 10:21:55 user nova-compute[71113]: DEBUG nova.virt.libvirt.imagecache [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5 has a disk file {{(pid=71113) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Jul 31 10:21:55 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:21:55 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:21:55 user nova-compute[71113]: DEBUG nova.virt.libvirt.imagecache [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5 is backed by 1a23da102527e12ce1165c0fe070d85f45ada2d9 {{(pid=71113) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Jul 31 10:21:55 user nova-compute[71113]: DEBUG nova.virt.libvirt.imagecache [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] 1ca22313-39ec-4366-abe0-fa40247dfa3b is a valid instance name {{(pid=71113) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Jul 31 10:21:55 user nova-compute[71113]: DEBUG nova.virt.libvirt.imagecache [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] 1ca22313-39ec-4366-abe0-fa40247dfa3b has a disk file {{(pid=71113) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Jul 31 10:21:55 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ca22313-39ec-4366-abe0-fa40247dfa3b/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:21:56 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ca22313-39ec-4366-abe0-fa40247dfa3b/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:21:56 user nova-compute[71113]: DEBUG nova.virt.libvirt.imagecache [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 1ca22313-39ec-4366-abe0-fa40247dfa3b is backed by 1a23da102527e12ce1165c0fe070d85f45ada2d9 {{(pid=71113) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Jul 31 10:21:56 user nova-compute[71113]: DEBUG nova.virt.libvirt.imagecache [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] 8129456b-a22c-46e3-b5db-89fdcec87dec is a valid instance name {{(pid=71113) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Jul 31 10:21:56 user nova-compute[71113]: DEBUG nova.virt.libvirt.imagecache [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] 8129456b-a22c-46e3-b5db-89fdcec87dec has a disk file {{(pid=71113) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Jul 31 10:21:56 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:21:56 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:21:56 user nova-compute[71113]: DEBUG nova.virt.libvirt.imagecache [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 8129456b-a22c-46e3-b5db-89fdcec87dec is backed by 1a23da102527e12ce1165c0fe070d85f45ada2d9 {{(pid=71113) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Jul 31 10:21:56 user nova-compute[71113]: DEBUG nova.virt.libvirt.imagecache [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb is a valid instance name {{(pid=71113) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Jul 31 10:21:56 user nova-compute[71113]: DEBUG nova.virt.libvirt.imagecache [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb has a disk file {{(pid=71113) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Jul 31 10:21:56 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:21:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-eab28a40-0e0f-41b4-9b14-222d0e1b0a33 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Acquiring lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:21:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-eab28a40-0e0f-41b4-9b14-222d0e1b0a33 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:21:56 user nova-compute[71113]: INFO nova.compute.manager [None req-eab28a40-0e0f-41b4-9b14-222d0e1b0a33 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Detaching volume 8d6b5056-c07e-4278-aeb5-3069dd0f4bb8
Jul 31 10:21:56 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:21:56 user nova-compute[71113]: DEBUG nova.virt.libvirt.imagecache [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb is backed by 1a23da102527e12ce1165c0fe070d85f45ada2d9 {{(pid=71113) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Jul 31 10:21:56 user nova-compute[71113]: WARNING nova.virt.libvirt.imagecache [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Unknown base file: /opt/stack/data/nova/instances/_base/6716e364bf45231893438011268d06f09ad151fc
Jul 31 10:21:56 user nova-compute[71113]: WARNING nova.virt.libvirt.imagecache [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Unknown base file: /opt/stack/data/nova/instances/_base/3c5522f157e58da6165cf1e4c98f38fb9ba3915a
Jul 31 10:21:56 user nova-compute[71113]: WARNING nova.virt.libvirt.imagecache [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ec19842b3b081c2df3995370cc1625b071225e56
Jul 31 10:21:56 user nova-compute[71113]: WARNING nova.virt.libvirt.imagecache [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Unknown base file: /opt/stack/data/nova/instances/_base/afb72aa9f76cf488ce2c1bb26a7aa16329c2961b
Jul 31 10:21:56 user nova-compute[71113]: WARNING nova.virt.libvirt.imagecache [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Unknown base file: /opt/stack/data/nova/instances/_base/5f53e13821f83924a2a8d8cb5717e8abc2c2989c
Jul 31 10:21:56 user nova-compute[71113]: WARNING nova.virt.libvirt.imagecache [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Unknown base file: /opt/stack/data/nova/instances/_base/9f360f67813288081219a4f2a245e1a1a18b2629
Jul 31 10:21:56 user nova-compute[71113]: WARNING nova.virt.libvirt.imagecache [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b67cbc39994203c9b2d8ee63a73aaebb35fe428f
Jul 31 10:21:56 user nova-compute[71113]: INFO nova.virt.libvirt.imagecache [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Active base files: /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9
Jul 31 10:21:56 user nova-compute[71113]: INFO nova.virt.libvirt.imagecache [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Removable base files: /opt/stack/data/nova/instances/_base/6716e364bf45231893438011268d06f09ad151fc /opt/stack/data/nova/instances/_base/3c5522f157e58da6165cf1e4c98f38fb9ba3915a /opt/stack/data/nova/instances/_base/ec19842b3b081c2df3995370cc1625b071225e56 /opt/stack/data/nova/instances/_base/afb72aa9f76cf488ce2c1bb26a7aa16329c2961b /opt/stack/data/nova/instances/_base/5f53e13821f83924a2a8d8cb5717e8abc2c2989c /opt/stack/data/nova/instances/_base/9f360f67813288081219a4f2a245e1a1a18b2629 /opt/stack/data/nova/instances/_base/b67cbc39994203c9b2d8ee63a73aaebb35fe428f
Jul 31 10:21:56 user nova-compute[71113]: INFO nova.virt.libvirt.imagecache [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6716e364bf45231893438011268d06f09ad151fc
Jul 31 10:21:56 user nova-compute[71113]: INFO nova.virt.libvirt.imagecache [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3c5522f157e58da6165cf1e4c98f38fb9ba3915a
Jul 31 10:21:56 user nova-compute[71113]: INFO nova.virt.libvirt.imagecache [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ec19842b3b081c2df3995370cc1625b071225e56
Jul 31 10:21:56 user nova-compute[71113]: INFO nova.virt.libvirt.imagecache [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/afb72aa9f76cf488ce2c1bb26a7aa16329c2961b
Jul 31 10:21:56 user nova-compute[71113]: INFO nova.virt.libvirt.imagecache [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5f53e13821f83924a2a8d8cb5717e8abc2c2989c
Jul 31 10:21:56 user nova-compute[71113]: INFO nova.virt.libvirt.imagecache [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9f360f67813288081219a4f2a245e1a1a18b2629
Jul 31 10:21:56 user nova-compute[71113]: INFO nova.virt.libvirt.imagecache [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b67cbc39994203c9b2d8ee63a73aaebb35fe428f
Jul 31 10:21:56 user nova-compute[71113]: DEBUG nova.virt.libvirt.imagecache [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Verification complete {{(pid=71113) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Jul 31 10:21:56 user nova-compute[71113]: DEBUG nova.virt.libvirt.imagecache [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Verify swap images {{(pid=71113) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Jul 31 10:21:56 user nova-compute[71113]: DEBUG nova.virt.libvirt.imagecache [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Verify ephemeral images {{(pid=71113) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Jul 31 10:21:56 user nova-compute[71113]: INFO nova.virt.block_device [None req-eab28a40-0e0f-41b4-9b14-222d0e1b0a33 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Attempting to driver detach volume 8d6b5056-c07e-4278-aeb5-3069dd0f4bb8 from mountpoint /dev/vdb
Jul 31 10:21:56 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-eab28a40-0e0f-41b4-9b14-222d0e1b0a33 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Attempting to detach device vdb from instance b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb from the persistent domain config. {{(pid=71113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 10:21:56 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-eab28a40-0e0f-41b4-9b14-222d0e1b0a33 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 10:21:56 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:21:56 user nova-compute[71113]:   <source dev="/dev/sdb"/>
Jul 31 10:21:56 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 10:21:56 user nova-compute[71113]:   <serial>8d6b5056-c07e-4278-aeb5-3069dd0f4bb8</serial>
Jul 31 10:21:56 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 10:21:56 user nova-compute[71113]: </disk>
Jul 31 10:21:56 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 10:21:56 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-eab28a40-0e0f-41b4-9b14-222d0e1b0a33 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Successfully detached device vdb from instance b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb from the persistent domain config.
Jul 31 10:21:56 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-eab28a40-0e0f-41b4-9b14-222d0e1b0a33 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb from the live domain config. {{(pid=71113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 10:21:56 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-eab28a40-0e0f-41b4-9b14-222d0e1b0a33 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 10:21:56 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:21:56 user nova-compute[71113]:   <source dev="/dev/sdb"/>
Jul 31 10:21:56 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 10:21:56 user nova-compute[71113]:   <serial>8d6b5056-c07e-4278-aeb5-3069dd0f4bb8</serial>
Jul 31 10:21:56 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 10:21:56 user nova-compute[71113]: </disk>
Jul 31 10:21:56 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 10:21:56 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Received event <DeviceRemovedEvent: 1690798916.9728951, b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71113) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 10:21:56 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-eab28a40-0e0f-41b4-9b14-222d0e1b0a33 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb {{(pid=71113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 10:21:56 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-eab28a40-0e0f-41b4-9b14-222d0e1b0a33 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Successfully detached device vdb from instance b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb from the live domain config.
Jul 31 10:21:56 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eab28a40-0e0f-41b4-9b14-222d0e1b0a33 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 10:21:56 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab28a40-0e0f-41b4-9b14-222d0e1b0a33 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:8d6b5056-c07e-4278-aeb5-3069dd0f4bb8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DhEvJRgG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:21:56 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-eab28a40-0e0f-41b4-9b14-222d0e1b0a33 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:21:56 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-eab28a40-0e0f-41b4-9b14-222d0e1b0a33 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:21:56 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-eab28a40-0e0f-41b4-9b14-222d0e1b0a33 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:21:56 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab28a40-0e0f-41b4-9b14-222d0e1b0a33 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d6b5056-c07e-4278-aeb5-3069dd0f4bb8', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 10:21:56 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:21:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:21:57 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0a0d74-5c3b-42ba-9958-cf9e968cc7f6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d6b5056-c07e-4278-aeb5-3069dd0f4bb8\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:21:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:21:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:21:57 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31bedda-6f82-4f63-b514-29fd4f0e8275]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d6b5056-c07e-4278-aeb5-3069dd0f4bb8 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:21:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab28a40-0e0f-41b4-9b14-222d0e1b0a33 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d6b5056-c07e-4278-aeb5-3069dd0f4bb8 (non-flash)
Jul 31 10:21:57 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:21:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab28a40-0e0f-41b4-9b14-222d0e1b0a33 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d6b5056-c07e-4278-aeb5-3069dd0f4bb8 (non-flash)
Jul 31 10:21:57 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:21:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab28a40-0e0f-41b4-9b14-222d0e1b0a33 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7908188af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d6b5056-c07e-4278-aeb5-3069dd0f4bb8'): ({'sdb'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 10:21:57 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-eab28a40-0e0f-41b4-9b14-222d0e1b0a33 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Removing single pathed devices sdb {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 10:21:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:21:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:21:57 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da41414-2eac-47de-b768-c7ddadcde8f5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:21:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:21:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:21:57 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1c5eb8-18c5-4a93-9158-d97ce525853a]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:21:57 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-eab28a40-0e0f-41b4-9b14-222d0e1b0a33 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Flushing IO for device /dev/sdb {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 10:21:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:21:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:21:57 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0541dde0-fd9d-4163-b8a8-50c26c9c5eec]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:21:57 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-eab28a40-0e0f-41b4-9b14-222d0e1b0a33 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 10:21:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:21:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:21:57 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5440c3ec-ec7b-44d1-850f-b3a3759a2fd6]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:21:57 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-eab28a40-0e0f-41b4-9b14-222d0e1b0a33 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 10:21:57 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-eab28a40-0e0f-41b4-9b14-222d0e1b0a33 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] SCSI volumes sdb have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 10:21:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab28a40-0e0f-41b4-9b14-222d0e1b0a33 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d6b5056-c07e-4278-aeb5-3069dd0f4bb8')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 10:21:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d6b5056-c07e-4278-aeb5-3069dd0f4bb8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:21:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d6b5056-c07e-4278-aeb5-3069dd0f4bb8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:21:57 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[923845c6-c028-42df-9c05-37b91227502f]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:21:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab28a40-0e0f-41b4-9b14-222d0e1b0a33 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:21:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d6b5056-c07e-4278-aeb5-3069dd0f4bb8 -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:21:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d6b5056-c07e-4278-aeb5-3069dd0f4bb8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:21:57 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[705137fc-e749-49f2-b7a5-ec2640d9cdb4]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:8d6b5056-c07e-4278-aeb5-3069dd0f4bb8, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:8d6b5056-c07e-4278-aeb5-3069dd0f4bb8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:21:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab28a40-0e0f-41b4-9b14-222d0e1b0a33 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:8d6b5056-c07e-4278-aeb5-3069dd0f4bb8, portal: 172.16.0.220,3260]
Jul 31 10:21:57 user nova-compute[71113]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:8d6b5056-c07e-4278-aeb5-3069dd0f4bb8, portal: 172.16.0.220,3260] successful.
Jul 31 10:21:57 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:21:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d6b5056-c07e-4278-aeb5-3069dd0f4bb8 -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:21:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d6b5056-c07e-4278-aeb5-3069dd0f4bb8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:21:57 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2996ae-8b5b-43b2-a28c-18ad70956f69]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:21:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab28a40-0e0f-41b4-9b14-222d0e1b0a33 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:21:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-eab28a40-0e0f-41b4-9b14-222d0e1b0a33 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.266s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:21:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab28a40-0e0f-41b4-9b14-222d0e1b0a33 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] <== disconnect_volume: return (268ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:21:57 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eab28a40-0e0f-41b4-9b14-222d0e1b0a33 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 10:21:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:21:57 user nova-compute[71113]: DEBUG nova.objects.instance [None req-eab28a40-0e0f-41b4-9b14-222d0e1b0a33 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lazy-loading 'flavor' on Instance uuid b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:21:58 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-eab28a40-0e0f-41b4-9b14-222d0e1b0a33 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.641s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:22:00 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:22:02 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:22:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:22:05 user nova-compute[71113]: DEBUG nova.compute.manager [req-00e8b000-eabb-4836-90af-86fc2a6d4371 req-4e71533d-a9cf-4d0f-a0f4-d40033dc12cf service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Received event network-changed-aa0481c2-d383-47ac-aaca-8830e727b0fd {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:22:05 user nova-compute[71113]: DEBUG nova.compute.manager [req-00e8b000-eabb-4836-90af-86fc2a6d4371 req-4e71533d-a9cf-4d0f-a0f4-d40033dc12cf service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Refreshing instance network info cache due to event network-changed-aa0481c2-d383-47ac-aaca-8830e727b0fd. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 10:22:05 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-00e8b000-eabb-4836-90af-86fc2a6d4371 req-4e71533d-a9cf-4d0f-a0f4-d40033dc12cf service nova] Acquiring lock "refresh_cache-1ca22313-39ec-4366-abe0-fa40247dfa3b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:22:05 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-00e8b000-eabb-4836-90af-86fc2a6d4371 req-4e71533d-a9cf-4d0f-a0f4-d40033dc12cf service nova] Acquired lock "refresh_cache-1ca22313-39ec-4366-abe0-fa40247dfa3b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:22:05 user nova-compute[71113]: DEBUG nova.network.neutron [req-00e8b000-eabb-4836-90af-86fc2a6d4371 req-4e71533d-a9cf-4d0f-a0f4-d40033dc12cf service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Refreshing network info cache for port aa0481c2-d383-47ac-aaca-8830e727b0fd {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 10:22:05 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b486a01f-2023-49f5-9ffe-c02a00835a5b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Acquiring lock "1ca22313-39ec-4366-abe0-fa40247dfa3b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:22:05 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b486a01f-2023-49f5-9ffe-c02a00835a5b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "1ca22313-39ec-4366-abe0-fa40247dfa3b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:22:05 user nova-compute[71113]: DEBUG nova.objects.instance [None req-b486a01f-2023-49f5-9ffe-c02a00835a5b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lazy-loading 'flavor' on Instance uuid 1ca22313-39ec-4366-abe0-fa40247dfa3b {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:22:05 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b486a01f-2023-49f5-9ffe-c02a00835a5b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "1ca22313-39ec-4366-abe0-fa40247dfa3b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:22:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b486a01f-2023-49f5-9ffe-c02a00835a5b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Acquiring lock "1ca22313-39ec-4366-abe0-fa40247dfa3b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:22:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b486a01f-2023-49f5-9ffe-c02a00835a5b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "1ca22313-39ec-4366-abe0-fa40247dfa3b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:22:06 user nova-compute[71113]: INFO nova.compute.manager [None req-b486a01f-2023-49f5-9ffe-c02a00835a5b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Attaching volume 26c5c180-7cb3-432b-99e9-09b9dfb10601 to /dev/vdb
Jul 31 10:22:06 user nova-compute[71113]: DEBUG os_brick.utils [None req-b486a01f-2023-49f5-9ffe-c02a00835a5b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:22:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:22:06 user nova-compute[71113]: DEBUG nova.network.neutron [req-00e8b000-eabb-4836-90af-86fc2a6d4371 req-4e71533d-a9cf-4d0f-a0f4-d40033dc12cf service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Updated VIF entry in instance network info cache for port aa0481c2-d383-47ac-aaca-8830e727b0fd. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 10:22:06 user nova-compute[71113]: DEBUG nova.network.neutron [req-00e8b000-eabb-4836-90af-86fc2a6d4371 req-4e71533d-a9cf-4d0f-a0f4-d40033dc12cf service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Updating instance_info_cache with network_info: [{"id": "aa0481c2-d383-47ac-aaca-8830e727b0fd", "address": "fa:16:3e:3a:ac:a2", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa0481c2-d3", "ovs_interfaceid": "aa0481c2-d383-47ac-aaca-8830e727b0fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:22:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:22:06 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34e7b99-df8b-4639-a5d7-d065e7630b1f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:22:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:22:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-00e8b000-eabb-4836-90af-86fc2a6d4371 req-4e71533d-a9cf-4d0f-a0f4-d40033dc12cf service nova] Releasing lock "refresh_cache-1ca22313-39ec-4366-abe0-fa40247dfa3b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:22:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:22:06 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d662261d-6cd8-4f90-8eb3-fbae6c367fd6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:22:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:22:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:22:06 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[63108196-dcdd-485b-8bd7-df01423e48df]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:22:06 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbe613e-ce6d-4bad-a665-314669256b46]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:22:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-b486a01f-2023-49f5-9ffe-c02a00835a5b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:22:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-b486a01f-2023-49f5-9ffe-c02a00835a5b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 10:22:06 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b486a01f-2023-49f5-9ffe-c02a00835a5b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 10:22:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:22:06 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 10:22:06 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 10:22:06 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a089546-a336-4c17-bde7-f1f9ad095b2a]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:22:06 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-b486a01f-2023-49f5-9ffe-c02a00835a5b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 10:22:06 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-b486a01f-2023-49f5-9ffe-c02a00835a5b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 10:22:06 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-b486a01f-2023-49f5-9ffe-c02a00835a5b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 10:22:06 user nova-compute[71113]: DEBUG os_brick.utils [None req-b486a01f-2023-49f5-9ffe-c02a00835a5b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:22:06 user nova-compute[71113]: DEBUG nova.virt.block_device [None req-b486a01f-2023-49f5-9ffe-c02a00835a5b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Updating existing volume attachment record: a438da7f-f0ba-4524-b544-f48d42067bd3 {{(pid=71113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 10:22:07 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:22:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:22:12 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:22:13 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b486a01f-2023-49f5-9ffe-c02a00835a5b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 10:22:13 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b486a01f-2023-49f5-9ffe-c02a00835a5b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:26c5c180-7cb3-432b-99e9-09b9dfb10601'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zoJAltyX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:22:13 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-b486a01f-2023-49f5-9ffe-c02a00835a5b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:22:13 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-b486a01f-2023-49f5-9ffe-c02a00835a5b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:22:13 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-b486a01f-2023-49f5-9ffe-c02a00835a5b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:22:13 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-b486a01f-2023-49f5-9ffe-c02a00835a5b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:22:13 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-b486a01f-2023-49f5-9ffe-c02a00835a5b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26c5c180-7cb3-432b-99e9-09b9dfb10601" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:22:13 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-b486a01f-2023-49f5-9ffe-c02a00835a5b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26c5c180-7cb3-432b-99e9-09b9dfb10601" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:22:13 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-b486a01f-2023-49f5-9ffe-c02a00835a5b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 10:22:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c5c180-7cb3-432b-99e9-09b9dfb10601 -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:22:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c5c180-7cb3-432b-99e9-09b9dfb10601 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:22:13 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eba980c-90ed-4a4a-be4d-267c15a1763a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:22:13 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b486a01f-2023-49f5-9ffe-c02a00835a5b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 10:22:13 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:22:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c5c180-7cb3-432b-99e9-09b9dfb10601 -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:22:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c5c180-7cb3-432b-99e9-09b9dfb10601 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:22:13 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eaea1d6-d60f-449c-89e6-9101a0b15211]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26c5c180-7cb3-432b-99e9-09b9dfb10601] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:22:13 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b486a01f-2023-49f5-9ffe-c02a00835a5b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26c5c180-7cb3-432b-99e9-09b9dfb10601] added
Jul 31 10:22:13 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:22:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c5c180-7cb3-432b-99e9-09b9dfb10601 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:22:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c5c180-7cb3-432b-99e9-09b9dfb10601 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:22:13 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8695a3-7c44-40b5-8777-897d77b18651]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:22:13 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b486a01f-2023-49f5-9ffe-c02a00835a5b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:22:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c5c180-7cb3-432b-99e9-09b9dfb10601 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:22:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c5c180-7cb3-432b-99e9-09b9dfb10601 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:22:13 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e42d86-6f2e-4ed2-9626-65f8f17840bb]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:22:13 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b486a01f-2023-49f5-9ffe-c02a00835a5b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:22:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c5c180-7cb3-432b-99e9-09b9dfb10601 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zoJAltyX {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:22:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c5c180-7cb3-432b-99e9-09b9dfb10601 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zoJAltyX" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:22:13 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c30047-38d6-4d8e-9b7b-d7763e0ccc38]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:22:13 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b486a01f-2023-49f5-9ffe-c02a00835a5b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zoJAltyX'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:22:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c5c180-7cb3-432b-99e9-09b9dfb10601 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:22:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c5c180-7cb3-432b-99e9-09b9dfb10601 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:22:13 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26da8fb-86f6-4926-bcb9-4cc1eccf3964]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:22:13 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b486a01f-2023-49f5-9ffe-c02a00835a5b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:22:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:22:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:22:13 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ccb2863-e6df-4ec1-b321-b9549c376eba]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:22:13 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b486a01f-2023-49f5-9ffe-c02a00835a5b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 31 10:22:13 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:22:13 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b486a01f-2023-49f5-9ffe-c02a00835a5b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 31 10:22:13 user nova-compute[71113]:  {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:22:13 user nova-compute[71113]: WARNING os_brick.initiator.connectors.iscsi [None req-b486a01f-2023-49f5-9ffe-c02a00835a5b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 31 10:22:13 user nova-compute[71113]: 
Jul 31 10:22:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c5c180-7cb3-432b-99e9-09b9dfb10601 -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:22:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c5c180-7cb3-432b-99e9-09b9dfb10601 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:22:13 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd4eb73-c432-4044-972b-b5e62adbebfb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:26c5c180-7cb3-432b-99e9-09b9dfb10601, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:26c5c180-7cb3-432b-99e9-09b9dfb10601, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:22:13 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b486a01f-2023-49f5-9ffe-c02a00835a5b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:26c5c180-7cb3-432b-99e9-09b9dfb10601, portal: 172.16.0.220,3260]
Jul 31 10:22:13 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:26c5c180-7cb3-432b-99e9-09b9dfb10601, portal: 172.16.0.220,3260] successful.
Jul 31 10:22:13 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:22:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c5c180-7cb3-432b-99e9-09b9dfb10601 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:22:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c5c180-7cb3-432b-99e9-09b9dfb10601 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:22:13 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d0fd52-0517-433c-82d7-50ba3367d44c]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:22:13 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b486a01f-2023-49f5-9ffe-c02a00835a5b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:22:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:22:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:22:13 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0defe5a-6036-43dc-bedf-98bda1c398ab]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c5c180-7cb3-432b-99e9-09b9dfb10601 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:22:13 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b486a01f-2023-49f5-9ffe-c02a00835a5b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c5c180-7cb3-432b-99e9-09b9dfb10601 (non-flash)
Jul 31 10:22:13 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:22:13 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b486a01f-2023-49f5-9ffe-c02a00835a5b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c5c180-7cb3-432b-99e9-09b9dfb10601 (non-flash)
Jul 31 10:22:13 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:22:13 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-b486a01f-2023-49f5-9ffe-c02a00835a5b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26c5c180-7cb3-432b-99e9-09b9dfb10601" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:22:13 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b486a01f-2023-49f5-9ffe-c02a00835a5b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 10:22:13 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-b486a01f-2023-49f5-9ffe-c02a00835a5b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 10:22:13 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-b486a01f-2023-49f5-9ffe-c02a00835a5b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 10:22:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:22:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:22:13 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4660c51-5259-40d3-834f-9e1dcfd7a784]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:22:13 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-b486a01f-2023-49f5-9ffe-c02a00835a5b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: None {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 10:22:14 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-b486a01f-2023-49f5-9ffe-c02a00835a5b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 10:22:14 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b486a01f-2023-49f5-9ffe-c02a00835a5b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zoJAltyX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 10:22:14 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-b486a01f-2023-49f5-9ffe-c02a00835a5b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:22:14 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-b486a01f-2023-49f5-9ffe-c02a00835a5b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '23232313833393063', 'path': '/dev/sdb'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:22:14 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b486a01f-2023-49f5-9ffe-c02a00835a5b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232313833393063', 'path': '/dev/sdb'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 10:22:14 user nova-compute[71113]: DEBUG nova.objects.instance [None req-b486a01f-2023-49f5-9ffe-c02a00835a5b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lazy-loading 'flavor' on Instance uuid 1ca22313-39ec-4366-abe0-fa40247dfa3b {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:22:14 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-b486a01f-2023-49f5-9ffe-c02a00835a5b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 10:22:14 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:22:14 user nova-compute[71113]:   <source dev="/dev/sdb"/>
Jul 31 10:22:14 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 10:22:14 user nova-compute[71113]:   <serial>26c5c180-7cb3-432b-99e9-09b9dfb10601</serial>
Jul 31 10:22:14 user nova-compute[71113]: </disk>
Jul 31 10:22:14 user nova-compute[71113]:  {{(pid=71113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 10:22:14 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-b486a01f-2023-49f5-9ffe-c02a00835a5b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:22:14 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-b486a01f-2023-49f5-9ffe-c02a00835a5b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:22:14 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-b486a01f-2023-49f5-9ffe-c02a00835a5b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] No VIF found with MAC fa:16:3e:3a:ac:a2, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 10:22:14 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b486a01f-2023-49f5-9ffe-c02a00835a5b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "1ca22313-39ec-4366-abe0-fa40247dfa3b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.742s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:22:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:22:15 user nova-compute[71113]: INFO nova.compute.manager [None req-264ea09b-beef-4958-a6dd-cdcb04038002 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Rescuing
Jul 31 10:22:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-264ea09b-beef-4958-a6dd-cdcb04038002 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Acquiring lock "refresh_cache-1ca22313-39ec-4366-abe0-fa40247dfa3b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:22:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-264ea09b-beef-4958-a6dd-cdcb04038002 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Acquired lock "refresh_cache-1ca22313-39ec-4366-abe0-fa40247dfa3b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:22:15 user nova-compute[71113]: DEBUG nova.network.neutron [None req-264ea09b-beef-4958-a6dd-cdcb04038002 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 10:22:16 user nova-compute[71113]: DEBUG nova.network.neutron [None req-264ea09b-beef-4958-a6dd-cdcb04038002 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Updating instance_info_cache with network_info: [{"id": "aa0481c2-d383-47ac-aaca-8830e727b0fd", "address": "fa:16:3e:3a:ac:a2", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa0481c2-d3", "ovs_interfaceid": "aa0481c2-d383-47ac-aaca-8830e727b0fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:22:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-264ea09b-beef-4958-a6dd-cdcb04038002 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Releasing lock "refresh_cache-1ca22313-39ec-4366-abe0-fa40247dfa3b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:22:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:22:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:22:16 user nova-compute[71113]: DEBUG nova.compute.manager [req-72a4c6e1-136a-449a-8cf4-27af028a98a3 req-24bf69bf-a031-4f7d-b301-703d595382b3 service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Received event network-vif-unplugged-aa0481c2-d383-47ac-aaca-8830e727b0fd {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:22:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-72a4c6e1-136a-449a-8cf4-27af028a98a3 req-24bf69bf-a031-4f7d-b301-703d595382b3 service nova] Acquiring lock "1ca22313-39ec-4366-abe0-fa40247dfa3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:22:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-72a4c6e1-136a-449a-8cf4-27af028a98a3 req-24bf69bf-a031-4f7d-b301-703d595382b3 service nova] Lock "1ca22313-39ec-4366-abe0-fa40247dfa3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:22:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-72a4c6e1-136a-449a-8cf4-27af028a98a3 req-24bf69bf-a031-4f7d-b301-703d595382b3 service nova] Lock "1ca22313-39ec-4366-abe0-fa40247dfa3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:22:16 user nova-compute[71113]: DEBUG nova.compute.manager [req-72a4c6e1-136a-449a-8cf4-27af028a98a3 req-24bf69bf-a031-4f7d-b301-703d595382b3 service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] No waiting events found dispatching network-vif-unplugged-aa0481c2-d383-47ac-aaca-8830e727b0fd {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:22:16 user nova-compute[71113]: WARNING nova.compute.manager [req-72a4c6e1-136a-449a-8cf4-27af028a98a3 req-24bf69bf-a031-4f7d-b301-703d595382b3 service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Received unexpected event network-vif-unplugged-aa0481c2-d383-47ac-aaca-8830e727b0fd for instance with vm_state active and task_state rescuing.
Jul 31 10:22:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:22:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:22:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:22:17 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Instance destroyed successfully.
Jul 31 10:22:17 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-264ea09b-beef-4958-a6dd-cdcb04038002 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Attempting rescue
Jul 31 10:22:17 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-264ea09b-beef-4958-a6dd-cdcb04038002 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71113) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 31 10:22:17 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-264ea09b-beef-4958-a6dd-cdcb04038002 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Instance directory exists: not creating {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 31 10:22:17 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-264ea09b-beef-4958-a6dd-cdcb04038002 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Creating image(s)
Jul 31 10:22:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-264ea09b-beef-4958-a6dd-cdcb04038002 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Acquiring lock "/opt/stack/data/nova/instances/1ca22313-39ec-4366-abe0-fa40247dfa3b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:22:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-264ea09b-beef-4958-a6dd-cdcb04038002 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "/opt/stack/data/nova/instances/1ca22313-39ec-4366-abe0-fa40247dfa3b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:22:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-264ea09b-beef-4958-a6dd-cdcb04038002 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "/opt/stack/data/nova/instances/1ca22313-39ec-4366-abe0-fa40247dfa3b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:22:17 user nova-compute[71113]: DEBUG nova.objects.instance [None req-264ea09b-beef-4958-a6dd-cdcb04038002 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1ca22313-39ec-4366-abe0-fa40247dfa3b {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:22:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-264ea09b-beef-4958-a6dd-cdcb04038002 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Acquiring lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:22:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-264ea09b-beef-4958-a6dd-cdcb04038002 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:22:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-264ea09b-beef-4958-a6dd-cdcb04038002 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:22:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-264ea09b-beef-4958-a6dd-cdcb04038002 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.134s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:22:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-264ea09b-beef-4958-a6dd-cdcb04038002 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/1ca22313-39ec-4366-abe0-fa40247dfa3b/disk.rescue {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:22:17 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-264ea09b-beef-4958-a6dd-cdcb04038002 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/1ca22313-39ec-4366-abe0-fa40247dfa3b/disk.rescue" returned: 0 in 0.068s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:22:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-264ea09b-beef-4958-a6dd-cdcb04038002 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.209s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:22:17 user nova-compute[71113]: DEBUG nova.objects.instance [None req-264ea09b-beef-4958-a6dd-cdcb04038002 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lazy-loading 'migration_context' on Instance uuid 1ca22313-39ec-4366-abe0-fa40247dfa3b {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:22:17 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-264ea09b-beef-4958-a6dd-cdcb04038002 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Created local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 10:22:17 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-264ea09b-beef-4958-a6dd-cdcb04038002 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Start _get_guest_xml network_info=[{"id": "aa0481c2-d383-47ac-aaca-8830e727b0fd", "address": "fa:16:3e:3a:ac:a2", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "vif_mac": "fa:16:3e:3a:ac:a2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa0481c2-d3", "ovs_interfaceid": "aa0481c2-d383-47ac-aaca-8830e727b0fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '078646fe-b504-41ed-a147-61072e903e51', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 10:22:17 user nova-compute[71113]: DEBUG nova.objects.instance [None req-264ea09b-beef-4958-a6dd-cdcb04038002 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lazy-loading 'resources' on Instance uuid 1ca22313-39ec-4366-abe0-fa40247dfa3b {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:22:17 user nova-compute[71113]: DEBUG nova.objects.instance [None req-264ea09b-beef-4958-a6dd-cdcb04038002 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lazy-loading 'numa_topology' on Instance uuid 1ca22313-39ec-4366-abe0-fa40247dfa3b {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:22:17 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-264ea09b-beef-4958-a6dd-cdcb04038002 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:22:17 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-264ea09b-beef-4958-a6dd-cdcb04038002 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:22:17 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-264ea09b-beef-4958-a6dd-cdcb04038002 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 10:22:17 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-264ea09b-beef-4958-a6dd-cdcb04038002 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 10:22:17 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-264ea09b-beef-4958-a6dd-cdcb04038002 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 10:22:17 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-264ea09b-beef-4958-a6dd-cdcb04038002 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 10:22:17 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-264ea09b-beef-4958-a6dd-cdcb04038002 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 10:22:17 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-264ea09b-beef-4958-a6dd-cdcb04038002 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 10:22:17 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-264ea09b-beef-4958-a6dd-cdcb04038002 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 10:22:17 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-264ea09b-beef-4958-a6dd-cdcb04038002 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 10:22:17 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-264ea09b-beef-4958-a6dd-cdcb04038002 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 10:22:17 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-264ea09b-beef-4958-a6dd-cdcb04038002 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 10:22:17 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-264ea09b-beef-4958-a6dd-cdcb04038002 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 10:22:17 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-264ea09b-beef-4958-a6dd-cdcb04038002 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 10:22:17 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-264ea09b-beef-4958-a6dd-cdcb04038002 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 10:22:17 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-264ea09b-beef-4958-a6dd-cdcb04038002 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 10:22:17 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-264ea09b-beef-4958-a6dd-cdcb04038002 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 10:22:17 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-264ea09b-beef-4958-a6dd-cdcb04038002 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 10:22:17 user nova-compute[71113]: DEBUG nova.objects.instance [None req-264ea09b-beef-4958-a6dd-cdcb04038002 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1ca22313-39ec-4366-abe0-fa40247dfa3b {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:22:17 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-264ea09b-beef-4958-a6dd-cdcb04038002 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:20:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1923872530',display_name='tempest-ServerRescueNegativeTestJSON-server-1923872530',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1923872530',id=48,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJYvScQMfs8bEpk0VjLb5yaNQU2cjc57kgHjVsVxKMOMYpMVc3RLCFV+tPuzRX2ZCcaPda03wbVcYWV0e22ylplzcU7e9BPDTnYIfC1NUaS2h4na+MPEQwy55tUq3ZGyHQ==',key_name='tempest-keypair-592677638',keypairs=<?>,launch_index=0,launched_at=2023-07-31T10:20:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='938c4f5af8a347cf9d700c8cdb5df356',ramdisk_id='',reservation_id='r-jy0mnt32',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-549904406',owner_user_name='tempest-ServerRescueNegativeTestJSON-549904406-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T10:20:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6023b7c67c0941d3975fa9c25140684f',uuid=1ca22313-39ec-4366-abe0-fa40247dfa3b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aa0481c2-d383-47ac-aaca-8830e727b0fd", "address": "fa:16:3e:3a:ac:a2", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "vif_mac": "fa:16:3e:3a:ac:a2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa0481c2-d3", "ovs_interfaceid": "aa0481c2-d383-47ac-aaca-8830e727b0fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 10:22:17 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-264ea09b-beef-4958-a6dd-cdcb04038002 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Converting VIF {"id": "aa0481c2-d383-47ac-aaca-8830e727b0fd", "address": "fa:16:3e:3a:ac:a2", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "vif_mac": "fa:16:3e:3a:ac:a2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa0481c2-d3", "ovs_interfaceid": "aa0481c2-d383-47ac-aaca-8830e727b0fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:22:17 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-264ea09b-beef-4958-a6dd-cdcb04038002 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:ac:a2,bridge_name='br-int',has_traffic_filtering=True,id=aa0481c2-d383-47ac-aaca-8830e727b0fd,network=Network(328e0f8b-5788-457c-afc6-7fe314ca8b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa0481c2-d3') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:22:17 user nova-compute[71113]: DEBUG nova.objects.instance [None req-264ea09b-beef-4958-a6dd-cdcb04038002 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lazy-loading 'pci_devices' on Instance uuid 1ca22313-39ec-4366-abe0-fa40247dfa3b {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:22:17 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-264ea09b-beef-4958-a6dd-cdcb04038002 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] End _get_guest_xml xml=<domain type="kvm">
Jul 31 10:22:17 user nova-compute[71113]:   <uuid>1ca22313-39ec-4366-abe0-fa40247dfa3b</uuid>
Jul 31 10:22:17 user nova-compute[71113]:   <name>instance-00000030</name>
Jul 31 10:22:17 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 10:22:17 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 10:22:17 user nova-compute[71113]:   <metadata>
Jul 31 10:22:17 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 10:22:17 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 10:22:17 user nova-compute[71113]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1923872530</nova:name>
Jul 31 10:22:17 user nova-compute[71113]:       <nova:creationTime>2023-07-31 10:22:17</nova:creationTime>
Jul 31 10:22:17 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 10:22:17 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 10:22:17 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 10:22:17 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 10:22:17 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 10:22:17 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 10:22:17 user nova-compute[71113]:       </nova:flavor>
Jul 31 10:22:17 user nova-compute[71113]:       <nova:owner>
Jul 31 10:22:17 user nova-compute[71113]:         <nova:user uuid="6023b7c67c0941d3975fa9c25140684f">tempest-ServerRescueNegativeTestJSON-549904406-project-member</nova:user>
Jul 31 10:22:17 user nova-compute[71113]:         <nova:project uuid="938c4f5af8a347cf9d700c8cdb5df356">tempest-ServerRescueNegativeTestJSON-549904406</nova:project>
Jul 31 10:22:17 user nova-compute[71113]:       </nova:owner>
Jul 31 10:22:17 user nova-compute[71113]:       <nova:root type="image" uuid="078646fe-b504-41ed-a147-61072e903e51"/>
Jul 31 10:22:17 user nova-compute[71113]:       <nova:ports>
Jul 31 10:22:17 user nova-compute[71113]:         <nova:port uuid="aa0481c2-d383-47ac-aaca-8830e727b0fd">
Jul 31 10:22:17 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 31 10:22:17 user nova-compute[71113]:         </nova:port>
Jul 31 10:22:17 user nova-compute[71113]:       </nova:ports>
Jul 31 10:22:17 user nova-compute[71113]:     </nova:instance>
Jul 31 10:22:17 user nova-compute[71113]:   </metadata>
Jul 31 10:22:17 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 10:22:17 user nova-compute[71113]:     <system>
Jul 31 10:22:17 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 10:22:17 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 10:22:17 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 10:22:17 user nova-compute[71113]:       <entry name="serial">1ca22313-39ec-4366-abe0-fa40247dfa3b</entry>
Jul 31 10:22:17 user nova-compute[71113]:       <entry name="uuid">1ca22313-39ec-4366-abe0-fa40247dfa3b</entry>
Jul 31 10:22:17 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 10:22:17 user nova-compute[71113]:     </system>
Jul 31 10:22:17 user nova-compute[71113]:   </sysinfo>
Jul 31 10:22:17 user nova-compute[71113]:   <os>
Jul 31 10:22:17 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 10:22:17 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 10:22:17 user nova-compute[71113]:   </os>
Jul 31 10:22:17 user nova-compute[71113]:   <features>
Jul 31 10:22:17 user nova-compute[71113]:     <acpi/>
Jul 31 10:22:17 user nova-compute[71113]:     <apic/>
Jul 31 10:22:17 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 10:22:17 user nova-compute[71113]:   </features>
Jul 31 10:22:17 user nova-compute[71113]:   <clock offset="utc">
Jul 31 10:22:17 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 10:22:17 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 10:22:17 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 10:22:17 user nova-compute[71113]:   </clock>
Jul 31 10:22:17 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 10:22:17 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 10:22:17 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 10:22:17 user nova-compute[71113]:   </cpu>
Jul 31 10:22:17 user nova-compute[71113]:   <devices>
Jul 31 10:22:17 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 10:22:17 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 10:22:17 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/1ca22313-39ec-4366-abe0-fa40247dfa3b/disk.rescue"/>
Jul 31 10:22:17 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 10:22:17 user nova-compute[71113]:     </disk>
Jul 31 10:22:17 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 10:22:17 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 10:22:17 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/1ca22313-39ec-4366-abe0-fa40247dfa3b/disk"/>
Jul 31 10:22:17 user nova-compute[71113]:       <target dev="vdb" bus="virtio"/>
Jul 31 10:22:17 user nova-compute[71113]:     </disk>
Jul 31 10:22:17 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 10:22:17 user nova-compute[71113]:       <mac address="fa:16:3e:3a:ac:a2"/>
Jul 31 10:22:17 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:22:17 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 10:22:17 user nova-compute[71113]:       <target dev="tapaa0481c2-d3"/>
Jul 31 10:22:17 user nova-compute[71113]:     </interface>
Jul 31 10:22:17 user nova-compute[71113]:     <serial type="pty">
Jul 31 10:22:17 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/1ca22313-39ec-4366-abe0-fa40247dfa3b/console.log" append="off"/>
Jul 31 10:22:17 user nova-compute[71113]:     </serial>
Jul 31 10:22:17 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 10:22:17 user nova-compute[71113]:     <video>
Jul 31 10:22:17 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:22:17 user nova-compute[71113]:     </video>
Jul 31 10:22:17 user nova-compute[71113]:     <rng model="virtio">
Jul 31 10:22:17 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 10:22:17 user nova-compute[71113]:     </rng>
Jul 31 10:22:17 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 10:22:17 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 10:22:17 user nova-compute[71113]:       <stats period="10"/>
Jul 31 10:22:17 user nova-compute[71113]:     </memballoon>
Jul 31 10:22:17 user nova-compute[71113]:   </devices>
Jul 31 10:22:17 user nova-compute[71113]: </domain>
Jul 31 10:22:17 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 10:22:17 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Instance destroyed successfully.
Jul 31 10:22:17 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-264ea09b-beef-4958-a6dd-cdcb04038002 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:22:17 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-264ea09b-beef-4958-a6dd-cdcb04038002 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:22:17 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-264ea09b-beef-4958-a6dd-cdcb04038002 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] No VIF found with MAC fa:16:3e:3a:ac:a2, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 10:22:17 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:22:18 user nova-compute[71113]: DEBUG nova.compute.manager [req-ef958ecf-5c18-44be-a09d-5ea82a9ba413 req-84d8b045-ca7f-41ee-ba6e-b9b14d8e0c94 service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Received event network-vif-plugged-aa0481c2-d383-47ac-aaca-8830e727b0fd {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:22:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ef958ecf-5c18-44be-a09d-5ea82a9ba413 req-84d8b045-ca7f-41ee-ba6e-b9b14d8e0c94 service nova] Acquiring lock "1ca22313-39ec-4366-abe0-fa40247dfa3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:22:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ef958ecf-5c18-44be-a09d-5ea82a9ba413 req-84d8b045-ca7f-41ee-ba6e-b9b14d8e0c94 service nova] Lock "1ca22313-39ec-4366-abe0-fa40247dfa3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:22:18 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-ef958ecf-5c18-44be-a09d-5ea82a9ba413 req-84d8b045-ca7f-41ee-ba6e-b9b14d8e0c94 service nova] Lock "1ca22313-39ec-4366-abe0-fa40247dfa3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:22:18 user nova-compute[71113]: DEBUG nova.compute.manager [req-ef958ecf-5c18-44be-a09d-5ea82a9ba413 req-84d8b045-ca7f-41ee-ba6e-b9b14d8e0c94 service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] No waiting events found dispatching network-vif-plugged-aa0481c2-d383-47ac-aaca-8830e727b0fd {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:22:18 user nova-compute[71113]: WARNING nova.compute.manager [req-ef958ecf-5c18-44be-a09d-5ea82a9ba413 req-84d8b045-ca7f-41ee-ba6e-b9b14d8e0c94 service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Received unexpected event network-vif-plugged-aa0481c2-d383-47ac-aaca-8830e727b0fd for instance with vm_state active and task_state rescuing.
Jul 31 10:22:18 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:22:18 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:22:18 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:22:18 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:22:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:22:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:22:20 user nova-compute[71113]: DEBUG nova.compute.manager [req-cbc01428-7b64-4ae1-9e26-00ec0db387ab req-2891c8c1-00ce-4d3f-b3b1-b1c011c355d5 service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Received event network-vif-plugged-aa0481c2-d383-47ac-aaca-8830e727b0fd {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:22:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-cbc01428-7b64-4ae1-9e26-00ec0db387ab req-2891c8c1-00ce-4d3f-b3b1-b1c011c355d5 service nova] Acquiring lock "1ca22313-39ec-4366-abe0-fa40247dfa3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:22:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-cbc01428-7b64-4ae1-9e26-00ec0db387ab req-2891c8c1-00ce-4d3f-b3b1-b1c011c355d5 service nova] Lock "1ca22313-39ec-4366-abe0-fa40247dfa3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:22:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-cbc01428-7b64-4ae1-9e26-00ec0db387ab req-2891c8c1-00ce-4d3f-b3b1-b1c011c355d5 service nova] Lock "1ca22313-39ec-4366-abe0-fa40247dfa3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:22:20 user nova-compute[71113]: DEBUG nova.compute.manager [req-cbc01428-7b64-4ae1-9e26-00ec0db387ab req-2891c8c1-00ce-4d3f-b3b1-b1c011c355d5 service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] No waiting events found dispatching network-vif-plugged-aa0481c2-d383-47ac-aaca-8830e727b0fd {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:22:20 user nova-compute[71113]: WARNING nova.compute.manager [req-cbc01428-7b64-4ae1-9e26-00ec0db387ab req-2891c8c1-00ce-4d3f-b3b1-b1c011c355d5 service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Received unexpected event network-vif-plugged-aa0481c2-d383-47ac-aaca-8830e727b0fd for instance with vm_state active and task_state rescuing.
Jul 31 10:22:20 user nova-compute[71113]: DEBUG nova.compute.manager [req-cbc01428-7b64-4ae1-9e26-00ec0db387ab req-2891c8c1-00ce-4d3f-b3b1-b1c011c355d5 service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Received event network-vif-plugged-aa0481c2-d383-47ac-aaca-8830e727b0fd {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:22:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-cbc01428-7b64-4ae1-9e26-00ec0db387ab req-2891c8c1-00ce-4d3f-b3b1-b1c011c355d5 service nova] Acquiring lock "1ca22313-39ec-4366-abe0-fa40247dfa3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:22:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-cbc01428-7b64-4ae1-9e26-00ec0db387ab req-2891c8c1-00ce-4d3f-b3b1-b1c011c355d5 service nova] Lock "1ca22313-39ec-4366-abe0-fa40247dfa3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:22:20 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-cbc01428-7b64-4ae1-9e26-00ec0db387ab req-2891c8c1-00ce-4d3f-b3b1-b1c011c355d5 service nova] Lock "1ca22313-39ec-4366-abe0-fa40247dfa3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:22:20 user nova-compute[71113]: DEBUG nova.compute.manager [req-cbc01428-7b64-4ae1-9e26-00ec0db387ab req-2891c8c1-00ce-4d3f-b3b1-b1c011c355d5 service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] No waiting events found dispatching network-vif-plugged-aa0481c2-d383-47ac-aaca-8830e727b0fd {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:22:20 user nova-compute[71113]: WARNING nova.compute.manager [req-cbc01428-7b64-4ae1-9e26-00ec0db387ab req-2891c8c1-00ce-4d3f-b3b1-b1c011c355d5 service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Received unexpected event network-vif-plugged-aa0481c2-d383-47ac-aaca-8830e727b0fd for instance with vm_state active and task_state rescuing.
Jul 31 10:22:21 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Removed pending event for 1ca22313-39ec-4366-abe0-fa40247dfa3b due to event {{(pid=71113) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 31 10:22:21 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690798941.0306213, 1ca22313-39ec-4366-abe0-fa40247dfa3b => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:22:21 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] VM Resumed (Lifecycle Event)
Jul 31 10:22:21 user nova-compute[71113]: DEBUG nova.compute.manager [None req-264ea09b-beef-4958-a6dd-cdcb04038002 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:22:21 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:22:21 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:22:21 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 31 10:22:21 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690798941.0337372, 1ca22313-39ec-4366-abe0-fa40247dfa3b => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:22:21 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] VM Started (Lifecycle Event)
Jul 31 10:22:21 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:22:21 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:22:21 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 31 10:22:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:22:26 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:22:26 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:22:26 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:22:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:22:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:22:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:22:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:22:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:22:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:22:30 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:22:30 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:22:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "refresh_cache-b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:22:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquired lock "refresh_cache-b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:22:30 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Forcefully refreshing network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 10:22:31 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Updating instance_info_cache with network_info: [{"id": "900a119c-0bab-4d30-b9a9-83cdd3b5c7a2", "address": "fa:16:3e:47:cb:d2", "network": {"id": "e555f641-77a4-4097-b894-059fd7706d51", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-992856525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffc32f92126b46439c2be05fc24def8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap900a119c-0b", "ovs_interfaceid": "900a119c-0bab-4d30-b9a9-83cdd3b5c7a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:22:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Releasing lock "refresh_cache-b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:22:31 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Updated the network info_cache for instance {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 10:22:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:22:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:22:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:22:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:22:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:22:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:22:34 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:22:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:22:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:22:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:22:34 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:22:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:22:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue --force-share --output=json" returned: 0 in 0.153s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:22:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:22:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:22:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:22:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:22:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:22:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:22:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:22:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:22:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:22:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:22:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:22:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:22:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:22:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:22:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:22:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ca22313-39ec-4366-abe0-fa40247dfa3b/disk.rescue --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:22:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ca22313-39ec-4366-abe0-fa40247dfa3b/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:22:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ca22313-39ec-4366-abe0-fa40247dfa3b/disk.rescue --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:22:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ca22313-39ec-4366-abe0-fa40247dfa3b/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:22:36 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /opt/stack/data/nova/instances/1ca22313-39ec-4366-abe0-fa40247dfa3b/disk (vdb) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 10:22:36 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:22:36 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:22:36 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=8552MB free_disk=25.1722412109375GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:22:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:22:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:22:36 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:22:36 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 8129456b-a22c-46e3-b5db-89fdcec87dec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:22:36 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:22:36 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 1ca22313-39ec-4366-abe0-fa40247dfa3b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:22:36 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:22:36 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:22:37 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Refreshing inventories for resource provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 31 10:22:37 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Updating ProviderTree inventory for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 31 10:22:37 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Updating inventory in ProviderTree for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 31 10:22:37 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Refreshing aggregate associations for resource provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05, aggregates: None {{(pid=71113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 31 10:22:37 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Refreshing trait associations for resource provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE2,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS {{(pid=71113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 31 10:22:37 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:22:37 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:22:37 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:22:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.536s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:22:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:22:38 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:22:38 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:22:38 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:22:40 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:22:41 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:22:41 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:22:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:22:43 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:22:43 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Cleaning up deleted instances {{(pid=71113) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 31 10:22:43 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] There are 0 instances to clean {{(pid=71113) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 31 10:22:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:22:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:22:48 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:22:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:22:51 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:22:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:22:55 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:22:55 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71113) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 31 10:22:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:23:02 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:23:07 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:23:07 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:23:07 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:23:07 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:23:07 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:23:07 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:23:12 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:23:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-da349794-3fb5-40fd-8c89-351ecc7a1468 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Acquiring lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:23:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-da349794-3fb5-40fd-8c89-351ecc7a1468 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:23:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-da349794-3fb5-40fd-8c89-351ecc7a1468 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Acquiring lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:23:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-da349794-3fb5-40fd-8c89-351ecc7a1468 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:23:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-da349794-3fb5-40fd-8c89-351ecc7a1468 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:23:15 user nova-compute[71113]: INFO nova.compute.manager [None req-da349794-3fb5-40fd-8c89-351ecc7a1468 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Terminating instance
Jul 31 10:23:15 user nova-compute[71113]: DEBUG nova.compute.manager [None req-da349794-3fb5-40fd-8c89-351ecc7a1468 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Start destroying the instance on the hypervisor. {{(pid=71113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 10:23:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:23:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:23:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:23:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:23:15 user nova-compute[71113]: DEBUG nova.compute.manager [req-195c8cba-3927-4ddf-91c2-fb795a8eb774 req-c5ab50c4-b4c5-4480-85b5-393f7acb952d service nova] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Received event network-vif-unplugged-900a119c-0bab-4d30-b9a9-83cdd3b5c7a2 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:23:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-195c8cba-3927-4ddf-91c2-fb795a8eb774 req-c5ab50c4-b4c5-4480-85b5-393f7acb952d service nova] Acquiring lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:23:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-195c8cba-3927-4ddf-91c2-fb795a8eb774 req-c5ab50c4-b4c5-4480-85b5-393f7acb952d service nova] Lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:23:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-195c8cba-3927-4ddf-91c2-fb795a8eb774 req-c5ab50c4-b4c5-4480-85b5-393f7acb952d service nova] Lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:23:15 user nova-compute[71113]: DEBUG nova.compute.manager [req-195c8cba-3927-4ddf-91c2-fb795a8eb774 req-c5ab50c4-b4c5-4480-85b5-393f7acb952d service nova] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] No waiting events found dispatching network-vif-unplugged-900a119c-0bab-4d30-b9a9-83cdd3b5c7a2 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:23:15 user nova-compute[71113]: DEBUG nova.compute.manager [req-195c8cba-3927-4ddf-91c2-fb795a8eb774 req-c5ab50c4-b4c5-4480-85b5-393f7acb952d service nova] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Received event network-vif-unplugged-900a119c-0bab-4d30-b9a9-83cdd3b5c7a2 for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 10:23:15 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Instance destroyed successfully.
Jul 31 10:23:15 user nova-compute[71113]: DEBUG nova.objects.instance [None req-da349794-3fb5-40fd-8c89-351ecc7a1468 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lazy-loading 'resources' on Instance uuid b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:23:15 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-da349794-3fb5-40fd-8c89-351ecc7a1468 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:16:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-345230251',display_name='tempest-SnapshotDataIntegrityTests-server-345230251',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-345230251',id=47,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUcH5JUMTJlZmbMvXk4UVoSMt58yVHVNoxhzq1VQI8lzwQC4YzqAXfAPvmvXudMgWDguSe3pU65Mz0OH9FHPBt8lEZ0eztLC4VdBwSrHioYW3rsrThlsJ81fUPVdzQZcA==',key_name='tempest-keypair-1347244460',keypairs=<?>,launch_index=0,launched_at=2023-07-31T10:16:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ffc32f92126b46439c2be05fc24def8e',ramdisk_id='',reservation_id='r-8lawef5j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1481072249',owner_user_name='tempest-SnapshotDataIntegrityTests-1481072249-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T10:16:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='912dd0384f654cf1bc555a9b1643476f',uuid=b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "900a119c-0bab-4d30-b9a9-83cdd3b5c7a2", "address": "fa:16:3e:47:cb:d2", "network": {"id": "e555f641-77a4-4097-b894-059fd7706d51", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-992856525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffc32f92126b46439c2be05fc24def8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap900a119c-0b", "ovs_interfaceid": "900a119c-0bab-4d30-b9a9-83cdd3b5c7a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 10:23:15 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-da349794-3fb5-40fd-8c89-351ecc7a1468 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Converting VIF {"id": "900a119c-0bab-4d30-b9a9-83cdd3b5c7a2", "address": "fa:16:3e:47:cb:d2", "network": {"id": "e555f641-77a4-4097-b894-059fd7706d51", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-992856525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ffc32f92126b46439c2be05fc24def8e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap900a119c-0b", "ovs_interfaceid": "900a119c-0bab-4d30-b9a9-83cdd3b5c7a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:23:15 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-da349794-3fb5-40fd-8c89-351ecc7a1468 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:cb:d2,bridge_name='br-int',has_traffic_filtering=True,id=900a119c-0bab-4d30-b9a9-83cdd3b5c7a2,network=Network(e555f641-77a4-4097-b894-059fd7706d51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap900a119c-0b') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:23:15 user nova-compute[71113]: DEBUG os_vif [None req-da349794-3fb5-40fd-8c89-351ecc7a1468 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:cb:d2,bridge_name='br-int',has_traffic_filtering=True,id=900a119c-0bab-4d30-b9a9-83cdd3b5c7a2,network=Network(e555f641-77a4-4097-b894-059fd7706d51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap900a119c-0b') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 10:23:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:23:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap900a119c-0b, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:23:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:23:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:23:15 user nova-compute[71113]: INFO os_vif [None req-da349794-3fb5-40fd-8c89-351ecc7a1468 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:cb:d2,bridge_name='br-int',has_traffic_filtering=True,id=900a119c-0bab-4d30-b9a9-83cdd3b5c7a2,network=Network(e555f641-77a4-4097-b894-059fd7706d51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap900a119c-0b')
Jul 31 10:23:15 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-da349794-3fb5-40fd-8c89-351ecc7a1468 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Deleting instance files /opt/stack/data/nova/instances/b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb_del
Jul 31 10:23:15 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-da349794-3fb5-40fd-8c89-351ecc7a1468 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Deletion of /opt/stack/data/nova/instances/b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb_del complete
Jul 31 10:23:16 user nova-compute[71113]: INFO nova.compute.manager [None req-da349794-3fb5-40fd-8c89-351ecc7a1468 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Took 0.86 seconds to destroy the instance on the hypervisor.
Jul 31 10:23:16 user nova-compute[71113]: DEBUG oslo.service.loopingcall [None req-da349794-3fb5-40fd-8c89-351ecc7a1468 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71113) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 10:23:16 user nova-compute[71113]: DEBUG nova.compute.manager [-] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Deallocating network for instance {{(pid=71113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 10:23:16 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] deallocate_for_instance() {{(pid=71113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 10:23:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:23:16 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:23:17 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Took 1.00 seconds to deallocate network for instance.
Jul 31 10:23:17 user nova-compute[71113]: DEBUG nova.compute.manager [req-d96c84fc-23b6-4f2c-92b7-246f9a1b80f7 req-675faf1e-e93f-4b8c-b3b2-2019cda49226 service nova] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Received event network-vif-deleted-900a119c-0bab-4d30-b9a9-83cdd3b5c7a2 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:23:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-da349794-3fb5-40fd-8c89-351ecc7a1468 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:23:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-da349794-3fb5-40fd-8c89-351ecc7a1468 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:23:17 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-da349794-3fb5-40fd-8c89-351ecc7a1468 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:23:17 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-da349794-3fb5-40fd-8c89-351ecc7a1468 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:23:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-da349794-3fb5-40fd-8c89-351ecc7a1468 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.205s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:23:17 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-da349794-3fb5-40fd-8c89-351ecc7a1468 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Deleted allocations for instance b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb
Jul 31 10:23:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-da349794-3fb5-40fd-8c89-351ecc7a1468 tempest-SnapshotDataIntegrityTests-1481072249 tempest-SnapshotDataIntegrityTests-1481072249-project-member] Lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.267s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:23:17 user nova-compute[71113]: DEBUG nova.compute.manager [req-9ff2de82-d22c-47e5-8497-1530297c37ac req-675cce3d-c755-4579-b919-c7575ef2781e service nova] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Received event network-vif-plugged-900a119c-0bab-4d30-b9a9-83cdd3b5c7a2 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:23:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9ff2de82-d22c-47e5-8497-1530297c37ac req-675cce3d-c755-4579-b919-c7575ef2781e service nova] Acquiring lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:23:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9ff2de82-d22c-47e5-8497-1530297c37ac req-675cce3d-c755-4579-b919-c7575ef2781e service nova] Lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:23:17 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9ff2de82-d22c-47e5-8497-1530297c37ac req-675cce3d-c755-4579-b919-c7575ef2781e service nova] Lock "b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:23:17 user nova-compute[71113]: DEBUG nova.compute.manager [req-9ff2de82-d22c-47e5-8497-1530297c37ac req-675cce3d-c755-4579-b919-c7575ef2781e service nova] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] No waiting events found dispatching network-vif-plugged-900a119c-0bab-4d30-b9a9-83cdd3b5c7a2 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:23:17 user nova-compute[71113]: WARNING nova.compute.manager [req-9ff2de82-d22c-47e5-8497-1530297c37ac req-675cce3d-c755-4579-b919-c7575ef2781e service nova] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Received unexpected event network-vif-plugged-900a119c-0bab-4d30-b9a9-83cdd3b5c7a2 for instance with vm_state deleted and task_state None.
Jul 31 10:23:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:23:25 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:23:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:23:26 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:23:28 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:23:30 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:23:30 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:23:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "refresh_cache-1ca22313-39ec-4366-abe0-fa40247dfa3b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:23:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquired lock "refresh_cache-1ca22313-39ec-4366-abe0-fa40247dfa3b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:23:30 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Forcefully refreshing network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 10:23:30 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690798995.8973048, b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:23:30 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] VM Stopped (Lifecycle Event)
Jul 31 10:23:30 user nova-compute[71113]: DEBUG nova.compute.manager [None req-df662a6f-232b-4772-8ed6-f51e8726b4cb None None] [instance: b5bbad93-6e05-47d5-a6ff-dbd4e45ac7fb] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:23:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:23:31 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Updating instance_info_cache with network_info: [{"id": "aa0481c2-d383-47ac-aaca-8830e727b0fd", "address": "fa:16:3e:3a:ac:a2", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa0481c2-d3", "ovs_interfaceid": "aa0481c2-d383-47ac-aaca-8830e727b0fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:23:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Releasing lock "refresh_cache-1ca22313-39ec-4366-abe0-fa40247dfa3b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:23:31 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Updated the network info_cache for instance {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 10:23:33 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:23:33 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Triggering sync for uuid c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5 {{(pid=71113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 10:23:33 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Triggering sync for uuid 8129456b-a22c-46e3-b5db-89fdcec87dec {{(pid=71113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 10:23:33 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Triggering sync for uuid 1ca22313-39ec-4366-abe0-fa40247dfa3b {{(pid=71113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 10:23:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:23:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:23:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "8129456b-a22c-46e3-b5db-89fdcec87dec" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:23:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "8129456b-a22c-46e3-b5db-89fdcec87dec" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:23:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "1ca22313-39ec-4366-abe0-fa40247dfa3b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:23:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "1ca22313-39ec-4366-abe0-fa40247dfa3b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:23:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:23:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "8129456b-a22c-46e3-b5db-89fdcec87dec" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:23:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "1ca22313-39ec-4366-abe0-fa40247dfa3b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:23:35 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:23:35 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:23:35 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:23:35 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:23:35 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:23:35 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:23:35 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:23:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:23:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:23:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:23:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:23:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:23:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:23:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:23:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:23:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:23:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:23:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:23:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:23:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:23:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ca22313-39ec-4366-abe0-fa40247dfa3b/disk.rescue --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:23:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ca22313-39ec-4366-abe0-fa40247dfa3b/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:23:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ca22313-39ec-4366-abe0-fa40247dfa3b/disk.rescue --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:23:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ca22313-39ec-4366-abe0-fa40247dfa3b/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:23:37 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /opt/stack/data/nova/instances/1ca22313-39ec-4366-abe0-fa40247dfa3b/disk (vdb) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 10:23:37 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:23:37 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:23:37 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=8656MB free_disk=25.19903564453125GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:23:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:23:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:23:37 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:23:37 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 8129456b-a22c-46e3-b5db-89fdcec87dec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:23:37 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 1ca22313-39ec-4366-abe0-fa40247dfa3b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:23:37 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:23:37 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:23:37 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:23:37 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:23:37 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:23:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.266s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:23:40 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:23:41 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:23:41 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:23:42 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:23:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:23:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:23:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:23:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:23:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:23:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:23:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:23:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:24:00 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:24:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:24:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:24:07 user nova-compute[71113]: INFO nova.compute.manager [None req-15026b20-0a8a-44c5-9c65-73e6a17cde45 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Unrescuing
Jul 31 10:24:07 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-15026b20-0a8a-44c5-9c65-73e6a17cde45 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Acquiring lock "refresh_cache-1ca22313-39ec-4366-abe0-fa40247dfa3b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:24:07 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-15026b20-0a8a-44c5-9c65-73e6a17cde45 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Acquired lock "refresh_cache-1ca22313-39ec-4366-abe0-fa40247dfa3b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:24:07 user nova-compute[71113]: DEBUG nova.network.neutron [None req-15026b20-0a8a-44c5-9c65-73e6a17cde45 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 10:24:07 user nova-compute[71113]: DEBUG nova.network.neutron [None req-15026b20-0a8a-44c5-9c65-73e6a17cde45 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Updating instance_info_cache with network_info: [{"id": "aa0481c2-d383-47ac-aaca-8830e727b0fd", "address": "fa:16:3e:3a:ac:a2", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa0481c2-d3", "ovs_interfaceid": "aa0481c2-d383-47ac-aaca-8830e727b0fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:24:07 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-15026b20-0a8a-44c5-9c65-73e6a17cde45 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Releasing lock "refresh_cache-1ca22313-39ec-4366-abe0-fa40247dfa3b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:24:07 user nova-compute[71113]: DEBUG nova.objects.instance [None req-15026b20-0a8a-44c5-9c65-73e6a17cde45 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lazy-loading 'flavor' on Instance uuid 1ca22313-39ec-4366-abe0-fa40247dfa3b {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:24:07 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:24:07 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:24:08 user nova-compute[71113]: DEBUG nova.compute.manager [req-5dfbe8ed-3778-4a7a-87af-d43fbcc4d489 req-5616de56-0f25-4ebe-b451-c179884df95a service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Received event network-vif-unplugged-aa0481c2-d383-47ac-aaca-8830e727b0fd {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:24:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-5dfbe8ed-3778-4a7a-87af-d43fbcc4d489 req-5616de56-0f25-4ebe-b451-c179884df95a service nova] Acquiring lock "1ca22313-39ec-4366-abe0-fa40247dfa3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:24:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-5dfbe8ed-3778-4a7a-87af-d43fbcc4d489 req-5616de56-0f25-4ebe-b451-c179884df95a service nova] Lock "1ca22313-39ec-4366-abe0-fa40247dfa3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:24:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-5dfbe8ed-3778-4a7a-87af-d43fbcc4d489 req-5616de56-0f25-4ebe-b451-c179884df95a service nova] Lock "1ca22313-39ec-4366-abe0-fa40247dfa3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:24:08 user nova-compute[71113]: DEBUG nova.compute.manager [req-5dfbe8ed-3778-4a7a-87af-d43fbcc4d489 req-5616de56-0f25-4ebe-b451-c179884df95a service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] No waiting events found dispatching network-vif-unplugged-aa0481c2-d383-47ac-aaca-8830e727b0fd {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:24:08 user nova-compute[71113]: WARNING nova.compute.manager [req-5dfbe8ed-3778-4a7a-87af-d43fbcc4d489 req-5616de56-0f25-4ebe-b451-c179884df95a service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Received unexpected event network-vif-unplugged-aa0481c2-d383-47ac-aaca-8830e727b0fd for instance with vm_state rescued and task_state unrescuing.
Jul 31 10:24:08 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:24:08 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:24:08 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Instance destroyed successfully.
Jul 31 10:24:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:24:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:24:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:24:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:24:10 user nova-compute[71113]: DEBUG nova.compute.manager [req-559f189a-59e7-4a37-8d0f-68f67cc4de87 req-3507f173-ab5d-4242-a815-62a0ab35ceb2 service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Received event network-vif-plugged-aa0481c2-d383-47ac-aaca-8830e727b0fd {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:24:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-559f189a-59e7-4a37-8d0f-68f67cc4de87 req-3507f173-ab5d-4242-a815-62a0ab35ceb2 service nova] Acquiring lock "1ca22313-39ec-4366-abe0-fa40247dfa3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:24:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-559f189a-59e7-4a37-8d0f-68f67cc4de87 req-3507f173-ab5d-4242-a815-62a0ab35ceb2 service nova] Lock "1ca22313-39ec-4366-abe0-fa40247dfa3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:24:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-559f189a-59e7-4a37-8d0f-68f67cc4de87 req-3507f173-ab5d-4242-a815-62a0ab35ceb2 service nova] Lock "1ca22313-39ec-4366-abe0-fa40247dfa3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:24:10 user nova-compute[71113]: DEBUG nova.compute.manager [req-559f189a-59e7-4a37-8d0f-68f67cc4de87 req-3507f173-ab5d-4242-a815-62a0ab35ceb2 service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] No waiting events found dispatching network-vif-plugged-aa0481c2-d383-47ac-aaca-8830e727b0fd {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:24:10 user nova-compute[71113]: WARNING nova.compute.manager [req-559f189a-59e7-4a37-8d0f-68f67cc4de87 req-3507f173-ab5d-4242-a815-62a0ab35ceb2 service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Received unexpected event network-vif-plugged-aa0481c2-d383-47ac-aaca-8830e727b0fd for instance with vm_state rescued and task_state unrescuing.
Jul 31 10:24:10 user nova-compute[71113]: DEBUG nova.compute.manager [req-559f189a-59e7-4a37-8d0f-68f67cc4de87 req-3507f173-ab5d-4242-a815-62a0ab35ceb2 service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Received event network-vif-plugged-aa0481c2-d383-47ac-aaca-8830e727b0fd {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:24:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-559f189a-59e7-4a37-8d0f-68f67cc4de87 req-3507f173-ab5d-4242-a815-62a0ab35ceb2 service nova] Acquiring lock "1ca22313-39ec-4366-abe0-fa40247dfa3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:24:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-559f189a-59e7-4a37-8d0f-68f67cc4de87 req-3507f173-ab5d-4242-a815-62a0ab35ceb2 service nova] Lock "1ca22313-39ec-4366-abe0-fa40247dfa3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:24:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-559f189a-59e7-4a37-8d0f-68f67cc4de87 req-3507f173-ab5d-4242-a815-62a0ab35ceb2 service nova] Lock "1ca22313-39ec-4366-abe0-fa40247dfa3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:24:10 user nova-compute[71113]: DEBUG nova.compute.manager [req-559f189a-59e7-4a37-8d0f-68f67cc4de87 req-3507f173-ab5d-4242-a815-62a0ab35ceb2 service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] No waiting events found dispatching network-vif-plugged-aa0481c2-d383-47ac-aaca-8830e727b0fd {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:24:10 user nova-compute[71113]: WARNING nova.compute.manager [req-559f189a-59e7-4a37-8d0f-68f67cc4de87 req-3507f173-ab5d-4242-a815-62a0ab35ceb2 service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Received unexpected event network-vif-plugged-aa0481c2-d383-47ac-aaca-8830e727b0fd for instance with vm_state rescued and task_state unrescuing.
Jul 31 10:24:10 user nova-compute[71113]: DEBUG nova.compute.manager [req-559f189a-59e7-4a37-8d0f-68f67cc4de87 req-3507f173-ab5d-4242-a815-62a0ab35ceb2 service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Received event network-vif-plugged-aa0481c2-d383-47ac-aaca-8830e727b0fd {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:24:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-559f189a-59e7-4a37-8d0f-68f67cc4de87 req-3507f173-ab5d-4242-a815-62a0ab35ceb2 service nova] Acquiring lock "1ca22313-39ec-4366-abe0-fa40247dfa3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:24:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-559f189a-59e7-4a37-8d0f-68f67cc4de87 req-3507f173-ab5d-4242-a815-62a0ab35ceb2 service nova] Lock "1ca22313-39ec-4366-abe0-fa40247dfa3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:24:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-559f189a-59e7-4a37-8d0f-68f67cc4de87 req-3507f173-ab5d-4242-a815-62a0ab35ceb2 service nova] Lock "1ca22313-39ec-4366-abe0-fa40247dfa3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:24:10 user nova-compute[71113]: DEBUG nova.compute.manager [req-559f189a-59e7-4a37-8d0f-68f67cc4de87 req-3507f173-ab5d-4242-a815-62a0ab35ceb2 service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] No waiting events found dispatching network-vif-plugged-aa0481c2-d383-47ac-aaca-8830e727b0fd {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:24:10 user nova-compute[71113]: WARNING nova.compute.manager [req-559f189a-59e7-4a37-8d0f-68f67cc4de87 req-3507f173-ab5d-4242-a815-62a0ab35ceb2 service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Received unexpected event network-vif-plugged-aa0481c2-d383-47ac-aaca-8830e727b0fd for instance with vm_state rescued and task_state unrescuing.
Jul 31 10:24:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:24:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:24:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:24:11 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Removed pending event for 1ca22313-39ec-4366-abe0-fa40247dfa3b due to event {{(pid=71113) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 31 10:24:11 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690799051.875081, 1ca22313-39ec-4366-abe0-fa40247dfa3b => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:24:11 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] VM Resumed (Lifecycle Event)
Jul 31 10:24:11 user nova-compute[71113]: DEBUG nova.compute.manager [None req-15026b20-0a8a-44c5-9c65-73e6a17cde45 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:24:11 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:24:11 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:24:11 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 31 10:24:11 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690799051.8756676, 1ca22313-39ec-4366-abe0-fa40247dfa3b => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:24:11 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] VM Started (Lifecycle Event)
Jul 31 10:24:11 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:24:11 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:24:13 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:24:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:24:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:24:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:24:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:24:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:24:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:24:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:24:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:24:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:24:26 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:24:26 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:24:28 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:24:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:24:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:24:31 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:24:31 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:24:31 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Rebuilding the list of instances to heal {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 10:24:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "refresh_cache-c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:24:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquired lock "refresh_cache-c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:24:31 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Forcefully refreshing network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 10:24:31 user nova-compute[71113]: DEBUG nova.objects.instance [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lazy-loading 'info_cache' on Instance uuid c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:24:32 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Updating instance_info_cache with network_info: [{"id": "85692854-658a-459b-9ab0-f448a6bf83f2", "address": "fa:16:3e:2b:2c:47", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85692854-65", "ovs_interfaceid": "85692854-658a-459b-9ab0-f448a6bf83f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:24:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Releasing lock "refresh_cache-c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:24:32 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Updated the network info_cache for instance {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 10:24:35 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:24:35 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:24:35 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:24:35 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:24:35 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:24:35 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:24:35 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:24:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:24:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:24:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:24:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:24:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:24:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:24:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:24:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:24:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:24:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:24:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:24:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:24:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:24:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:24:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ca22313-39ec-4366-abe0-fa40247dfa3b/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:24:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ca22313-39ec-4366-abe0-fa40247dfa3b/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:24:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ca22313-39ec-4366-abe0-fa40247dfa3b/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:24:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ca22313-39ec-4366-abe0-fa40247dfa3b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:24:37 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 10:24:37 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:24:37 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:24:37 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=8691MB free_disk=25.189197540283203GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:24:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:24:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:24:37 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:24:37 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 8129456b-a22c-46e3-b5db-89fdcec87dec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:24:37 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 1ca22313-39ec-4366-abe0-fa40247dfa3b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:24:37 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:24:37 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:24:37 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:24:37 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:24:37 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:24:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.243s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:24:40 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:24:40 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:24:42 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:24:42 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:24:44 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:24:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:24:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:24:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:24:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:24:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:24:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:24:48 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:24:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:24:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:24:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:24:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:24:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:24:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:24:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:25:00 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:25:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:25:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:25:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:25:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:25:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:25:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:25:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:25:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:25:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:25:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:25:26 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:25:26 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:25:28 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:25:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:25:32 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:25:32 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:25:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "refresh_cache-8129456b-a22c-46e3-b5db-89fdcec87dec" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:25:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquired lock "refresh_cache-8129456b-a22c-46e3-b5db-89fdcec87dec" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:25:32 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Forcefully refreshing network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 10:25:33 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Updating instance_info_cache with network_info: [{"id": "1a2da0f9-2fb6-4880-96b5-be8dd9d12574", "address": "fa:16:3e:fe:2b:04", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a2da0f9-2f", "ovs_interfaceid": "1a2da0f9-2fb6-4880-96b5-be8dd9d12574", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:25:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Releasing lock "refresh_cache-8129456b-a22c-46e3-b5db-89fdcec87dec" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:25:33 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Updated the network info_cache for instance {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 10:25:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:25:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:25:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:25:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:25:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:25:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:25:36 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:25:36 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:25:36 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:25:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:25:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:25:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:25:36 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:25:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:25:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:25:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:25:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:25:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:25:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:25:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:25:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:25:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:25:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:25:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:25:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:25:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ca22313-39ec-4366-abe0-fa40247dfa3b/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:25:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ca22313-39ec-4366-abe0-fa40247dfa3b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:25:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ca22313-39ec-4366-abe0-fa40247dfa3b/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:25:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ca22313-39ec-4366-abe0-fa40247dfa3b/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:25:38 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 10:25:38 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:25:38 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:25:38 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=8736MB free_disk=25.1885986328125GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:25:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:25:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:25:38 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:25:38 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 8129456b-a22c-46e3-b5db-89fdcec87dec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:25:38 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 1ca22313-39ec-4366-abe0-fa40247dfa3b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:25:38 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:25:38 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:25:38 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:25:38 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:25:38 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:25:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.225s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:25:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:25:42 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:25:42 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:25:45 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:25:46 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:25:51 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:25:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:25:59 user nova-compute[71113]: DEBUG nova.compute.manager [req-20982e36-4f84-40d4-9e14-71765535fcdd req-11fed360-6364-4538-a0d7-1012f3996b2f service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Received event network-changed-aa0481c2-d383-47ac-aaca-8830e727b0fd {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:25:59 user nova-compute[71113]: DEBUG nova.compute.manager [req-20982e36-4f84-40d4-9e14-71765535fcdd req-11fed360-6364-4538-a0d7-1012f3996b2f service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Refreshing instance network info cache due to event network-changed-aa0481c2-d383-47ac-aaca-8830e727b0fd. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 10:25:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-20982e36-4f84-40d4-9e14-71765535fcdd req-11fed360-6364-4538-a0d7-1012f3996b2f service nova] Acquiring lock "refresh_cache-1ca22313-39ec-4366-abe0-fa40247dfa3b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:25:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-20982e36-4f84-40d4-9e14-71765535fcdd req-11fed360-6364-4538-a0d7-1012f3996b2f service nova] Acquired lock "refresh_cache-1ca22313-39ec-4366-abe0-fa40247dfa3b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:25:59 user nova-compute[71113]: DEBUG nova.network.neutron [req-20982e36-4f84-40d4-9e14-71765535fcdd req-11fed360-6364-4538-a0d7-1012f3996b2f service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Refreshing network info cache for port aa0481c2-d383-47ac-aaca-8830e727b0fd {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 10:26:00 user nova-compute[71113]: DEBUG nova.network.neutron [req-20982e36-4f84-40d4-9e14-71765535fcdd req-11fed360-6364-4538-a0d7-1012f3996b2f service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Updated VIF entry in instance network info cache for port aa0481c2-d383-47ac-aaca-8830e727b0fd. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 10:26:00 user nova-compute[71113]: DEBUG nova.network.neutron [req-20982e36-4f84-40d4-9e14-71765535fcdd req-11fed360-6364-4538-a0d7-1012f3996b2f service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Updating instance_info_cache with network_info: [{"id": "aa0481c2-d383-47ac-aaca-8830e727b0fd", "address": "fa:16:3e:3a:ac:a2", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa0481c2-d3", "ovs_interfaceid": "aa0481c2-d383-47ac-aaca-8830e727b0fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:26:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-20982e36-4f84-40d4-9e14-71765535fcdd req-11fed360-6364-4538-a0d7-1012f3996b2f service nova] Releasing lock "refresh_cache-1ca22313-39ec-4366-abe0-fa40247dfa3b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:26:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-66371289-ff38-4d14-904c-c1fa9fd7e44b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Acquiring lock "1ca22313-39ec-4366-abe0-fa40247dfa3b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:26:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-66371289-ff38-4d14-904c-c1fa9fd7e44b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "1ca22313-39ec-4366-abe0-fa40247dfa3b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:26:00 user nova-compute[71113]: INFO nova.compute.manager [None req-66371289-ff38-4d14-904c-c1fa9fd7e44b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Detaching volume 26c5c180-7cb3-432b-99e9-09b9dfb10601
Jul 31 10:26:00 user nova-compute[71113]: INFO nova.virt.block_device [None req-66371289-ff38-4d14-904c-c1fa9fd7e44b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Attempting to driver detach volume 26c5c180-7cb3-432b-99e9-09b9dfb10601 from mountpoint /dev/vdb
Jul 31 10:26:00 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-66371289-ff38-4d14-904c-c1fa9fd7e44b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Attempting to detach device vdb from instance 1ca22313-39ec-4366-abe0-fa40247dfa3b from the persistent domain config. {{(pid=71113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 10:26:00 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-66371289-ff38-4d14-904c-c1fa9fd7e44b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 10:26:00 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:26:00 user nova-compute[71113]:   <source dev="/dev/sdb"/>
Jul 31 10:26:00 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 10:26:00 user nova-compute[71113]:   <serial>26c5c180-7cb3-432b-99e9-09b9dfb10601</serial>
Jul 31 10:26:00 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 10:26:00 user nova-compute[71113]: </disk>
Jul 31 10:26:00 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 10:26:00 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-66371289-ff38-4d14-904c-c1fa9fd7e44b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Successfully detached device vdb from instance 1ca22313-39ec-4366-abe0-fa40247dfa3b from the persistent domain config.
Jul 31 10:26:00 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-66371289-ff38-4d14-904c-c1fa9fd7e44b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1ca22313-39ec-4366-abe0-fa40247dfa3b from the live domain config. {{(pid=71113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 10:26:00 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-66371289-ff38-4d14-904c-c1fa9fd7e44b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 10:26:00 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:26:00 user nova-compute[71113]:   <source dev="/dev/sdb"/>
Jul 31 10:26:00 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 10:26:00 user nova-compute[71113]:   <serial>26c5c180-7cb3-432b-99e9-09b9dfb10601</serial>
Jul 31 10:26:00 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 10:26:00 user nova-compute[71113]: </disk>
Jul 31 10:26:00 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 10:26:00 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Received event <DeviceRemovedEvent: 1690799160.6559107, 1ca22313-39ec-4366-abe0-fa40247dfa3b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71113) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 10:26:00 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-66371289-ff38-4d14-904c-c1fa9fd7e44b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1ca22313-39ec-4366-abe0-fa40247dfa3b {{(pid=71113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 10:26:00 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-66371289-ff38-4d14-904c-c1fa9fd7e44b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Successfully detached device vdb from instance 1ca22313-39ec-4366-abe0-fa40247dfa3b from the live domain config.
Jul 31 10:26:00 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66371289-ff38-4d14-904c-c1fa9fd7e44b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 10:26:00 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-66371289-ff38-4d14-904c-c1fa9fd7e44b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:26c5c180-7cb3-432b-99e9-09b9dfb10601'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zoJAltyX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:26:00 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-66371289-ff38-4d14-904c-c1fa9fd7e44b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:26:00 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-66371289-ff38-4d14-904c-c1fa9fd7e44b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:26:00 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-66371289-ff38-4d14-904c-c1fa9fd7e44b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:26:00 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-66371289-ff38-4d14-904c-c1fa9fd7e44b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26c5c180-7cb3-432b-99e9-09b9dfb10601', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 10:26:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:26:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:26:00 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b754fdc-2459-4a3f-82a7-f4897b4eff7a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26c5c180-7cb3-432b-99e9-09b9dfb10601\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:26:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:26:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:26:00 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4966cd3-a9f0-41ff-acf5-80fc0314f380]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c5c180-7cb3-432b-99e9-09b9dfb10601 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:26:00 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-66371289-ff38-4d14-904c-c1fa9fd7e44b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c5c180-7cb3-432b-99e9-09b9dfb10601 (non-flash)
Jul 31 10:26:00 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:26:00 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-66371289-ff38-4d14-904c-c1fa9fd7e44b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26c5c180-7cb3-432b-99e9-09b9dfb10601 (non-flash)
Jul 31 10:26:00 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:26:00 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-66371289-ff38-4d14-904c-c1fa9fd7e44b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f78cc72e4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26c5c180-7cb3-432b-99e9-09b9dfb10601'): ({'sdb'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 10:26:00 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-66371289-ff38-4d14-904c-c1fa9fd7e44b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Removing single pathed devices sdb {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 10:26:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:26:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:26:00 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ee9af0-8ab3-466a-a3d2-84582acb0bb3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:26:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:26:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:26:00 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b64e31c-8c58-48ff-afa2-69b205940586]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:26:00 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-66371289-ff38-4d14-904c-c1fa9fd7e44b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Flushing IO for device /dev/sdb {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 10:26:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:26:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:26:00 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f172145d-24f4-488d-a496-1ce3a950b5bd]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:26:00 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-66371289-ff38-4d14-904c-c1fa9fd7e44b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 10:26:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:26:00 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:26:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:26:00 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef6216a-25f6-4c09-9a37-da0f9bbcc655]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:26:00 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-66371289-ff38-4d14-904c-c1fa9fd7e44b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 10:26:00 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-66371289-ff38-4d14-904c-c1fa9fd7e44b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] SCSI volumes sdb have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 10:26:00 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-66371289-ff38-4d14-904c-c1fa9fd7e44b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26c5c180-7cb3-432b-99e9-09b9dfb10601')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 10:26:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c5c180-7cb3-432b-99e9-09b9dfb10601 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:26:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c5c180-7cb3-432b-99e9-09b9dfb10601 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:26:00 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54165f9-f100-43a3-87cf-eecbac8deb14]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:26:00 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-66371289-ff38-4d14-904c-c1fa9fd7e44b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:26:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c5c180-7cb3-432b-99e9-09b9dfb10601 -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:26:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c5c180-7cb3-432b-99e9-09b9dfb10601 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:26:00 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24c0e62-e00d-4566-a8f9-137d10f8c878]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:26c5c180-7cb3-432b-99e9-09b9dfb10601, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:26c5c180-7cb3-432b-99e9-09b9dfb10601, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:26:00 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-66371289-ff38-4d14-904c-c1fa9fd7e44b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:26c5c180-7cb3-432b-99e9-09b9dfb10601, portal: 172.16.0.220,3260]
Jul 31 10:26:00 user nova-compute[71113]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:26c5c180-7cb3-432b-99e9-09b9dfb10601, portal: 172.16.0.220,3260] successful.
Jul 31 10:26:00 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:26:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26c5c180-7cb3-432b-99e9-09b9dfb10601 -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:26:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26c5c180-7cb3-432b-99e9-09b9dfb10601 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:26:00 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c46de4-6f0f-428c-9a86-f01e60e258bb]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:26:00 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-66371289-ff38-4d14-904c-c1fa9fd7e44b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:26:00 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-66371289-ff38-4d14-904c-c1fa9fd7e44b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.258s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:26:00 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-66371289-ff38-4d14-904c-c1fa9fd7e44b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] <== disconnect_volume: return (259ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:26:00 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66371289-ff38-4d14-904c-c1fa9fd7e44b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 10:26:01 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:26:01 user nova-compute[71113]: DEBUG nova.compute.manager [req-e4eaf669-5a48-437d-a785-df64d7cf2362 req-2171eb0f-aad9-4f85-b92b-18eb67696bd3 service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Received event network-changed-aa0481c2-d383-47ac-aaca-8830e727b0fd {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:26:01 user nova-compute[71113]: DEBUG nova.compute.manager [req-e4eaf669-5a48-437d-a785-df64d7cf2362 req-2171eb0f-aad9-4f85-b92b-18eb67696bd3 service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Refreshing instance network info cache due to event network-changed-aa0481c2-d383-47ac-aaca-8830e727b0fd. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 10:26:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e4eaf669-5a48-437d-a785-df64d7cf2362 req-2171eb0f-aad9-4f85-b92b-18eb67696bd3 service nova] Acquiring lock "refresh_cache-1ca22313-39ec-4366-abe0-fa40247dfa3b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:26:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e4eaf669-5a48-437d-a785-df64d7cf2362 req-2171eb0f-aad9-4f85-b92b-18eb67696bd3 service nova] Acquired lock "refresh_cache-1ca22313-39ec-4366-abe0-fa40247dfa3b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:26:01 user nova-compute[71113]: DEBUG nova.network.neutron [req-e4eaf669-5a48-437d-a785-df64d7cf2362 req-2171eb0f-aad9-4f85-b92b-18eb67696bd3 service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Refreshing network info cache for port aa0481c2-d383-47ac-aaca-8830e727b0fd {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 10:26:01 user nova-compute[71113]: DEBUG nova.objects.instance [None req-66371289-ff38-4d14-904c-c1fa9fd7e44b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lazy-loading 'flavor' on Instance uuid 1ca22313-39ec-4366-abe0-fa40247dfa3b {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:26:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-66371289-ff38-4d14-904c-c1fa9fd7e44b tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "1ca22313-39ec-4366-abe0-fa40247dfa3b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.641s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:26:02 user nova-compute[71113]: DEBUG nova.network.neutron [req-e4eaf669-5a48-437d-a785-df64d7cf2362 req-2171eb0f-aad9-4f85-b92b-18eb67696bd3 service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Updated VIF entry in instance network info cache for port aa0481c2-d383-47ac-aaca-8830e727b0fd. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 10:26:02 user nova-compute[71113]: DEBUG nova.network.neutron [req-e4eaf669-5a48-437d-a785-df64d7cf2362 req-2171eb0f-aad9-4f85-b92b-18eb67696bd3 service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Updating instance_info_cache with network_info: [{"id": "aa0481c2-d383-47ac-aaca-8830e727b0fd", "address": "fa:16:3e:3a:ac:a2", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa0481c2-d3", "ovs_interfaceid": "aa0481c2-d383-47ac-aaca-8830e727b0fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:26:02 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e4eaf669-5a48-437d-a785-df64d7cf2362 req-2171eb0f-aad9-4f85-b92b-18eb67696bd3 service nova] Releasing lock "refresh_cache-1ca22313-39ec-4366-abe0-fa40247dfa3b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:26:06 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:26:06 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:26:06 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:26:06 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:26:06 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:26:06 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:26:11 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:26:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:26:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:26:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:26:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:26:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:26:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:26:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:26:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:26:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:26:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:26:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:26:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:26:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:26:26 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:26:28 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:26:28 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:26:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:26:34 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:26:34 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:26:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "refresh_cache-1ca22313-39ec-4366-abe0-fa40247dfa3b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:26:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquired lock "refresh_cache-1ca22313-39ec-4366-abe0-fa40247dfa3b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:26:34 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Forcefully refreshing network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 10:26:35 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Updating instance_info_cache with network_info: [{"id": "aa0481c2-d383-47ac-aaca-8830e727b0fd", "address": "fa:16:3e:3a:ac:a2", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa0481c2-d3", "ovs_interfaceid": "aa0481c2-d383-47ac-aaca-8830e727b0fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:26:35 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Releasing lock "refresh_cache-1ca22313-39ec-4366-abe0-fa40247dfa3b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:26:35 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Updated the network info_cache for instance {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 10:26:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:26:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:26:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:26:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:26:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:26:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:26:37 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:26:37 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:26:38 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:26:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:26:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:26:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:26:38 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:26:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:26:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:26:38 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:26:39 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:26:39 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:26:39 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:26:39 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:26:39 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:26:39 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:26:39 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:26:39 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:26:39 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:26:39 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ca22313-39ec-4366-abe0-fa40247dfa3b/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:26:39 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ca22313-39ec-4366-abe0-fa40247dfa3b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:26:39 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ca22313-39ec-4366-abe0-fa40247dfa3b/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:26:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ca22313-39ec-4366-abe0-fa40247dfa3b/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:26:40 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:26:40 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:26:40 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=8733MB free_disk=25.18783187866211GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:26:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:26:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:26:40 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:26:40 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 8129456b-a22c-46e3-b5db-89fdcec87dec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:26:40 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 1ca22313-39ec-4366-abe0-fa40247dfa3b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:26:40 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:26:40 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:26:40 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:26:40 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:26:40 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:26:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.251s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:26:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:26:44 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:26:44 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:26:46 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:26:47 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:26:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-4ac49a34-6b64-4da6-805f-bacd9b7d10af tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Acquiring lock "1ca22313-39ec-4366-abe0-fa40247dfa3b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:26:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-4ac49a34-6b64-4da6-805f-bacd9b7d10af tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "1ca22313-39ec-4366-abe0-fa40247dfa3b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:26:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-4ac49a34-6b64-4da6-805f-bacd9b7d10af tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Acquiring lock "1ca22313-39ec-4366-abe0-fa40247dfa3b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:26:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-4ac49a34-6b64-4da6-805f-bacd9b7d10af tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "1ca22313-39ec-4366-abe0-fa40247dfa3b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:26:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-4ac49a34-6b64-4da6-805f-bacd9b7d10af tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "1ca22313-39ec-4366-abe0-fa40247dfa3b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:26:50 user nova-compute[71113]: INFO nova.compute.manager [None req-4ac49a34-6b64-4da6-805f-bacd9b7d10af tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Terminating instance
Jul 31 10:26:50 user nova-compute[71113]: DEBUG nova.compute.manager [None req-4ac49a34-6b64-4da6-805f-bacd9b7d10af tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Start destroying the instance on the hypervisor. {{(pid=71113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 10:26:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:26:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:26:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:26:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:26:50 user nova-compute[71113]: DEBUG nova.compute.manager [req-f742d9f1-023c-4943-ba01-5ae617502cb9 req-d8282c12-db2c-4fba-a100-47dad90f44a1 service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Received event network-vif-unplugged-aa0481c2-d383-47ac-aaca-8830e727b0fd {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:26:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f742d9f1-023c-4943-ba01-5ae617502cb9 req-d8282c12-db2c-4fba-a100-47dad90f44a1 service nova] Acquiring lock "1ca22313-39ec-4366-abe0-fa40247dfa3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:26:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f742d9f1-023c-4943-ba01-5ae617502cb9 req-d8282c12-db2c-4fba-a100-47dad90f44a1 service nova] Lock "1ca22313-39ec-4366-abe0-fa40247dfa3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:26:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f742d9f1-023c-4943-ba01-5ae617502cb9 req-d8282c12-db2c-4fba-a100-47dad90f44a1 service nova] Lock "1ca22313-39ec-4366-abe0-fa40247dfa3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:26:50 user nova-compute[71113]: DEBUG nova.compute.manager [req-f742d9f1-023c-4943-ba01-5ae617502cb9 req-d8282c12-db2c-4fba-a100-47dad90f44a1 service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] No waiting events found dispatching network-vif-unplugged-aa0481c2-d383-47ac-aaca-8830e727b0fd {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:26:50 user nova-compute[71113]: DEBUG nova.compute.manager [req-f742d9f1-023c-4943-ba01-5ae617502cb9 req-d8282c12-db2c-4fba-a100-47dad90f44a1 service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Received event network-vif-unplugged-aa0481c2-d383-47ac-aaca-8830e727b0fd for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 10:26:51 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:26:51 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:26:51 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:26:51 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:26:51 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:26:51 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Instance destroyed successfully.
Jul 31 10:26:51 user nova-compute[71113]: DEBUG nova.objects.instance [None req-4ac49a34-6b64-4da6-805f-bacd9b7d10af tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lazy-loading 'resources' on Instance uuid 1ca22313-39ec-4366-abe0-fa40247dfa3b {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:26:51 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:26:51 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-4ac49a34-6b64-4da6-805f-bacd9b7d10af tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:20:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1923872530',display_name='tempest-ServerRescueNegativeTestJSON-server-1923872530',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1923872530',id=48,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJYvScQMfs8bEpk0VjLb5yaNQU2cjc57kgHjVsVxKMOMYpMVc3RLCFV+tPuzRX2ZCcaPda03wbVcYWV0e22ylplzcU7e9BPDTnYIfC1NUaS2h4na+MPEQwy55tUq3ZGyHQ==',key_name='tempest-keypair-592677638',keypairs=<?>,launch_index=0,launched_at=2023-07-31T10:22:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='938c4f5af8a347cf9d700c8cdb5df356',ramdisk_id='',reservation_id='r-jy0mnt32',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-549904406',owner_user_name='tempest-ServerRescueNegativeTestJSON-549904406-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T10:24:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6023b7c67c0941d3975fa9c25140684f',uuid=1ca22313-39ec-4366-abe0-fa40247dfa3b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aa0481c2-d383-47ac-aaca-8830e727b0fd", "address": "fa:16:3e:3a:ac:a2", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa0481c2-d3", "ovs_interfaceid": "aa0481c2-d383-47ac-aaca-8830e727b0fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 10:26:51 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-4ac49a34-6b64-4da6-805f-bacd9b7d10af tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Converting VIF {"id": "aa0481c2-d383-47ac-aaca-8830e727b0fd", "address": "fa:16:3e:3a:ac:a2", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa0481c2-d3", "ovs_interfaceid": "aa0481c2-d383-47ac-aaca-8830e727b0fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:26:51 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-4ac49a34-6b64-4da6-805f-bacd9b7d10af tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:ac:a2,bridge_name='br-int',has_traffic_filtering=True,id=aa0481c2-d383-47ac-aaca-8830e727b0fd,network=Network(328e0f8b-5788-457c-afc6-7fe314ca8b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa0481c2-d3') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:26:51 user nova-compute[71113]: DEBUG os_vif [None req-4ac49a34-6b64-4da6-805f-bacd9b7d10af tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:ac:a2,bridge_name='br-int',has_traffic_filtering=True,id=aa0481c2-d383-47ac-aaca-8830e727b0fd,network=Network(328e0f8b-5788-457c-afc6-7fe314ca8b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa0481c2-d3') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 10:26:51 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:26:51 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaa0481c2-d3, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:26:51 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:26:51 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:26:51 user nova-compute[71113]: INFO os_vif [None req-4ac49a34-6b64-4da6-805f-bacd9b7d10af tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:ac:a2,bridge_name='br-int',has_traffic_filtering=True,id=aa0481c2-d383-47ac-aaca-8830e727b0fd,network=Network(328e0f8b-5788-457c-afc6-7fe314ca8b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa0481c2-d3')
Jul 31 10:26:51 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-4ac49a34-6b64-4da6-805f-bacd9b7d10af tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Deleting instance files /opt/stack/data/nova/instances/1ca22313-39ec-4366-abe0-fa40247dfa3b_del
Jul 31 10:26:51 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-4ac49a34-6b64-4da6-805f-bacd9b7d10af tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Deletion of /opt/stack/data/nova/instances/1ca22313-39ec-4366-abe0-fa40247dfa3b_del complete
Jul 31 10:26:51 user nova-compute[71113]: INFO nova.compute.manager [None req-4ac49a34-6b64-4da6-805f-bacd9b7d10af tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Took 0.86 seconds to destroy the instance on the hypervisor.
Jul 31 10:26:51 user nova-compute[71113]: DEBUG oslo.service.loopingcall [None req-4ac49a34-6b64-4da6-805f-bacd9b7d10af tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71113) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 10:26:51 user nova-compute[71113]: DEBUG nova.compute.manager [-] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Deallocating network for instance {{(pid=71113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 10:26:51 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] deallocate_for_instance() {{(pid=71113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 10:26:51 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:26:51 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:26:51 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:26:51 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:26:52 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:26:52 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Took 1.04 seconds to deallocate network for instance.
Jul 31 10:26:52 user nova-compute[71113]: DEBUG nova.compute.manager [req-06f6d206-6223-44df-9b9c-f58efd338421 req-e9cc1e47-fb2a-408d-a880-b73127b3c037 service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Received event network-vif-deleted-aa0481c2-d383-47ac-aaca-8830e727b0fd {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:26:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-4ac49a34-6b64-4da6-805f-bacd9b7d10af tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:26:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-4ac49a34-6b64-4da6-805f-bacd9b7d10af tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:26:52 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-4ac49a34-6b64-4da6-805f-bacd9b7d10af tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:26:52 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-4ac49a34-6b64-4da6-805f-bacd9b7d10af tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:26:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-4ac49a34-6b64-4da6-805f-bacd9b7d10af tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.178s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:26:52 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-4ac49a34-6b64-4da6-805f-bacd9b7d10af tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Deleted allocations for instance 1ca22313-39ec-4366-abe0-fa40247dfa3b
Jul 31 10:26:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-4ac49a34-6b64-4da6-805f-bacd9b7d10af tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "1ca22313-39ec-4366-abe0-fa40247dfa3b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.280s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:26:52 user nova-compute[71113]: DEBUG nova.compute.manager [req-f0d3d22a-b01c-4bae-9a80-32d1d738e09a req-263cc653-b5a2-4b81-a5ce-6949dda121ea service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Received event network-vif-plugged-aa0481c2-d383-47ac-aaca-8830e727b0fd {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:26:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f0d3d22a-b01c-4bae-9a80-32d1d738e09a req-263cc653-b5a2-4b81-a5ce-6949dda121ea service nova] Acquiring lock "1ca22313-39ec-4366-abe0-fa40247dfa3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:26:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f0d3d22a-b01c-4bae-9a80-32d1d738e09a req-263cc653-b5a2-4b81-a5ce-6949dda121ea service nova] Lock "1ca22313-39ec-4366-abe0-fa40247dfa3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:26:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f0d3d22a-b01c-4bae-9a80-32d1d738e09a req-263cc653-b5a2-4b81-a5ce-6949dda121ea service nova] Lock "1ca22313-39ec-4366-abe0-fa40247dfa3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:26:52 user nova-compute[71113]: DEBUG nova.compute.manager [req-f0d3d22a-b01c-4bae-9a80-32d1d738e09a req-263cc653-b5a2-4b81-a5ce-6949dda121ea service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] No waiting events found dispatching network-vif-plugged-aa0481c2-d383-47ac-aaca-8830e727b0fd {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:26:52 user nova-compute[71113]: WARNING nova.compute.manager [req-f0d3d22a-b01c-4bae-9a80-32d1d738e09a req-263cc653-b5a2-4b81-a5ce-6949dda121ea service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Received unexpected event network-vif-plugged-aa0481c2-d383-47ac-aaca-8830e727b0fd for instance with vm_state deleted and task_state None.
Jul 31 10:26:52 user nova-compute[71113]: DEBUG nova.compute.manager [req-f0d3d22a-b01c-4bae-9a80-32d1d738e09a req-263cc653-b5a2-4b81-a5ce-6949dda121ea service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Received event network-vif-plugged-aa0481c2-d383-47ac-aaca-8830e727b0fd {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:26:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f0d3d22a-b01c-4bae-9a80-32d1d738e09a req-263cc653-b5a2-4b81-a5ce-6949dda121ea service nova] Acquiring lock "1ca22313-39ec-4366-abe0-fa40247dfa3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:26:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f0d3d22a-b01c-4bae-9a80-32d1d738e09a req-263cc653-b5a2-4b81-a5ce-6949dda121ea service nova] Lock "1ca22313-39ec-4366-abe0-fa40247dfa3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:26:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f0d3d22a-b01c-4bae-9a80-32d1d738e09a req-263cc653-b5a2-4b81-a5ce-6949dda121ea service nova] Lock "1ca22313-39ec-4366-abe0-fa40247dfa3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:26:52 user nova-compute[71113]: DEBUG nova.compute.manager [req-f0d3d22a-b01c-4bae-9a80-32d1d738e09a req-263cc653-b5a2-4b81-a5ce-6949dda121ea service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] No waiting events found dispatching network-vif-plugged-aa0481c2-d383-47ac-aaca-8830e727b0fd {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:26:52 user nova-compute[71113]: WARNING nova.compute.manager [req-f0d3d22a-b01c-4bae-9a80-32d1d738e09a req-263cc653-b5a2-4b81-a5ce-6949dda121ea service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Received unexpected event network-vif-plugged-aa0481c2-d383-47ac-aaca-8830e727b0fd for instance with vm_state deleted and task_state None.
Jul 31 10:26:52 user nova-compute[71113]: DEBUG nova.compute.manager [req-f0d3d22a-b01c-4bae-9a80-32d1d738e09a req-263cc653-b5a2-4b81-a5ce-6949dda121ea service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Received event network-vif-plugged-aa0481c2-d383-47ac-aaca-8830e727b0fd {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:26:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f0d3d22a-b01c-4bae-9a80-32d1d738e09a req-263cc653-b5a2-4b81-a5ce-6949dda121ea service nova] Acquiring lock "1ca22313-39ec-4366-abe0-fa40247dfa3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:26:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f0d3d22a-b01c-4bae-9a80-32d1d738e09a req-263cc653-b5a2-4b81-a5ce-6949dda121ea service nova] Lock "1ca22313-39ec-4366-abe0-fa40247dfa3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:26:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f0d3d22a-b01c-4bae-9a80-32d1d738e09a req-263cc653-b5a2-4b81-a5ce-6949dda121ea service nova] Lock "1ca22313-39ec-4366-abe0-fa40247dfa3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:26:52 user nova-compute[71113]: DEBUG nova.compute.manager [req-f0d3d22a-b01c-4bae-9a80-32d1d738e09a req-263cc653-b5a2-4b81-a5ce-6949dda121ea service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] No waiting events found dispatching network-vif-plugged-aa0481c2-d383-47ac-aaca-8830e727b0fd {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:26:52 user nova-compute[71113]: WARNING nova.compute.manager [req-f0d3d22a-b01c-4bae-9a80-32d1d738e09a req-263cc653-b5a2-4b81-a5ce-6949dda121ea service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Received unexpected event network-vif-plugged-aa0481c2-d383-47ac-aaca-8830e727b0fd for instance with vm_state deleted and task_state None.
Jul 31 10:26:52 user nova-compute[71113]: DEBUG nova.compute.manager [req-f0d3d22a-b01c-4bae-9a80-32d1d738e09a req-263cc653-b5a2-4b81-a5ce-6949dda121ea service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Received event network-vif-unplugged-aa0481c2-d383-47ac-aaca-8830e727b0fd {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:26:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f0d3d22a-b01c-4bae-9a80-32d1d738e09a req-263cc653-b5a2-4b81-a5ce-6949dda121ea service nova] Acquiring lock "1ca22313-39ec-4366-abe0-fa40247dfa3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:26:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f0d3d22a-b01c-4bae-9a80-32d1d738e09a req-263cc653-b5a2-4b81-a5ce-6949dda121ea service nova] Lock "1ca22313-39ec-4366-abe0-fa40247dfa3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:26:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f0d3d22a-b01c-4bae-9a80-32d1d738e09a req-263cc653-b5a2-4b81-a5ce-6949dda121ea service nova] Lock "1ca22313-39ec-4366-abe0-fa40247dfa3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:26:52 user nova-compute[71113]: DEBUG nova.compute.manager [req-f0d3d22a-b01c-4bae-9a80-32d1d738e09a req-263cc653-b5a2-4b81-a5ce-6949dda121ea service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] No waiting events found dispatching network-vif-unplugged-aa0481c2-d383-47ac-aaca-8830e727b0fd {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:26:52 user nova-compute[71113]: WARNING nova.compute.manager [req-f0d3d22a-b01c-4bae-9a80-32d1d738e09a req-263cc653-b5a2-4b81-a5ce-6949dda121ea service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Received unexpected event network-vif-unplugged-aa0481c2-d383-47ac-aaca-8830e727b0fd for instance with vm_state deleted and task_state None.
Jul 31 10:26:52 user nova-compute[71113]: DEBUG nova.compute.manager [req-f0d3d22a-b01c-4bae-9a80-32d1d738e09a req-263cc653-b5a2-4b81-a5ce-6949dda121ea service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Received event network-vif-plugged-aa0481c2-d383-47ac-aaca-8830e727b0fd {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:26:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f0d3d22a-b01c-4bae-9a80-32d1d738e09a req-263cc653-b5a2-4b81-a5ce-6949dda121ea service nova] Acquiring lock "1ca22313-39ec-4366-abe0-fa40247dfa3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:26:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f0d3d22a-b01c-4bae-9a80-32d1d738e09a req-263cc653-b5a2-4b81-a5ce-6949dda121ea service nova] Lock "1ca22313-39ec-4366-abe0-fa40247dfa3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:26:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-f0d3d22a-b01c-4bae-9a80-32d1d738e09a req-263cc653-b5a2-4b81-a5ce-6949dda121ea service nova] Lock "1ca22313-39ec-4366-abe0-fa40247dfa3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:26:52 user nova-compute[71113]: DEBUG nova.compute.manager [req-f0d3d22a-b01c-4bae-9a80-32d1d738e09a req-263cc653-b5a2-4b81-a5ce-6949dda121ea service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] No waiting events found dispatching network-vif-plugged-aa0481c2-d383-47ac-aaca-8830e727b0fd {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:26:52 user nova-compute[71113]: WARNING nova.compute.manager [req-f0d3d22a-b01c-4bae-9a80-32d1d738e09a req-263cc653-b5a2-4b81-a5ce-6949dda121ea service nova] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Received unexpected event network-vif-plugged-aa0481c2-d383-47ac-aaca-8830e727b0fd for instance with vm_state deleted and task_state None.
Jul 31 10:26:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:27:01 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:27:01 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:27:01 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:27:01 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:27:01 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:27:01 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:27:06 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690799211.243535, 1ca22313-39ec-4366-abe0-fa40247dfa3b => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:27:06 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] VM Stopped (Lifecycle Event)
Jul 31 10:27:06 user nova-compute[71113]: DEBUG nova.compute.manager [None req-a6eb0b44-d8d1-4044-8fc6-a83c383ae7da None None] [instance: 1ca22313-39ec-4366-abe0-fa40247dfa3b] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:27:06 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:27:06 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:27:06 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:27:06 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:27:06 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:27:06 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:27:11 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:27:11 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:27:11 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:27:11 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:27:11 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:27:11 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:27:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:27:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:27:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:27:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:27:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:27:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:27:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:27:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:27:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:27:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:27:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:27:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:27:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:27:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:27:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:27:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:27:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:27:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:27:26 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:27:29 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:27:30 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:27:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:27:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:27:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:27:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:27:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:27:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:27:35 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:27:35 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:27:35 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Rebuilding the list of instances to heal {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 10:27:35 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "refresh_cache-c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:27:35 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquired lock "refresh_cache-c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:27:35 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Forcefully refreshing network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 10:27:35 user nova-compute[71113]: DEBUG nova.objects.instance [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lazy-loading 'info_cache' on Instance uuid c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:27:36 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Updating instance_info_cache with network_info: [{"id": "85692854-658a-459b-9ab0-f448a6bf83f2", "address": "fa:16:3e:2b:2c:47", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85692854-65", "ovs_interfaceid": "85692854-658a-459b-9ab0-f448a6bf83f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:27:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:27:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Releasing lock "refresh_cache-c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:27:36 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Updated the network info_cache for instance {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 10:27:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:27:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:27:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:27:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:27:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:27:39 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:27:39 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:27:39 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:27:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:27:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:27:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:27:39 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:27:39 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:27:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:27:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:27:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:27:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:27:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:27:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:27:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:27:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:27:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:27:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:27:40 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:27:41 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:27:41 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:27:41 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=8830MB free_disk=25.21508026123047GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:27:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:27:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:27:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:27:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:27:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:27:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:27:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:27:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:27:41 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:27:41 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 8129456b-a22c-46e3-b5db-89fdcec87dec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:27:41 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:27:41 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:27:41 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Refreshing inventories for resource provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 31 10:27:41 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Updating ProviderTree inventory for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 31 10:27:41 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Updating inventory in ProviderTree for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 31 10:27:41 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Refreshing aggregate associations for resource provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05, aggregates: None {{(pid=71113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 31 10:27:41 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Refreshing trait associations for resource provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE2,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS {{(pid=71113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 31 10:27:41 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:27:41 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:27:41 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:27:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.447s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:27:44 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:27:44 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:27:46 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:27:47 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:27:48 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:27:48 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Cleaning up deleted instances {{(pid=71113) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 31 10:27:48 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] There are 0 instances to clean {{(pid=71113) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 31 10:27:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c670c3bd-b2fe-4b58-8dd7-8962160f4bca tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Acquiring lock "8129456b-a22c-46e3-b5db-89fdcec87dec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:27:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c670c3bd-b2fe-4b58-8dd7-8962160f4bca tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "8129456b-a22c-46e3-b5db-89fdcec87dec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:27:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c670c3bd-b2fe-4b58-8dd7-8962160f4bca tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Acquiring lock "8129456b-a22c-46e3-b5db-89fdcec87dec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:27:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c670c3bd-b2fe-4b58-8dd7-8962160f4bca tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "8129456b-a22c-46e3-b5db-89fdcec87dec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:27:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c670c3bd-b2fe-4b58-8dd7-8962160f4bca tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "8129456b-a22c-46e3-b5db-89fdcec87dec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:27:50 user nova-compute[71113]: INFO nova.compute.manager [None req-c670c3bd-b2fe-4b58-8dd7-8962160f4bca tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Terminating instance
Jul 31 10:27:50 user nova-compute[71113]: DEBUG nova.compute.manager [None req-c670c3bd-b2fe-4b58-8dd7-8962160f4bca tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Start destroying the instance on the hypervisor. {{(pid=71113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 10:27:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:27:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:27:51 user nova-compute[71113]: DEBUG nova.compute.manager [req-94607783-c3dc-40d4-8d5f-365d4ca2dfcf req-f81d3a44-9f4f-4f99-bf48-f90284a54a29 service nova] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Received event network-vif-unplugged-1a2da0f9-2fb6-4880-96b5-be8dd9d12574 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:27:51 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-94607783-c3dc-40d4-8d5f-365d4ca2dfcf req-f81d3a44-9f4f-4f99-bf48-f90284a54a29 service nova] Acquiring lock "8129456b-a22c-46e3-b5db-89fdcec87dec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:27:51 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-94607783-c3dc-40d4-8d5f-365d4ca2dfcf req-f81d3a44-9f4f-4f99-bf48-f90284a54a29 service nova] Lock "8129456b-a22c-46e3-b5db-89fdcec87dec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:27:51 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-94607783-c3dc-40d4-8d5f-365d4ca2dfcf req-f81d3a44-9f4f-4f99-bf48-f90284a54a29 service nova] Lock "8129456b-a22c-46e3-b5db-89fdcec87dec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:27:51 user nova-compute[71113]: DEBUG nova.compute.manager [req-94607783-c3dc-40d4-8d5f-365d4ca2dfcf req-f81d3a44-9f4f-4f99-bf48-f90284a54a29 service nova] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] No waiting events found dispatching network-vif-unplugged-1a2da0f9-2fb6-4880-96b5-be8dd9d12574 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:27:51 user nova-compute[71113]: DEBUG nova.compute.manager [req-94607783-c3dc-40d4-8d5f-365d4ca2dfcf req-f81d3a44-9f4f-4f99-bf48-f90284a54a29 service nova] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Received event network-vif-unplugged-1a2da0f9-2fb6-4880-96b5-be8dd9d12574 for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 10:27:51 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:27:51 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:27:51 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:27:51 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:27:51 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Instance destroyed successfully.
Jul 31 10:27:51 user nova-compute[71113]: DEBUG nova.objects.instance [None req-c670c3bd-b2fe-4b58-8dd7-8962160f4bca tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lazy-loading 'resources' on Instance uuid 8129456b-a22c-46e3-b5db-89fdcec87dec {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:27:51 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-c670c3bd-b2fe-4b58-8dd7-8962160f4bca tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:11:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-271752726',display_name='tempest-ServerRescueNegativeTestJSON-server-271752726',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-271752726',id=43,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T10:13:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='938c4f5af8a347cf9d700c8cdb5df356',ramdisk_id='',reservation_id='r-10x57duk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-549904406',owner_user_name='tempest-ServerRescueNegativeTestJSON-549904406-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T10:13:37Z,user_data=None,user_id='6023b7c67c0941d3975fa9c25140684f',uuid=8129456b-a22c-46e3-b5db-89fdcec87dec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "1a2da0f9-2fb6-4880-96b5-be8dd9d12574", "address": "fa:16:3e:fe:2b:04", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a2da0f9-2f", "ovs_interfaceid": "1a2da0f9-2fb6-4880-96b5-be8dd9d12574", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 10:27:51 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-c670c3bd-b2fe-4b58-8dd7-8962160f4bca tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Converting VIF {"id": "1a2da0f9-2fb6-4880-96b5-be8dd9d12574", "address": "fa:16:3e:fe:2b:04", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a2da0f9-2f", "ovs_interfaceid": "1a2da0f9-2fb6-4880-96b5-be8dd9d12574", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:27:51 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-c670c3bd-b2fe-4b58-8dd7-8962160f4bca tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:2b:04,bridge_name='br-int',has_traffic_filtering=True,id=1a2da0f9-2fb6-4880-96b5-be8dd9d12574,network=Network(328e0f8b-5788-457c-afc6-7fe314ca8b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a2da0f9-2f') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:27:51 user nova-compute[71113]: DEBUG os_vif [None req-c670c3bd-b2fe-4b58-8dd7-8962160f4bca tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:2b:04,bridge_name='br-int',has_traffic_filtering=True,id=1a2da0f9-2fb6-4880-96b5-be8dd9d12574,network=Network(328e0f8b-5788-457c-afc6-7fe314ca8b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a2da0f9-2f') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 10:27:51 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:27:51 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1a2da0f9-2f, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:27:51 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:27:51 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:27:51 user nova-compute[71113]: INFO os_vif [None req-c670c3bd-b2fe-4b58-8dd7-8962160f4bca tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:2b:04,bridge_name='br-int',has_traffic_filtering=True,id=1a2da0f9-2fb6-4880-96b5-be8dd9d12574,network=Network(328e0f8b-5788-457c-afc6-7fe314ca8b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a2da0f9-2f')
Jul 31 10:27:51 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-c670c3bd-b2fe-4b58-8dd7-8962160f4bca tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Deleting instance files /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec_del
Jul 31 10:27:51 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-c670c3bd-b2fe-4b58-8dd7-8962160f4bca tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Deletion of /opt/stack/data/nova/instances/8129456b-a22c-46e3-b5db-89fdcec87dec_del complete
Jul 31 10:27:51 user nova-compute[71113]: INFO nova.compute.manager [None req-c670c3bd-b2fe-4b58-8dd7-8962160f4bca tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Took 0.71 seconds to destroy the instance on the hypervisor.
Jul 31 10:27:51 user nova-compute[71113]: DEBUG oslo.service.loopingcall [None req-c670c3bd-b2fe-4b58-8dd7-8962160f4bca tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71113) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 10:27:51 user nova-compute[71113]: DEBUG nova.compute.manager [-] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Deallocating network for instance {{(pid=71113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 10:27:51 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] deallocate_for_instance() {{(pid=71113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 10:27:52 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:27:52 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Took 0.59 seconds to deallocate network for instance.
Jul 31 10:27:52 user nova-compute[71113]: DEBUG nova.compute.manager [req-208b94af-5293-451a-82e8-21f546c61800 req-79e6a164-bf8b-4de1-996c-d95b7a2034db service nova] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Received event network-vif-deleted-1a2da0f9-2fb6-4880-96b5-be8dd9d12574 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:27:52 user nova-compute[71113]: INFO nova.compute.manager [req-208b94af-5293-451a-82e8-21f546c61800 req-79e6a164-bf8b-4de1-996c-d95b7a2034db service nova] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Neutron deleted interface 1a2da0f9-2fb6-4880-96b5-be8dd9d12574; detaching it from the instance and deleting it from the info cache
Jul 31 10:27:52 user nova-compute[71113]: DEBUG nova.network.neutron [req-208b94af-5293-451a-82e8-21f546c61800 req-79e6a164-bf8b-4de1-996c-d95b7a2034db service nova] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:27:52 user nova-compute[71113]: DEBUG nova.compute.manager [req-208b94af-5293-451a-82e8-21f546c61800 req-79e6a164-bf8b-4de1-996c-d95b7a2034db service nova] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Detach interface failed, port_id=1a2da0f9-2fb6-4880-96b5-be8dd9d12574, reason: Instance 8129456b-a22c-46e3-b5db-89fdcec87dec could not be found. {{(pid=71113) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 10:27:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c670c3bd-b2fe-4b58-8dd7-8962160f4bca tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:27:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c670c3bd-b2fe-4b58-8dd7-8962160f4bca tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:27:52 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-c670c3bd-b2fe-4b58-8dd7-8962160f4bca tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:27:52 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-c670c3bd-b2fe-4b58-8dd7-8962160f4bca tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:27:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c670c3bd-b2fe-4b58-8dd7-8962160f4bca tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.146s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:27:52 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-c670c3bd-b2fe-4b58-8dd7-8962160f4bca tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Deleted allocations for instance 8129456b-a22c-46e3-b5db-89fdcec87dec
Jul 31 10:27:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c670c3bd-b2fe-4b58-8dd7-8962160f4bca tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "8129456b-a22c-46e3-b5db-89fdcec87dec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.660s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:27:53 user nova-compute[71113]: DEBUG nova.compute.manager [req-8ea16d74-9d47-423f-a213-58ad230e8ae0 req-c45d2eaf-0061-45a2-9a35-dc5b4abc32f5 service nova] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Received event network-vif-plugged-1a2da0f9-2fb6-4880-96b5-be8dd9d12574 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:27:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8ea16d74-9d47-423f-a213-58ad230e8ae0 req-c45d2eaf-0061-45a2-9a35-dc5b4abc32f5 service nova] Acquiring lock "8129456b-a22c-46e3-b5db-89fdcec87dec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:27:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8ea16d74-9d47-423f-a213-58ad230e8ae0 req-c45d2eaf-0061-45a2-9a35-dc5b4abc32f5 service nova] Lock "8129456b-a22c-46e3-b5db-89fdcec87dec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:27:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8ea16d74-9d47-423f-a213-58ad230e8ae0 req-c45d2eaf-0061-45a2-9a35-dc5b4abc32f5 service nova] Lock "8129456b-a22c-46e3-b5db-89fdcec87dec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:27:53 user nova-compute[71113]: DEBUG nova.compute.manager [req-8ea16d74-9d47-423f-a213-58ad230e8ae0 req-c45d2eaf-0061-45a2-9a35-dc5b4abc32f5 service nova] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] No waiting events found dispatching network-vif-plugged-1a2da0f9-2fb6-4880-96b5-be8dd9d12574 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:27:53 user nova-compute[71113]: WARNING nova.compute.manager [req-8ea16d74-9d47-423f-a213-58ad230e8ae0 req-c45d2eaf-0061-45a2-9a35-dc5b4abc32f5 service nova] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Received unexpected event network-vif-plugged-1a2da0f9-2fb6-4880-96b5-be8dd9d12574 for instance with vm_state deleted and task_state None.
Jul 31 10:27:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:27:59 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:28:01 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:28:05 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:28:05 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71113) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 31 10:28:06 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690799271.3682392, 8129456b-a22c-46e3-b5db-89fdcec87dec => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:28:06 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] VM Stopped (Lifecycle Event)
Jul 31 10:28:06 user nova-compute[71113]: DEBUG nova.compute.manager [None req-39437671-7d64-428b-97cd-12a2a99c7a93 None None] [instance: 8129456b-a22c-46e3-b5db-89fdcec87dec] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:28:06 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:28:11 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:28:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:28:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:28:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:28:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:28:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:28:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:28:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:28:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:28:28 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:28:30 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:28:30 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:28:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:28:35 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:28:35 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:28:35 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Didn't find any instances for network info cache update. {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 10:28:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:28:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:28:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:28:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:28:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:28:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:28:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:28:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0ed5fbea-2249-4b4f-b72e-3391ca9c5ca8 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Acquiring lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:28:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0ed5fbea-2249-4b4f-b72e-3391ca9c5ca8 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:28:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0ed5fbea-2249-4b4f-b72e-3391ca9c5ca8 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Acquiring lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:28:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0ed5fbea-2249-4b4f-b72e-3391ca9c5ca8 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:28:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0ed5fbea-2249-4b4f-b72e-3391ca9c5ca8 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:28:41 user nova-compute[71113]: INFO nova.compute.manager [None req-0ed5fbea-2249-4b4f-b72e-3391ca9c5ca8 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Terminating instance
Jul 31 10:28:41 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0ed5fbea-2249-4b4f-b72e-3391ca9c5ca8 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Start destroying the instance on the hypervisor. {{(pid=71113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 10:28:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:28:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:28:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:28:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:28:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:28:41 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:28:41 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:28:41 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:28:41 user nova-compute[71113]: DEBUG nova.compute.manager [req-cfe9d179-4cdb-4d23-96fb-bba070487b0e req-b0e57382-5923-4c70-bd78-27b23697f720 service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Received event network-vif-unplugged-85692854-658a-459b-9ab0-f448a6bf83f2 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:28:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-cfe9d179-4cdb-4d23-96fb-bba070487b0e req-b0e57382-5923-4c70-bd78-27b23697f720 service nova] Acquiring lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:28:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-cfe9d179-4cdb-4d23-96fb-bba070487b0e req-b0e57382-5923-4c70-bd78-27b23697f720 service nova] Lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:28:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-cfe9d179-4cdb-4d23-96fb-bba070487b0e req-b0e57382-5923-4c70-bd78-27b23697f720 service nova] Lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:28:41 user nova-compute[71113]: DEBUG nova.compute.manager [req-cfe9d179-4cdb-4d23-96fb-bba070487b0e req-b0e57382-5923-4c70-bd78-27b23697f720 service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] No waiting events found dispatching network-vif-unplugged-85692854-658a-459b-9ab0-f448a6bf83f2 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:28:41 user nova-compute[71113]: DEBUG nova.compute.manager [req-cfe9d179-4cdb-4d23-96fb-bba070487b0e req-b0e57382-5923-4c70-bd78-27b23697f720 service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Received event network-vif-unplugged-85692854-658a-459b-9ab0-f448a6bf83f2 for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 10:28:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:28:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:28:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:28:41 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:28:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:28:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:28:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:28:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:28:42 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Instance destroyed successfully.
Jul 31 10:28:42 user nova-compute[71113]: DEBUG nova.objects.instance [None req-0ed5fbea-2249-4b4f-b72e-3391ca9c5ca8 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lazy-loading 'resources' on Instance uuid c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:28:42 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-0ed5fbea-2249-4b4f-b72e-3391ca9c5ca8 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:11:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-206616969',display_name='tempest-ServerRescueNegativeTestJSON-server-206616969',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-206616969',id=42,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T10:16:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='938c4f5af8a347cf9d700c8cdb5df356',ramdisk_id='',reservation_id='r-80w6skid',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-549904406',owner_user_name='tempest-ServerRescueNegativeTestJSON-549904406-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T10:18:22Z,user_data=None,user_id='6023b7c67c0941d3975fa9c25140684f',uuid=c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85692854-658a-459b-9ab0-f448a6bf83f2", "address": "fa:16:3e:2b:2c:47", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85692854-65", "ovs_interfaceid": "85692854-658a-459b-9ab0-f448a6bf83f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 10:28:42 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-0ed5fbea-2249-4b4f-b72e-3391ca9c5ca8 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Converting VIF {"id": "85692854-658a-459b-9ab0-f448a6bf83f2", "address": "fa:16:3e:2b:2c:47", "network": {"id": "328e0f8b-5788-457c-afc6-7fe314ca8b32", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2129694806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938c4f5af8a347cf9d700c8cdb5df356", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85692854-65", "ovs_interfaceid": "85692854-658a-459b-9ab0-f448a6bf83f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:28:42 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-0ed5fbea-2249-4b4f-b72e-3391ca9c5ca8 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:2c:47,bridge_name='br-int',has_traffic_filtering=True,id=85692854-658a-459b-9ab0-f448a6bf83f2,network=Network(328e0f8b-5788-457c-afc6-7fe314ca8b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85692854-65') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:28:42 user nova-compute[71113]: DEBUG os_vif [None req-0ed5fbea-2249-4b4f-b72e-3391ca9c5ca8 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:2c:47,bridge_name='br-int',has_traffic_filtering=True,id=85692854-658a-459b-9ab0-f448a6bf83f2,network=Network(328e0f8b-5788-457c-afc6-7fe314ca8b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85692854-65') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 10:28:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:28:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85692854-65, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:28:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:28:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:28:42 user nova-compute[71113]: INFO os_vif [None req-0ed5fbea-2249-4b4f-b72e-3391ca9c5ca8 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:2c:47,bridge_name='br-int',has_traffic_filtering=True,id=85692854-658a-459b-9ab0-f448a6bf83f2,network=Network(328e0f8b-5788-457c-afc6-7fe314ca8b32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85692854-65')
Jul 31 10:28:42 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-0ed5fbea-2249-4b4f-b72e-3391ca9c5ca8 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Deleting instance files /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5_del
Jul 31 10:28:42 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-0ed5fbea-2249-4b4f-b72e-3391ca9c5ca8 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Deletion of /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5_del complete
Jul 31 10:28:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:28:42 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-0000002a, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5/disk
Jul 31 10:28:42 user nova-compute[71113]: INFO nova.compute.manager [None req-0ed5fbea-2249-4b4f-b72e-3391ca9c5ca8 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Took 0.87 seconds to destroy the instance on the hypervisor.
Jul 31 10:28:42 user nova-compute[71113]: DEBUG oslo.service.loopingcall [None req-0ed5fbea-2249-4b4f-b72e-3391ca9c5ca8 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71113) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 10:28:42 user nova-compute[71113]: DEBUG nova.compute.manager [-] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Deallocating network for instance {{(pid=71113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 10:28:42 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] deallocate_for_instance() {{(pid=71113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 10:28:42 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:28:42 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:28:42 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=9002MB free_disk=25.24240493774414GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:28:42 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:28:42 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:28:42 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:28:42 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:28:42 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:28:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:28:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:28:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:28:42 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:28:42 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:28:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:28:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:28:42 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:28:42 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.226s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:28:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:28:43 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:28:43 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Took 0.81 seconds to deallocate network for instance.
Jul 31 10:28:43 user nova-compute[71113]: DEBUG nova.compute.manager [req-bd5c9add-41a2-429a-908e-3fa2f38d1ff3 req-7455aabf-6280-4c22-9834-eb371e507ea0 service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Received event network-vif-deleted-85692854-658a-459b-9ab0-f448a6bf83f2 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:28:43 user nova-compute[71113]: INFO nova.compute.manager [req-bd5c9add-41a2-429a-908e-3fa2f38d1ff3 req-7455aabf-6280-4c22-9834-eb371e507ea0 service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Neutron deleted interface 85692854-658a-459b-9ab0-f448a6bf83f2; detaching it from the instance and deleting it from the info cache
Jul 31 10:28:43 user nova-compute[71113]: DEBUG nova.network.neutron [req-bd5c9add-41a2-429a-908e-3fa2f38d1ff3 req-7455aabf-6280-4c22-9834-eb371e507ea0 service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:28:43 user nova-compute[71113]: DEBUG nova.compute.manager [req-bd5c9add-41a2-429a-908e-3fa2f38d1ff3 req-7455aabf-6280-4c22-9834-eb371e507ea0 service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Detach interface failed, port_id=85692854-658a-459b-9ab0-f448a6bf83f2, reason: Instance c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5 could not be found. {{(pid=71113) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 10:28:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0ed5fbea-2249-4b4f-b72e-3391ca9c5ca8 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:28:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0ed5fbea-2249-4b4f-b72e-3391ca9c5ca8 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:28:43 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0ed5fbea-2249-4b4f-b72e-3391ca9c5ca8 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:28:43 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0ed5fbea-2249-4b4f-b72e-3391ca9c5ca8 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:28:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0ed5fbea-2249-4b4f-b72e-3391ca9c5ca8 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.105s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:28:43 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-0ed5fbea-2249-4b4f-b72e-3391ca9c5ca8 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Deleted allocations for instance c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5
Jul 31 10:28:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0ed5fbea-2249-4b4f-b72e-3391ca9c5ca8 tempest-ServerRescueNegativeTestJSON-549904406 tempest-ServerRescueNegativeTestJSON-549904406-project-member] Lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.956s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:28:43 user nova-compute[71113]: DEBUG nova.compute.manager [req-e2124e1a-9d48-4932-a2ec-888e7ca6e78b req-2485cbcd-1c98-4266-ada8-576db73db509 service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Received event network-vif-plugged-85692854-658a-459b-9ab0-f448a6bf83f2 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:28:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e2124e1a-9d48-4932-a2ec-888e7ca6e78b req-2485cbcd-1c98-4266-ada8-576db73db509 service nova] Acquiring lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:28:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e2124e1a-9d48-4932-a2ec-888e7ca6e78b req-2485cbcd-1c98-4266-ada8-576db73db509 service nova] Lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:28:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e2124e1a-9d48-4932-a2ec-888e7ca6e78b req-2485cbcd-1c98-4266-ada8-576db73db509 service nova] Lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:28:43 user nova-compute[71113]: DEBUG nova.compute.manager [req-e2124e1a-9d48-4932-a2ec-888e7ca6e78b req-2485cbcd-1c98-4266-ada8-576db73db509 service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] No waiting events found dispatching network-vif-plugged-85692854-658a-459b-9ab0-f448a6bf83f2 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:28:43 user nova-compute[71113]: WARNING nova.compute.manager [req-e2124e1a-9d48-4932-a2ec-888e7ca6e78b req-2485cbcd-1c98-4266-ada8-576db73db509 service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Received unexpected event network-vif-plugged-85692854-658a-459b-9ab0-f448a6bf83f2 for instance with vm_state deleted and task_state None.
Jul 31 10:28:43 user nova-compute[71113]: DEBUG nova.compute.manager [req-e2124e1a-9d48-4932-a2ec-888e7ca6e78b req-2485cbcd-1c98-4266-ada8-576db73db509 service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Received event network-vif-plugged-85692854-658a-459b-9ab0-f448a6bf83f2 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:28:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e2124e1a-9d48-4932-a2ec-888e7ca6e78b req-2485cbcd-1c98-4266-ada8-576db73db509 service nova] Acquiring lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:28:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e2124e1a-9d48-4932-a2ec-888e7ca6e78b req-2485cbcd-1c98-4266-ada8-576db73db509 service nova] Lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:28:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e2124e1a-9d48-4932-a2ec-888e7ca6e78b req-2485cbcd-1c98-4266-ada8-576db73db509 service nova] Lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:28:43 user nova-compute[71113]: DEBUG nova.compute.manager [req-e2124e1a-9d48-4932-a2ec-888e7ca6e78b req-2485cbcd-1c98-4266-ada8-576db73db509 service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] No waiting events found dispatching network-vif-plugged-85692854-658a-459b-9ab0-f448a6bf83f2 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:28:43 user nova-compute[71113]: WARNING nova.compute.manager [req-e2124e1a-9d48-4932-a2ec-888e7ca6e78b req-2485cbcd-1c98-4266-ada8-576db73db509 service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Received unexpected event network-vif-plugged-85692854-658a-459b-9ab0-f448a6bf83f2 for instance with vm_state deleted and task_state None.
Jul 31 10:28:43 user nova-compute[71113]: DEBUG nova.compute.manager [req-e2124e1a-9d48-4932-a2ec-888e7ca6e78b req-2485cbcd-1c98-4266-ada8-576db73db509 service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Received event network-vif-plugged-85692854-658a-459b-9ab0-f448a6bf83f2 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:28:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e2124e1a-9d48-4932-a2ec-888e7ca6e78b req-2485cbcd-1c98-4266-ada8-576db73db509 service nova] Acquiring lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:28:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e2124e1a-9d48-4932-a2ec-888e7ca6e78b req-2485cbcd-1c98-4266-ada8-576db73db509 service nova] Lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:28:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e2124e1a-9d48-4932-a2ec-888e7ca6e78b req-2485cbcd-1c98-4266-ada8-576db73db509 service nova] Lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:28:43 user nova-compute[71113]: DEBUG nova.compute.manager [req-e2124e1a-9d48-4932-a2ec-888e7ca6e78b req-2485cbcd-1c98-4266-ada8-576db73db509 service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] No waiting events found dispatching network-vif-plugged-85692854-658a-459b-9ab0-f448a6bf83f2 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:28:43 user nova-compute[71113]: WARNING nova.compute.manager [req-e2124e1a-9d48-4932-a2ec-888e7ca6e78b req-2485cbcd-1c98-4266-ada8-576db73db509 service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Received unexpected event network-vif-plugged-85692854-658a-459b-9ab0-f448a6bf83f2 for instance with vm_state deleted and task_state None.
Jul 31 10:28:43 user nova-compute[71113]: DEBUG nova.compute.manager [req-e2124e1a-9d48-4932-a2ec-888e7ca6e78b req-2485cbcd-1c98-4266-ada8-576db73db509 service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Received event network-vif-unplugged-85692854-658a-459b-9ab0-f448a6bf83f2 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:28:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e2124e1a-9d48-4932-a2ec-888e7ca6e78b req-2485cbcd-1c98-4266-ada8-576db73db509 service nova] Acquiring lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:28:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e2124e1a-9d48-4932-a2ec-888e7ca6e78b req-2485cbcd-1c98-4266-ada8-576db73db509 service nova] Lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:28:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e2124e1a-9d48-4932-a2ec-888e7ca6e78b req-2485cbcd-1c98-4266-ada8-576db73db509 service nova] Lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:28:43 user nova-compute[71113]: DEBUG nova.compute.manager [req-e2124e1a-9d48-4932-a2ec-888e7ca6e78b req-2485cbcd-1c98-4266-ada8-576db73db509 service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] No waiting events found dispatching network-vif-unplugged-85692854-658a-459b-9ab0-f448a6bf83f2 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:28:43 user nova-compute[71113]: WARNING nova.compute.manager [req-e2124e1a-9d48-4932-a2ec-888e7ca6e78b req-2485cbcd-1c98-4266-ada8-576db73db509 service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Received unexpected event network-vif-unplugged-85692854-658a-459b-9ab0-f448a6bf83f2 for instance with vm_state deleted and task_state None.
Jul 31 10:28:43 user nova-compute[71113]: DEBUG nova.compute.manager [req-e2124e1a-9d48-4932-a2ec-888e7ca6e78b req-2485cbcd-1c98-4266-ada8-576db73db509 service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Received event network-vif-plugged-85692854-658a-459b-9ab0-f448a6bf83f2 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:28:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e2124e1a-9d48-4932-a2ec-888e7ca6e78b req-2485cbcd-1c98-4266-ada8-576db73db509 service nova] Acquiring lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:28:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e2124e1a-9d48-4932-a2ec-888e7ca6e78b req-2485cbcd-1c98-4266-ada8-576db73db509 service nova] Lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:28:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e2124e1a-9d48-4932-a2ec-888e7ca6e78b req-2485cbcd-1c98-4266-ada8-576db73db509 service nova] Lock "c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:28:43 user nova-compute[71113]: DEBUG nova.compute.manager [req-e2124e1a-9d48-4932-a2ec-888e7ca6e78b req-2485cbcd-1c98-4266-ada8-576db73db509 service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] No waiting events found dispatching network-vif-plugged-85692854-658a-459b-9ab0-f448a6bf83f2 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:28:43 user nova-compute[71113]: WARNING nova.compute.manager [req-e2124e1a-9d48-4932-a2ec-888e7ca6e78b req-2485cbcd-1c98-4266-ada8-576db73db509 service nova] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Received unexpected event network-vif-plugged-85692854-658a-459b-9ab0-f448a6bf83f2 for instance with vm_state deleted and task_state None.
Jul 31 10:28:44 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:28:44 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:28:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:28:48 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:28:51 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:28:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:28:57 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690799322.2310345, c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5 => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:28:57 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] VM Stopped (Lifecycle Event)
Jul 31 10:28:57 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0eb344a1-1f46-4140-baa0-b0b8cd514147 None None] [instance: c5d0c24a-ce65-48e3-89ed-a40ec7a0fcc5] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:28:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:28:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:28:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:28:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:28:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:28:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:29:02 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:29:07 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:29:12 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:29:12 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:29:12 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:29:12 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:29:12 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:29:12 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:29:17 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:29:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:29:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:29:29 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:29:30 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:29:31 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:29:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:29:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:29:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:29:36 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:29:36 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:29:36 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Rebuilding the list of instances to heal {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 10:29:36 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Didn't find any instances for network info cache update. {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 10:29:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:29:41 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:29:41 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:29:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:29:43 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:29:43 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:29:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:29:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:29:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:29:43 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:29:44 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:29:44 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:29:44 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=9002MB free_disk=25.26934814453125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:29:44 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:29:44 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:29:44 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:29:44 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:29:44 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:29:44 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:29:44 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:29:44 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.143s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:29:45 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:29:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:29:48 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:29:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:29:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:30:02 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:30:07 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:30:12 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:30:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:30:17 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:30:17 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:30:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:30:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:30:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:30:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:30:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:30:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:30:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Acquiring lock "4eb47c5d-5398-46ec-8674-40ea1a98636a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:30:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "4eb47c5d-5398-46ec-8674-40ea1a98636a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:30:28 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Starting instance... {{(pid=71113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 10:30:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:30:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:30:28 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 10:30:28 user nova-compute[71113]: INFO nova.compute.claims [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Claim successful on node user
Jul 31 10:30:28 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:30:28 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:30:28 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.215s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:30:28 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Start building networks asynchronously for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 10:30:29 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Allocating IP information in the background. {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 10:30:29 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] allocate_for_instance() {{(pid=71113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 10:30:29 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 10:30:29 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Start building block device mappings for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 10:30:29 user nova-compute[71113]: DEBUG nova.policy [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4a47a5b738a6402db511c0e096f2c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02892a9661ba44dd8c32b91f74446d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71113) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 10:30:29 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Start spawning the instance on the hypervisor. {{(pid=71113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 10:30:29 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 10:30:29 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Creating image(s)
Jul 31 10:30:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Acquiring lock "/opt/stack/data/nova/instances/4eb47c5d-5398-46ec-8674-40ea1a98636a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:30:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "/opt/stack/data/nova/instances/4eb47c5d-5398-46ec-8674-40ea1a98636a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:30:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "/opt/stack/data/nova/instances/4eb47c5d-5398-46ec-8674-40ea1a98636a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:30:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Acquiring lock "94a6bf95dc0df2da9f28ee35dd8d5af672407a77" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:30:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "94a6bf95dc0df2da9f28ee35dd8d5af672407a77" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:30:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/94a6bf95dc0df2da9f28ee35dd8d5af672407a77.part --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:30:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/94a6bf95dc0df2da9f28ee35dd8d5af672407a77.part --force-share --output=json" returned: 0 in 0.141s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:30:29 user nova-compute[71113]: DEBUG nova.virt.images [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] 94a8ad05-1080-4adb-a459-0c03205f2a1d was qcow2, converting to raw {{(pid=71113) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 31 10:30:29 user nova-compute[71113]: DEBUG nova.privsep.utils [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71113) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 10:30:29 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/94a6bf95dc0df2da9f28ee35dd8d5af672407a77.part /opt/stack/data/nova/instances/_base/94a6bf95dc0df2da9f28ee35dd8d5af672407a77.converted {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:30:29 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Successfully created port: 68243307-5696-444d-8f67-05f07d39db2a {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 10:30:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/94a6bf95dc0df2da9f28ee35dd8d5af672407a77.part /opt/stack/data/nova/instances/_base/94a6bf95dc0df2da9f28ee35dd8d5af672407a77.converted" returned: 0 in 0.363s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:30:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/94a6bf95dc0df2da9f28ee35dd8d5af672407a77.converted --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:30:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/94a6bf95dc0df2da9f28ee35dd8d5af672407a77.converted --force-share --output=json" returned: 0 in 0.131s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:30:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "94a6bf95dc0df2da9f28ee35dd8d5af672407a77" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.088s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:30:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/94a6bf95dc0df2da9f28ee35dd8d5af672407a77 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:30:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/94a6bf95dc0df2da9f28ee35dd8d5af672407a77 --force-share --output=json" returned: 0 in 0.132s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:30:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Acquiring lock "94a6bf95dc0df2da9f28ee35dd8d5af672407a77" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:30:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "94a6bf95dc0df2da9f28ee35dd8d5af672407a77" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:30:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/94a6bf95dc0df2da9f28ee35dd8d5af672407a77 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:30:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/94a6bf95dc0df2da9f28ee35dd8d5af672407a77 --force-share --output=json" returned: 0 in 0.131s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:30:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/94a6bf95dc0df2da9f28ee35dd8d5af672407a77,backing_fmt=raw /opt/stack/data/nova/instances/4eb47c5d-5398-46ec-8674-40ea1a98636a/disk 1073741824 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:30:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/94a6bf95dc0df2da9f28ee35dd8d5af672407a77,backing_fmt=raw /opt/stack/data/nova/instances/4eb47c5d-5398-46ec-8674-40ea1a98636a/disk 1073741824" returned: 0 in 0.049s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:30:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "94a6bf95dc0df2da9f28ee35dd8d5af672407a77" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:30:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/94a6bf95dc0df2da9f28ee35dd8d5af672407a77 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:30:30 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Successfully updated port: 68243307-5696-444d-8f67-05f07d39db2a {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 10:30:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Acquiring lock "refresh_cache-4eb47c5d-5398-46ec-8674-40ea1a98636a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:30:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Acquired lock "refresh_cache-4eb47c5d-5398-46ec-8674-40ea1a98636a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:30:30 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 10:30:30 user nova-compute[71113]: DEBUG nova.compute.manager [req-2096c2e7-aa11-4371-8c38-1498b2d0e34b req-6e8cb80f-bd9d-4972-accf-7c34d3f20139 service nova] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Received event network-changed-68243307-5696-444d-8f67-05f07d39db2a {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:30:30 user nova-compute[71113]: DEBUG nova.compute.manager [req-2096c2e7-aa11-4371-8c38-1498b2d0e34b req-6e8cb80f-bd9d-4972-accf-7c34d3f20139 service nova] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Refreshing instance network info cache due to event network-changed-68243307-5696-444d-8f67-05f07d39db2a. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 10:30:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-2096c2e7-aa11-4371-8c38-1498b2d0e34b req-6e8cb80f-bd9d-4972-accf-7c34d3f20139 service nova] Acquiring lock "refresh_cache-4eb47c5d-5398-46ec-8674-40ea1a98636a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:30:30 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 10:30:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/94a6bf95dc0df2da9f28ee35dd8d5af672407a77 --force-share --output=json" returned: 0 in 0.138s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:30:30 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4eb47c5d-5398-46ec-8674-40ea1a98636a/disk. size=1073741824 {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 10:30:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb47c5d-5398-46ec-8674-40ea1a98636a/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:30:30 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:30:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:30:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb47c5d-5398-46ec-8674-40ea1a98636a/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:30:30 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Cannot resize image /opt/stack/data/nova/instances/4eb47c5d-5398-46ec-8674-40ea1a98636a/disk to a smaller size. {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 10:30:30 user nova-compute[71113]: DEBUG nova.objects.instance [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lazy-loading 'migration_context' on Instance uuid 4eb47c5d-5398-46ec-8674-40ea1a98636a {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:30:30 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Created local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 10:30:30 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Ensure instance console log exists: /opt/stack/data/nova/instances/4eb47c5d-5398-46ec-8674-40ea1a98636a/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 10:30:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:30:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:30:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:30:31 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Updating instance_info_cache with network_info: [{"id": "68243307-5696-444d-8f67-05f07d39db2a", "address": "fa:16:3e:c8:ab:8e", "network": {"id": "b535bacc-9690-4269-a1e4-6aee5466ece4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-811923488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02892a9661ba44dd8c32b91f74446d99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68243307-56", "ovs_interfaceid": "68243307-5696-444d-8f67-05f07d39db2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:30:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Releasing lock "refresh_cache-4eb47c5d-5398-46ec-8674-40ea1a98636a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:30:31 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Instance network_info: |[{"id": "68243307-5696-444d-8f67-05f07d39db2a", "address": "fa:16:3e:c8:ab:8e", "network": {"id": "b535bacc-9690-4269-a1e4-6aee5466ece4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-811923488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02892a9661ba44dd8c32b91f74446d99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68243307-56", "ovs_interfaceid": "68243307-5696-444d-8f67-05f07d39db2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 10:30:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-2096c2e7-aa11-4371-8c38-1498b2d0e34b req-6e8cb80f-bd9d-4972-accf-7c34d3f20139 service nova] Acquired lock "refresh_cache-4eb47c5d-5398-46ec-8674-40ea1a98636a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:30:31 user nova-compute[71113]: DEBUG nova.network.neutron [req-2096c2e7-aa11-4371-8c38-1498b2d0e34b req-6e8cb80f-bd9d-4972-accf-7c34d3f20139 service nova] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Refreshing network info cache for port 68243307-5696-444d-8f67-05f07d39db2a {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 10:30:31 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Start _get_guest_xml network_info=[{"id": "68243307-5696-444d-8f67-05f07d39db2a", "address": "fa:16:3e:c8:ab:8e", "network": {"id": "b535bacc-9690-4269-a1e4-6aee5466ece4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-811923488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02892a9661ba44dd8c32b91f74446d99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68243307-56", "ovs_interfaceid": "68243307-5696-444d-8f67-05f07d39db2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T10:30:26Z,direct_url=<?>,disk_format='qcow2',id=94a8ad05-1080-4adb-a459-0c03205f2a1d,min_disk=0,min_ram=0,name='tempest-scenario-img--69026688',owner='02892a9661ba44dd8c32b91f74446d99',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T10:30:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'image_id': '94a8ad05-1080-4adb-a459-0c03205f2a1d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 10:30:31 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:30:31 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:30:31 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 10:30:31 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 10:30:31 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 10:30:31 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 10:30:31 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 10:30:31 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T10:30:26Z,direct_url=<?>,disk_format='qcow2',id=94a8ad05-1080-4adb-a459-0c03205f2a1d,min_disk=0,min_ram=0,name='tempest-scenario-img--69026688',owner='02892a9661ba44dd8c32b91f74446d99',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T10:30:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 10:30:31 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 10:30:31 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 10:30:31 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 10:30:31 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 10:30:31 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 10:30:31 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 10:30:31 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 10:30:31 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 10:30:31 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 10:30:31 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 10:30:31 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:30:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2037126371',display_name='tempest-TestMinimumBasicScenario-server-2037126371',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2037126371',id=49,image_ref='94a8ad05-1080-4adb-a459-0c03205f2a1d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFupQC4fA9dh6E5Zjfm9UglkIiRCNHJLSfEDGtK26Q7BMVZ6BWaHJkiX3U0lFHI76EqPtJ5R/KDp30iEbseobGBUhzv9eZMEY7oqVzSJCHtJVpLePFtcnb57Y1Rr4pmdXw==',key_name='tempest-TestMinimumBasicScenario-263130476',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02892a9661ba44dd8c32b91f74446d99',ramdisk_id='',reservation_id='r-gly1u0g9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='94a8ad05-1080-4adb-a459-0c03205f2a1d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-248468997',owner_user_name='tempest-TestMinimumBasicScenario-248468997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T10:30:29Z,user_data=None,user_id='4a47a5b738a6402db511c0e096f2c26e',uuid=4eb47c5d-5398-46ec-8674-40ea1a98636a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68243307-5696-444d-8f67-05f07d39db2a", "address": "fa:16:3e:c8:ab:8e", "network": {"id": "b535bacc-9690-4269-a1e4-6aee5466ece4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-811923488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02892a9661ba44dd8c32b91f74446d99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68243307-56", "ovs_interfaceid": "68243307-5696-444d-8f67-05f07d39db2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 10:30:31 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Converting VIF {"id": "68243307-5696-444d-8f67-05f07d39db2a", "address": "fa:16:3e:c8:ab:8e", "network": {"id": "b535bacc-9690-4269-a1e4-6aee5466ece4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-811923488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02892a9661ba44dd8c32b91f74446d99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68243307-56", "ovs_interfaceid": "68243307-5696-444d-8f67-05f07d39db2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:30:31 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:ab:8e,bridge_name='br-int',has_traffic_filtering=True,id=68243307-5696-444d-8f67-05f07d39db2a,network=Network(b535bacc-9690-4269-a1e4-6aee5466ece4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68243307-56') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:30:31 user nova-compute[71113]: DEBUG nova.objects.instance [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lazy-loading 'pci_devices' on Instance uuid 4eb47c5d-5398-46ec-8674-40ea1a98636a {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:30:31 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] End _get_guest_xml xml=<domain type="kvm">
Jul 31 10:30:31 user nova-compute[71113]:   <uuid>4eb47c5d-5398-46ec-8674-40ea1a98636a</uuid>
Jul 31 10:30:31 user nova-compute[71113]:   <name>instance-00000031</name>
Jul 31 10:30:31 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 10:30:31 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 10:30:31 user nova-compute[71113]:   <metadata>
Jul 31 10:30:31 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 10:30:31 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 10:30:31 user nova-compute[71113]:       <nova:name>tempest-TestMinimumBasicScenario-server-2037126371</nova:name>
Jul 31 10:30:31 user nova-compute[71113]:       <nova:creationTime>2023-07-31 10:30:31</nova:creationTime>
Jul 31 10:30:31 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 10:30:31 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 10:30:31 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 10:30:31 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 10:30:31 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 10:30:31 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 10:30:31 user nova-compute[71113]:       </nova:flavor>
Jul 31 10:30:31 user nova-compute[71113]:       <nova:owner>
Jul 31 10:30:31 user nova-compute[71113]:         <nova:user uuid="4a47a5b738a6402db511c0e096f2c26e">tempest-TestMinimumBasicScenario-248468997-project-member</nova:user>
Jul 31 10:30:31 user nova-compute[71113]:         <nova:project uuid="02892a9661ba44dd8c32b91f74446d99">tempest-TestMinimumBasicScenario-248468997</nova:project>
Jul 31 10:30:31 user nova-compute[71113]:       </nova:owner>
Jul 31 10:30:31 user nova-compute[71113]:       <nova:root type="image" uuid="94a8ad05-1080-4adb-a459-0c03205f2a1d"/>
Jul 31 10:30:31 user nova-compute[71113]:       <nova:ports>
Jul 31 10:30:31 user nova-compute[71113]:         <nova:port uuid="68243307-5696-444d-8f67-05f07d39db2a">
Jul 31 10:30:31 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 31 10:30:31 user nova-compute[71113]:         </nova:port>
Jul 31 10:30:31 user nova-compute[71113]:       </nova:ports>
Jul 31 10:30:31 user nova-compute[71113]:     </nova:instance>
Jul 31 10:30:31 user nova-compute[71113]:   </metadata>
Jul 31 10:30:31 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 10:30:31 user nova-compute[71113]:     <system>
Jul 31 10:30:31 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 10:30:31 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 10:30:31 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 10:30:31 user nova-compute[71113]:       <entry name="serial">4eb47c5d-5398-46ec-8674-40ea1a98636a</entry>
Jul 31 10:30:31 user nova-compute[71113]:       <entry name="uuid">4eb47c5d-5398-46ec-8674-40ea1a98636a</entry>
Jul 31 10:30:31 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 10:30:31 user nova-compute[71113]:     </system>
Jul 31 10:30:31 user nova-compute[71113]:   </sysinfo>
Jul 31 10:30:31 user nova-compute[71113]:   <os>
Jul 31 10:30:31 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 10:30:31 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 10:30:31 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 10:30:31 user nova-compute[71113]:   </os>
Jul 31 10:30:31 user nova-compute[71113]:   <features>
Jul 31 10:30:31 user nova-compute[71113]:     <acpi/>
Jul 31 10:30:31 user nova-compute[71113]:     <apic/>
Jul 31 10:30:31 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 10:30:31 user nova-compute[71113]:   </features>
Jul 31 10:30:31 user nova-compute[71113]:   <clock offset="utc">
Jul 31 10:30:31 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 10:30:31 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 10:30:31 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 10:30:31 user nova-compute[71113]:   </clock>
Jul 31 10:30:31 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 10:30:31 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 10:30:31 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 10:30:31 user nova-compute[71113]:   </cpu>
Jul 31 10:30:31 user nova-compute[71113]:   <devices>
Jul 31 10:30:31 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 10:30:31 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 10:30:31 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/4eb47c5d-5398-46ec-8674-40ea1a98636a/disk"/>
Jul 31 10:30:31 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 10:30:31 user nova-compute[71113]:     </disk>
Jul 31 10:30:31 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 10:30:31 user nova-compute[71113]:       <mac address="fa:16:3e:c8:ab:8e"/>
Jul 31 10:30:31 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:30:31 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 10:30:31 user nova-compute[71113]:       <target dev="tap68243307-56"/>
Jul 31 10:30:31 user nova-compute[71113]:     </interface>
Jul 31 10:30:31 user nova-compute[71113]:     <serial type="pty">
Jul 31 10:30:31 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/4eb47c5d-5398-46ec-8674-40ea1a98636a/console.log" append="off"/>
Jul 31 10:30:31 user nova-compute[71113]:     </serial>
Jul 31 10:30:31 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 10:30:31 user nova-compute[71113]:     <video>
Jul 31 10:30:31 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:30:31 user nova-compute[71113]:     </video>
Jul 31 10:30:31 user nova-compute[71113]:     <rng model="virtio">
Jul 31 10:30:31 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 10:30:31 user nova-compute[71113]:     </rng>
Jul 31 10:30:31 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 10:30:31 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 10:30:31 user nova-compute[71113]:       <stats period="10"/>
Jul 31 10:30:31 user nova-compute[71113]:     </memballoon>
Jul 31 10:30:31 user nova-compute[71113]:   </devices>
Jul 31 10:30:31 user nova-compute[71113]: </domain>
Jul 31 10:30:31 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 10:30:31 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:30:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2037126371',display_name='tempest-TestMinimumBasicScenario-server-2037126371',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2037126371',id=49,image_ref='94a8ad05-1080-4adb-a459-0c03205f2a1d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFupQC4fA9dh6E5Zjfm9UglkIiRCNHJLSfEDGtK26Q7BMVZ6BWaHJkiX3U0lFHI76EqPtJ5R/KDp30iEbseobGBUhzv9eZMEY7oqVzSJCHtJVpLePFtcnb57Y1Rr4pmdXw==',key_name='tempest-TestMinimumBasicScenario-263130476',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02892a9661ba44dd8c32b91f74446d99',ramdisk_id='',reservation_id='r-gly1u0g9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='94a8ad05-1080-4adb-a459-0c03205f2a1d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-248468997',owner_user_name='tempest-TestMinimumBasicScenario-248468997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T10:30:29Z,user_data=None,user_id='4a47a5b738a6402db511c0e096f2c26e',uuid=4eb47c5d-5398-46ec-8674-40ea1a98636a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68243307-5696-444d-8f67-05f07d39db2a", "address": "fa:16:3e:c8:ab:8e", "network": {"id": "b535bacc-9690-4269-a1e4-6aee5466ece4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-811923488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02892a9661ba44dd8c32b91f74446d99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68243307-56", "ovs_interfaceid": "68243307-5696-444d-8f67-05f07d39db2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 10:30:31 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Converting VIF {"id": "68243307-5696-444d-8f67-05f07d39db2a", "address": "fa:16:3e:c8:ab:8e", "network": {"id": "b535bacc-9690-4269-a1e4-6aee5466ece4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-811923488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02892a9661ba44dd8c32b91f74446d99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68243307-56", "ovs_interfaceid": "68243307-5696-444d-8f67-05f07d39db2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:30:31 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:ab:8e,bridge_name='br-int',has_traffic_filtering=True,id=68243307-5696-444d-8f67-05f07d39db2a,network=Network(b535bacc-9690-4269-a1e4-6aee5466ece4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68243307-56') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:30:31 user nova-compute[71113]: DEBUG os_vif [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:ab:8e,bridge_name='br-int',has_traffic_filtering=True,id=68243307-5696-444d-8f67-05f07d39db2a,network=Network(b535bacc-9690-4269-a1e4-6aee5466ece4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68243307-56') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 10:30:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:30:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:30:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 10:30:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:30:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap68243307-56, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:30:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap68243307-56, col_values=(('external_ids', {'iface-id': '68243307-5696-444d-8f67-05f07d39db2a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:ab:8e', 'vm-uuid': '4eb47c5d-5398-46ec-8674-40ea1a98636a'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:30:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:30:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:30:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:30:31 user nova-compute[71113]: INFO os_vif [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:ab:8e,bridge_name='br-int',has_traffic_filtering=True,id=68243307-5696-444d-8f67-05f07d39db2a,network=Network(b535bacc-9690-4269-a1e4-6aee5466ece4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68243307-56')
Jul 31 10:30:31 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:30:31 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] No VIF found with MAC fa:16:3e:c8:ab:8e, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 10:30:31 user nova-compute[71113]: DEBUG nova.network.neutron [req-2096c2e7-aa11-4371-8c38-1498b2d0e34b req-6e8cb80f-bd9d-4972-accf-7c34d3f20139 service nova] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Updated VIF entry in instance network info cache for port 68243307-5696-444d-8f67-05f07d39db2a. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 10:30:31 user nova-compute[71113]: DEBUG nova.network.neutron [req-2096c2e7-aa11-4371-8c38-1498b2d0e34b req-6e8cb80f-bd9d-4972-accf-7c34d3f20139 service nova] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Updating instance_info_cache with network_info: [{"id": "68243307-5696-444d-8f67-05f07d39db2a", "address": "fa:16:3e:c8:ab:8e", "network": {"id": "b535bacc-9690-4269-a1e4-6aee5466ece4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-811923488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02892a9661ba44dd8c32b91f74446d99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68243307-56", "ovs_interfaceid": "68243307-5696-444d-8f67-05f07d39db2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:30:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-2096c2e7-aa11-4371-8c38-1498b2d0e34b req-6e8cb80f-bd9d-4972-accf-7c34d3f20139 service nova] Releasing lock "refresh_cache-4eb47c5d-5398-46ec-8674-40ea1a98636a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:30:31 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:30:31 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:30:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:30:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:30:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:30:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:30:32 user nova-compute[71113]: DEBUG nova.compute.manager [req-3e0b4aec-c536-4ec0-9c1b-e1463db28411 req-03b2f577-7271-44cf-9d90-418608affe29 service nova] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Received event network-vif-plugged-68243307-5696-444d-8f67-05f07d39db2a {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:30:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3e0b4aec-c536-4ec0-9c1b-e1463db28411 req-03b2f577-7271-44cf-9d90-418608affe29 service nova] Acquiring lock "4eb47c5d-5398-46ec-8674-40ea1a98636a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:30:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3e0b4aec-c536-4ec0-9c1b-e1463db28411 req-03b2f577-7271-44cf-9d90-418608affe29 service nova] Lock "4eb47c5d-5398-46ec-8674-40ea1a98636a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:30:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3e0b4aec-c536-4ec0-9c1b-e1463db28411 req-03b2f577-7271-44cf-9d90-418608affe29 service nova] Lock "4eb47c5d-5398-46ec-8674-40ea1a98636a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:30:32 user nova-compute[71113]: DEBUG nova.compute.manager [req-3e0b4aec-c536-4ec0-9c1b-e1463db28411 req-03b2f577-7271-44cf-9d90-418608affe29 service nova] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] No waiting events found dispatching network-vif-plugged-68243307-5696-444d-8f67-05f07d39db2a {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:30:32 user nova-compute[71113]: WARNING nova.compute.manager [req-3e0b4aec-c536-4ec0-9c1b-e1463db28411 req-03b2f577-7271-44cf-9d90-418608affe29 service nova] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Received unexpected event network-vif-plugged-68243307-5696-444d-8f67-05f07d39db2a for instance with vm_state building and task_state spawning.
Jul 31 10:30:33 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:30:33 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:30:34 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690799434.6044903, 4eb47c5d-5398-46ec-8674-40ea1a98636a => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:30:34 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] VM Resumed (Lifecycle Event)
Jul 31 10:30:34 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 10:30:34 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 10:30:34 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Instance spawned successfully.
Jul 31 10:30:34 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 10:30:34 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Found default for hw_cdrom_bus of ide {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:30:34 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Found default for hw_disk_bus of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:30:34 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Found default for hw_input_bus of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:30:34 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Found default for hw_pointer_model of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:30:34 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Found default for hw_video_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:30:34 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Found default for hw_vif_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:30:34 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:30:34 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:30:34 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 10:30:34 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690799434.6059244, 4eb47c5d-5398-46ec-8674-40ea1a98636a => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:30:34 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] VM Started (Lifecycle Event)
Jul 31 10:30:34 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:30:34 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:30:34 user nova-compute[71113]: INFO nova.compute.manager [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Took 5.56 seconds to spawn the instance on the hypervisor.
Jul 31 10:30:34 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:30:34 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 10:30:34 user nova-compute[71113]: INFO nova.compute.manager [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Took 6.10 seconds to build instance.
Jul 31 10:30:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0a5161fc-d879-411e-9b01-482444e03033 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "4eb47c5d-5398-46ec-8674-40ea1a98636a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.207s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:30:34 user nova-compute[71113]: DEBUG nova.compute.manager [req-c8a1c6f1-572a-4079-9f56-466184debcf8 req-3964c95a-652e-45a1-8356-2fb954feed7f service nova] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Received event network-vif-plugged-68243307-5696-444d-8f67-05f07d39db2a {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:30:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-c8a1c6f1-572a-4079-9f56-466184debcf8 req-3964c95a-652e-45a1-8356-2fb954feed7f service nova] Acquiring lock "4eb47c5d-5398-46ec-8674-40ea1a98636a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:30:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-c8a1c6f1-572a-4079-9f56-466184debcf8 req-3964c95a-652e-45a1-8356-2fb954feed7f service nova] Lock "4eb47c5d-5398-46ec-8674-40ea1a98636a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:30:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-c8a1c6f1-572a-4079-9f56-466184debcf8 req-3964c95a-652e-45a1-8356-2fb954feed7f service nova] Lock "4eb47c5d-5398-46ec-8674-40ea1a98636a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:30:34 user nova-compute[71113]: DEBUG nova.compute.manager [req-c8a1c6f1-572a-4079-9f56-466184debcf8 req-3964c95a-652e-45a1-8356-2fb954feed7f service nova] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] No waiting events found dispatching network-vif-plugged-68243307-5696-444d-8f67-05f07d39db2a {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:30:34 user nova-compute[71113]: WARNING nova.compute.manager [req-c8a1c6f1-572a-4079-9f56-466184debcf8 req-3964c95a-652e-45a1-8356-2fb954feed7f service nova] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Received unexpected event network-vif-plugged-68243307-5696-444d-8f67-05f07d39db2a for instance with vm_state active and task_state None.
Jul 31 10:30:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:30:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:30:38 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:30:38 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:30:38 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Rebuilding the list of instances to heal {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 10:30:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "refresh_cache-4eb47c5d-5398-46ec-8674-40ea1a98636a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:30:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquired lock "refresh_cache-4eb47c5d-5398-46ec-8674-40ea1a98636a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:30:38 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Forcefully refreshing network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 10:30:38 user nova-compute[71113]: DEBUG nova.objects.instance [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lazy-loading 'info_cache' on Instance uuid 4eb47c5d-5398-46ec-8674-40ea1a98636a {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:30:39 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Updating instance_info_cache with network_info: [{"id": "68243307-5696-444d-8f67-05f07d39db2a", "address": "fa:16:3e:c8:ab:8e", "network": {"id": "b535bacc-9690-4269-a1e4-6aee5466ece4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-811923488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02892a9661ba44dd8c32b91f74446d99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68243307-56", "ovs_interfaceid": "68243307-5696-444d-8f67-05f07d39db2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:30:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Releasing lock "refresh_cache-4eb47c5d-5398-46ec-8674-40ea1a98636a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:30:39 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Updated the network info_cache for instance {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 10:30:40 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:30:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:30:42 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:30:42 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:30:43 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:30:44 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:30:44 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:30:44 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:30:44 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:30:44 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:30:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb47c5d-5398-46ec-8674-40ea1a98636a/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:30:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb47c5d-5398-46ec-8674-40ea1a98636a/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:30:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb47c5d-5398-46ec-8674-40ea1a98636a/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:30:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb47c5d-5398-46ec-8674-40ea1a98636a/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:30:45 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:30:45 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:30:45 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=8859MB free_disk=25.197040557861328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:30:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:30:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:30:45 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 4eb47c5d-5398-46ec-8674-40ea1a98636a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:30:45 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:30:45 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:30:45 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:30:45 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:30:45 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:30:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.197s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:30:46 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:30:47 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:30:48 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:30:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:30:51 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:30:51 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:30:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:30:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:31:00 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:31:01 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:31:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:31:06 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:31:11 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:31:11 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:31:11 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:31:11 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:31:11 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:31:11 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:31:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:31:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:31:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:31:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:31:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:31:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:31:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:31:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:31:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:31:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:31:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:31:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:31:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:31:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:31:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:31:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:31:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:31:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:31:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:31:31 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:31:32 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:31:33 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:31:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:31:38 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:31:38 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:31:38 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Rebuilding the list of instances to heal {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 10:31:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "refresh_cache-4eb47c5d-5398-46ec-8674-40ea1a98636a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:31:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquired lock "refresh_cache-4eb47c5d-5398-46ec-8674-40ea1a98636a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:31:38 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Forcefully refreshing network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 10:31:38 user nova-compute[71113]: DEBUG nova.objects.instance [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lazy-loading 'info_cache' on Instance uuid 4eb47c5d-5398-46ec-8674-40ea1a98636a {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:31:39 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Updating instance_info_cache with network_info: [{"id": "68243307-5696-444d-8f67-05f07d39db2a", "address": "fa:16:3e:c8:ab:8e", "network": {"id": "b535bacc-9690-4269-a1e4-6aee5466ece4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-811923488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02892a9661ba44dd8c32b91f74446d99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68243307-56", "ovs_interfaceid": "68243307-5696-444d-8f67-05f07d39db2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:31:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Releasing lock "refresh_cache-4eb47c5d-5398-46ec-8674-40ea1a98636a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:31:39 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Updated the network info_cache for instance {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 10:31:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:31:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:31:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:31:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:31:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:31:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:31:44 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:31:44 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:31:45 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:31:45 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:31:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:31:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:31:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:31:45 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:31:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb47c5d-5398-46ec-8674-40ea1a98636a/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:31:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb47c5d-5398-46ec-8674-40ea1a98636a/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:31:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb47c5d-5398-46ec-8674-40ea1a98636a/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:31:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb47c5d-5398-46ec-8674-40ea1a98636a/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:31:46 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:31:46 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:31:46 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:31:46 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=8866MB free_disk=25.168651580810547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:31:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:31:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:31:46 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 4eb47c5d-5398-46ec-8674-40ea1a98636a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:31:46 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:31:46 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:31:46 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:31:46 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:31:46 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:31:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.154s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:31:48 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:31:50 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:31:51 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:31:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:32:01 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:32:01 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:32:01 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:32:01 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:32:01 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:32:01 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:32:06 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:32:06 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:32:06 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:32:06 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:32:06 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:32:06 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:32:11 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:32:11 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:32:11 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:32:11 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:32:11 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:32:11 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:32:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:32:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:32:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:32:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:32:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:32:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:32:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:32:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:32:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:32:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:32:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:32:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:32:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-6eb3663a-85a1-4762-8f29-4143b852324a tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Acquiring lock "4eb47c5d-5398-46ec-8674-40ea1a98636a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:32:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-6eb3663a-85a1-4762-8f29-4143b852324a tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "4eb47c5d-5398-46ec-8674-40ea1a98636a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:32:23 user nova-compute[71113]: DEBUG nova.objects.instance [None req-6eb3663a-85a1-4762-8f29-4143b852324a tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lazy-loading 'flavor' on Instance uuid 4eb47c5d-5398-46ec-8674-40ea1a98636a {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:32:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-6eb3663a-85a1-4762-8f29-4143b852324a tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "4eb47c5d-5398-46ec-8674-40ea1a98636a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:32:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-6eb3663a-85a1-4762-8f29-4143b852324a tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Acquiring lock "4eb47c5d-5398-46ec-8674-40ea1a98636a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:32:23 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-6eb3663a-85a1-4762-8f29-4143b852324a tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "4eb47c5d-5398-46ec-8674-40ea1a98636a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:32:23 user nova-compute[71113]: INFO nova.compute.manager [None req-6eb3663a-85a1-4762-8f29-4143b852324a tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Attaching volume b4963435-c8f7-4c9d-b1c8-51616d1adf05 to /dev/vdb
Jul 31 10:32:23 user nova-compute[71113]: DEBUG os_brick.utils [None req-6eb3663a-85a1-4762-8f29-4143b852324a tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:32:23 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:32:23 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:32:23 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc3d402-a916-4577-94d3-b7dec51ebbbf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:32:23 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:32:23 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:32:23 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5069d32-65be-4f6c-914b-a5af865f30f4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:32:23 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:32:23 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:32:23 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[777c1dc1-da1f-47bf-a059-823c270a17b4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:32:23 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e84ecd-4471-4a53-abdc-7149a8bb10a0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:32:23 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-6eb3663a-85a1-4762-8f29-4143b852324a tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:32:23 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-6eb3663a-85a1-4762-8f29-4143b852324a tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 10:32:23 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6eb3663a-85a1-4762-8f29-4143b852324a tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 10:32:23 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:32:23 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 10:32:23 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 10:32:23 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4aef34-9e09-486e-88d4-f76fed0ca170]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:32:23 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-6eb3663a-85a1-4762-8f29-4143b852324a tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 10:32:23 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-6eb3663a-85a1-4762-8f29-4143b852324a tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 10:32:23 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-6eb3663a-85a1-4762-8f29-4143b852324a tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 10:32:23 user nova-compute[71113]: DEBUG os_brick.utils [None req-6eb3663a-85a1-4762-8f29-4143b852324a tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:32:23 user nova-compute[71113]: DEBUG nova.virt.block_device [None req-6eb3663a-85a1-4762-8f29-4143b852324a tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Updating existing volume attachment record: 6edd9072-afaa-4094-8496-a1536b2562bc {{(pid=71113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 10:32:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:32:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:32:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:32:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:32:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:32:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:32:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:32:31 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:32:33 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:32:34 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:32:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6eb3663a-85a1-4762-8f29-4143b852324a tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 10:32:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb3663a-85a1-4762-8f29-4143b852324a tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PvCQjnsm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:32:35 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-6eb3663a-85a1-4762-8f29-4143b852324a tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:32:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-6eb3663a-85a1-4762-8f29-4143b852324a tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:32:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-6eb3663a-85a1-4762-8f29-4143b852324a tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:32:35 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-6eb3663a-85a1-4762-8f29-4143b852324a tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:32:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-6eb3663a-85a1-4762-8f29-4143b852324a tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:32:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-6eb3663a-85a1-4762-8f29-4143b852324a tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:32:35 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-6eb3663a-85a1-4762-8f29-4143b852324a tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 10:32:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05 -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:32:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:32:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5d08b5-03d9-4f35-b8cd-ee2e9daf8a28]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:32:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb3663a-85a1-4762-8f29-4143b852324a tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 10:32:35 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:32:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05 -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:32:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:32:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b49ab4c-6b35-4b2e-bbb5-b7c151f5784c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:32:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb3663a-85a1-4762-8f29-4143b852324a tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05] added
Jul 31 10:32:35 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:32:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:32:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:32:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0694dcc3-2297-4963-9e19-fcdc3e1b27c5]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:32:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb3663a-85a1-4762-8f29-4143b852324a tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:32:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:32:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:32:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5745681d-4457-4afd-b300-109ab42e56ae]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:32:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb3663a-85a1-4762-8f29-4143b852324a tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:32:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PvCQjnsm {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:32:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PvCQjnsm" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:32:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8caaa276-f935-40ca-acd4-8cd5c52b3e2b]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:32:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb3663a-85a1-4762-8f29-4143b852324a tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PvCQjnsm'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:32:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:32:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:32:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[05df7f2f-73a7-452c-b7ac-7cb1e5ff50c5]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:32:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb3663a-85a1-4762-8f29-4143b852324a tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:32:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:32:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:32:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e3141d-c9d0-441c-a66d-5a283ae7ac7e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:32:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb3663a-85a1-4762-8f29-4143b852324a tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 31 10:32:35 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:32:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb3663a-85a1-4762-8f29-4143b852324a tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 31 10:32:35 user nova-compute[71113]:  {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:32:35 user nova-compute[71113]: WARNING os_brick.initiator.connectors.iscsi [None req-6eb3663a-85a1-4762-8f29-4143b852324a tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 31 10:32:35 user nova-compute[71113]: 
Jul 31 10:32:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05 -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:32:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:32:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba77023-7edc-48cc-9451-38d2b3de785a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:32:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb3663a-85a1-4762-8f29-4143b852324a tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05, portal: 172.16.0.220,3260]
Jul 31 10:32:35 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05, portal: 172.16.0.220,3260] successful.
Jul 31 10:32:35 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:32:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:32:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:32:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c728685c-c15f-4735-a650-60d92610ed60]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:32:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb3663a-85a1-4762-8f29-4143b852324a tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:32:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:32:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:32:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[773b143a-af07-42ee-bc35-756233e366e8]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:32:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb3663a-85a1-4762-8f29-4143b852324a tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05 (non-flash)
Jul 31 10:32:35 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:32:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb3663a-85a1-4762-8f29-4143b852324a tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05 (non-flash)
Jul 31 10:32:35 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:32:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-6eb3663a-85a1-4762-8f29-4143b852324a tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:32:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb3663a-85a1-4762-8f29-4143b852324a tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 10:32:35 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-6eb3663a-85a1-4762-8f29-4143b852324a tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 10:32:35 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-6eb3663a-85a1-4762-8f29-4143b852324a tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 10:32:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:32:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:32:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5467090d-ba1d-4991-9bdb-12b4cfc24a4e]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:32:35 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-6eb3663a-85a1-4762-8f29-4143b852324a tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: None {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 10:32:36 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-6eb3663a-85a1-4762-8f29-4143b852324a tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 10:32:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb3663a-85a1-4762-8f29-4143b852324a tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PvCQjnsm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 10:32:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-6eb3663a-85a1-4762-8f29-4143b852324a tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:32:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb3663a-85a1-4762-8f29-4143b852324a tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23764363439353032', 'path': '/dev/sdb'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:32:36 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6eb3663a-85a1-4762-8f29-4143b852324a tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23764363439353032', 'path': '/dev/sdb'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 10:32:36 user nova-compute[71113]: DEBUG nova.objects.instance [None req-6eb3663a-85a1-4762-8f29-4143b852324a tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lazy-loading 'flavor' on Instance uuid 4eb47c5d-5398-46ec-8674-40ea1a98636a {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:32:36 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-6eb3663a-85a1-4762-8f29-4143b852324a tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 10:32:36 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:32:36 user nova-compute[71113]:   <source dev="/dev/sdb"/>
Jul 31 10:32:36 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 10:32:36 user nova-compute[71113]:   <serial>b4963435-c8f7-4c9d-b1c8-51616d1adf05</serial>
Jul 31 10:32:36 user nova-compute[71113]: </disk>
Jul 31 10:32:36 user nova-compute[71113]:  {{(pid=71113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 10:32:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:32:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:32:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:32:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:32:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:32:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:32:36 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-6eb3663a-85a1-4762-8f29-4143b852324a tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:32:36 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-6eb3663a-85a1-4762-8f29-4143b852324a tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:32:36 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-6eb3663a-85a1-4762-8f29-4143b852324a tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] No VIF found with MAC fa:16:3e:c8:ab:8e, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 10:32:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-6eb3663a-85a1-4762-8f29-4143b852324a tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "4eb47c5d-5398-46ec-8674-40ea1a98636a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.519s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:32:38 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:32:38 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:32:38 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Rebuilding the list of instances to heal {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 10:32:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "refresh_cache-4eb47c5d-5398-46ec-8674-40ea1a98636a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:32:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquired lock "refresh_cache-4eb47c5d-5398-46ec-8674-40ea1a98636a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:32:38 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Forcefully refreshing network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 10:32:38 user nova-compute[71113]: DEBUG nova.objects.instance [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lazy-loading 'info_cache' on Instance uuid 4eb47c5d-5398-46ec-8674-40ea1a98636a {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:32:39 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Updating instance_info_cache with network_info: [{"id": "68243307-5696-444d-8f67-05f07d39db2a", "address": "fa:16:3e:c8:ab:8e", "network": {"id": "b535bacc-9690-4269-a1e4-6aee5466ece4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-811923488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02892a9661ba44dd8c32b91f74446d99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68243307-56", "ovs_interfaceid": "68243307-5696-444d-8f67-05f07d39db2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:32:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Releasing lock "refresh_cache-4eb47c5d-5398-46ec-8674-40ea1a98636a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:32:39 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Updated the network info_cache for instance {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 10:32:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:32:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:32:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:32:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:32:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:32:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:32:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:32:43 user nova-compute[71113]: DEBUG nova.compute.manager [req-c5bce01c-071c-422f-a083-5a1a3ec5050c req-96c0a3b5-7665-4239-8cf6-0043de99c848 service nova] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Received event network-changed-68243307-5696-444d-8f67-05f07d39db2a {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:32:43 user nova-compute[71113]: DEBUG nova.compute.manager [req-c5bce01c-071c-422f-a083-5a1a3ec5050c req-96c0a3b5-7665-4239-8cf6-0043de99c848 service nova] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Refreshing instance network info cache due to event network-changed-68243307-5696-444d-8f67-05f07d39db2a. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 10:32:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-c5bce01c-071c-422f-a083-5a1a3ec5050c req-96c0a3b5-7665-4239-8cf6-0043de99c848 service nova] Acquiring lock "refresh_cache-4eb47c5d-5398-46ec-8674-40ea1a98636a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:32:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-c5bce01c-071c-422f-a083-5a1a3ec5050c req-96c0a3b5-7665-4239-8cf6-0043de99c848 service nova] Acquired lock "refresh_cache-4eb47c5d-5398-46ec-8674-40ea1a98636a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:32:43 user nova-compute[71113]: DEBUG nova.network.neutron [req-c5bce01c-071c-422f-a083-5a1a3ec5050c req-96c0a3b5-7665-4239-8cf6-0043de99c848 service nova] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Refreshing network info cache for port 68243307-5696-444d-8f67-05f07d39db2a {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 10:32:44 user nova-compute[71113]: DEBUG nova.network.neutron [req-c5bce01c-071c-422f-a083-5a1a3ec5050c req-96c0a3b5-7665-4239-8cf6-0043de99c848 service nova] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Updated VIF entry in instance network info cache for port 68243307-5696-444d-8f67-05f07d39db2a. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 10:32:44 user nova-compute[71113]: DEBUG nova.network.neutron [req-c5bce01c-071c-422f-a083-5a1a3ec5050c req-96c0a3b5-7665-4239-8cf6-0043de99c848 service nova] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Updating instance_info_cache with network_info: [{"id": "68243307-5696-444d-8f67-05f07d39db2a", "address": "fa:16:3e:c8:ab:8e", "network": {"id": "b535bacc-9690-4269-a1e4-6aee5466ece4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-811923488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02892a9661ba44dd8c32b91f74446d99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68243307-56", "ovs_interfaceid": "68243307-5696-444d-8f67-05f07d39db2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:32:44 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-c5bce01c-071c-422f-a083-5a1a3ec5050c req-96c0a3b5-7665-4239-8cf6-0043de99c848 service nova] Releasing lock "refresh_cache-4eb47c5d-5398-46ec-8674-40ea1a98636a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:32:45 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:32:45 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:32:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:32:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:32:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:32:45 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:32:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb47c5d-5398-46ec-8674-40ea1a98636a/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:32:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:32:45 user nova-compute[71113]: DEBUG nova.compute.manager [req-5649660a-c004-4320-98f5-1a8c5a76dbd3 req-41e81fc1-47bc-4cce-8ee3-99e44f3ef8d2 service nova] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Received event network-changed-68243307-5696-444d-8f67-05f07d39db2a {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:32:45 user nova-compute[71113]: DEBUG nova.compute.manager [req-5649660a-c004-4320-98f5-1a8c5a76dbd3 req-41e81fc1-47bc-4cce-8ee3-99e44f3ef8d2 service nova] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Refreshing instance network info cache due to event network-changed-68243307-5696-444d-8f67-05f07d39db2a. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 10:32:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-5649660a-c004-4320-98f5-1a8c5a76dbd3 req-41e81fc1-47bc-4cce-8ee3-99e44f3ef8d2 service nova] Acquiring lock "refresh_cache-4eb47c5d-5398-46ec-8674-40ea1a98636a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:32:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-5649660a-c004-4320-98f5-1a8c5a76dbd3 req-41e81fc1-47bc-4cce-8ee3-99e44f3ef8d2 service nova] Acquired lock "refresh_cache-4eb47c5d-5398-46ec-8674-40ea1a98636a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:32:45 user nova-compute[71113]: DEBUG nova.network.neutron [req-5649660a-c004-4320-98f5-1a8c5a76dbd3 req-41e81fc1-47bc-4cce-8ee3-99e44f3ef8d2 service nova] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Refreshing network info cache for port 68243307-5696-444d-8f67-05f07d39db2a {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 10:32:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb47c5d-5398-46ec-8674-40ea1a98636a/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:32:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb47c5d-5398-46ec-8674-40ea1a98636a/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:32:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb47c5d-5398-46ec-8674-40ea1a98636a/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:32:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 10:32:46 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:32:46 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:32:46 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=8876MB free_disk=25.16745376586914GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:32:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:32:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:32:46 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:32:46 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 4eb47c5d-5398-46ec-8674-40ea1a98636a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:32:46 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:32:46 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:32:46 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Refreshing inventories for resource provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 31 10:32:46 user nova-compute[71113]: DEBUG nova.network.neutron [req-5649660a-c004-4320-98f5-1a8c5a76dbd3 req-41e81fc1-47bc-4cce-8ee3-99e44f3ef8d2 service nova] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Updated VIF entry in instance network info cache for port 68243307-5696-444d-8f67-05f07d39db2a. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 10:32:46 user nova-compute[71113]: DEBUG nova.network.neutron [req-5649660a-c004-4320-98f5-1a8c5a76dbd3 req-41e81fc1-47bc-4cce-8ee3-99e44f3ef8d2 service nova] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Updating instance_info_cache with network_info: [{"id": "68243307-5696-444d-8f67-05f07d39db2a", "address": "fa:16:3e:c8:ab:8e", "network": {"id": "b535bacc-9690-4269-a1e4-6aee5466ece4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-811923488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02892a9661ba44dd8c32b91f74446d99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68243307-56", "ovs_interfaceid": "68243307-5696-444d-8f67-05f07d39db2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:32:46 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Updating ProviderTree inventory for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 31 10:32:46 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Updating inventory in ProviderTree for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 31 10:32:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-5649660a-c004-4320-98f5-1a8c5a76dbd3 req-41e81fc1-47bc-4cce-8ee3-99e44f3ef8d2 service nova] Releasing lock "refresh_cache-4eb47c5d-5398-46ec-8674-40ea1a98636a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:32:46 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Refreshing aggregate associations for resource provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05, aggregates: None {{(pid=71113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 31 10:32:46 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Refreshing trait associations for resource provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE2,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS {{(pid=71113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 31 10:32:46 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:32:46 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:32:46 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:32:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.369s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:32:47 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:32:47 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:32:47 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:32:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Acquiring lock "4eb47c5d-5398-46ec-8674-40ea1a98636a" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:32:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "4eb47c5d-5398-46ec-8674-40ea1a98636a" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:32:49 user nova-compute[71113]: INFO nova.compute.manager [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Rebooting instance
Jul 31 10:32:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Acquiring lock "refresh_cache-4eb47c5d-5398-46ec-8674-40ea1a98636a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:32:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Acquired lock "refresh_cache-4eb47c5d-5398-46ec-8674-40ea1a98636a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:32:49 user nova-compute[71113]: DEBUG nova.network.neutron [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 10:32:50 user nova-compute[71113]: DEBUG nova.network.neutron [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Updating instance_info_cache with network_info: [{"id": "68243307-5696-444d-8f67-05f07d39db2a", "address": "fa:16:3e:c8:ab:8e", "network": {"id": "b535bacc-9690-4269-a1e4-6aee5466ece4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-811923488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02892a9661ba44dd8c32b91f74446d99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68243307-56", "ovs_interfaceid": "68243307-5696-444d-8f67-05f07d39db2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:32:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Releasing lock "refresh_cache-4eb47c5d-5398-46ec-8674-40ea1a98636a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:32:50 user nova-compute[71113]: DEBUG nova.compute.manager [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:32:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:32:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:32:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:32:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:32:51 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Instance destroyed successfully.
Jul 31 10:32:51 user nova-compute[71113]: DEBUG nova.objects.instance [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lazy-loading 'resources' on Instance uuid 4eb47c5d-5398-46ec-8674-40ea1a98636a {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:30:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2037126371',display_name='tempest-TestMinimumBasicScenario-server-2037126371',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2037126371',id=49,image_ref='94a8ad05-1080-4adb-a459-0c03205f2a1d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFupQC4fA9dh6E5Zjfm9UglkIiRCNHJLSfEDGtK26Q7BMVZ6BWaHJkiX3U0lFHI76EqPtJ5R/KDp30iEbseobGBUhzv9eZMEY7oqVzSJCHtJVpLePFtcnb57Y1Rr4pmdXw==',key_name='tempest-TestMinimumBasicScenario-263130476',keypairs=<?>,launch_index=0,launched_at=2023-07-31T10:30:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='02892a9661ba44dd8c32b91f74446d99',ramdisk_id='',reservation_id='r-gly1u0g9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='94a8ad05-1080-4adb-a459-0c03205f2a1d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-248468997',owner_user_name='tempest-TestMinimumBasicScenario-248468997-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T10:32:51Z,user_data=None,user_id='4a47a5b738a6402db511c0e096f2c26e',uuid=4eb47c5d-5398-46ec-8674-40ea1a98636a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68243307-5696-444d-8f67-05f07d39db2a", "address": "fa:16:3e:c8:ab:8e", "network": {"id": "b535bacc-9690-4269-a1e4-6aee5466ece4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-811923488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02892a9661ba44dd8c32b91f74446d99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68243307-56", "ovs_interfaceid": "68243307-5696-444d-8f67-05f07d39db2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Converting VIF {"id": "68243307-5696-444d-8f67-05f07d39db2a", "address": "fa:16:3e:c8:ab:8e", "network": {"id": "b535bacc-9690-4269-a1e4-6aee5466ece4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-811923488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02892a9661ba44dd8c32b91f74446d99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68243307-56", "ovs_interfaceid": "68243307-5696-444d-8f67-05f07d39db2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:ab:8e,bridge_name='br-int',has_traffic_filtering=True,id=68243307-5696-444d-8f67-05f07d39db2a,network=Network(b535bacc-9690-4269-a1e4-6aee5466ece4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68243307-56') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG os_vif [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:ab:8e,bridge_name='br-int',has_traffic_filtering=True,id=68243307-5696-444d-8f67-05f07d39db2a,network=Network(b535bacc-9690-4269-a1e4-6aee5466ece4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68243307-56') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap68243307-56, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:32:51 user nova-compute[71113]: INFO os_vif [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:ab:8e,bridge_name='br-int',has_traffic_filtering=True,id=68243307-5696-444d-8f67-05f07d39db2a,network=Network(b535bacc-9690-4269-a1e4-6aee5466ece4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68243307-56')
Jul 31 10:32:51 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PvCQjnsm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:32:51 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:32:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48058d3-c96a-48f1-8f24-6209e0f3944e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a363aad2-77ce-4599-b137-3f1f52b9cc17]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05 (non-flash)
Jul 31 10:32:51 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05 (non-flash)
Jul 31 10:32:51 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f78cc72fa30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05'): ({'sdb'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Removing single pathed devices sdb {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[48467619-898e-44a3-b4d2-e35c0f7bebc4]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[091e9452-3cc2-4f3a-bf4b-7fe74549c0aa]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Flushing IO for device /dev/sdb {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1afb65-4507-4113-8752-dd085679adc7]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[713f6083-cc9e-446f-b2ab-0e9c9913d208]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] SCSI volumes sdb have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca173d0-47ea-4f3a-8f47-ea50581ff27b]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05 -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9581c4-016f-46fb-b03d-3f177da5ee6b]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05, portal: 172.16.0.220,3260]
Jul 31 10:32:51 user nova-compute[71113]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05, portal: 172.16.0.220,3260] successful.
Jul 31 10:32:51 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05 -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6bfdf04-b0cf-4878-9a02-5fd3d65d8797]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] <== disconnect_volume: return (275ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Start _get_guest_xml network_info=[{"id": "68243307-5696-444d-8f67-05f07d39db2a", "address": "fa:16:3e:c8:ab:8e", "network": {"id": "b535bacc-9690-4269-a1e4-6aee5466ece4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-811923488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02892a9661ba44dd8c32b91f74446d99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68243307-56", "ovs_interfaceid": "68243307-5696-444d-8f67-05f07d39db2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=94a8ad05-1080-4adb-a459-0c03205f2a1d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'image_id': '94a8ad05-1080-4adb-a459-0c03205f2a1d'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '6edd9072-afaa-4094-8496-a1536b2562bc', 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PvCQjnsm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '4eb47c5d-5398-46ec-8674-40ea1a98636a', 'attached_at': '', 'detached_at': '', 'volume_id': 'b4963435-c8f7-4c9d-b1c8-51616d1adf05', 'serial': 'b4963435-c8f7-4c9d-b1c8-51616d1adf05'}, 'boot_index': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 10:32:51 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:32:51 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:32:51 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=94a8ad05-1080-4adb-a459-0c03205f2a1d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG nova.objects.instance [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4eb47c5d-5398-46ec-8674-40ea1a98636a {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PvCQjnsm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:32:51 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:32:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:32:51 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:32:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:32:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:32:51 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 10:32:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05 -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:32:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:32:52 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0014b1e3-2c37-43c3-b05d-a0597edfa93e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:32:52 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 10:32:52 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:32:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05 -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:32:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:32:52 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a6a68b-568a-4b31-aee6-c60d809020df]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:32:52 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05] added
Jul 31 10:32:52 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:32:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:32:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:32:52 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d748a357-9362-4641-834c-a99cb5923483]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:32:52 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:32:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:32:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.035s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:32:52 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26b2348-f32a-4796-863f-2d86867c6f9c]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:32:52 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:32:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PvCQjnsm {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:32:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PvCQjnsm" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:32:52 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9b115e-8650-4cd9-9de8-a5cea02fecf1]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:32:52 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PvCQjnsm'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:32:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:32:52 user nova-compute[71113]: DEBUG nova.compute.manager [req-5fe156cf-e985-430f-ae86-b59d117deeab req-47fd0280-4203-46a7-9157-dbe93c747259 service nova] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Received event network-vif-unplugged-68243307-5696-444d-8f67-05f07d39db2a {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:32:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-5fe156cf-e985-430f-ae86-b59d117deeab req-47fd0280-4203-46a7-9157-dbe93c747259 service nova] Acquiring lock "4eb47c5d-5398-46ec-8674-40ea1a98636a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:32:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-5fe156cf-e985-430f-ae86-b59d117deeab req-47fd0280-4203-46a7-9157-dbe93c747259 service nova] Lock "4eb47c5d-5398-46ec-8674-40ea1a98636a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:32:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-5fe156cf-e985-430f-ae86-b59d117deeab req-47fd0280-4203-46a7-9157-dbe93c747259 service nova] Lock "4eb47c5d-5398-46ec-8674-40ea1a98636a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:32:52 user nova-compute[71113]: DEBUG nova.compute.manager [req-5fe156cf-e985-430f-ae86-b59d117deeab req-47fd0280-4203-46a7-9157-dbe93c747259 service nova] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] No waiting events found dispatching network-vif-unplugged-68243307-5696-444d-8f67-05f07d39db2a {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:32:52 user nova-compute[71113]: WARNING nova.compute.manager [req-5fe156cf-e985-430f-ae86-b59d117deeab req-47fd0280-4203-46a7-9157-dbe93c747259 service nova] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Received unexpected event network-vif-unplugged-68243307-5696-444d-8f67-05f07d39db2a for instance with vm_state active and task_state reboot_started_hard.
Jul 31 10:32:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:32:52 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae65f3e-dfe7-4f9a-900e-819f469e1cb9]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:32:52 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:32:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:32:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:32:52 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e314a02-4b9f-48d3-86a6-736444ef8a84]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:32:52 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 31 10:32:52 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:32:52 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 31 10:32:52 user nova-compute[71113]:  {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:32:52 user nova-compute[71113]: WARNING os_brick.initiator.connectors.iscsi [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 31 10:32:52 user nova-compute[71113]: 
Jul 31 10:32:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05 -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:32:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:32:52 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa925ca-b3b8-4d11-8c70-559f7ad97294]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:32:52 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05, portal: 172.16.0.220,3260]
Jul 31 10:32:52 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05, portal: 172.16.0.220,3260] successful.
Jul 31 10:32:52 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:32:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:32:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:32:52 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe30524-1a30-4c6e-b534-6e923b1001a0]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:32:52 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:32:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:32:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:32:52 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1730165c-1f8c-447b-95f7-8e5a33b59371]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:32:52 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05 (non-flash)
Jul 31 10:32:52 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:32:52 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05 (non-flash)
Jul 31 10:32:52 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:32:52 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:32:52 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 10:32:52 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 10:32:52 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 10:32:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:32:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:32:52 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9065600-e8b9-40a8-9843-8bb07004f41c]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:32:52 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: None {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 10:32:52 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:32:53 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 10:32:53 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PvCQjnsm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 10:32:53 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:32:53 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '23764363439353032', 'path': '/dev/sdb'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:32:53 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23764363439353032', 'path': '/dev/sdb'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 10:32:53 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:30:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2037126371',display_name='tempest-TestMinimumBasicScenario-server-2037126371',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2037126371',id=49,image_ref='94a8ad05-1080-4adb-a459-0c03205f2a1d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFupQC4fA9dh6E5Zjfm9UglkIiRCNHJLSfEDGtK26Q7BMVZ6BWaHJkiX3U0lFHI76EqPtJ5R/KDp30iEbseobGBUhzv9eZMEY7oqVzSJCHtJVpLePFtcnb57Y1Rr4pmdXw==',key_name='tempest-TestMinimumBasicScenario-263130476',keypairs=<?>,launch_index=0,launched_at=2023-07-31T10:30:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='02892a9661ba44dd8c32b91f74446d99',ramdisk_id='',reservation_id='r-gly1u0g9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='94a8ad05-1080-4adb-a459-0c03205f2a1d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-248468997',owner_user_name='tempest-TestMinimumBasicScenario-248468997-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T10:32:51Z,user_data=None,user_id='4a47a5b738a6402db511c0e096f2c26e',uuid=4eb47c5d-5398-46ec-8674-40ea1a98636a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68243307-5696-444d-8f67-05f07d39db2a", "address": "fa:16:3e:c8:ab:8e", "network": {"id": "b535bacc-9690-4269-a1e4-6aee5466ece4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-811923488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02892a9661ba44dd8c32b91f74446d99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68243307-56", "ovs_interfaceid": "68243307-5696-444d-8f67-05f07d39db2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 10:32:53 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Converting VIF {"id": "68243307-5696-444d-8f67-05f07d39db2a", "address": "fa:16:3e:c8:ab:8e", "network": {"id": "b535bacc-9690-4269-a1e4-6aee5466ece4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-811923488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02892a9661ba44dd8c32b91f74446d99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68243307-56", "ovs_interfaceid": "68243307-5696-444d-8f67-05f07d39db2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:32:53 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:ab:8e,bridge_name='br-int',has_traffic_filtering=True,id=68243307-5696-444d-8f67-05f07d39db2a,network=Network(b535bacc-9690-4269-a1e4-6aee5466ece4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68243307-56') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:32:53 user nova-compute[71113]: DEBUG nova.objects.instance [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lazy-loading 'pci_devices' on Instance uuid 4eb47c5d-5398-46ec-8674-40ea1a98636a {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:32:53 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] End _get_guest_xml xml=<domain type="kvm">
Jul 31 10:32:53 user nova-compute[71113]:   <uuid>4eb47c5d-5398-46ec-8674-40ea1a98636a</uuid>
Jul 31 10:32:53 user nova-compute[71113]:   <name>instance-00000031</name>
Jul 31 10:32:53 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 10:32:53 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 10:32:53 user nova-compute[71113]:   <metadata>
Jul 31 10:32:53 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 10:32:53 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 10:32:53 user nova-compute[71113]:       <nova:name>tempest-TestMinimumBasicScenario-server-2037126371</nova:name>
Jul 31 10:32:53 user nova-compute[71113]:       <nova:creationTime>2023-07-31 10:32:51</nova:creationTime>
Jul 31 10:32:53 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 10:32:53 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 10:32:53 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 10:32:53 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 10:32:53 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 10:32:53 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 10:32:53 user nova-compute[71113]:       </nova:flavor>
Jul 31 10:32:53 user nova-compute[71113]:       <nova:owner>
Jul 31 10:32:53 user nova-compute[71113]:         <nova:user uuid="4a47a5b738a6402db511c0e096f2c26e">tempest-TestMinimumBasicScenario-248468997-project-member</nova:user>
Jul 31 10:32:53 user nova-compute[71113]:         <nova:project uuid="02892a9661ba44dd8c32b91f74446d99">tempest-TestMinimumBasicScenario-248468997</nova:project>
Jul 31 10:32:53 user nova-compute[71113]:       </nova:owner>
Jul 31 10:32:53 user nova-compute[71113]:       <nova:root type="image" uuid="94a8ad05-1080-4adb-a459-0c03205f2a1d"/>
Jul 31 10:32:53 user nova-compute[71113]:       <nova:ports>
Jul 31 10:32:53 user nova-compute[71113]:         <nova:port uuid="68243307-5696-444d-8f67-05f07d39db2a">
Jul 31 10:32:53 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 31 10:32:53 user nova-compute[71113]:         </nova:port>
Jul 31 10:32:53 user nova-compute[71113]:       </nova:ports>
Jul 31 10:32:53 user nova-compute[71113]:     </nova:instance>
Jul 31 10:32:53 user nova-compute[71113]:   </metadata>
Jul 31 10:32:53 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 10:32:53 user nova-compute[71113]:     <system>
Jul 31 10:32:53 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 10:32:53 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 10:32:53 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 10:32:53 user nova-compute[71113]:       <entry name="serial">4eb47c5d-5398-46ec-8674-40ea1a98636a</entry>
Jul 31 10:32:53 user nova-compute[71113]:       <entry name="uuid">4eb47c5d-5398-46ec-8674-40ea1a98636a</entry>
Jul 31 10:32:53 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 10:32:53 user nova-compute[71113]:     </system>
Jul 31 10:32:53 user nova-compute[71113]:   </sysinfo>
Jul 31 10:32:53 user nova-compute[71113]:   <os>
Jul 31 10:32:53 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 10:32:53 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 10:32:53 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 10:32:53 user nova-compute[71113]:   </os>
Jul 31 10:32:53 user nova-compute[71113]:   <features>
Jul 31 10:32:53 user nova-compute[71113]:     <acpi/>
Jul 31 10:32:53 user nova-compute[71113]:     <apic/>
Jul 31 10:32:53 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 10:32:53 user nova-compute[71113]:   </features>
Jul 31 10:32:53 user nova-compute[71113]:   <clock offset="utc">
Jul 31 10:32:53 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 10:32:53 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 10:32:53 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 10:32:53 user nova-compute[71113]:   </clock>
Jul 31 10:32:53 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 10:32:53 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 10:32:53 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 10:32:53 user nova-compute[71113]:   </cpu>
Jul 31 10:32:53 user nova-compute[71113]:   <devices>
Jul 31 10:32:53 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 10:32:53 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 10:32:53 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/4eb47c5d-5398-46ec-8674-40ea1a98636a/disk"/>
Jul 31 10:32:53 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 10:32:53 user nova-compute[71113]:     </disk>
Jul 31 10:32:53 user nova-compute[71113]:     <disk type="block" device="disk">
Jul 31 10:32:53 user nova-compute[71113]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:32:53 user nova-compute[71113]:       <source dev="/dev/sdb"/>
Jul 31 10:32:53 user nova-compute[71113]:       <target dev="vdb" bus="virtio"/>
Jul 31 10:32:53 user nova-compute[71113]:       <serial>b4963435-c8f7-4c9d-b1c8-51616d1adf05</serial>
Jul 31 10:32:53 user nova-compute[71113]:     </disk>
Jul 31 10:32:53 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 10:32:53 user nova-compute[71113]:       <mac address="fa:16:3e:c8:ab:8e"/>
Jul 31 10:32:53 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:32:53 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 10:32:53 user nova-compute[71113]:       <target dev="tap68243307-56"/>
Jul 31 10:32:53 user nova-compute[71113]:     </interface>
Jul 31 10:32:53 user nova-compute[71113]:     <serial type="pty">
Jul 31 10:32:53 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/4eb47c5d-5398-46ec-8674-40ea1a98636a/console.log" append="off"/>
Jul 31 10:32:53 user nova-compute[71113]:     </serial>
Jul 31 10:32:53 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 10:32:53 user nova-compute[71113]:     <video>
Jul 31 10:32:53 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:32:53 user nova-compute[71113]:     </video>
Jul 31 10:32:53 user nova-compute[71113]:     <rng model="virtio">
Jul 31 10:32:53 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 10:32:53 user nova-compute[71113]:     </rng>
Jul 31 10:32:53 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 10:32:53 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 10:32:53 user nova-compute[71113]:       <stats period="10"/>
Jul 31 10:32:53 user nova-compute[71113]:     </memballoon>
Jul 31 10:32:53 user nova-compute[71113]:   </devices>
Jul 31 10:32:53 user nova-compute[71113]: </domain>
Jul 31 10:32:53 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 10:32:53 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb47c5d-5398-46ec-8674-40ea1a98636a/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:32:53 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb47c5d-5398-46ec-8674-40ea1a98636a/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:32:53 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb47c5d-5398-46ec-8674-40ea1a98636a/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:32:53 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb47c5d-5398-46ec-8674-40ea1a98636a/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:32:53 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 10:32:53 user nova-compute[71113]: DEBUG nova.objects.instance [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4eb47c5d-5398-46ec-8674-40ea1a98636a {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:32:53 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/94a6bf95dc0df2da9f28ee35dd8d5af672407a77 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:32:53 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:32:53 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Cleaning up deleted instances {{(pid=71113) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 31 10:32:53 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] There are 0 instances to clean {{(pid=71113) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 31 10:32:53 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/94a6bf95dc0df2da9f28ee35dd8d5af672407a77 --force-share --output=json" returned: 0 in 0.139s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:32:53 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4eb47c5d-5398-46ec-8674-40ea1a98636a/disk. size=1073741824 {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 10:32:53 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb47c5d-5398-46ec-8674-40ea1a98636a/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:32:53 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb47c5d-5398-46ec-8674-40ea1a98636a/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:32:53 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Cannot resize image /opt/stack/data/nova/instances/4eb47c5d-5398-46ec-8674-40ea1a98636a/disk to a smaller size. {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 10:32:53 user nova-compute[71113]: DEBUG nova.objects.instance [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lazy-loading 'migration_context' on Instance uuid 4eb47c5d-5398-46ec-8674-40ea1a98636a {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:32:53 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:30:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2037126371',display_name='tempest-TestMinimumBasicScenario-server-2037126371',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2037126371',id=49,image_ref='94a8ad05-1080-4adb-a459-0c03205f2a1d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFupQC4fA9dh6E5Zjfm9UglkIiRCNHJLSfEDGtK26Q7BMVZ6BWaHJkiX3U0lFHI76EqPtJ5R/KDp30iEbseobGBUhzv9eZMEY7oqVzSJCHtJVpLePFtcnb57Y1Rr4pmdXw==',key_name='tempest-TestMinimumBasicScenario-263130476',keypairs=<?>,launch_index=0,launched_at=2023-07-31T10:30:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='02892a9661ba44dd8c32b91f74446d99',ramdisk_id='',reservation_id='r-gly1u0g9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='94a8ad05-1080-4adb-a459-0c03205f2a1d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-248468997',owner_user_name='tempest-TestMinimumBasicScenario-248468997-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T10:32:51Z,user_data=None,user_id='4a47a5b738a6402db511c0e096f2c26e',uuid=4eb47c5d-5398-46ec-8674-40ea1a98636a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68243307-5696-444d-8f67-05f07d39db2a", "address": "fa:16:3e:c8:ab:8e", "network": {"id": "b535bacc-9690-4269-a1e4-6aee5466ece4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-811923488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02892a9661ba44dd8c32b91f74446d99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68243307-56", "ovs_interfaceid": "68243307-5696-444d-8f67-05f07d39db2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 10:32:53 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Converting VIF {"id": "68243307-5696-444d-8f67-05f07d39db2a", "address": "fa:16:3e:c8:ab:8e", "network": {"id": "b535bacc-9690-4269-a1e4-6aee5466ece4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-811923488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02892a9661ba44dd8c32b91f74446d99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68243307-56", "ovs_interfaceid": "68243307-5696-444d-8f67-05f07d39db2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:32:53 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:ab:8e,bridge_name='br-int',has_traffic_filtering=True,id=68243307-5696-444d-8f67-05f07d39db2a,network=Network(b535bacc-9690-4269-a1e4-6aee5466ece4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68243307-56') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:32:53 user nova-compute[71113]: DEBUG os_vif [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:ab:8e,bridge_name='br-int',has_traffic_filtering=True,id=68243307-5696-444d-8f67-05f07d39db2a,network=Network(b535bacc-9690-4269-a1e4-6aee5466ece4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68243307-56') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 10:32:53 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:32:53 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:32:53 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 10:32:53 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:32:53 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap68243307-56, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:32:53 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap68243307-56, col_values=(('external_ids', {'iface-id': '68243307-5696-444d-8f67-05f07d39db2a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:ab:8e', 'vm-uuid': '4eb47c5d-5398-46ec-8674-40ea1a98636a'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:32:53 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:32:53 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:32:53 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:32:53 user nova-compute[71113]: INFO os_vif [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:ab:8e,bridge_name='br-int',has_traffic_filtering=True,id=68243307-5696-444d-8f67-05f07d39db2a,network=Network(b535bacc-9690-4269-a1e4-6aee5466ece4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68243307-56')
Jul 31 10:32:54 user nova-compute[71113]: DEBUG nova.compute.manager [req-8a8ff3a3-74fa-463f-8b02-5c8f4b59bce8 req-16cfbeb4-1583-4a71-b877-d6bec625a48a service nova] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Received event network-vif-plugged-68243307-5696-444d-8f67-05f07d39db2a {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:32:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8a8ff3a3-74fa-463f-8b02-5c8f4b59bce8 req-16cfbeb4-1583-4a71-b877-d6bec625a48a service nova] Acquiring lock "4eb47c5d-5398-46ec-8674-40ea1a98636a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:32:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8a8ff3a3-74fa-463f-8b02-5c8f4b59bce8 req-16cfbeb4-1583-4a71-b877-d6bec625a48a service nova] Lock "4eb47c5d-5398-46ec-8674-40ea1a98636a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:32:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8a8ff3a3-74fa-463f-8b02-5c8f4b59bce8 req-16cfbeb4-1583-4a71-b877-d6bec625a48a service nova] Lock "4eb47c5d-5398-46ec-8674-40ea1a98636a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:32:54 user nova-compute[71113]: DEBUG nova.compute.manager [req-8a8ff3a3-74fa-463f-8b02-5c8f4b59bce8 req-16cfbeb4-1583-4a71-b877-d6bec625a48a service nova] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] No waiting events found dispatching network-vif-plugged-68243307-5696-444d-8f67-05f07d39db2a {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:32:54 user nova-compute[71113]: WARNING nova.compute.manager [req-8a8ff3a3-74fa-463f-8b02-5c8f4b59bce8 req-16cfbeb4-1583-4a71-b877-d6bec625a48a service nova] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Received unexpected event network-vif-plugged-68243307-5696-444d-8f67-05f07d39db2a for instance with vm_state active and task_state reboot_started_hard.
Jul 31 10:32:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:32:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:32:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:32:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:32:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:32:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:32:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:32:56 user nova-compute[71113]: DEBUG nova.compute.manager [req-13667924-9be6-4760-a988-9b4aa03d26a4 req-9c2d13a0-7bfc-441a-bd6a-b230ed4d52c7 service nova] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Received event network-vif-plugged-68243307-5696-444d-8f67-05f07d39db2a {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:32:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-13667924-9be6-4760-a988-9b4aa03d26a4 req-9c2d13a0-7bfc-441a-bd6a-b230ed4d52c7 service nova] Acquiring lock "4eb47c5d-5398-46ec-8674-40ea1a98636a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:32:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-13667924-9be6-4760-a988-9b4aa03d26a4 req-9c2d13a0-7bfc-441a-bd6a-b230ed4d52c7 service nova] Lock "4eb47c5d-5398-46ec-8674-40ea1a98636a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:32:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-13667924-9be6-4760-a988-9b4aa03d26a4 req-9c2d13a0-7bfc-441a-bd6a-b230ed4d52c7 service nova] Lock "4eb47c5d-5398-46ec-8674-40ea1a98636a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:32:56 user nova-compute[71113]: DEBUG nova.compute.manager [req-13667924-9be6-4760-a988-9b4aa03d26a4 req-9c2d13a0-7bfc-441a-bd6a-b230ed4d52c7 service nova] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] No waiting events found dispatching network-vif-plugged-68243307-5696-444d-8f67-05f07d39db2a {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:32:56 user nova-compute[71113]: WARNING nova.compute.manager [req-13667924-9be6-4760-a988-9b4aa03d26a4 req-9c2d13a0-7bfc-441a-bd6a-b230ed4d52c7 service nova] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Received unexpected event network-vif-plugged-68243307-5696-444d-8f67-05f07d39db2a for instance with vm_state active and task_state reboot_started_hard.
Jul 31 10:32:56 user nova-compute[71113]: DEBUG nova.compute.manager [req-13667924-9be6-4760-a988-9b4aa03d26a4 req-9c2d13a0-7bfc-441a-bd6a-b230ed4d52c7 service nova] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Received event network-vif-plugged-68243307-5696-444d-8f67-05f07d39db2a {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:32:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-13667924-9be6-4760-a988-9b4aa03d26a4 req-9c2d13a0-7bfc-441a-bd6a-b230ed4d52c7 service nova] Acquiring lock "4eb47c5d-5398-46ec-8674-40ea1a98636a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:32:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-13667924-9be6-4760-a988-9b4aa03d26a4 req-9c2d13a0-7bfc-441a-bd6a-b230ed4d52c7 service nova] Lock "4eb47c5d-5398-46ec-8674-40ea1a98636a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:32:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-13667924-9be6-4760-a988-9b4aa03d26a4 req-9c2d13a0-7bfc-441a-bd6a-b230ed4d52c7 service nova] Lock "4eb47c5d-5398-46ec-8674-40ea1a98636a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:32:56 user nova-compute[71113]: DEBUG nova.compute.manager [req-13667924-9be6-4760-a988-9b4aa03d26a4 req-9c2d13a0-7bfc-441a-bd6a-b230ed4d52c7 service nova] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] No waiting events found dispatching network-vif-plugged-68243307-5696-444d-8f67-05f07d39db2a {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:32:56 user nova-compute[71113]: WARNING nova.compute.manager [req-13667924-9be6-4760-a988-9b4aa03d26a4 req-9c2d13a0-7bfc-441a-bd6a-b230ed4d52c7 service nova] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Received unexpected event network-vif-plugged-68243307-5696-444d-8f67-05f07d39db2a for instance with vm_state active and task_state reboot_started_hard.
Jul 31 10:32:57 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Removed pending event for 4eb47c5d-5398-46ec-8674-40ea1a98636a due to event {{(pid=71113) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 31 10:32:57 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690799577.552289, 4eb47c5d-5398-46ec-8674-40ea1a98636a => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:32:57 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] VM Resumed (Lifecycle Event)
Jul 31 10:32:57 user nova-compute[71113]: DEBUG nova.compute.manager [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 10:32:57 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Instance rebooted successfully.
Jul 31 10:32:57 user nova-compute[71113]: DEBUG nova.compute.manager [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:32:57 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:32:57 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:32:57 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Jul 31 10:32:57 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690799577.5536978, 4eb47c5d-5398-46ec-8674-40ea1a98636a => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:32:57 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] VM Started (Lifecycle Event)
Jul 31 10:32:57 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:32:57 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:32:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9111c5ff-d846-43f1-b7c4-4d5f0769d251 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "4eb47c5d-5398-46ec-8674-40ea1a98636a" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.719s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:32:58 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:33:00 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:33:03 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:33:05 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:33:08 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:33:11 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:33:11 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71113) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 31 10:33:13 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:33:13 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:33:13 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:33:13 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:33:13 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:33:13 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:33:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:33:18 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:33:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:33:23 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:33:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:33:28 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:33:33 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:33:33 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:33:33 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:33:33 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:33:33 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:33:33 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:33:33 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:33:33 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:33:35 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:33:38 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:33:40 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:33:40 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:33:40 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Rebuilding the list of instances to heal {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 10:33:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "refresh_cache-4eb47c5d-5398-46ec-8674-40ea1a98636a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:33:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquired lock "refresh_cache-4eb47c5d-5398-46ec-8674-40ea1a98636a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:33:40 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Forcefully refreshing network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 10:33:40 user nova-compute[71113]: DEBUG nova.objects.instance [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lazy-loading 'info_cache' on Instance uuid 4eb47c5d-5398-46ec-8674-40ea1a98636a {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:33:41 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Updating instance_info_cache with network_info: [{"id": "68243307-5696-444d-8f67-05f07d39db2a", "address": "fa:16:3e:c8:ab:8e", "network": {"id": "b535bacc-9690-4269-a1e4-6aee5466ece4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-811923488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02892a9661ba44dd8c32b91f74446d99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68243307-56", "ovs_interfaceid": "68243307-5696-444d-8f67-05f07d39db2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:33:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Releasing lock "refresh_cache-4eb47c5d-5398-46ec-8674-40ea1a98636a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:33:41 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Updated the network info_cache for instance {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 10:33:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:33:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:33:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:33:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:33:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:33:43 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:33:45 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:33:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:33:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:33:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:33:45 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:33:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb47c5d-5398-46ec-8674-40ea1a98636a/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:33:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb47c5d-5398-46ec-8674-40ea1a98636a/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:33:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb47c5d-5398-46ec-8674-40ea1a98636a/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:33:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb47c5d-5398-46ec-8674-40ea1a98636a/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:33:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 10:33:46 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:33:46 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:33:46 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=8873MB free_disk=25.16573715209961GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:33:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:33:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:33:46 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 4eb47c5d-5398-46ec-8674-40ea1a98636a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:33:46 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:33:46 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:33:46 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:33:46 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:33:46 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:33:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.163s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:33:47 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:33:47 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:33:47 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Triggering sync for uuid 4eb47c5d-5398-46ec-8674-40ea1a98636a {{(pid=71113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 10:33:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "4eb47c5d-5398-46ec-8674-40ea1a98636a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:33:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "4eb47c5d-5398-46ec-8674-40ea1a98636a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:33:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "4eb47c5d-5398-46ec-8674-40ea1a98636a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:33:48 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:33:48 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:33:48 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:33:48 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:33:53 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:33:53 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:33:53 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:33:53 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:33:53 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:33:53 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:33:53 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:33:58 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:34:03 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:34:03 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:34:03 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:34:03 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:34:03 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:34:03 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:34:08 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:34:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:34:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:34:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:34:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:34:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:34:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:34:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:34:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:34:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:34:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:34:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:34:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:34:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:34:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:34:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:34:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:34:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:34:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:34:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:34:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:34:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:34:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:34:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:34:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:34:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:34:34 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:34:34 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:34:35 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:34:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:34:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:34:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:34:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:34:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:34:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:34:40 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:34:40 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:34:40 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Rebuilding the list of instances to heal {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 10:34:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "refresh_cache-4eb47c5d-5398-46ec-8674-40ea1a98636a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:34:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquired lock "refresh_cache-4eb47c5d-5398-46ec-8674-40ea1a98636a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:34:40 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Forcefully refreshing network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 10:34:40 user nova-compute[71113]: DEBUG nova.objects.instance [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lazy-loading 'info_cache' on Instance uuid 4eb47c5d-5398-46ec-8674-40ea1a98636a {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:34:40 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:34:41 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Updating instance_info_cache with network_info: [{"id": "68243307-5696-444d-8f67-05f07d39db2a", "address": "fa:16:3e:c8:ab:8e", "network": {"id": "b535bacc-9690-4269-a1e4-6aee5466ece4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-811923488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02892a9661ba44dd8c32b91f74446d99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68243307-56", "ovs_interfaceid": "68243307-5696-444d-8f67-05f07d39db2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:34:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Releasing lock "refresh_cache-4eb47c5d-5398-46ec-8674-40ea1a98636a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:34:41 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Updated the network info_cache for instance {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 10:34:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:34:42 user nova-compute[71113]: DEBUG nova.compute.manager [req-1f692b78-f4ae-4df3-9ede-15f4483b6f31 req-8ec7cf58-973c-4fec-b6a6-747924feb67c service nova] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Received event network-changed-68243307-5696-444d-8f67-05f07d39db2a {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:34:42 user nova-compute[71113]: DEBUG nova.compute.manager [req-1f692b78-f4ae-4df3-9ede-15f4483b6f31 req-8ec7cf58-973c-4fec-b6a6-747924feb67c service nova] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Refreshing instance network info cache due to event network-changed-68243307-5696-444d-8f67-05f07d39db2a. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 10:34:42 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1f692b78-f4ae-4df3-9ede-15f4483b6f31 req-8ec7cf58-973c-4fec-b6a6-747924feb67c service nova] Acquiring lock "refresh_cache-4eb47c5d-5398-46ec-8674-40ea1a98636a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:34:42 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1f692b78-f4ae-4df3-9ede-15f4483b6f31 req-8ec7cf58-973c-4fec-b6a6-747924feb67c service nova] Acquired lock "refresh_cache-4eb47c5d-5398-46ec-8674-40ea1a98636a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:34:42 user nova-compute[71113]: DEBUG nova.network.neutron [req-1f692b78-f4ae-4df3-9ede-15f4483b6f31 req-8ec7cf58-973c-4fec-b6a6-747924feb67c service nova] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Refreshing network info cache for port 68243307-5696-444d-8f67-05f07d39db2a {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 10:34:42 user nova-compute[71113]: DEBUG nova.network.neutron [req-1f692b78-f4ae-4df3-9ede-15f4483b6f31 req-8ec7cf58-973c-4fec-b6a6-747924feb67c service nova] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Updated VIF entry in instance network info cache for port 68243307-5696-444d-8f67-05f07d39db2a. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 10:34:42 user nova-compute[71113]: DEBUG nova.network.neutron [req-1f692b78-f4ae-4df3-9ede-15f4483b6f31 req-8ec7cf58-973c-4fec-b6a6-747924feb67c service nova] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Updating instance_info_cache with network_info: [{"id": "68243307-5696-444d-8f67-05f07d39db2a", "address": "fa:16:3e:c8:ab:8e", "network": {"id": "b535bacc-9690-4269-a1e4-6aee5466ece4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-811923488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02892a9661ba44dd8c32b91f74446d99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68243307-56", "ovs_interfaceid": "68243307-5696-444d-8f67-05f07d39db2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:34:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-1f692b78-f4ae-4df3-9ede-15f4483b6f31 req-8ec7cf58-973c-4fec-b6a6-747924feb67c service nova] Releasing lock "refresh_cache-4eb47c5d-5398-46ec-8674-40ea1a98636a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:34:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-80a466d1-1d92-40db-8285-3f942e9c3d71 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Acquiring lock "4eb47c5d-5398-46ec-8674-40ea1a98636a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:34:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-80a466d1-1d92-40db-8285-3f942e9c3d71 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "4eb47c5d-5398-46ec-8674-40ea1a98636a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:34:43 user nova-compute[71113]: INFO nova.compute.manager [None req-80a466d1-1d92-40db-8285-3f942e9c3d71 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Detaching volume b4963435-c8f7-4c9d-b1c8-51616d1adf05
Jul 31 10:34:43 user nova-compute[71113]: INFO nova.virt.block_device [None req-80a466d1-1d92-40db-8285-3f942e9c3d71 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Attempting to driver detach volume b4963435-c8f7-4c9d-b1c8-51616d1adf05 from mountpoint /dev/vdb
Jul 31 10:34:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-80a466d1-1d92-40db-8285-3f942e9c3d71 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Attempting to detach device vdb from instance 4eb47c5d-5398-46ec-8674-40ea1a98636a from the persistent domain config. {{(pid=71113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 10:34:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-80a466d1-1d92-40db-8285-3f942e9c3d71 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 10:34:43 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:34:43 user nova-compute[71113]:   <source dev="/dev/sdb"/>
Jul 31 10:34:43 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 10:34:43 user nova-compute[71113]:   <serial>b4963435-c8f7-4c9d-b1c8-51616d1adf05</serial>
Jul 31 10:34:43 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 31 10:34:43 user nova-compute[71113]: </disk>
Jul 31 10:34:43 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 10:34:43 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-80a466d1-1d92-40db-8285-3f942e9c3d71 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Successfully detached device vdb from instance 4eb47c5d-5398-46ec-8674-40ea1a98636a from the persistent domain config.
Jul 31 10:34:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-80a466d1-1d92-40db-8285-3f942e9c3d71 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4eb47c5d-5398-46ec-8674-40ea1a98636a from the live domain config. {{(pid=71113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 10:34:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-80a466d1-1d92-40db-8285-3f942e9c3d71 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 10:34:43 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:34:43 user nova-compute[71113]:   <source dev="/dev/sdb"/>
Jul 31 10:34:43 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 10:34:43 user nova-compute[71113]:   <serial>b4963435-c8f7-4c9d-b1c8-51616d1adf05</serial>
Jul 31 10:34:43 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 31 10:34:43 user nova-compute[71113]: </disk>
Jul 31 10:34:43 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 10:34:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:34:44 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Received event <DeviceRemovedEvent: 1690799684.13775, 4eb47c5d-5398-46ec-8674-40ea1a98636a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71113) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 10:34:44 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-80a466d1-1d92-40db-8285-3f942e9c3d71 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4eb47c5d-5398-46ec-8674-40ea1a98636a {{(pid=71113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 10:34:44 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-80a466d1-1d92-40db-8285-3f942e9c3d71 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Successfully detached device vdb from instance 4eb47c5d-5398-46ec-8674-40ea1a98636a from the live domain config.
Jul 31 10:34:44 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80a466d1-1d92-40db-8285-3f942e9c3d71 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 10:34:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-80a466d1-1d92-40db-8285-3f942e9c3d71 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PvCQjnsm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:34:44 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-80a466d1-1d92-40db-8285-3f942e9c3d71 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:34:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-80a466d1-1d92-40db-8285-3f942e9c3d71 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:34:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-80a466d1-1d92-40db-8285-3f942e9c3d71 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:34:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-80a466d1-1d92-40db-8285-3f942e9c3d71 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 10:34:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:34:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:34:44 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1903a7ed-ce55-4c8b-a62f-74fd66719850]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:34:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:34:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:34:44 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1bb9fac-a713-44fb-b82a-085195c15fbb]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:34:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-80a466d1-1d92-40db-8285-3f942e9c3d71 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05 (non-flash)
Jul 31 10:34:44 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:34:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-80a466d1-1d92-40db-8285-3f942e9c3d71 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05 (non-flash)
Jul 31 10:34:44 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:34:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-80a466d1-1d92-40db-8285-3f942e9c3d71 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f78f02dc790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05'): ({'sdb'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 10:34:44 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-80a466d1-1d92-40db-8285-3f942e9c3d71 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Removing single pathed devices sdb {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 10:34:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:34:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:34:44 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6707c2-254d-41ac-abff-5a48a9b95d5c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:34:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:34:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:34:44 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[17eff9be-f36a-4590-91bf-a6faec4c4402]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:34:44 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-80a466d1-1d92-40db-8285-3f942e9c3d71 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Flushing IO for device /dev/sdb {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 10:34:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:34:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:34:44 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1788118-44c3-47d2-b9a4-e1f5c256a8f1]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:34:44 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-80a466d1-1d92-40db-8285-3f942e9c3d71 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 10:34:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:34:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:34:44 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ec7dcb-d2df-413e-87ff-0026bf33e8e6]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:34:44 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-80a466d1-1d92-40db-8285-3f942e9c3d71 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 10:34:44 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-80a466d1-1d92-40db-8285-3f942e9c3d71 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] SCSI volumes sdb have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 10:34:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-80a466d1-1d92-40db-8285-3f942e9c3d71 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 10:34:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:34:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:34:44 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d583d2-0d04-49e7-aa11-343f0780682e]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:34:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-80a466d1-1d92-40db-8285-3f942e9c3d71 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:34:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05 -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:34:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:34:44 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03f9e5c-b9a7-479f-a44a-e400a80e699a]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:34:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-80a466d1-1d92-40db-8285-3f942e9c3d71 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05, portal: 172.16.0.220,3260]
Jul 31 10:34:44 user nova-compute[71113]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05, portal: 172.16.0.220,3260] successful.
Jul 31 10:34:44 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:34:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05 -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:34:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4963435-c8f7-4c9d-b1c8-51616d1adf05 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:34:44 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa2b18a-60f9-44fc-b0ed-9e94eb125cde]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:34:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-80a466d1-1d92-40db-8285-3f942e9c3d71 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:34:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-80a466d1-1d92-40db-8285-3f942e9c3d71 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:34:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-80a466d1-1d92-40db-8285-3f942e9c3d71 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] <== disconnect_volume: return (278ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:34:44 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80a466d1-1d92-40db-8285-3f942e9c3d71 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 10:34:44 user nova-compute[71113]: DEBUG nova.compute.manager [req-323ec62b-2f70-4116-b1c6-9af6dd5b6748 req-daac3ab6-c8fc-4922-8526-bc143070735f service nova] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Received event network-changed-68243307-5696-444d-8f67-05f07d39db2a {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:34:44 user nova-compute[71113]: DEBUG nova.compute.manager [req-323ec62b-2f70-4116-b1c6-9af6dd5b6748 req-daac3ab6-c8fc-4922-8526-bc143070735f service nova] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Refreshing instance network info cache due to event network-changed-68243307-5696-444d-8f67-05f07d39db2a. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 10:34:44 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-323ec62b-2f70-4116-b1c6-9af6dd5b6748 req-daac3ab6-c8fc-4922-8526-bc143070735f service nova] Acquiring lock "refresh_cache-4eb47c5d-5398-46ec-8674-40ea1a98636a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:34:44 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-323ec62b-2f70-4116-b1c6-9af6dd5b6748 req-daac3ab6-c8fc-4922-8526-bc143070735f service nova] Acquired lock "refresh_cache-4eb47c5d-5398-46ec-8674-40ea1a98636a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:34:44 user nova-compute[71113]: DEBUG nova.network.neutron [req-323ec62b-2f70-4116-b1c6-9af6dd5b6748 req-daac3ab6-c8fc-4922-8526-bc143070735f service nova] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Refreshing network info cache for port 68243307-5696-444d-8f67-05f07d39db2a {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 10:34:44 user nova-compute[71113]: DEBUG nova.network.neutron [req-323ec62b-2f70-4116-b1c6-9af6dd5b6748 req-daac3ab6-c8fc-4922-8526-bc143070735f service nova] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Updated VIF entry in instance network info cache for port 68243307-5696-444d-8f67-05f07d39db2a. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 10:34:44 user nova-compute[71113]: DEBUG nova.network.neutron [req-323ec62b-2f70-4116-b1c6-9af6dd5b6748 req-daac3ab6-c8fc-4922-8526-bc143070735f service nova] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Updating instance_info_cache with network_info: [{"id": "68243307-5696-444d-8f67-05f07d39db2a", "address": "fa:16:3e:c8:ab:8e", "network": {"id": "b535bacc-9690-4269-a1e4-6aee5466ece4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-811923488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02892a9661ba44dd8c32b91f74446d99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68243307-56", "ovs_interfaceid": "68243307-5696-444d-8f67-05f07d39db2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:34:44 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-323ec62b-2f70-4116-b1c6-9af6dd5b6748 req-daac3ab6-c8fc-4922-8526-bc143070735f service nova] Releasing lock "refresh_cache-4eb47c5d-5398-46ec-8674-40ea1a98636a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:34:45 user nova-compute[71113]: DEBUG nova.objects.instance [None req-80a466d1-1d92-40db-8285-3f942e9c3d71 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lazy-loading 'flavor' on Instance uuid 4eb47c5d-5398-46ec-8674-40ea1a98636a {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:34:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-80a466d1-1d92-40db-8285-3f942e9c3d71 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "4eb47c5d-5398-46ec-8674-40ea1a98636a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.716s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:34:45 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:34:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:34:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:34:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:34:45 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:34:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb47c5d-5398-46ec-8674-40ea1a98636a/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:34:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:34:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb47c5d-5398-46ec-8674-40ea1a98636a/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:34:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb47c5d-5398-46ec-8674-40ea1a98636a/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:34:46 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4eb47c5d-5398-46ec-8674-40ea1a98636a/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:34:46 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:34:46 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:34:46 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=8875MB free_disk=25.164928436279297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:34:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:34:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:34:46 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 4eb47c5d-5398-46ec-8674-40ea1a98636a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:34:46 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:34:46 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:34:46 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:34:46 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:34:46 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:34:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.176s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:34:48 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:34:48 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:34:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:34:49 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:34:49 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:34:53 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:34:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:34:55 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:34:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:35:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:35:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:35:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:35:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:35:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:35:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:35:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:35:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:35:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:35:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:35:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:35:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:35:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:35:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:35:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:35:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:35:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:35:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:35:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:35:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:35:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:35:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:35:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:35:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:35:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:35:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:35:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:35:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:35:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:35:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:35:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:35:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:35:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:35:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:35:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:35:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:35:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:35:35 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:35:36 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:35:36 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:35:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-99e10900-46f0-43e6-9210-fbb70e70e845 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Acquiring lock "4eb47c5d-5398-46ec-8674-40ea1a98636a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:35:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-99e10900-46f0-43e6-9210-fbb70e70e845 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "4eb47c5d-5398-46ec-8674-40ea1a98636a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:35:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-99e10900-46f0-43e6-9210-fbb70e70e845 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Acquiring lock "4eb47c5d-5398-46ec-8674-40ea1a98636a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:35:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-99e10900-46f0-43e6-9210-fbb70e70e845 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "4eb47c5d-5398-46ec-8674-40ea1a98636a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:35:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-99e10900-46f0-43e6-9210-fbb70e70e845 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "4eb47c5d-5398-46ec-8674-40ea1a98636a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:35:38 user nova-compute[71113]: INFO nova.compute.manager [None req-99e10900-46f0-43e6-9210-fbb70e70e845 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Terminating instance
Jul 31 10:35:38 user nova-compute[71113]: DEBUG nova.compute.manager [None req-99e10900-46f0-43e6-9210-fbb70e70e845 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Start destroying the instance on the hypervisor. {{(pid=71113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 10:35:38 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:35:38 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:35:38 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:35:38 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:35:38 user nova-compute[71113]: DEBUG nova.compute.manager [req-32201833-b72d-46ea-94a3-94d870055757 req-2a73bda9-3ea3-4b5c-8e87-27d1d4d95a67 service nova] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Received event network-vif-unplugged-68243307-5696-444d-8f67-05f07d39db2a {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:35:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-32201833-b72d-46ea-94a3-94d870055757 req-2a73bda9-3ea3-4b5c-8e87-27d1d4d95a67 service nova] Acquiring lock "4eb47c5d-5398-46ec-8674-40ea1a98636a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:35:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-32201833-b72d-46ea-94a3-94d870055757 req-2a73bda9-3ea3-4b5c-8e87-27d1d4d95a67 service nova] Lock "4eb47c5d-5398-46ec-8674-40ea1a98636a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:35:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-32201833-b72d-46ea-94a3-94d870055757 req-2a73bda9-3ea3-4b5c-8e87-27d1d4d95a67 service nova] Lock "4eb47c5d-5398-46ec-8674-40ea1a98636a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:35:38 user nova-compute[71113]: DEBUG nova.compute.manager [req-32201833-b72d-46ea-94a3-94d870055757 req-2a73bda9-3ea3-4b5c-8e87-27d1d4d95a67 service nova] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] No waiting events found dispatching network-vif-unplugged-68243307-5696-444d-8f67-05f07d39db2a {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:35:38 user nova-compute[71113]: DEBUG nova.compute.manager [req-32201833-b72d-46ea-94a3-94d870055757 req-2a73bda9-3ea3-4b5c-8e87-27d1d4d95a67 service nova] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Received event network-vif-unplugged-68243307-5696-444d-8f67-05f07d39db2a for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 10:35:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:35:39 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Instance destroyed successfully.
Jul 31 10:35:39 user nova-compute[71113]: DEBUG nova.objects.instance [None req-99e10900-46f0-43e6-9210-fbb70e70e845 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lazy-loading 'resources' on Instance uuid 4eb47c5d-5398-46ec-8674-40ea1a98636a {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:35:39 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-99e10900-46f0-43e6-9210-fbb70e70e845 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:30:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2037126371',display_name='tempest-TestMinimumBasicScenario-server-2037126371',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2037126371',id=49,image_ref='94a8ad05-1080-4adb-a459-0c03205f2a1d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFupQC4fA9dh6E5Zjfm9UglkIiRCNHJLSfEDGtK26Q7BMVZ6BWaHJkiX3U0lFHI76EqPtJ5R/KDp30iEbseobGBUhzv9eZMEY7oqVzSJCHtJVpLePFtcnb57Y1Rr4pmdXw==',key_name='tempest-TestMinimumBasicScenario-263130476',keypairs=<?>,launch_index=0,launched_at=2023-07-31T10:30:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='02892a9661ba44dd8c32b91f74446d99',ramdisk_id='',reservation_id='r-gly1u0g9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='94a8ad05-1080-4adb-a459-0c03205f2a1d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-248468997',owner_user_name='tempest-TestMinimumBasicScenario-248468997-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T10:32:58Z,user_data=None,user_id='4a47a5b738a6402db511c0e096f2c26e',uuid=4eb47c5d-5398-46ec-8674-40ea1a98636a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68243307-5696-444d-8f67-05f07d39db2a", "address": "fa:16:3e:c8:ab:8e", "network": {"id": "b535bacc-9690-4269-a1e4-6aee5466ece4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-811923488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02892a9661ba44dd8c32b91f74446d99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68243307-56", "ovs_interfaceid": "68243307-5696-444d-8f67-05f07d39db2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 10:35:39 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-99e10900-46f0-43e6-9210-fbb70e70e845 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Converting VIF {"id": "68243307-5696-444d-8f67-05f07d39db2a", "address": "fa:16:3e:c8:ab:8e", "network": {"id": "b535bacc-9690-4269-a1e4-6aee5466ece4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-811923488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02892a9661ba44dd8c32b91f74446d99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68243307-56", "ovs_interfaceid": "68243307-5696-444d-8f67-05f07d39db2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:35:39 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-99e10900-46f0-43e6-9210-fbb70e70e845 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:ab:8e,bridge_name='br-int',has_traffic_filtering=True,id=68243307-5696-444d-8f67-05f07d39db2a,network=Network(b535bacc-9690-4269-a1e4-6aee5466ece4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68243307-56') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:35:39 user nova-compute[71113]: DEBUG os_vif [None req-99e10900-46f0-43e6-9210-fbb70e70e845 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:ab:8e,bridge_name='br-int',has_traffic_filtering=True,id=68243307-5696-444d-8f67-05f07d39db2a,network=Network(b535bacc-9690-4269-a1e4-6aee5466ece4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68243307-56') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 10:35:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:35:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap68243307-56, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:35:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:35:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:35:39 user nova-compute[71113]: INFO os_vif [None req-99e10900-46f0-43e6-9210-fbb70e70e845 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:ab:8e,bridge_name='br-int',has_traffic_filtering=True,id=68243307-5696-444d-8f67-05f07d39db2a,network=Network(b535bacc-9690-4269-a1e4-6aee5466ece4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68243307-56')
Jul 31 10:35:39 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-99e10900-46f0-43e6-9210-fbb70e70e845 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Deleting instance files /opt/stack/data/nova/instances/4eb47c5d-5398-46ec-8674-40ea1a98636a_del
Jul 31 10:35:39 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-99e10900-46f0-43e6-9210-fbb70e70e845 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Deletion of /opt/stack/data/nova/instances/4eb47c5d-5398-46ec-8674-40ea1a98636a_del complete
Jul 31 10:35:39 user nova-compute[71113]: INFO nova.compute.manager [None req-99e10900-46f0-43e6-9210-fbb70e70e845 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Took 0.89 seconds to destroy the instance on the hypervisor.
Jul 31 10:35:39 user nova-compute[71113]: DEBUG oslo.service.loopingcall [None req-99e10900-46f0-43e6-9210-fbb70e70e845 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71113) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 10:35:39 user nova-compute[71113]: DEBUG nova.compute.manager [-] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Deallocating network for instance {{(pid=71113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 10:35:39 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] deallocate_for_instance() {{(pid=71113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 10:35:39 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:35:39 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:35:39 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Took 0.64 seconds to deallocate network for instance.
Jul 31 10:35:39 user nova-compute[71113]: DEBUG nova.compute.manager [req-639d31dc-d74f-4160-9a2b-4e3553247215 req-55c2176f-6ca4-43be-86ce-f2cc0465cdcf service nova] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Received event network-vif-deleted-68243307-5696-444d-8f67-05f07d39db2a {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:35:39 user nova-compute[71113]: INFO nova.compute.manager [req-639d31dc-d74f-4160-9a2b-4e3553247215 req-55c2176f-6ca4-43be-86ce-f2cc0465cdcf service nova] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Neutron deleted interface 68243307-5696-444d-8f67-05f07d39db2a; detaching it from the instance and deleting it from the info cache
Jul 31 10:35:39 user nova-compute[71113]: DEBUG nova.network.neutron [req-639d31dc-d74f-4160-9a2b-4e3553247215 req-55c2176f-6ca4-43be-86ce-f2cc0465cdcf service nova] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:35:39 user nova-compute[71113]: DEBUG nova.compute.manager [req-639d31dc-d74f-4160-9a2b-4e3553247215 req-55c2176f-6ca4-43be-86ce-f2cc0465cdcf service nova] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Detach interface failed, port_id=68243307-5696-444d-8f67-05f07d39db2a, reason: Instance 4eb47c5d-5398-46ec-8674-40ea1a98636a could not be found. {{(pid=71113) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 10:35:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-99e10900-46f0-43e6-9210-fbb70e70e845 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:35:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-99e10900-46f0-43e6-9210-fbb70e70e845 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:35:40 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-99e10900-46f0-43e6-9210-fbb70e70e845 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:35:40 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-99e10900-46f0-43e6-9210-fbb70e70e845 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:35:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-99e10900-46f0-43e6-9210-fbb70e70e845 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.112s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:35:40 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-99e10900-46f0-43e6-9210-fbb70e70e845 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Deleted allocations for instance 4eb47c5d-5398-46ec-8674-40ea1a98636a
Jul 31 10:35:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-99e10900-46f0-43e6-9210-fbb70e70e845 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "4eb47c5d-5398-46ec-8674-40ea1a98636a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.827s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:35:40 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:35:40 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:35:40 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Rebuilding the list of instances to heal {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 10:35:40 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Didn't find any instances for network info cache update. {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 10:35:40 user nova-compute[71113]: DEBUG nova.compute.manager [req-598c7e30-88be-40f9-82d0-2a6d1f2ca3bc req-2b1e78e1-b0ce-4d75-8378-58a3ec800009 service nova] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Received event network-vif-plugged-68243307-5696-444d-8f67-05f07d39db2a {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:35:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-598c7e30-88be-40f9-82d0-2a6d1f2ca3bc req-2b1e78e1-b0ce-4d75-8378-58a3ec800009 service nova] Acquiring lock "4eb47c5d-5398-46ec-8674-40ea1a98636a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:35:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-598c7e30-88be-40f9-82d0-2a6d1f2ca3bc req-2b1e78e1-b0ce-4d75-8378-58a3ec800009 service nova] Lock "4eb47c5d-5398-46ec-8674-40ea1a98636a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:35:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-598c7e30-88be-40f9-82d0-2a6d1f2ca3bc req-2b1e78e1-b0ce-4d75-8378-58a3ec800009 service nova] Lock "4eb47c5d-5398-46ec-8674-40ea1a98636a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:35:40 user nova-compute[71113]: DEBUG nova.compute.manager [req-598c7e30-88be-40f9-82d0-2a6d1f2ca3bc req-2b1e78e1-b0ce-4d75-8378-58a3ec800009 service nova] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] No waiting events found dispatching network-vif-plugged-68243307-5696-444d-8f67-05f07d39db2a {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:35:40 user nova-compute[71113]: WARNING nova.compute.manager [req-598c7e30-88be-40f9-82d0-2a6d1f2ca3bc req-2b1e78e1-b0ce-4d75-8378-58a3ec800009 service nova] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Received unexpected event network-vif-plugged-68243307-5696-444d-8f67-05f07d39db2a for instance with vm_state deleted and task_state None.
Jul 31 10:35:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:35:47 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:35:47 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:35:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:35:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:35:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:35:47 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:35:48 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:35:48 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:35:48 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=9022MB free_disk=25.19219970703125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:35:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:35:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:35:48 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:35:48 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:35:48 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:35:48 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:35:48 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:35:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.155s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:35:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:35:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:35:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:35:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:35:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:35:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:35:50 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:35:50 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:35:50 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:35:53 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:35:54 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690799739.1459985, 4eb47c5d-5398-46ec-8674-40ea1a98636a => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:35:54 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] VM Stopped (Lifecycle Event)
Jul 31 10:35:54 user nova-compute[71113]: DEBUG nova.compute.manager [None req-b82a2c03-4857-4577-8c8e-935d7a476da3 None None] [instance: 4eb47c5d-5398-46ec-8674-40ea1a98636a] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:35:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:35:59 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:36:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:36:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:36:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:36:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:36:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:36:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:36:09 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:36:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:36:19 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:36:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:36:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:36:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:36:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:36:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:36:24 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:36:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:36:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Acquiring lock "a5f197cf-4a1c-409f-aef6-8d174b013c9b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:36:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "a5f197cf-4a1c-409f-aef6-8d174b013c9b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:36:32 user nova-compute[71113]: DEBUG nova.compute.manager [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Starting instance... {{(pid=71113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 10:36:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:36:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:36:32 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 10:36:32 user nova-compute[71113]: INFO nova.compute.claims [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Claim successful on node user
Jul 31 10:36:32 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:36:32 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:36:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.186s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:36:32 user nova-compute[71113]: DEBUG nova.compute.manager [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Start building networks asynchronously for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 10:36:32 user nova-compute[71113]: DEBUG nova.compute.manager [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Allocating IP information in the background. {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 10:36:32 user nova-compute[71113]: DEBUG nova.network.neutron [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] allocate_for_instance() {{(pid=71113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 10:36:32 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 10:36:32 user nova-compute[71113]: DEBUG nova.compute.manager [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Start building block device mappings for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 10:36:32 user nova-compute[71113]: DEBUG nova.policy [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4a47a5b738a6402db511c0e096f2c26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02892a9661ba44dd8c32b91f74446d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71113) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 10:36:32 user nova-compute[71113]: DEBUG nova.compute.manager [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Start spawning the instance on the hypervisor. {{(pid=71113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 10:36:32 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 10:36:32 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Creating image(s)
Jul 31 10:36:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Acquiring lock "/opt/stack/data/nova/instances/a5f197cf-4a1c-409f-aef6-8d174b013c9b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:36:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "/opt/stack/data/nova/instances/a5f197cf-4a1c-409f-aef6-8d174b013c9b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:36:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "/opt/stack/data/nova/instances/a5f197cf-4a1c-409f-aef6-8d174b013c9b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:36:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Acquiring lock "e9756de3d24e26a8a048754a473808bb7503982f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:36:32 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "e9756de3d24e26a8a048754a473808bb7503982f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:36:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9756de3d24e26a8a048754a473808bb7503982f.part --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:36:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9756de3d24e26a8a048754a473808bb7503982f.part --force-share --output=json" returned: 0 in 0.140s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:36:33 user nova-compute[71113]: DEBUG nova.virt.images [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] 7924d8c7-4600-41ec-823b-d430e6f0dcc5 was qcow2, converting to raw {{(pid=71113) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 31 10:36:33 user nova-compute[71113]: DEBUG nova.privsep.utils [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71113) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 10:36:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e9756de3d24e26a8a048754a473808bb7503982f.part /opt/stack/data/nova/instances/_base/e9756de3d24e26a8a048754a473808bb7503982f.converted {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:36:33 user nova-compute[71113]: DEBUG nova.network.neutron [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Successfully created port: 424ff6f3-e6ab-4576-a1d6-fb6585b19eb1 {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 10:36:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e9756de3d24e26a8a048754a473808bb7503982f.part /opt/stack/data/nova/instances/_base/e9756de3d24e26a8a048754a473808bb7503982f.converted" returned: 0 in 0.293s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:36:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9756de3d24e26a8a048754a473808bb7503982f.converted --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:36:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9756de3d24e26a8a048754a473808bb7503982f.converted --force-share --output=json" returned: 0 in 0.153s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:36:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "e9756de3d24e26a8a048754a473808bb7503982f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.128s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:36:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9756de3d24e26a8a048754a473808bb7503982f --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:36:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9756de3d24e26a8a048754a473808bb7503982f --force-share --output=json" returned: 0 in 0.142s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:36:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Acquiring lock "e9756de3d24e26a8a048754a473808bb7503982f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:36:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "e9756de3d24e26a8a048754a473808bb7503982f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:36:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9756de3d24e26a8a048754a473808bb7503982f --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:36:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9756de3d24e26a8a048754a473808bb7503982f --force-share --output=json" returned: 0 in 0.139s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:36:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9756de3d24e26a8a048754a473808bb7503982f,backing_fmt=raw /opt/stack/data/nova/instances/a5f197cf-4a1c-409f-aef6-8d174b013c9b/disk 1073741824 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:36:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e9756de3d24e26a8a048754a473808bb7503982f,backing_fmt=raw /opt/stack/data/nova/instances/a5f197cf-4a1c-409f-aef6-8d174b013c9b/disk 1073741824" returned: 0 in 0.057s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:36:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "e9756de3d24e26a8a048754a473808bb7503982f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:36:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9756de3d24e26a8a048754a473808bb7503982f --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:36:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:36:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e9756de3d24e26a8a048754a473808bb7503982f --force-share --output=json" returned: 0 in 0.137s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:36:34 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a5f197cf-4a1c-409f-aef6-8d174b013c9b/disk. size=1073741824 {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 10:36:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f197cf-4a1c-409f-aef6-8d174b013c9b/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:36:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f197cf-4a1c-409f-aef6-8d174b013c9b/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:36:34 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Cannot resize image /opt/stack/data/nova/instances/a5f197cf-4a1c-409f-aef6-8d174b013c9b/disk to a smaller size. {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 10:36:34 user nova-compute[71113]: DEBUG nova.objects.instance [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lazy-loading 'migration_context' on Instance uuid a5f197cf-4a1c-409f-aef6-8d174b013c9b {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:36:34 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Created local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 10:36:34 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Ensure instance console log exists: /opt/stack/data/nova/instances/a5f197cf-4a1c-409f-aef6-8d174b013c9b/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 10:36:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:36:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:36:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:36:34 user nova-compute[71113]: DEBUG nova.network.neutron [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Successfully updated port: 424ff6f3-e6ab-4576-a1d6-fb6585b19eb1 {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 10:36:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Acquiring lock "refresh_cache-a5f197cf-4a1c-409f-aef6-8d174b013c9b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:36:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Acquired lock "refresh_cache-a5f197cf-4a1c-409f-aef6-8d174b013c9b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:36:34 user nova-compute[71113]: DEBUG nova.network.neutron [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 10:36:34 user nova-compute[71113]: DEBUG nova.compute.manager [req-6ab7c916-0901-49b5-bae9-1878e67d0612 req-91053861-0b9f-4b80-a7f6-a914297d725d service nova] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Received event network-changed-424ff6f3-e6ab-4576-a1d6-fb6585b19eb1 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:36:34 user nova-compute[71113]: DEBUG nova.compute.manager [req-6ab7c916-0901-49b5-bae9-1878e67d0612 req-91053861-0b9f-4b80-a7f6-a914297d725d service nova] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Refreshing instance network info cache due to event network-changed-424ff6f3-e6ab-4576-a1d6-fb6585b19eb1. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 10:36:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-6ab7c916-0901-49b5-bae9-1878e67d0612 req-91053861-0b9f-4b80-a7f6-a914297d725d service nova] Acquiring lock "refresh_cache-a5f197cf-4a1c-409f-aef6-8d174b013c9b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:36:34 user nova-compute[71113]: DEBUG nova.network.neutron [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 10:36:34 user nova-compute[71113]: DEBUG nova.network.neutron [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Updating instance_info_cache with network_info: [{"id": "424ff6f3-e6ab-4576-a1d6-fb6585b19eb1", "address": "fa:16:3e:31:8b:3a", "network": {"id": "b535bacc-9690-4269-a1e4-6aee5466ece4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-811923488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02892a9661ba44dd8c32b91f74446d99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424ff6f3-e6", "ovs_interfaceid": "424ff6f3-e6ab-4576-a1d6-fb6585b19eb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:36:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Releasing lock "refresh_cache-a5f197cf-4a1c-409f-aef6-8d174b013c9b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:36:34 user nova-compute[71113]: DEBUG nova.compute.manager [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Instance network_info: |[{"id": "424ff6f3-e6ab-4576-a1d6-fb6585b19eb1", "address": "fa:16:3e:31:8b:3a", "network": {"id": "b535bacc-9690-4269-a1e4-6aee5466ece4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-811923488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02892a9661ba44dd8c32b91f74446d99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424ff6f3-e6", "ovs_interfaceid": "424ff6f3-e6ab-4576-a1d6-fb6585b19eb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 10:36:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-6ab7c916-0901-49b5-bae9-1878e67d0612 req-91053861-0b9f-4b80-a7f6-a914297d725d service nova] Acquired lock "refresh_cache-a5f197cf-4a1c-409f-aef6-8d174b013c9b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:36:34 user nova-compute[71113]: DEBUG nova.network.neutron [req-6ab7c916-0901-49b5-bae9-1878e67d0612 req-91053861-0b9f-4b80-a7f6-a914297d725d service nova] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Refreshing network info cache for port 424ff6f3-e6ab-4576-a1d6-fb6585b19eb1 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 10:36:34 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Start _get_guest_xml network_info=[{"id": "424ff6f3-e6ab-4576-a1d6-fb6585b19eb1", "address": "fa:16:3e:31:8b:3a", "network": {"id": "b535bacc-9690-4269-a1e4-6aee5466ece4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-811923488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02892a9661ba44dd8c32b91f74446d99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424ff6f3-e6", "ovs_interfaceid": "424ff6f3-e6ab-4576-a1d6-fb6585b19eb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T10:36:29Z,direct_url=<?>,disk_format='qcow2',id=7924d8c7-4600-41ec-823b-d430e6f0dcc5,min_disk=0,min_ram=0,name='tempest-scenario-img--1242562236',owner='02892a9661ba44dd8c32b91f74446d99',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T10:36:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'image_id': '7924d8c7-4600-41ec-823b-d430e6f0dcc5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 10:36:34 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:36:34 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:36:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 10:36:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 10:36:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 10:36:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 10:36:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 10:36:35 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T10:36:29Z,direct_url=<?>,disk_format='qcow2',id=7924d8c7-4600-41ec-823b-d430e6f0dcc5,min_disk=0,min_ram=0,name='tempest-scenario-img--1242562236',owner='02892a9661ba44dd8c32b91f74446d99',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T10:36:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 10:36:35 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 10:36:35 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 10:36:35 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 10:36:35 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 10:36:35 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 10:36:35 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 10:36:35 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 10:36:35 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 10:36:35 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 10:36:35 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 10:36:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:36:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-335839255',display_name='tempest-TestMinimumBasicScenario-server-335839255',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-335839255',id=50,image_ref='7924d8c7-4600-41ec-823b-d430e6f0dcc5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBA5r3PLo16suTuQPvQh+TdmPkpGYbiPZ8NayH8BdyZaBs9Gejv1BixRwXbZmKCUEOSeFWxcdWPjQdOG1GmbXiVy3Rmp+IyELt4RwLk6onlyMDNjPNvqJtaMLDdPpVnOJw==',key_name='tempest-TestMinimumBasicScenario-790916345',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02892a9661ba44dd8c32b91f74446d99',ramdisk_id='',reservation_id='r-w7jupi9t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7924d8c7-4600-41ec-823b-d430e6f0dcc5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-248468997',owner_user_name='tempest-TestMinimumBasicScenario-248468997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T10:36:33Z,user_data=None,user_id='4a47a5b738a6402db511c0e096f2c26e',uuid=a5f197cf-4a1c-409f-aef6-8d174b013c9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "424ff6f3-e6ab-4576-a1d6-fb6585b19eb1", "address": "fa:16:3e:31:8b:3a", "network": {"id": "b535bacc-9690-4269-a1e4-6aee5466ece4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-811923488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02892a9661ba44dd8c32b91f74446d99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424ff6f3-e6", "ovs_interfaceid": "424ff6f3-e6ab-4576-a1d6-fb6585b19eb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 10:36:35 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Converting VIF {"id": "424ff6f3-e6ab-4576-a1d6-fb6585b19eb1", "address": "fa:16:3e:31:8b:3a", "network": {"id": "b535bacc-9690-4269-a1e4-6aee5466ece4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-811923488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02892a9661ba44dd8c32b91f74446d99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424ff6f3-e6", "ovs_interfaceid": "424ff6f3-e6ab-4576-a1d6-fb6585b19eb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:36:35 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:8b:3a,bridge_name='br-int',has_traffic_filtering=True,id=424ff6f3-e6ab-4576-a1d6-fb6585b19eb1,network=Network(b535bacc-9690-4269-a1e4-6aee5466ece4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap424ff6f3-e6') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:36:35 user nova-compute[71113]: DEBUG nova.objects.instance [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lazy-loading 'pci_devices' on Instance uuid a5f197cf-4a1c-409f-aef6-8d174b013c9b {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:36:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] End _get_guest_xml xml=<domain type="kvm">
Jul 31 10:36:35 user nova-compute[71113]:   <uuid>a5f197cf-4a1c-409f-aef6-8d174b013c9b</uuid>
Jul 31 10:36:35 user nova-compute[71113]:   <name>instance-00000032</name>
Jul 31 10:36:35 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 10:36:35 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 10:36:35 user nova-compute[71113]:   <metadata>
Jul 31 10:36:35 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 10:36:35 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 10:36:35 user nova-compute[71113]:       <nova:name>tempest-TestMinimumBasicScenario-server-335839255</nova:name>
Jul 31 10:36:35 user nova-compute[71113]:       <nova:creationTime>2023-07-31 10:36:34</nova:creationTime>
Jul 31 10:36:35 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 10:36:35 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 10:36:35 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 10:36:35 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 10:36:35 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 10:36:35 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 10:36:35 user nova-compute[71113]:       </nova:flavor>
Jul 31 10:36:35 user nova-compute[71113]:       <nova:owner>
Jul 31 10:36:35 user nova-compute[71113]:         <nova:user uuid="4a47a5b738a6402db511c0e096f2c26e">tempest-TestMinimumBasicScenario-248468997-project-member</nova:user>
Jul 31 10:36:35 user nova-compute[71113]:         <nova:project uuid="02892a9661ba44dd8c32b91f74446d99">tempest-TestMinimumBasicScenario-248468997</nova:project>
Jul 31 10:36:35 user nova-compute[71113]:       </nova:owner>
Jul 31 10:36:35 user nova-compute[71113]:       <nova:root type="image" uuid="7924d8c7-4600-41ec-823b-d430e6f0dcc5"/>
Jul 31 10:36:35 user nova-compute[71113]:       <nova:ports>
Jul 31 10:36:35 user nova-compute[71113]:         <nova:port uuid="424ff6f3-e6ab-4576-a1d6-fb6585b19eb1">
Jul 31 10:36:35 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 31 10:36:35 user nova-compute[71113]:         </nova:port>
Jul 31 10:36:35 user nova-compute[71113]:       </nova:ports>
Jul 31 10:36:35 user nova-compute[71113]:     </nova:instance>
Jul 31 10:36:35 user nova-compute[71113]:   </metadata>
Jul 31 10:36:35 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 10:36:35 user nova-compute[71113]:     <system>
Jul 31 10:36:35 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 10:36:35 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 10:36:35 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 10:36:35 user nova-compute[71113]:       <entry name="serial">a5f197cf-4a1c-409f-aef6-8d174b013c9b</entry>
Jul 31 10:36:35 user nova-compute[71113]:       <entry name="uuid">a5f197cf-4a1c-409f-aef6-8d174b013c9b</entry>
Jul 31 10:36:35 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 10:36:35 user nova-compute[71113]:     </system>
Jul 31 10:36:35 user nova-compute[71113]:   </sysinfo>
Jul 31 10:36:35 user nova-compute[71113]:   <os>
Jul 31 10:36:35 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 10:36:35 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 10:36:35 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 10:36:35 user nova-compute[71113]:   </os>
Jul 31 10:36:35 user nova-compute[71113]:   <features>
Jul 31 10:36:35 user nova-compute[71113]:     <acpi/>
Jul 31 10:36:35 user nova-compute[71113]:     <apic/>
Jul 31 10:36:35 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 10:36:35 user nova-compute[71113]:   </features>
Jul 31 10:36:35 user nova-compute[71113]:   <clock offset="utc">
Jul 31 10:36:35 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 10:36:35 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 10:36:35 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 10:36:35 user nova-compute[71113]:   </clock>
Jul 31 10:36:35 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 10:36:35 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 10:36:35 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 10:36:35 user nova-compute[71113]:   </cpu>
Jul 31 10:36:35 user nova-compute[71113]:   <devices>
Jul 31 10:36:35 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 10:36:35 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 10:36:35 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/a5f197cf-4a1c-409f-aef6-8d174b013c9b/disk"/>
Jul 31 10:36:35 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 10:36:35 user nova-compute[71113]:     </disk>
Jul 31 10:36:35 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 10:36:35 user nova-compute[71113]:       <mac address="fa:16:3e:31:8b:3a"/>
Jul 31 10:36:35 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:36:35 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 10:36:35 user nova-compute[71113]:       <target dev="tap424ff6f3-e6"/>
Jul 31 10:36:35 user nova-compute[71113]:     </interface>
Jul 31 10:36:35 user nova-compute[71113]:     <serial type="pty">
Jul 31 10:36:35 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/a5f197cf-4a1c-409f-aef6-8d174b013c9b/console.log" append="off"/>
Jul 31 10:36:35 user nova-compute[71113]:     </serial>
Jul 31 10:36:35 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 10:36:35 user nova-compute[71113]:     <video>
Jul 31 10:36:35 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:36:35 user nova-compute[71113]:     </video>
Jul 31 10:36:35 user nova-compute[71113]:     <rng model="virtio">
Jul 31 10:36:35 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 10:36:35 user nova-compute[71113]:     </rng>
Jul 31 10:36:35 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 10:36:35 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 10:36:35 user nova-compute[71113]:       <stats period="10"/>
Jul 31 10:36:35 user nova-compute[71113]:     </memballoon>
Jul 31 10:36:35 user nova-compute[71113]:   </devices>
Jul 31 10:36:35 user nova-compute[71113]: </domain>
Jul 31 10:36:35 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 10:36:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:36:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-335839255',display_name='tempest-TestMinimumBasicScenario-server-335839255',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-335839255',id=50,image_ref='7924d8c7-4600-41ec-823b-d430e6f0dcc5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBA5r3PLo16suTuQPvQh+TdmPkpGYbiPZ8NayH8BdyZaBs9Gejv1BixRwXbZmKCUEOSeFWxcdWPjQdOG1GmbXiVy3Rmp+IyELt4RwLk6onlyMDNjPNvqJtaMLDdPpVnOJw==',key_name='tempest-TestMinimumBasicScenario-790916345',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02892a9661ba44dd8c32b91f74446d99',ramdisk_id='',reservation_id='r-w7jupi9t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7924d8c7-4600-41ec-823b-d430e6f0dcc5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-248468997',owner_user_name='tempest-TestMinimumBasicScenario-248468997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T10:36:33Z,user_data=None,user_id='4a47a5b738a6402db511c0e096f2c26e',uuid=a5f197cf-4a1c-409f-aef6-8d174b013c9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "424ff6f3-e6ab-4576-a1d6-fb6585b19eb1", "address": "fa:16:3e:31:8b:3a", "network": {"id": "b535bacc-9690-4269-a1e4-6aee5466ece4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-811923488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02892a9661ba44dd8c32b91f74446d99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424ff6f3-e6", "ovs_interfaceid": "424ff6f3-e6ab-4576-a1d6-fb6585b19eb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 10:36:35 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Converting VIF {"id": "424ff6f3-e6ab-4576-a1d6-fb6585b19eb1", "address": "fa:16:3e:31:8b:3a", "network": {"id": "b535bacc-9690-4269-a1e4-6aee5466ece4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-811923488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02892a9661ba44dd8c32b91f74446d99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424ff6f3-e6", "ovs_interfaceid": "424ff6f3-e6ab-4576-a1d6-fb6585b19eb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:36:35 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:8b:3a,bridge_name='br-int',has_traffic_filtering=True,id=424ff6f3-e6ab-4576-a1d6-fb6585b19eb1,network=Network(b535bacc-9690-4269-a1e4-6aee5466ece4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap424ff6f3-e6') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:36:35 user nova-compute[71113]: DEBUG os_vif [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:8b:3a,bridge_name='br-int',has_traffic_filtering=True,id=424ff6f3-e6ab-4576-a1d6-fb6585b19eb1,network=Network(b535bacc-9690-4269-a1e4-6aee5466ece4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap424ff6f3-e6') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 10:36:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:36:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:36:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 10:36:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:36:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap424ff6f3-e6, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:36:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap424ff6f3-e6, col_values=(('external_ids', {'iface-id': '424ff6f3-e6ab-4576-a1d6-fb6585b19eb1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:8b:3a', 'vm-uuid': 'a5f197cf-4a1c-409f-aef6-8d174b013c9b'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:36:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:36:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:36:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:36:35 user nova-compute[71113]: INFO os_vif [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:8b:3a,bridge_name='br-int',has_traffic_filtering=True,id=424ff6f3-e6ab-4576-a1d6-fb6585b19eb1,network=Network(b535bacc-9690-4269-a1e4-6aee5466ece4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap424ff6f3-e6')
Jul 31 10:36:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:36:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] No VIF found with MAC fa:16:3e:31:8b:3a, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 10:36:35 user nova-compute[71113]: DEBUG nova.network.neutron [req-6ab7c916-0901-49b5-bae9-1878e67d0612 req-91053861-0b9f-4b80-a7f6-a914297d725d service nova] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Updated VIF entry in instance network info cache for port 424ff6f3-e6ab-4576-a1d6-fb6585b19eb1. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 10:36:35 user nova-compute[71113]: DEBUG nova.network.neutron [req-6ab7c916-0901-49b5-bae9-1878e67d0612 req-91053861-0b9f-4b80-a7f6-a914297d725d service nova] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Updating instance_info_cache with network_info: [{"id": "424ff6f3-e6ab-4576-a1d6-fb6585b19eb1", "address": "fa:16:3e:31:8b:3a", "network": {"id": "b535bacc-9690-4269-a1e4-6aee5466ece4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-811923488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02892a9661ba44dd8c32b91f74446d99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424ff6f3-e6", "ovs_interfaceid": "424ff6f3-e6ab-4576-a1d6-fb6585b19eb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:36:35 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-6ab7c916-0901-49b5-bae9-1878e67d0612 req-91053861-0b9f-4b80-a7f6-a914297d725d service nova] Releasing lock "refresh_cache-a5f197cf-4a1c-409f-aef6-8d174b013c9b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:36:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:36:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:36:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:36:36 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:36:36 user nova-compute[71113]: DEBUG nova.compute.manager [req-8791f1c1-f865-4653-a730-c86d012389c6 req-20bc0386-00d1-45b8-961d-1a3f2012185f service nova] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Received event network-vif-plugged-424ff6f3-e6ab-4576-a1d6-fb6585b19eb1 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:36:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8791f1c1-f865-4653-a730-c86d012389c6 req-20bc0386-00d1-45b8-961d-1a3f2012185f service nova] Acquiring lock "a5f197cf-4a1c-409f-aef6-8d174b013c9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:36:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8791f1c1-f865-4653-a730-c86d012389c6 req-20bc0386-00d1-45b8-961d-1a3f2012185f service nova] Lock "a5f197cf-4a1c-409f-aef6-8d174b013c9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:36:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8791f1c1-f865-4653-a730-c86d012389c6 req-20bc0386-00d1-45b8-961d-1a3f2012185f service nova] Lock "a5f197cf-4a1c-409f-aef6-8d174b013c9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:36:36 user nova-compute[71113]: DEBUG nova.compute.manager [req-8791f1c1-f865-4653-a730-c86d012389c6 req-20bc0386-00d1-45b8-961d-1a3f2012185f service nova] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] No waiting events found dispatching network-vif-plugged-424ff6f3-e6ab-4576-a1d6-fb6585b19eb1 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:36:36 user nova-compute[71113]: WARNING nova.compute.manager [req-8791f1c1-f865-4653-a730-c86d012389c6 req-20bc0386-00d1-45b8-961d-1a3f2012185f service nova] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Received unexpected event network-vif-plugged-424ff6f3-e6ab-4576-a1d6-fb6585b19eb1 for instance with vm_state building and task_state spawning.
Jul 31 10:36:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:36:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:36:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:36:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:36:37 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:36:38 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:36:38 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690799798.7676132, a5f197cf-4a1c-409f-aef6-8d174b013c9b => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:36:38 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] VM Resumed (Lifecycle Event)
Jul 31 10:36:38 user nova-compute[71113]: DEBUG nova.compute.manager [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 10:36:38 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 10:36:38 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Instance spawned successfully.
Jul 31 10:36:38 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 10:36:38 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:36:38 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:36:38 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Found default for hw_cdrom_bus of ide {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:36:38 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Found default for hw_disk_bus of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:36:38 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Found default for hw_input_bus of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:36:38 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Found default for hw_pointer_model of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:36:38 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Found default for hw_video_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:36:38 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Found default for hw_vif_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:36:38 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 10:36:38 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690799798.7704825, a5f197cf-4a1c-409f-aef6-8d174b013c9b => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:36:38 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] VM Started (Lifecycle Event)
Jul 31 10:36:38 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:36:38 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:36:38 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 10:36:38 user nova-compute[71113]: INFO nova.compute.manager [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Took 6.22 seconds to spawn the instance on the hypervisor.
Jul 31 10:36:38 user nova-compute[71113]: DEBUG nova.compute.manager [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:36:38 user nova-compute[71113]: DEBUG nova.compute.manager [req-7ac77cde-b34f-4701-a97d-e2a99a3dd8dc req-e9d1803c-7879-4188-9b90-9ced28f02a83 service nova] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Received event network-vif-plugged-424ff6f3-e6ab-4576-a1d6-fb6585b19eb1 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:36:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7ac77cde-b34f-4701-a97d-e2a99a3dd8dc req-e9d1803c-7879-4188-9b90-9ced28f02a83 service nova] Acquiring lock "a5f197cf-4a1c-409f-aef6-8d174b013c9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:36:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7ac77cde-b34f-4701-a97d-e2a99a3dd8dc req-e9d1803c-7879-4188-9b90-9ced28f02a83 service nova] Lock "a5f197cf-4a1c-409f-aef6-8d174b013c9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:36:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-7ac77cde-b34f-4701-a97d-e2a99a3dd8dc req-e9d1803c-7879-4188-9b90-9ced28f02a83 service nova] Lock "a5f197cf-4a1c-409f-aef6-8d174b013c9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:36:38 user nova-compute[71113]: DEBUG nova.compute.manager [req-7ac77cde-b34f-4701-a97d-e2a99a3dd8dc req-e9d1803c-7879-4188-9b90-9ced28f02a83 service nova] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] No waiting events found dispatching network-vif-plugged-424ff6f3-e6ab-4576-a1d6-fb6585b19eb1 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:36:38 user nova-compute[71113]: WARNING nova.compute.manager [req-7ac77cde-b34f-4701-a97d-e2a99a3dd8dc req-e9d1803c-7879-4188-9b90-9ced28f02a83 service nova] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Received unexpected event network-vif-plugged-424ff6f3-e6ab-4576-a1d6-fb6585b19eb1 for instance with vm_state building and task_state spawning.
Jul 31 10:36:38 user nova-compute[71113]: INFO nova.compute.manager [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Took 6.73 seconds to build instance.
Jul 31 10:36:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-c3c98945-ced9-478d-876c-fd66a6137e29 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "a5f197cf-4a1c-409f-aef6-8d174b013c9b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.818s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:36:40 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:36:40 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:36:42 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:36:42 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:36:42 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Rebuilding the list of instances to heal {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 10:36:42 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "refresh_cache-a5f197cf-4a1c-409f-aef6-8d174b013c9b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:36:42 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquired lock "refresh_cache-a5f197cf-4a1c-409f-aef6-8d174b013c9b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:36:42 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Forcefully refreshing network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 10:36:42 user nova-compute[71113]: DEBUG nova.objects.instance [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lazy-loading 'info_cache' on Instance uuid a5f197cf-4a1c-409f-aef6-8d174b013c9b {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:36:43 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Updating instance_info_cache with network_info: [{"id": "424ff6f3-e6ab-4576-a1d6-fb6585b19eb1", "address": "fa:16:3e:31:8b:3a", "network": {"id": "b535bacc-9690-4269-a1e4-6aee5466ece4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-811923488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02892a9661ba44dd8c32b91f74446d99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424ff6f3-e6", "ovs_interfaceid": "424ff6f3-e6ab-4576-a1d6-fb6585b19eb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:36:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Releasing lock "refresh_cache-a5f197cf-4a1c-409f-aef6-8d174b013c9b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:36:43 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Updated the network info_cache for instance {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 10:36:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:36:47 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:36:47 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:36:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:36:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:36:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:36:47 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:36:47 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f197cf-4a1c-409f-aef6-8d174b013c9b/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:36:47 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f197cf-4a1c-409f-aef6-8d174b013c9b/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:36:47 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f197cf-4a1c-409f-aef6-8d174b013c9b/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:36:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f197cf-4a1c-409f-aef6-8d174b013c9b/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:36:48 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:36:48 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:36:48 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=8838MB free_disk=25.169483184814453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:36:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:36:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:36:48 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance a5f197cf-4a1c-409f-aef6-8d174b013c9b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:36:48 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:36:48 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:36:48 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:36:48 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:36:48 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:36:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.188s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:36:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:36:50 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:36:50 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:36:50 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:36:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:36:55 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:36:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:36:57 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:37:00 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:37:00 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:37:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:37:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:37:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:37:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:37:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:37:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:37:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:37:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:37:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:37:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:37:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:37:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:37:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:37:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:37:36 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:37:39 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:37:40 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:37:40 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:37:42 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:37:42 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:37:42 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Rebuilding the list of instances to heal {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 10:37:42 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "refresh_cache-a5f197cf-4a1c-409f-aef6-8d174b013c9b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:37:42 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquired lock "refresh_cache-a5f197cf-4a1c-409f-aef6-8d174b013c9b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:37:42 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Forcefully refreshing network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 10:37:42 user nova-compute[71113]: DEBUG nova.objects.instance [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lazy-loading 'info_cache' on Instance uuid a5f197cf-4a1c-409f-aef6-8d174b013c9b {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:37:43 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Updating instance_info_cache with network_info: [{"id": "424ff6f3-e6ab-4576-a1d6-fb6585b19eb1", "address": "fa:16:3e:31:8b:3a", "network": {"id": "b535bacc-9690-4269-a1e4-6aee5466ece4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-811923488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02892a9661ba44dd8c32b91f74446d99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424ff6f3-e6", "ovs_interfaceid": "424ff6f3-e6ab-4576-a1d6-fb6585b19eb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:37:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Releasing lock "refresh_cache-a5f197cf-4a1c-409f-aef6-8d174b013c9b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:37:43 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Updated the network info_cache for instance {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 10:37:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:37:47 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:37:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:37:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:37:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:37:47 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:37:47 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f197cf-4a1c-409f-aef6-8d174b013c9b/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:37:47 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f197cf-4a1c-409f-aef6-8d174b013c9b/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:37:47 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f197cf-4a1c-409f-aef6-8d174b013c9b/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:37:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f197cf-4a1c-409f-aef6-8d174b013c9b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:37:48 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:37:48 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:37:48 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=8860MB free_disk=25.141109466552734GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:37:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:37:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:37:48 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance a5f197cf-4a1c-409f-aef6-8d174b013c9b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:37:48 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:37:48 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:37:48 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Refreshing inventories for resource provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 31 10:37:48 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Updating ProviderTree inventory for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 31 10:37:48 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Updating inventory in ProviderTree for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 31 10:37:48 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Refreshing aggregate associations for resource provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05, aggregates: None {{(pid=71113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 31 10:37:48 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Refreshing trait associations for resource provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE2,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS {{(pid=71113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 31 10:37:48 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:37:48 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:37:48 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:37:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.370s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:37:49 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:37:49 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:37:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:37:50 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:37:50 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:37:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:37:55 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:37:59 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:37:59 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Cleaning up deleted instances {{(pid=71113) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 31 10:37:59 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] There are 0 instances to clean {{(pid=71113) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 31 10:38:00 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:38:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:38:09 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:38:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:38:14 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:38:14 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71113) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 31 10:38:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:38:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:38:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:38:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:38:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:38:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:38:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:38:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:38:26 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-27fb3497-2055-4960-ae83-447090784924 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Acquiring lock "a5f197cf-4a1c-409f-aef6-8d174b013c9b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:38:26 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-27fb3497-2055-4960-ae83-447090784924 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "a5f197cf-4a1c-409f-aef6-8d174b013c9b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:38:26 user nova-compute[71113]: DEBUG nova.objects.instance [None req-27fb3497-2055-4960-ae83-447090784924 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lazy-loading 'flavor' on Instance uuid a5f197cf-4a1c-409f-aef6-8d174b013c9b {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:38:26 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-27fb3497-2055-4960-ae83-447090784924 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "a5f197cf-4a1c-409f-aef6-8d174b013c9b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:38:26 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-27fb3497-2055-4960-ae83-447090784924 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Acquiring lock "a5f197cf-4a1c-409f-aef6-8d174b013c9b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:38:26 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-27fb3497-2055-4960-ae83-447090784924 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "a5f197cf-4a1c-409f-aef6-8d174b013c9b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:38:26 user nova-compute[71113]: INFO nova.compute.manager [None req-27fb3497-2055-4960-ae83-447090784924 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Attaching volume 2b83f1d2-e294-4082-91b3-2a360c6b355b to /dev/vdb
Jul 31 10:38:26 user nova-compute[71113]: DEBUG os_brick.utils [None req-27fb3497-2055-4960-ae83-447090784924 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:38:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:38:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:38:26 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ae1d1b-4a3f-4a29-b0aa-52b2fb610446]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:38:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:38:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:38:26 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4970ff60-dab7-41a6-b5a7-a6c7c9c1bc61]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:38:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:38:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:38:26 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d68783-3ef7-4e0f-a617-60839afa0d7c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:38:26 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1479f27-6998-4577-8ace-6b24646c6afd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:38:26 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-27fb3497-2055-4960-ae83-447090784924 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:38:27 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-27fb3497-2055-4960-ae83-447090784924 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 10:38:27 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-27fb3497-2055-4960-ae83-447090784924 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 10:38:27 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:38:27 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 10:38:27 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 10:38:27 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[46eadafa-bf19-459e-937a-80ed7e1b7ec6]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:38:27 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-27fb3497-2055-4960-ae83-447090784924 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 10:38:27 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-27fb3497-2055-4960-ae83-447090784924 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 10:38:27 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-27fb3497-2055-4960-ae83-447090784924 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 10:38:27 user nova-compute[71113]: DEBUG os_brick.utils [None req-27fb3497-2055-4960-ae83-447090784924 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:38:27 user nova-compute[71113]: DEBUG nova.virt.block_device [None req-27fb3497-2055-4960-ae83-447090784924 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Updating existing volume attachment record: 3b797979-b8bd-4343-8879-5d5ccd1df346 {{(pid=71113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 10:38:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:38:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27fb3497-2055-4960-ae83-447090784924 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 10:38:33 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fb3497-2055-4960-ae83-447090784924 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2b83f1d2-e294-4082-91b3-2a360c6b355b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'usnzjEXv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:38:33 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-27fb3497-2055-4960-ae83-447090784924 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:38:33 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-27fb3497-2055-4960-ae83-447090784924 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:38:33 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-27fb3497-2055-4960-ae83-447090784924 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:38:33 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-27fb3497-2055-4960-ae83-447090784924 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:38:33 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-27fb3497-2055-4960-ae83-447090784924 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b83f1d2-e294-4082-91b3-2a360c6b355b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:38:33 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-27fb3497-2055-4960-ae83-447090784924 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b83f1d2-e294-4082-91b3-2a360c6b355b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:38:33 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-27fb3497-2055-4960-ae83-447090784924 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 10:38:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b83f1d2-e294-4082-91b3-2a360c6b355b -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:38:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b83f1d2-e294-4082-91b3-2a360c6b355b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:38:33 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0156040a-c1b3-41b8-a098-7b0f3d6e0f70]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:38:33 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fb3497-2055-4960-ae83-447090784924 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 10:38:33 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:38:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b83f1d2-e294-4082-91b3-2a360c6b355b -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:38:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b83f1d2-e294-4082-91b3-2a360c6b355b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:38:33 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4b804c-48a7-4f2c-a194-491b240d5170]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b83f1d2-e294-4082-91b3-2a360c6b355b] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:38:33 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fb3497-2055-4960-ae83-447090784924 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b83f1d2-e294-4082-91b3-2a360c6b355b] added
Jul 31 10:38:33 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:38:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b83f1d2-e294-4082-91b3-2a360c6b355b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:38:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b83f1d2-e294-4082-91b3-2a360c6b355b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:38:33 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6ebcd1-e388-40d8-9c76-ad74f6c5a783]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:38:33 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fb3497-2055-4960-ae83-447090784924 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:38:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b83f1d2-e294-4082-91b3-2a360c6b355b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:38:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b83f1d2-e294-4082-91b3-2a360c6b355b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:38:33 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b340e2f4-43bc-4e28-a027-5ee4663fff80]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:38:33 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fb3497-2055-4960-ae83-447090784924 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:38:33 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b83f1d2-e294-4082-91b3-2a360c6b355b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v usnzjEXv {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:38:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b83f1d2-e294-4082-91b3-2a360c6b355b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v usnzjEXv" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:38:34 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f3cdd8-a503-4860-86e4-3a4c773f3730]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:38:34 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fb3497-2055-4960-ae83-447090784924 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'usnzjEXv'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:38:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b83f1d2-e294-4082-91b3-2a360c6b355b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:38:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b83f1d2-e294-4082-91b3-2a360c6b355b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:38:34 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[37931f83-0c49-48e9-88ca-787b287ba789]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:38:34 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fb3497-2055-4960-ae83-447090784924 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:38:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:38:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:38:34 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b292432d-eba4-40fd-8bbb-bd8e48a87afa]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:38:34 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fb3497-2055-4960-ae83-447090784924 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 31 10:38:34 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:38:34 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fb3497-2055-4960-ae83-447090784924 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 31 10:38:34 user nova-compute[71113]:  {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:38:34 user nova-compute[71113]: WARNING os_brick.initiator.connectors.iscsi [None req-27fb3497-2055-4960-ae83-447090784924 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 31 10:38:34 user nova-compute[71113]: 
Jul 31 10:38:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b83f1d2-e294-4082-91b3-2a360c6b355b -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:38:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b83f1d2-e294-4082-91b3-2a360c6b355b -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:38:34 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eaa5209-2eb9-48f1-bef7-140e988da58e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b83f1d2-e294-4082-91b3-2a360c6b355b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2b83f1d2-e294-4082-91b3-2a360c6b355b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:38:34 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fb3497-2055-4960-ae83-447090784924 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b83f1d2-e294-4082-91b3-2a360c6b355b, portal: 172.16.0.220,3260]
Jul 31 10:38:34 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:2b83f1d2-e294-4082-91b3-2a360c6b355b, portal: 172.16.0.220,3260] successful.
Jul 31 10:38:34 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:38:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b83f1d2-e294-4082-91b3-2a360c6b355b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:38:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b83f1d2-e294-4082-91b3-2a360c6b355b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:38:34 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0937b6a-5793-4d34-96bf-2bc9c4db69d3]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:38:34 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fb3497-2055-4960-ae83-447090784924 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:38:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:38:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:38:34 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98a576e-9eed-4ce2-b83a-efab59671086]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b83f1d2-e294-4082-91b3-2a360c6b355b (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:38:34 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fb3497-2055-4960-ae83-447090784924 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b83f1d2-e294-4082-91b3-2a360c6b355b (non-flash)
Jul 31 10:38:34 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:38:34 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fb3497-2055-4960-ae83-447090784924 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b83f1d2-e294-4082-91b3-2a360c6b355b (non-flash)
Jul 31 10:38:34 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:38:34 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-27fb3497-2055-4960-ae83-447090784924 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b83f1d2-e294-4082-91b3-2a360c6b355b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:38:34 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fb3497-2055-4960-ae83-447090784924 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 10:38:34 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-27fb3497-2055-4960-ae83-447090784924 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 10:38:34 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-27fb3497-2055-4960-ae83-447090784924 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 10:38:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:38:34 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:38:34 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b01a7cd-4eb2-4da1-a42a-2d1d86d9c81d]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:38:34 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-27fb3497-2055-4960-ae83-447090784924 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: None {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 10:38:35 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-27fb3497-2055-4960-ae83-447090784924 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 10:38:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fb3497-2055-4960-ae83-447090784924 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'usnzjEXv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 10:38:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-27fb3497-2055-4960-ae83-447090784924 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:38:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-27fb3497-2055-4960-ae83-447090784924 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '26431663466653337', 'path': '/dev/sdb'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:38:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27fb3497-2055-4960-ae83-447090784924 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431663466653337', 'path': '/dev/sdb'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 10:38:35 user nova-compute[71113]: DEBUG nova.objects.instance [None req-27fb3497-2055-4960-ae83-447090784924 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lazy-loading 'flavor' on Instance uuid a5f197cf-4a1c-409f-aef6-8d174b013c9b {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:38:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-27fb3497-2055-4960-ae83-447090784924 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 10:38:35 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:38:35 user nova-compute[71113]:   <source dev="/dev/sdb"/>
Jul 31 10:38:35 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 10:38:35 user nova-compute[71113]:   <serial>2b83f1d2-e294-4082-91b3-2a360c6b355b</serial>
Jul 31 10:38:35 user nova-compute[71113]: </disk>
Jul 31 10:38:35 user nova-compute[71113]:  {{(pid=71113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 10:38:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:38:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-27fb3497-2055-4960-ae83-447090784924 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:38:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-27fb3497-2055-4960-ae83-447090784924 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:38:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-27fb3497-2055-4960-ae83-447090784924 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] No VIF found with MAC fa:16:3e:31:8b:3a, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 10:38:35 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-27fb3497-2055-4960-ae83-447090784924 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "a5f197cf-4a1c-409f-aef6-8d174b013c9b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.921s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:38:36 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:38:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:38:38 user nova-compute[71113]: DEBUG nova.compute.manager [req-af4a5c6c-9c47-458a-9cbd-ae2c0273bb0a req-2bf1a7a3-bed8-4dda-80a4-f202cf3abb84 service nova] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Received event network-changed-424ff6f3-e6ab-4576-a1d6-fb6585b19eb1 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:38:38 user nova-compute[71113]: DEBUG nova.compute.manager [req-af4a5c6c-9c47-458a-9cbd-ae2c0273bb0a req-2bf1a7a3-bed8-4dda-80a4-f202cf3abb84 service nova] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Refreshing instance network info cache due to event network-changed-424ff6f3-e6ab-4576-a1d6-fb6585b19eb1. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 10:38:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-af4a5c6c-9c47-458a-9cbd-ae2c0273bb0a req-2bf1a7a3-bed8-4dda-80a4-f202cf3abb84 service nova] Acquiring lock "refresh_cache-a5f197cf-4a1c-409f-aef6-8d174b013c9b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:38:38 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-af4a5c6c-9c47-458a-9cbd-ae2c0273bb0a req-2bf1a7a3-bed8-4dda-80a4-f202cf3abb84 service nova] Acquired lock "refresh_cache-a5f197cf-4a1c-409f-aef6-8d174b013c9b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:38:38 user nova-compute[71113]: DEBUG nova.network.neutron [req-af4a5c6c-9c47-458a-9cbd-ae2c0273bb0a req-2bf1a7a3-bed8-4dda-80a4-f202cf3abb84 service nova] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Refreshing network info cache for port 424ff6f3-e6ab-4576-a1d6-fb6585b19eb1 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 10:38:39 user nova-compute[71113]: DEBUG nova.network.neutron [req-af4a5c6c-9c47-458a-9cbd-ae2c0273bb0a req-2bf1a7a3-bed8-4dda-80a4-f202cf3abb84 service nova] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Updated VIF entry in instance network info cache for port 424ff6f3-e6ab-4576-a1d6-fb6585b19eb1. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 10:38:39 user nova-compute[71113]: DEBUG nova.network.neutron [req-af4a5c6c-9c47-458a-9cbd-ae2c0273bb0a req-2bf1a7a3-bed8-4dda-80a4-f202cf3abb84 service nova] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Updating instance_info_cache with network_info: [{"id": "424ff6f3-e6ab-4576-a1d6-fb6585b19eb1", "address": "fa:16:3e:31:8b:3a", "network": {"id": "b535bacc-9690-4269-a1e4-6aee5466ece4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-811923488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02892a9661ba44dd8c32b91f74446d99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424ff6f3-e6", "ovs_interfaceid": "424ff6f3-e6ab-4576-a1d6-fb6585b19eb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:38:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-af4a5c6c-9c47-458a-9cbd-ae2c0273bb0a req-2bf1a7a3-bed8-4dda-80a4-f202cf3abb84 service nova] Releasing lock "refresh_cache-a5f197cf-4a1c-409f-aef6-8d174b013c9b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:38:40 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:38:40 user nova-compute[71113]: DEBUG nova.compute.manager [req-6067168b-5def-4727-b68d-9d34eb357240 req-d8d1d69d-e3bc-4f61-80fc-a74ca3aee1c8 service nova] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Received event network-changed-424ff6f3-e6ab-4576-a1d6-fb6585b19eb1 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:38:40 user nova-compute[71113]: DEBUG nova.compute.manager [req-6067168b-5def-4727-b68d-9d34eb357240 req-d8d1d69d-e3bc-4f61-80fc-a74ca3aee1c8 service nova] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Refreshing instance network info cache due to event network-changed-424ff6f3-e6ab-4576-a1d6-fb6585b19eb1. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 10:38:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-6067168b-5def-4727-b68d-9d34eb357240 req-d8d1d69d-e3bc-4f61-80fc-a74ca3aee1c8 service nova] Acquiring lock "refresh_cache-a5f197cf-4a1c-409f-aef6-8d174b013c9b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:38:40 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-6067168b-5def-4727-b68d-9d34eb357240 req-d8d1d69d-e3bc-4f61-80fc-a74ca3aee1c8 service nova] Acquired lock "refresh_cache-a5f197cf-4a1c-409f-aef6-8d174b013c9b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:38:40 user nova-compute[71113]: DEBUG nova.network.neutron [req-6067168b-5def-4727-b68d-9d34eb357240 req-d8d1d69d-e3bc-4f61-80fc-a74ca3aee1c8 service nova] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Refreshing network info cache for port 424ff6f3-e6ab-4576-a1d6-fb6585b19eb1 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 10:38:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:38:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b39d5e87-384e-4e0d-8468-c7ae313937cf tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Acquiring lock "a5f197cf-4a1c-409f-aef6-8d174b013c9b" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:38:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b39d5e87-384e-4e0d-8468-c7ae313937cf tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "a5f197cf-4a1c-409f-aef6-8d174b013c9b" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:38:41 user nova-compute[71113]: INFO nova.compute.manager [None req-b39d5e87-384e-4e0d-8468-c7ae313937cf tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Rebooting instance
Jul 31 10:38:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b39d5e87-384e-4e0d-8468-c7ae313937cf tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Acquiring lock "refresh_cache-a5f197cf-4a1c-409f-aef6-8d174b013c9b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:38:41 user nova-compute[71113]: DEBUG nova.network.neutron [req-6067168b-5def-4727-b68d-9d34eb357240 req-d8d1d69d-e3bc-4f61-80fc-a74ca3aee1c8 service nova] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Updated VIF entry in instance network info cache for port 424ff6f3-e6ab-4576-a1d6-fb6585b19eb1. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 10:38:41 user nova-compute[71113]: DEBUG nova.network.neutron [req-6067168b-5def-4727-b68d-9d34eb357240 req-d8d1d69d-e3bc-4f61-80fc-a74ca3aee1c8 service nova] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Updating instance_info_cache with network_info: [{"id": "424ff6f3-e6ab-4576-a1d6-fb6585b19eb1", "address": "fa:16:3e:31:8b:3a", "network": {"id": "b535bacc-9690-4269-a1e4-6aee5466ece4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-811923488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02892a9661ba44dd8c32b91f74446d99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424ff6f3-e6", "ovs_interfaceid": "424ff6f3-e6ab-4576-a1d6-fb6585b19eb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:38:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-6067168b-5def-4727-b68d-9d34eb357240 req-d8d1d69d-e3bc-4f61-80fc-a74ca3aee1c8 service nova] Releasing lock "refresh_cache-a5f197cf-4a1c-409f-aef6-8d174b013c9b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:38:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b39d5e87-384e-4e0d-8468-c7ae313937cf tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Acquired lock "refresh_cache-a5f197cf-4a1c-409f-aef6-8d174b013c9b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:38:41 user nova-compute[71113]: DEBUG nova.network.neutron [None req-b39d5e87-384e-4e0d-8468-c7ae313937cf tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 10:38:41 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:38:41 user nova-compute[71113]: DEBUG nova.network.neutron [None req-b39d5e87-384e-4e0d-8468-c7ae313937cf tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Updating instance_info_cache with network_info: [{"id": "424ff6f3-e6ab-4576-a1d6-fb6585b19eb1", "address": "fa:16:3e:31:8b:3a", "network": {"id": "b535bacc-9690-4269-a1e4-6aee5466ece4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-811923488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02892a9661ba44dd8c32b91f74446d99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424ff6f3-e6", "ovs_interfaceid": "424ff6f3-e6ab-4576-a1d6-fb6585b19eb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:38:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b39d5e87-384e-4e0d-8468-c7ae313937cf tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Releasing lock "refresh_cache-a5f197cf-4a1c-409f-aef6-8d174b013c9b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:38:41 user nova-compute[71113]: DEBUG nova.compute.manager [None req-b39d5e87-384e-4e0d-8468-c7ae313937cf tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:38:42 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:38:43 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:38:43 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:38:43 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Rebuilding the list of instances to heal {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 10:38:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "refresh_cache-a5f197cf-4a1c-409f-aef6-8d174b013c9b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:38:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquired lock "refresh_cache-a5f197cf-4a1c-409f-aef6-8d174b013c9b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:38:43 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Forcefully refreshing network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 10:38:43 user nova-compute[71113]: DEBUG nova.objects.instance [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lazy-loading 'info_cache' on Instance uuid a5f197cf-4a1c-409f-aef6-8d174b013c9b {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:38:44 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Updating instance_info_cache with network_info: [{"id": "424ff6f3-e6ab-4576-a1d6-fb6585b19eb1", "address": "fa:16:3e:31:8b:3a", "network": {"id": "b535bacc-9690-4269-a1e4-6aee5466ece4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-811923488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02892a9661ba44dd8c32b91f74446d99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424ff6f3-e6", "ovs_interfaceid": "424ff6f3-e6ab-4576-a1d6-fb6585b19eb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:38:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:38:44 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Releasing lock "refresh_cache-a5f197cf-4a1c-409f-aef6-8d174b013c9b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:38:44 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Updated the network info_cache for instance {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 10:38:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:38:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:38:44 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:38:44 user nova-compute[71113]: DEBUG nova.compute.manager [req-e9a48ca7-94a5-44d4-bd6a-abc2cb523500 req-084894f3-17fe-4da7-bbb1-f37918a86849 service nova] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Received event network-vif-unplugged-424ff6f3-e6ab-4576-a1d6-fb6585b19eb1 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:38:44 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e9a48ca7-94a5-44d4-bd6a-abc2cb523500 req-084894f3-17fe-4da7-bbb1-f37918a86849 service nova] Acquiring lock "a5f197cf-4a1c-409f-aef6-8d174b013c9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:38:44 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e9a48ca7-94a5-44d4-bd6a-abc2cb523500 req-084894f3-17fe-4da7-bbb1-f37918a86849 service nova] Lock "a5f197cf-4a1c-409f-aef6-8d174b013c9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:38:44 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e9a48ca7-94a5-44d4-bd6a-abc2cb523500 req-084894f3-17fe-4da7-bbb1-f37918a86849 service nova] Lock "a5f197cf-4a1c-409f-aef6-8d174b013c9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:38:44 user nova-compute[71113]: DEBUG nova.compute.manager [req-e9a48ca7-94a5-44d4-bd6a-abc2cb523500 req-084894f3-17fe-4da7-bbb1-f37918a86849 service nova] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] No waiting events found dispatching network-vif-unplugged-424ff6f3-e6ab-4576-a1d6-fb6585b19eb1 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:38:44 user nova-compute[71113]: WARNING nova.compute.manager [req-e9a48ca7-94a5-44d4-bd6a-abc2cb523500 req-084894f3-17fe-4da7-bbb1-f37918a86849 service nova] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Received unexpected event network-vif-unplugged-424ff6f3-e6ab-4576-a1d6-fb6585b19eb1 for instance with vm_state active and task_state reboot_started.
Jul 31 10:38:45 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-b39d5e87-384e-4e0d-8468-c7ae313937cf tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Instance shutdown successfully.
Jul 31 10:38:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:38:46 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:38:46 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:38:46 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:38:46 user nova-compute[71113]: DEBUG nova.compute.manager [req-9ced86d6-54ad-4dc8-bcd6-80d63cb8cf44 req-b20a5b42-4187-4a65-be35-8cf945dd1578 service nova] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Received event network-vif-plugged-424ff6f3-e6ab-4576-a1d6-fb6585b19eb1 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:38:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9ced86d6-54ad-4dc8-bcd6-80d63cb8cf44 req-b20a5b42-4187-4a65-be35-8cf945dd1578 service nova] Acquiring lock "a5f197cf-4a1c-409f-aef6-8d174b013c9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:38:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9ced86d6-54ad-4dc8-bcd6-80d63cb8cf44 req-b20a5b42-4187-4a65-be35-8cf945dd1578 service nova] Lock "a5f197cf-4a1c-409f-aef6-8d174b013c9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:38:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-9ced86d6-54ad-4dc8-bcd6-80d63cb8cf44 req-b20a5b42-4187-4a65-be35-8cf945dd1578 service nova] Lock "a5f197cf-4a1c-409f-aef6-8d174b013c9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:38:46 user nova-compute[71113]: DEBUG nova.compute.manager [req-9ced86d6-54ad-4dc8-bcd6-80d63cb8cf44 req-b20a5b42-4187-4a65-be35-8cf945dd1578 service nova] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] No waiting events found dispatching network-vif-plugged-424ff6f3-e6ab-4576-a1d6-fb6585b19eb1 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:38:46 user nova-compute[71113]: WARNING nova.compute.manager [req-9ced86d6-54ad-4dc8-bcd6-80d63cb8cf44 req-b20a5b42-4187-4a65-be35-8cf945dd1578 service nova] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Received unexpected event network-vif-plugged-424ff6f3-e6ab-4576-a1d6-fb6585b19eb1 for instance with vm_state active and task_state reboot_started.
Jul 31 10:38:46 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:38:46 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:38:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:38:48 user nova-compute[71113]: DEBUG nova.compute.manager [req-58e27ac4-e094-4312-b262-31a7f45f399d req-02eb5665-6f6a-43de-b9b0-7595cad27e78 service nova] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Received event network-vif-plugged-424ff6f3-e6ab-4576-a1d6-fb6585b19eb1 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:38:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-58e27ac4-e094-4312-b262-31a7f45f399d req-02eb5665-6f6a-43de-b9b0-7595cad27e78 service nova] Acquiring lock "a5f197cf-4a1c-409f-aef6-8d174b013c9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:38:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-58e27ac4-e094-4312-b262-31a7f45f399d req-02eb5665-6f6a-43de-b9b0-7595cad27e78 service nova] Lock "a5f197cf-4a1c-409f-aef6-8d174b013c9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:38:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-58e27ac4-e094-4312-b262-31a7f45f399d req-02eb5665-6f6a-43de-b9b0-7595cad27e78 service nova] Lock "a5f197cf-4a1c-409f-aef6-8d174b013c9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:38:48 user nova-compute[71113]: DEBUG nova.compute.manager [req-58e27ac4-e094-4312-b262-31a7f45f399d req-02eb5665-6f6a-43de-b9b0-7595cad27e78 service nova] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] No waiting events found dispatching network-vif-plugged-424ff6f3-e6ab-4576-a1d6-fb6585b19eb1 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:38:48 user nova-compute[71113]: WARNING nova.compute.manager [req-58e27ac4-e094-4312-b262-31a7f45f399d req-02eb5665-6f6a-43de-b9b0-7595cad27e78 service nova] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Received unexpected event network-vif-plugged-424ff6f3-e6ab-4576-a1d6-fb6585b19eb1 for instance with vm_state active and task_state reboot_started.
Jul 31 10:38:48 user nova-compute[71113]: DEBUG nova.compute.manager [req-58e27ac4-e094-4312-b262-31a7f45f399d req-02eb5665-6f6a-43de-b9b0-7595cad27e78 service nova] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Received event network-vif-plugged-424ff6f3-e6ab-4576-a1d6-fb6585b19eb1 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:38:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-58e27ac4-e094-4312-b262-31a7f45f399d req-02eb5665-6f6a-43de-b9b0-7595cad27e78 service nova] Acquiring lock "a5f197cf-4a1c-409f-aef6-8d174b013c9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:38:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-58e27ac4-e094-4312-b262-31a7f45f399d req-02eb5665-6f6a-43de-b9b0-7595cad27e78 service nova] Lock "a5f197cf-4a1c-409f-aef6-8d174b013c9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:38:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-58e27ac4-e094-4312-b262-31a7f45f399d req-02eb5665-6f6a-43de-b9b0-7595cad27e78 service nova] Lock "a5f197cf-4a1c-409f-aef6-8d174b013c9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:38:48 user nova-compute[71113]: DEBUG nova.compute.manager [req-58e27ac4-e094-4312-b262-31a7f45f399d req-02eb5665-6f6a-43de-b9b0-7595cad27e78 service nova] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] No waiting events found dispatching network-vif-plugged-424ff6f3-e6ab-4576-a1d6-fb6585b19eb1 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:38:48 user nova-compute[71113]: WARNING nova.compute.manager [req-58e27ac4-e094-4312-b262-31a7f45f399d req-02eb5665-6f6a-43de-b9b0-7595cad27e78 service nova] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Received unexpected event network-vif-plugged-424ff6f3-e6ab-4576-a1d6-fb6585b19eb1 for instance with vm_state active and task_state reboot_started.
Jul 31 10:38:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Removed pending event for a5f197cf-4a1c-409f-aef6-8d174b013c9b due to event {{(pid=71113) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 31 10:38:48 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690799928.617535, a5f197cf-4a1c-409f-aef6-8d174b013c9b => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:38:48 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] VM Resumed (Lifecycle Event)
Jul 31 10:38:48 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Instance running successfully.
Jul 31 10:38:48 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-b39d5e87-384e-4e0d-8468-c7ae313937cf tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Instance soft rebooted successfully.
Jul 31 10:38:48 user nova-compute[71113]: DEBUG nova.compute.manager [None req-b39d5e87-384e-4e0d-8468-c7ae313937cf tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:38:48 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:38:48 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:38:48 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] During sync_power_state the instance has a pending task (reboot_started). Skip.
Jul 31 10:38:48 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690799928.619665, a5f197cf-4a1c-409f-aef6-8d174b013c9b => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:38:48 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] VM Started (Lifecycle Event)
Jul 31 10:38:48 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:38:48 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:38:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b39d5e87-384e-4e0d-8468-c7ae313937cf tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "a5f197cf-4a1c-409f-aef6-8d174b013c9b" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.414s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:38:48 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:38:48 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:38:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:38:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:38:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:38:48 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:38:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f197cf-4a1c-409f-aef6-8d174b013c9b/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:38:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f197cf-4a1c-409f-aef6-8d174b013c9b/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:38:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f197cf-4a1c-409f-aef6-8d174b013c9b/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:38:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f197cf-4a1c-409f-aef6-8d174b013c9b/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:38:49 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 10:38:49 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:38:49 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:38:49 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=8948MB free_disk=25.139163970947266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:38:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:38:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:38:49 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance a5f197cf-4a1c-409f-aef6-8d174b013c9b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:38:49 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:38:49 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:38:49 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:38:49 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:38:49 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:38:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.164s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:38:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:38:50 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:38:50 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:38:50 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:38:51 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:38:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:38:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:38:56 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:39:00 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:39:00 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:39:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:39:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:39:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:39:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:39:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:39:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:39:06 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:39:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:39:11 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:39:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:39:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:39:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:39:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:39:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:39:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:39:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:39:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:39:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:39:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:39:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:39:37 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:39:40 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:39:42 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:39:42 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:39:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:39:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:39:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:39:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:39:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:39:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:39:45 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:39:45 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:39:45 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Rebuilding the list of instances to heal {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 10:39:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "refresh_cache-a5f197cf-4a1c-409f-aef6-8d174b013c9b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:39:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquired lock "refresh_cache-a5f197cf-4a1c-409f-aef6-8d174b013c9b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:39:45 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Forcefully refreshing network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 10:39:45 user nova-compute[71113]: DEBUG nova.objects.instance [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lazy-loading 'info_cache' on Instance uuid a5f197cf-4a1c-409f-aef6-8d174b013c9b {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:39:46 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Updating instance_info_cache with network_info: [{"id": "424ff6f3-e6ab-4576-a1d6-fb6585b19eb1", "address": "fa:16:3e:31:8b:3a", "network": {"id": "b535bacc-9690-4269-a1e4-6aee5466ece4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-811923488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02892a9661ba44dd8c32b91f74446d99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424ff6f3-e6", "ovs_interfaceid": "424ff6f3-e6ab-4576-a1d6-fb6585b19eb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:39:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Releasing lock "refresh_cache-a5f197cf-4a1c-409f-aef6-8d174b013c9b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:39:46 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Updated the network info_cache for instance {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 10:39:48 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:39:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:39:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:39:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:39:48 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:39:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f197cf-4a1c-409f-aef6-8d174b013c9b/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:39:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f197cf-4a1c-409f-aef6-8d174b013c9b/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:39:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f197cf-4a1c-409f-aef6-8d174b013c9b/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:39:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f197cf-4a1c-409f-aef6-8d174b013c9b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:39:49 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 10:39:49 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:39:49 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:39:49 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=8903MB free_disk=25.13837432861328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:39:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:39:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:39:49 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance a5f197cf-4a1c-409f-aef6-8d174b013c9b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:39:49 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:39:49 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:39:49 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:39:49 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:39:49 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:39:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.212s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:39:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:39:51 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:39:51 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:39:51 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:39:51 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:39:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:39:58 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:40:00 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:40:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:40:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:40:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:40:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:40:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:40:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:40:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:40:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:40:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:40:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:40:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:40:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:40:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:40:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:40:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:40:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:40:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:40:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:40:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:40:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:40:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:40:33 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:40:33 user nova-compute[71113]: DEBUG nova.compute.manager [req-a20d68ce-9643-4fdb-8271-2d9126772f52 req-0cede11e-dcbd-4db8-90d9-1fbb83f66ed7 service nova] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Received event network-changed-424ff6f3-e6ab-4576-a1d6-fb6585b19eb1 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:40:33 user nova-compute[71113]: DEBUG nova.compute.manager [req-a20d68ce-9643-4fdb-8271-2d9126772f52 req-0cede11e-dcbd-4db8-90d9-1fbb83f66ed7 service nova] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Refreshing instance network info cache due to event network-changed-424ff6f3-e6ab-4576-a1d6-fb6585b19eb1. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 10:40:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-a20d68ce-9643-4fdb-8271-2d9126772f52 req-0cede11e-dcbd-4db8-90d9-1fbb83f66ed7 service nova] Acquiring lock "refresh_cache-a5f197cf-4a1c-409f-aef6-8d174b013c9b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:40:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-a20d68ce-9643-4fdb-8271-2d9126772f52 req-0cede11e-dcbd-4db8-90d9-1fbb83f66ed7 service nova] Acquired lock "refresh_cache-a5f197cf-4a1c-409f-aef6-8d174b013c9b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:40:33 user nova-compute[71113]: DEBUG nova.network.neutron [req-a20d68ce-9643-4fdb-8271-2d9126772f52 req-0cede11e-dcbd-4db8-90d9-1fbb83f66ed7 service nova] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Refreshing network info cache for port 424ff6f3-e6ab-4576-a1d6-fb6585b19eb1 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 10:40:34 user nova-compute[71113]: DEBUG nova.network.neutron [req-a20d68ce-9643-4fdb-8271-2d9126772f52 req-0cede11e-dcbd-4db8-90d9-1fbb83f66ed7 service nova] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Updated VIF entry in instance network info cache for port 424ff6f3-e6ab-4576-a1d6-fb6585b19eb1. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 10:40:34 user nova-compute[71113]: DEBUG nova.network.neutron [req-a20d68ce-9643-4fdb-8271-2d9126772f52 req-0cede11e-dcbd-4db8-90d9-1fbb83f66ed7 service nova] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Updating instance_info_cache with network_info: [{"id": "424ff6f3-e6ab-4576-a1d6-fb6585b19eb1", "address": "fa:16:3e:31:8b:3a", "network": {"id": "b535bacc-9690-4269-a1e4-6aee5466ece4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-811923488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02892a9661ba44dd8c32b91f74446d99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424ff6f3-e6", "ovs_interfaceid": "424ff6f3-e6ab-4576-a1d6-fb6585b19eb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:40:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-a20d68ce-9643-4fdb-8271-2d9126772f52 req-0cede11e-dcbd-4db8-90d9-1fbb83f66ed7 service nova] Releasing lock "refresh_cache-a5f197cf-4a1c-409f-aef6-8d174b013c9b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:40:34 user nova-compute[71113]: DEBUG nova.compute.manager [req-5f2e1208-601e-4dd7-8106-b845cc212252 req-60703045-6294-4e62-8c27-04ce5188589b service nova] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Received event network-changed-424ff6f3-e6ab-4576-a1d6-fb6585b19eb1 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:40:34 user nova-compute[71113]: DEBUG nova.compute.manager [req-5f2e1208-601e-4dd7-8106-b845cc212252 req-60703045-6294-4e62-8c27-04ce5188589b service nova] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Refreshing instance network info cache due to event network-changed-424ff6f3-e6ab-4576-a1d6-fb6585b19eb1. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 10:40:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-5f2e1208-601e-4dd7-8106-b845cc212252 req-60703045-6294-4e62-8c27-04ce5188589b service nova] Acquiring lock "refresh_cache-a5f197cf-4a1c-409f-aef6-8d174b013c9b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:40:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-5f2e1208-601e-4dd7-8106-b845cc212252 req-60703045-6294-4e62-8c27-04ce5188589b service nova] Acquired lock "refresh_cache-a5f197cf-4a1c-409f-aef6-8d174b013c9b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:40:34 user nova-compute[71113]: DEBUG nova.network.neutron [req-5f2e1208-601e-4dd7-8106-b845cc212252 req-60703045-6294-4e62-8c27-04ce5188589b service nova] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Refreshing network info cache for port 424ff6f3-e6ab-4576-a1d6-fb6585b19eb1 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 10:40:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-a335af39-1a7f-436e-9075-045217a067d7 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Acquiring lock "a5f197cf-4a1c-409f-aef6-8d174b013c9b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:40:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-a335af39-1a7f-436e-9075-045217a067d7 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "a5f197cf-4a1c-409f-aef6-8d174b013c9b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:40:34 user nova-compute[71113]: INFO nova.compute.manager [None req-a335af39-1a7f-436e-9075-045217a067d7 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Detaching volume 2b83f1d2-e294-4082-91b3-2a360c6b355b
Jul 31 10:40:34 user nova-compute[71113]: INFO nova.virt.block_device [None req-a335af39-1a7f-436e-9075-045217a067d7 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Attempting to driver detach volume 2b83f1d2-e294-4082-91b3-2a360c6b355b from mountpoint /dev/vdb
Jul 31 10:40:34 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-a335af39-1a7f-436e-9075-045217a067d7 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Attempting to detach device vdb from instance a5f197cf-4a1c-409f-aef6-8d174b013c9b from the persistent domain config. {{(pid=71113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 10:40:34 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-a335af39-1a7f-436e-9075-045217a067d7 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 10:40:34 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:40:34 user nova-compute[71113]:   <source dev="/dev/sdb"/>
Jul 31 10:40:34 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 10:40:34 user nova-compute[71113]:   <serial>2b83f1d2-e294-4082-91b3-2a360c6b355b</serial>
Jul 31 10:40:34 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 10:40:34 user nova-compute[71113]: </disk>
Jul 31 10:40:34 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 10:40:34 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-a335af39-1a7f-436e-9075-045217a067d7 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Successfully detached device vdb from instance a5f197cf-4a1c-409f-aef6-8d174b013c9b from the persistent domain config.
Jul 31 10:40:34 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-a335af39-1a7f-436e-9075-045217a067d7 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a5f197cf-4a1c-409f-aef6-8d174b013c9b from the live domain config. {{(pid=71113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 10:40:34 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-a335af39-1a7f-436e-9075-045217a067d7 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 10:40:34 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:40:34 user nova-compute[71113]:   <source dev="/dev/sdb"/>
Jul 31 10:40:34 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 10:40:34 user nova-compute[71113]:   <serial>2b83f1d2-e294-4082-91b3-2a360c6b355b</serial>
Jul 31 10:40:34 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 10:40:34 user nova-compute[71113]: </disk>
Jul 31 10:40:34 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 10:40:34 user nova-compute[71113]: DEBUG nova.network.neutron [req-5f2e1208-601e-4dd7-8106-b845cc212252 req-60703045-6294-4e62-8c27-04ce5188589b service nova] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Updated VIF entry in instance network info cache for port 424ff6f3-e6ab-4576-a1d6-fb6585b19eb1. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 10:40:34 user nova-compute[71113]: DEBUG nova.network.neutron [req-5f2e1208-601e-4dd7-8106-b845cc212252 req-60703045-6294-4e62-8c27-04ce5188589b service nova] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Updating instance_info_cache with network_info: [{"id": "424ff6f3-e6ab-4576-a1d6-fb6585b19eb1", "address": "fa:16:3e:31:8b:3a", "network": {"id": "b535bacc-9690-4269-a1e4-6aee5466ece4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-811923488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02892a9661ba44dd8c32b91f74446d99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424ff6f3-e6", "ovs_interfaceid": "424ff6f3-e6ab-4576-a1d6-fb6585b19eb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:40:34 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-5f2e1208-601e-4dd7-8106-b845cc212252 req-60703045-6294-4e62-8c27-04ce5188589b service nova] Releasing lock "refresh_cache-a5f197cf-4a1c-409f-aef6-8d174b013c9b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:40:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Received event <DeviceRemovedEvent: 1690800035.085883, a5f197cf-4a1c-409f-aef6-8d174b013c9b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71113) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 10:40:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-a335af39-1a7f-436e-9075-045217a067d7 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a5f197cf-4a1c-409f-aef6-8d174b013c9b {{(pid=71113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 10:40:35 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-a335af39-1a7f-436e-9075-045217a067d7 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Successfully detached device vdb from instance a5f197cf-4a1c-409f-aef6-8d174b013c9b from the live domain config.
Jul 31 10:40:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a335af39-1a7f-436e-9075-045217a067d7 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 10:40:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a335af39-1a7f-436e-9075-045217a067d7 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:2b83f1d2-e294-4082-91b3-2a360c6b355b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'usnzjEXv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:40:35 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-a335af39-1a7f-436e-9075-045217a067d7 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:40:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-a335af39-1a7f-436e-9075-045217a067d7 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:40:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-a335af39-1a7f-436e-9075-045217a067d7 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:40:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a335af39-1a7f-436e-9075-045217a067d7 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b83f1d2-e294-4082-91b3-2a360c6b355b', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 10:40:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:40:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:40:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9a224a-32d3-48a2-84e0-769af4b14738]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b83f1d2-e294-4082-91b3-2a360c6b355b\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:40:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:40:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:40:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d872cbdc-0b96-449c-a934-4b57d7b8e428]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b83f1d2-e294-4082-91b3-2a360c6b355b (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:40:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a335af39-1a7f-436e-9075-045217a067d7 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b83f1d2-e294-4082-91b3-2a360c6b355b (non-flash)
Jul 31 10:40:35 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:40:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a335af39-1a7f-436e-9075-045217a067d7 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b83f1d2-e294-4082-91b3-2a360c6b355b (non-flash)
Jul 31 10:40:35 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:40:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a335af39-1a7f-436e-9075-045217a067d7 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7914c1f6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b83f1d2-e294-4082-91b3-2a360c6b355b'): ({'sdb'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 10:40:35 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-a335af39-1a7f-436e-9075-045217a067d7 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Removing single pathed devices sdb {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 10:40:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:40:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:40:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc978372-9a19-421c-a1df-1352acad1a03]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:40:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:40:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:40:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d913a933-0cf8-4db5-a63e-fbd148817d46]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:40:35 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-a335af39-1a7f-436e-9075-045217a067d7 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Flushing IO for device /dev/sdb {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 10:40:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:40:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:40:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a08d01-b997-4f45-9d4f-f707b7c97aaf]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:40:35 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-a335af39-1a7f-436e-9075-045217a067d7 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 10:40:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:40:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:40:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a614affc-769c-44c8-afb9-e160d00c5012]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:40:35 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-a335af39-1a7f-436e-9075-045217a067d7 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 10:40:35 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-a335af39-1a7f-436e-9075-045217a067d7 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] SCSI volumes sdb have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 10:40:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a335af39-1a7f-436e-9075-045217a067d7 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b83f1d2-e294-4082-91b3-2a360c6b355b')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 10:40:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b83f1d2-e294-4082-91b3-2a360c6b355b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:40:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b83f1d2-e294-4082-91b3-2a360c6b355b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:40:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8251d018-7bfa-4bbd-87e7-8a0c8cfddd63]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:40:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a335af39-1a7f-436e-9075-045217a067d7 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:40:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b83f1d2-e294-4082-91b3-2a360c6b355b -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:40:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b83f1d2-e294-4082-91b3-2a360c6b355b -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:40:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11fcbc3-d11d-4134-8d96-6f5d88240ffb]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:2b83f1d2-e294-4082-91b3-2a360c6b355b, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:2b83f1d2-e294-4082-91b3-2a360c6b355b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:40:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a335af39-1a7f-436e-9075-045217a067d7 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:2b83f1d2-e294-4082-91b3-2a360c6b355b, portal: 172.16.0.220,3260]
Jul 31 10:40:35 user nova-compute[71113]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:2b83f1d2-e294-4082-91b3-2a360c6b355b, portal: 172.16.0.220,3260] successful.
Jul 31 10:40:35 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:40:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b83f1d2-e294-4082-91b3-2a360c6b355b -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:40:35 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b83f1d2-e294-4082-91b3-2a360c6b355b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:40:35 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ebae0d-08b0-40f0-8fed-d8da66dbc34b]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:40:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a335af39-1a7f-436e-9075-045217a067d7 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:40:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-a335af39-1a7f-436e-9075-045217a067d7 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.260s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:40:35 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-a335af39-1a7f-436e-9075-045217a067d7 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] <== disconnect_volume: return (262ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:40:35 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a335af39-1a7f-436e-9075-045217a067d7 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 10:40:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:40:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:40:36 user nova-compute[71113]: DEBUG nova.objects.instance [None req-a335af39-1a7f-436e-9075-045217a067d7 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lazy-loading 'flavor' on Instance uuid a5f197cf-4a1c-409f-aef6-8d174b013c9b {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:40:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-a335af39-1a7f-436e-9075-045217a067d7 tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "a5f197cf-4a1c-409f-aef6-8d174b013c9b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.593s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:40:39 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:40:40 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:40:43 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:40:44 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:40:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:40:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:40:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:40:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:40:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:40:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:40:47 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:40:47 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:40:47 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Rebuilding the list of instances to heal {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 10:40:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "refresh_cache-a5f197cf-4a1c-409f-aef6-8d174b013c9b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:40:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquired lock "refresh_cache-a5f197cf-4a1c-409f-aef6-8d174b013c9b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:40:47 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Forcefully refreshing network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 10:40:47 user nova-compute[71113]: DEBUG nova.objects.instance [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lazy-loading 'info_cache' on Instance uuid a5f197cf-4a1c-409f-aef6-8d174b013c9b {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:40:48 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Updating instance_info_cache with network_info: [{"id": "424ff6f3-e6ab-4576-a1d6-fb6585b19eb1", "address": "fa:16:3e:31:8b:3a", "network": {"id": "b535bacc-9690-4269-a1e4-6aee5466ece4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-811923488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02892a9661ba44dd8c32b91f74446d99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424ff6f3-e6", "ovs_interfaceid": "424ff6f3-e6ab-4576-a1d6-fb6585b19eb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:40:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Releasing lock "refresh_cache-a5f197cf-4a1c-409f-aef6-8d174b013c9b" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:40:48 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Updated the network info_cache for instance {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 10:40:49 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:40:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:40:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:40:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:40:49 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:40:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f197cf-4a1c-409f-aef6-8d174b013c9b/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:40:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f197cf-4a1c-409f-aef6-8d174b013c9b/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:40:49 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f197cf-4a1c-409f-aef6-8d174b013c9b/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:40:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f197cf-4a1c-409f-aef6-8d174b013c9b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:40:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:40:50 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:40:50 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:40:50 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=8880MB free_disk=25.137554168701172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:40:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:40:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:40:50 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance a5f197cf-4a1c-409f-aef6-8d174b013c9b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:40:50 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:40:50 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:40:50 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:40:50 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:40:50 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:40:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.355s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:40:51 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:40:51 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:40:51 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:40:53 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:40:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:40:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:40:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:40:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:40:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:40:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:40:59 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:41:00 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:41:04 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:41:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:41:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:41:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:41:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:41:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:41:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:41:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:41:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:41:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:41:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:41:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:41:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:41:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:41:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:41:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:41:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1205cd91-6e10-42b5-9ea5-e3825b8489ca tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Acquiring lock "a5f197cf-4a1c-409f-aef6-8d174b013c9b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:41:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1205cd91-6e10-42b5-9ea5-e3825b8489ca tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "a5f197cf-4a1c-409f-aef6-8d174b013c9b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:41:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1205cd91-6e10-42b5-9ea5-e3825b8489ca tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Acquiring lock "a5f197cf-4a1c-409f-aef6-8d174b013c9b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:41:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1205cd91-6e10-42b5-9ea5-e3825b8489ca tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "a5f197cf-4a1c-409f-aef6-8d174b013c9b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:41:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1205cd91-6e10-42b5-9ea5-e3825b8489ca tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "a5f197cf-4a1c-409f-aef6-8d174b013c9b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:41:29 user nova-compute[71113]: INFO nova.compute.manager [None req-1205cd91-6e10-42b5-9ea5-e3825b8489ca tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Terminating instance
Jul 31 10:41:29 user nova-compute[71113]: DEBUG nova.compute.manager [None req-1205cd91-6e10-42b5-9ea5-e3825b8489ca tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Start destroying the instance on the hypervisor. {{(pid=71113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 10:41:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:41:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:41:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:41:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:41:29 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:41:29 user nova-compute[71113]: DEBUG nova.compute.manager [req-c3ced9a2-db3b-41d5-ad30-bafc24662086 req-ac73d80d-a543-4cde-accc-e4b9299dfca6 service nova] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Received event network-vif-unplugged-424ff6f3-e6ab-4576-a1d6-fb6585b19eb1 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:41:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-c3ced9a2-db3b-41d5-ad30-bafc24662086 req-ac73d80d-a543-4cde-accc-e4b9299dfca6 service nova] Acquiring lock "a5f197cf-4a1c-409f-aef6-8d174b013c9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:41:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-c3ced9a2-db3b-41d5-ad30-bafc24662086 req-ac73d80d-a543-4cde-accc-e4b9299dfca6 service nova] Lock "a5f197cf-4a1c-409f-aef6-8d174b013c9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:41:29 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-c3ced9a2-db3b-41d5-ad30-bafc24662086 req-ac73d80d-a543-4cde-accc-e4b9299dfca6 service nova] Lock "a5f197cf-4a1c-409f-aef6-8d174b013c9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:41:29 user nova-compute[71113]: DEBUG nova.compute.manager [req-c3ced9a2-db3b-41d5-ad30-bafc24662086 req-ac73d80d-a543-4cde-accc-e4b9299dfca6 service nova] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] No waiting events found dispatching network-vif-unplugged-424ff6f3-e6ab-4576-a1d6-fb6585b19eb1 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:41:29 user nova-compute[71113]: DEBUG nova.compute.manager [req-c3ced9a2-db3b-41d5-ad30-bafc24662086 req-ac73d80d-a543-4cde-accc-e4b9299dfca6 service nova] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Received event network-vif-unplugged-424ff6f3-e6ab-4576-a1d6-fb6585b19eb1 for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 10:41:30 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Instance destroyed successfully.
Jul 31 10:41:30 user nova-compute[71113]: DEBUG nova.objects.instance [None req-1205cd91-6e10-42b5-9ea5-e3825b8489ca tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lazy-loading 'resources' on Instance uuid a5f197cf-4a1c-409f-aef6-8d174b013c9b {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:41:30 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-1205cd91-6e10-42b5-9ea5-e3825b8489ca tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:36:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-335839255',display_name='tempest-TestMinimumBasicScenario-server-335839255',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-335839255',id=50,image_ref='7924d8c7-4600-41ec-823b-d430e6f0dcc5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBA5r3PLo16suTuQPvQh+TdmPkpGYbiPZ8NayH8BdyZaBs9Gejv1BixRwXbZmKCUEOSeFWxcdWPjQdOG1GmbXiVy3Rmp+IyELt4RwLk6onlyMDNjPNvqJtaMLDdPpVnOJw==',key_name='tempest-TestMinimumBasicScenario-790916345',keypairs=<?>,launch_index=0,launched_at=2023-07-31T10:36:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='02892a9661ba44dd8c32b91f74446d99',ramdisk_id='',reservation_id='r-w7jupi9t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7924d8c7-4600-41ec-823b-d430e6f0dcc5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-248468997',owner_user_name='tempest-TestMinimumBasicScenario-248468997-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T10:38:49Z,user_data=None,user_id='4a47a5b738a6402db511c0e096f2c26e',uuid=a5f197cf-4a1c-409f-aef6-8d174b013c9b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "424ff6f3-e6ab-4576-a1d6-fb6585b19eb1", "address": "fa:16:3e:31:8b:3a", "network": {"id": "b535bacc-9690-4269-a1e4-6aee5466ece4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-811923488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02892a9661ba44dd8c32b91f74446d99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424ff6f3-e6", "ovs_interfaceid": "424ff6f3-e6ab-4576-a1d6-fb6585b19eb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 10:41:30 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-1205cd91-6e10-42b5-9ea5-e3825b8489ca tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Converting VIF {"id": "424ff6f3-e6ab-4576-a1d6-fb6585b19eb1", "address": "fa:16:3e:31:8b:3a", "network": {"id": "b535bacc-9690-4269-a1e4-6aee5466ece4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-811923488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02892a9661ba44dd8c32b91f74446d99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap424ff6f3-e6", "ovs_interfaceid": "424ff6f3-e6ab-4576-a1d6-fb6585b19eb1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:41:30 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-1205cd91-6e10-42b5-9ea5-e3825b8489ca tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:8b:3a,bridge_name='br-int',has_traffic_filtering=True,id=424ff6f3-e6ab-4576-a1d6-fb6585b19eb1,network=Network(b535bacc-9690-4269-a1e4-6aee5466ece4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap424ff6f3-e6') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:41:30 user nova-compute[71113]: DEBUG os_vif [None req-1205cd91-6e10-42b5-9ea5-e3825b8489ca tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:8b:3a,bridge_name='br-int',has_traffic_filtering=True,id=424ff6f3-e6ab-4576-a1d6-fb6585b19eb1,network=Network(b535bacc-9690-4269-a1e4-6aee5466ece4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap424ff6f3-e6') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 10:41:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:41:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap424ff6f3-e6, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:41:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:41:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:41:30 user nova-compute[71113]: INFO os_vif [None req-1205cd91-6e10-42b5-9ea5-e3825b8489ca tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:8b:3a,bridge_name='br-int',has_traffic_filtering=True,id=424ff6f3-e6ab-4576-a1d6-fb6585b19eb1,network=Network(b535bacc-9690-4269-a1e4-6aee5466ece4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap424ff6f3-e6')
Jul 31 10:41:30 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-1205cd91-6e10-42b5-9ea5-e3825b8489ca tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Deleting instance files /opt/stack/data/nova/instances/a5f197cf-4a1c-409f-aef6-8d174b013c9b_del
Jul 31 10:41:30 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-1205cd91-6e10-42b5-9ea5-e3825b8489ca tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Deletion of /opt/stack/data/nova/instances/a5f197cf-4a1c-409f-aef6-8d174b013c9b_del complete
Jul 31 10:41:30 user nova-compute[71113]: INFO nova.compute.manager [None req-1205cd91-6e10-42b5-9ea5-e3825b8489ca tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Took 0.89 seconds to destroy the instance on the hypervisor.
Jul 31 10:41:30 user nova-compute[71113]: DEBUG oslo.service.loopingcall [None req-1205cd91-6e10-42b5-9ea5-e3825b8489ca tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71113) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 10:41:30 user nova-compute[71113]: DEBUG nova.compute.manager [-] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Deallocating network for instance {{(pid=71113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 10:41:30 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] deallocate_for_instance() {{(pid=71113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 10:41:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:41:30 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:41:30 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Took 0.78 seconds to deallocate network for instance.
Jul 31 10:41:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1205cd91-6e10-42b5-9ea5-e3825b8489ca tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:41:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1205cd91-6e10-42b5-9ea5-e3825b8489ca tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:41:31 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-1205cd91-6e10-42b5-9ea5-e3825b8489ca tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:41:31 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-1205cd91-6e10-42b5-9ea5-e3825b8489ca tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:41:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1205cd91-6e10-42b5-9ea5-e3825b8489ca tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.114s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:41:31 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-1205cd91-6e10-42b5-9ea5-e3825b8489ca tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Deleted allocations for instance a5f197cf-4a1c-409f-aef6-8d174b013c9b
Jul 31 10:41:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1205cd91-6e10-42b5-9ea5-e3825b8489ca tempest-TestMinimumBasicScenario-248468997 tempest-TestMinimumBasicScenario-248468997-project-member] Lock "a5f197cf-4a1c-409f-aef6-8d174b013c9b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.965s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:41:31 user nova-compute[71113]: DEBUG nova.compute.manager [req-e234bac1-5fd9-46ee-bc57-49a81f6b61de req-fa19a220-cae4-4790-ac87-499b128614f0 service nova] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Received event network-vif-plugged-424ff6f3-e6ab-4576-a1d6-fb6585b19eb1 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:41:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e234bac1-5fd9-46ee-bc57-49a81f6b61de req-fa19a220-cae4-4790-ac87-499b128614f0 service nova] Acquiring lock "a5f197cf-4a1c-409f-aef6-8d174b013c9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:41:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e234bac1-5fd9-46ee-bc57-49a81f6b61de req-fa19a220-cae4-4790-ac87-499b128614f0 service nova] Lock "a5f197cf-4a1c-409f-aef6-8d174b013c9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:41:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-e234bac1-5fd9-46ee-bc57-49a81f6b61de req-fa19a220-cae4-4790-ac87-499b128614f0 service nova] Lock "a5f197cf-4a1c-409f-aef6-8d174b013c9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:41:31 user nova-compute[71113]: DEBUG nova.compute.manager [req-e234bac1-5fd9-46ee-bc57-49a81f6b61de req-fa19a220-cae4-4790-ac87-499b128614f0 service nova] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] No waiting events found dispatching network-vif-plugged-424ff6f3-e6ab-4576-a1d6-fb6585b19eb1 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:41:31 user nova-compute[71113]: WARNING nova.compute.manager [req-e234bac1-5fd9-46ee-bc57-49a81f6b61de req-fa19a220-cae4-4790-ac87-499b128614f0 service nova] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Received unexpected event network-vif-plugged-424ff6f3-e6ab-4576-a1d6-fb6585b19eb1 for instance with vm_state deleted and task_state None.
Jul 31 10:41:31 user nova-compute[71113]: DEBUG nova.compute.manager [req-e234bac1-5fd9-46ee-bc57-49a81f6b61de req-fa19a220-cae4-4790-ac87-499b128614f0 service nova] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Received event network-vif-deleted-424ff6f3-e6ab-4576-a1d6-fb6585b19eb1 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:41:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:41:40 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:41:41 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:41:44 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:41:45 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690800090.0308793, a5f197cf-4a1c-409f-aef6-8d174b013c9b => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:41:45 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] VM Stopped (Lifecycle Event)
Jul 31 10:41:45 user nova-compute[71113]: DEBUG nova.compute.manager [None req-c485839f-2a62-4d17-8c82-ea5580481ffd None None] [instance: a5f197cf-4a1c-409f-aef6-8d174b013c9b] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:41:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:41:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:41:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:41:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:41:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:41:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:41:45 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:41:47 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:41:47 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:41:47 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Rebuilding the list of instances to heal {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 10:41:47 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Didn't find any instances for network info cache update. {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 10:41:50 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:41:50 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:41:50 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:41:51 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:41:51 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:41:51 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:41:51 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:41:51 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:41:52 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:41:52 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:41:52 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=9019MB free_disk=25.164875030517578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:41:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:41:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:41:52 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:41:52 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:41:52 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:41:52 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:41:52 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:41:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.168s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:41:53 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:41:55 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:41:55 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:41:55 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:41:59 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:42:00 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:42:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:42:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:42:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:42:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:42:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:42:05 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:42:10 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:42:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:42:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:42:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:42:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:42:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:42:15 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:42:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:42:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:42:23 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:42:25 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:42:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:42:30 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:42:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:42:34 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:42:35 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:42:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:42:38 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:42:40 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:42:40 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:42:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:42:43 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:42:44 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Acquiring lock "6666778c-d327-432a-8d7c-6bc52205dae8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:42:44 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Lock "6666778c-d327-432a-8d7c-6bc52205dae8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:42:44 user nova-compute[71113]: DEBUG nova.compute.manager [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Starting instance... {{(pid=71113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 10:42:44 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:42:44 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:42:44 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 10:42:44 user nova-compute[71113]: INFO nova.compute.claims [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Claim successful on node user
Jul 31 10:42:44 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:42:44 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:42:44 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.193s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:42:44 user nova-compute[71113]: DEBUG nova.compute.manager [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Start building networks asynchronously for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 10:42:44 user nova-compute[71113]: DEBUG nova.compute.manager [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Allocating IP information in the background. {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 10:42:44 user nova-compute[71113]: DEBUG nova.network.neutron [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] allocate_for_instance() {{(pid=71113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 10:42:44 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 10:42:44 user nova-compute[71113]: DEBUG nova.compute.manager [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Start building block device mappings for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 10:42:44 user nova-compute[71113]: DEBUG nova.compute.manager [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Start spawning the instance on the hypervisor. {{(pid=71113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 10:42:44 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 10:42:44 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Creating image(s)
Jul 31 10:42:44 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Acquiring lock "/opt/stack/data/nova/instances/6666778c-d327-432a-8d7c-6bc52205dae8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:42:44 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Lock "/opt/stack/data/nova/instances/6666778c-d327-432a-8d7c-6bc52205dae8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:42:44 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Lock "/opt/stack/data/nova/instances/6666778c-d327-432a-8d7c-6bc52205dae8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.016s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:42:44 user nova-compute[71113]: DEBUG nova.policy [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '78153b3290e34899bc33e84c1347bc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '167c779016a24b7590affddbebbe1a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71113) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 10:42:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:42:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.144s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:42:44 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Acquiring lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:42:44 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:42:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:42:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.131s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:42:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/6666778c-d327-432a-8d7c-6bc52205dae8/disk 1073741824 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:42:45 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:42:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/6666778c-d327-432a-8d7c-6bc52205dae8/disk 1073741824" returned: 0 in 0.055s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:42:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:42:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:42:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.131s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:42:45 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6666778c-d327-432a-8d7c-6bc52205dae8/disk. size=1073741824 {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 10:42:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6666778c-d327-432a-8d7c-6bc52205dae8/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:42:45 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6666778c-d327-432a-8d7c-6bc52205dae8/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:42:45 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Cannot resize image /opt/stack/data/nova/instances/6666778c-d327-432a-8d7c-6bc52205dae8/disk to a smaller size. {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 10:42:45 user nova-compute[71113]: DEBUG nova.objects.instance [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Lazy-loading 'migration_context' on Instance uuid 6666778c-d327-432a-8d7c-6bc52205dae8 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:42:45 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Created local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 10:42:45 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Ensure instance console log exists: /opt/stack/data/nova/instances/6666778c-d327-432a-8d7c-6bc52205dae8/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 10:42:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:42:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:42:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:42:45 user nova-compute[71113]: DEBUG nova.network.neutron [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Successfully created port: efc0ddb4-defd-4575-a1f7-64f43ad451fc {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 10:42:45 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:42:46 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:42:46 user nova-compute[71113]: DEBUG nova.network.neutron [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Successfully updated port: efc0ddb4-defd-4575-a1f7-64f43ad451fc {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 10:42:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Acquiring lock "refresh_cache-6666778c-d327-432a-8d7c-6bc52205dae8" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:42:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Acquired lock "refresh_cache-6666778c-d327-432a-8d7c-6bc52205dae8" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:42:46 user nova-compute[71113]: DEBUG nova.network.neutron [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 10:42:46 user nova-compute[71113]: DEBUG nova.compute.manager [req-13bf460f-106b-462c-81cf-67389e80cc7c req-02e8cba7-fc29-4a62-800d-b866d08df5e6 service nova] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Received event network-changed-efc0ddb4-defd-4575-a1f7-64f43ad451fc {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:42:46 user nova-compute[71113]: DEBUG nova.compute.manager [req-13bf460f-106b-462c-81cf-67389e80cc7c req-02e8cba7-fc29-4a62-800d-b866d08df5e6 service nova] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Refreshing instance network info cache due to event network-changed-efc0ddb4-defd-4575-a1f7-64f43ad451fc. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 10:42:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-13bf460f-106b-462c-81cf-67389e80cc7c req-02e8cba7-fc29-4a62-800d-b866d08df5e6 service nova] Acquiring lock "refresh_cache-6666778c-d327-432a-8d7c-6bc52205dae8" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:42:46 user nova-compute[71113]: DEBUG nova.network.neutron [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 10:42:46 user nova-compute[71113]: DEBUG nova.network.neutron [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Updating instance_info_cache with network_info: [{"id": "efc0ddb4-defd-4575-a1f7-64f43ad451fc", "address": "fa:16:3e:ab:15:31", "network": {"id": "a93ed111-3752-4659-9926-71ad0efe0b8e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-175323687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "167c779016a24b7590affddbebbe1a8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefc0ddb4-de", "ovs_interfaceid": "efc0ddb4-defd-4575-a1f7-64f43ad451fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:42:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Releasing lock "refresh_cache-6666778c-d327-432a-8d7c-6bc52205dae8" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:42:46 user nova-compute[71113]: DEBUG nova.compute.manager [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Instance network_info: |[{"id": "efc0ddb4-defd-4575-a1f7-64f43ad451fc", "address": "fa:16:3e:ab:15:31", "network": {"id": "a93ed111-3752-4659-9926-71ad0efe0b8e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-175323687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "167c779016a24b7590affddbebbe1a8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefc0ddb4-de", "ovs_interfaceid": "efc0ddb4-defd-4575-a1f7-64f43ad451fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 10:42:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-13bf460f-106b-462c-81cf-67389e80cc7c req-02e8cba7-fc29-4a62-800d-b866d08df5e6 service nova] Acquired lock "refresh_cache-6666778c-d327-432a-8d7c-6bc52205dae8" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:42:46 user nova-compute[71113]: DEBUG nova.network.neutron [req-13bf460f-106b-462c-81cf-67389e80cc7c req-02e8cba7-fc29-4a62-800d-b866d08df5e6 service nova] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Refreshing network info cache for port efc0ddb4-defd-4575-a1f7-64f43ad451fc {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 10:42:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Start _get_guest_xml network_info=[{"id": "efc0ddb4-defd-4575-a1f7-64f43ad451fc", "address": "fa:16:3e:ab:15:31", "network": {"id": "a93ed111-3752-4659-9926-71ad0efe0b8e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-175323687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "167c779016a24b7590affddbebbe1a8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefc0ddb4-de", "ovs_interfaceid": "efc0ddb4-defd-4575-a1f7-64f43ad451fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'image_id': '078646fe-b504-41ed-a147-61072e903e51'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 10:42:46 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:42:46 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:42:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 10:42:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 10:42:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 10:42:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 10:42:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 10:42:46 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 10:42:46 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 10:42:46 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 10:42:46 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 10:42:46 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 10:42:46 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 10:42:46 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 10:42:46 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 10:42:46 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 10:42:46 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 10:42:46 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 10:42:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:42:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-232979101',display_name='tempest-TestServerVolumeAttachmentScenario-server-232979101',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-232979101',id=51,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRO8kSSaWa+w41ESdpFg81sUVhg6nOjXcz0jgLPNOtfLTMfRg4WjXJXxQyfRIp/9OxkmS6J1On8jqVl9z2fon/7lTw6RPGyde1jMbuNyc1Ujk9PtdcGmAFgiUoowefJnA==',key_name='tempest-keypair-766384137',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='167c779016a24b7590affddbebbe1a8d',ramdisk_id='',reservation_id='r-1han7gjy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-488365166',owner_user_name='tempest-TestServerVolumeAttachmentScenario-488365166-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T10:42:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78153b3290e34899bc33e84c1347bc58',uuid=6666778c-d327-432a-8d7c-6bc52205dae8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "efc0ddb4-defd-4575-a1f7-64f43ad451fc", "address": "fa:16:3e:ab:15:31", "network": {"id": "a93ed111-3752-4659-9926-71ad0efe0b8e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-175323687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "167c779016a24b7590affddbebbe1a8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefc0ddb4-de", "ovs_interfaceid": "efc0ddb4-defd-4575-a1f7-64f43ad451fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 10:42:46 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Converting VIF {"id": "efc0ddb4-defd-4575-a1f7-64f43ad451fc", "address": "fa:16:3e:ab:15:31", "network": {"id": "a93ed111-3752-4659-9926-71ad0efe0b8e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-175323687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "167c779016a24b7590affddbebbe1a8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefc0ddb4-de", "ovs_interfaceid": "efc0ddb4-defd-4575-a1f7-64f43ad451fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:42:46 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:15:31,bridge_name='br-int',has_traffic_filtering=True,id=efc0ddb4-defd-4575-a1f7-64f43ad451fc,network=Network(a93ed111-3752-4659-9926-71ad0efe0b8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefc0ddb4-de') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:42:46 user nova-compute[71113]: DEBUG nova.objects.instance [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Lazy-loading 'pci_devices' on Instance uuid 6666778c-d327-432a-8d7c-6bc52205dae8 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:42:47 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] End _get_guest_xml xml=<domain type="kvm">
Jul 31 10:42:47 user nova-compute[71113]:   <uuid>6666778c-d327-432a-8d7c-6bc52205dae8</uuid>
Jul 31 10:42:47 user nova-compute[71113]:   <name>instance-00000033</name>
Jul 31 10:42:47 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 10:42:47 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 10:42:47 user nova-compute[71113]:   <metadata>
Jul 31 10:42:47 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 10:42:47 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 10:42:47 user nova-compute[71113]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-232979101</nova:name>
Jul 31 10:42:47 user nova-compute[71113]:       <nova:creationTime>2023-07-31 10:42:46</nova:creationTime>
Jul 31 10:42:47 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 10:42:47 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 10:42:47 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 10:42:47 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 10:42:47 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 10:42:47 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 10:42:47 user nova-compute[71113]:       </nova:flavor>
Jul 31 10:42:47 user nova-compute[71113]:       <nova:owner>
Jul 31 10:42:47 user nova-compute[71113]:         <nova:user uuid="78153b3290e34899bc33e84c1347bc58">tempest-TestServerVolumeAttachmentScenario-488365166-project-member</nova:user>
Jul 31 10:42:47 user nova-compute[71113]:         <nova:project uuid="167c779016a24b7590affddbebbe1a8d">tempest-TestServerVolumeAttachmentScenario-488365166</nova:project>
Jul 31 10:42:47 user nova-compute[71113]:       </nova:owner>
Jul 31 10:42:47 user nova-compute[71113]:       <nova:root type="image" uuid="078646fe-b504-41ed-a147-61072e903e51"/>
Jul 31 10:42:47 user nova-compute[71113]:       <nova:ports>
Jul 31 10:42:47 user nova-compute[71113]:         <nova:port uuid="efc0ddb4-defd-4575-a1f7-64f43ad451fc">
Jul 31 10:42:47 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 31 10:42:47 user nova-compute[71113]:         </nova:port>
Jul 31 10:42:47 user nova-compute[71113]:       </nova:ports>
Jul 31 10:42:47 user nova-compute[71113]:     </nova:instance>
Jul 31 10:42:47 user nova-compute[71113]:   </metadata>
Jul 31 10:42:47 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 10:42:47 user nova-compute[71113]:     <system>
Jul 31 10:42:47 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 10:42:47 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 10:42:47 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 10:42:47 user nova-compute[71113]:       <entry name="serial">6666778c-d327-432a-8d7c-6bc52205dae8</entry>
Jul 31 10:42:47 user nova-compute[71113]:       <entry name="uuid">6666778c-d327-432a-8d7c-6bc52205dae8</entry>
Jul 31 10:42:47 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 10:42:47 user nova-compute[71113]:     </system>
Jul 31 10:42:47 user nova-compute[71113]:   </sysinfo>
Jul 31 10:42:47 user nova-compute[71113]:   <os>
Jul 31 10:42:47 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 10:42:47 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 10:42:47 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 10:42:47 user nova-compute[71113]:   </os>
Jul 31 10:42:47 user nova-compute[71113]:   <features>
Jul 31 10:42:47 user nova-compute[71113]:     <acpi/>
Jul 31 10:42:47 user nova-compute[71113]:     <apic/>
Jul 31 10:42:47 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 10:42:47 user nova-compute[71113]:   </features>
Jul 31 10:42:47 user nova-compute[71113]:   <clock offset="utc">
Jul 31 10:42:47 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 10:42:47 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 10:42:47 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 10:42:47 user nova-compute[71113]:   </clock>
Jul 31 10:42:47 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 10:42:47 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 10:42:47 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 10:42:47 user nova-compute[71113]:   </cpu>
Jul 31 10:42:47 user nova-compute[71113]:   <devices>
Jul 31 10:42:47 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 10:42:47 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 10:42:47 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/6666778c-d327-432a-8d7c-6bc52205dae8/disk"/>
Jul 31 10:42:47 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 10:42:47 user nova-compute[71113]:     </disk>
Jul 31 10:42:47 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 10:42:47 user nova-compute[71113]:       <mac address="fa:16:3e:ab:15:31"/>
Jul 31 10:42:47 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:42:47 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 10:42:47 user nova-compute[71113]:       <target dev="tapefc0ddb4-de"/>
Jul 31 10:42:47 user nova-compute[71113]:     </interface>
Jul 31 10:42:47 user nova-compute[71113]:     <serial type="pty">
Jul 31 10:42:47 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/6666778c-d327-432a-8d7c-6bc52205dae8/console.log" append="off"/>
Jul 31 10:42:47 user nova-compute[71113]:     </serial>
Jul 31 10:42:47 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 10:42:47 user nova-compute[71113]:     <video>
Jul 31 10:42:47 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:42:47 user nova-compute[71113]:     </video>
Jul 31 10:42:47 user nova-compute[71113]:     <rng model="virtio">
Jul 31 10:42:47 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 10:42:47 user nova-compute[71113]:     </rng>
Jul 31 10:42:47 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 10:42:47 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 10:42:47 user nova-compute[71113]:       <stats period="10"/>
Jul 31 10:42:47 user nova-compute[71113]:     </memballoon>
Jul 31 10:42:47 user nova-compute[71113]:   </devices>
Jul 31 10:42:47 user nova-compute[71113]: </domain>
Jul 31 10:42:47 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 10:42:47 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:42:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-232979101',display_name='tempest-TestServerVolumeAttachmentScenario-server-232979101',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-232979101',id=51,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRO8kSSaWa+w41ESdpFg81sUVhg6nOjXcz0jgLPNOtfLTMfRg4WjXJXxQyfRIp/9OxkmS6J1On8jqVl9z2fon/7lTw6RPGyde1jMbuNyc1Ujk9PtdcGmAFgiUoowefJnA==',key_name='tempest-keypair-766384137',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='167c779016a24b7590affddbebbe1a8d',ramdisk_id='',reservation_id='r-1han7gjy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-488365166',owner_user_name='tempest-TestServerVolumeAttachmentScenario-488365166-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T10:42:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78153b3290e34899bc33e84c1347bc58',uuid=6666778c-d327-432a-8d7c-6bc52205dae8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "efc0ddb4-defd-4575-a1f7-64f43ad451fc", "address": "fa:16:3e:ab:15:31", "network": {"id": "a93ed111-3752-4659-9926-71ad0efe0b8e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-175323687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "167c779016a24b7590affddbebbe1a8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefc0ddb4-de", "ovs_interfaceid": "efc0ddb4-defd-4575-a1f7-64f43ad451fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 10:42:47 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Converting VIF {"id": "efc0ddb4-defd-4575-a1f7-64f43ad451fc", "address": "fa:16:3e:ab:15:31", "network": {"id": "a93ed111-3752-4659-9926-71ad0efe0b8e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-175323687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "167c779016a24b7590affddbebbe1a8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefc0ddb4-de", "ovs_interfaceid": "efc0ddb4-defd-4575-a1f7-64f43ad451fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:42:47 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:15:31,bridge_name='br-int',has_traffic_filtering=True,id=efc0ddb4-defd-4575-a1f7-64f43ad451fc,network=Network(a93ed111-3752-4659-9926-71ad0efe0b8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefc0ddb4-de') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:42:47 user nova-compute[71113]: DEBUG os_vif [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:15:31,bridge_name='br-int',has_traffic_filtering=True,id=efc0ddb4-defd-4575-a1f7-64f43ad451fc,network=Network(a93ed111-3752-4659-9926-71ad0efe0b8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefc0ddb4-de') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 10:42:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:42:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:42:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 10:42:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:42:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapefc0ddb4-de, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:42:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapefc0ddb4-de, col_values=(('external_ids', {'iface-id': 'efc0ddb4-defd-4575-a1f7-64f43ad451fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:15:31', 'vm-uuid': '6666778c-d327-432a-8d7c-6bc52205dae8'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:42:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:42:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:42:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:42:47 user nova-compute[71113]: INFO os_vif [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:15:31,bridge_name='br-int',has_traffic_filtering=True,id=efc0ddb4-defd-4575-a1f7-64f43ad451fc,network=Network(a93ed111-3752-4659-9926-71ad0efe0b8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefc0ddb4-de')
Jul 31 10:42:47 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:42:47 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] No VIF found with MAC fa:16:3e:ab:15:31, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 10:42:47 user nova-compute[71113]: DEBUG nova.network.neutron [req-13bf460f-106b-462c-81cf-67389e80cc7c req-02e8cba7-fc29-4a62-800d-b866d08df5e6 service nova] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Updated VIF entry in instance network info cache for port efc0ddb4-defd-4575-a1f7-64f43ad451fc. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 10:42:47 user nova-compute[71113]: DEBUG nova.network.neutron [req-13bf460f-106b-462c-81cf-67389e80cc7c req-02e8cba7-fc29-4a62-800d-b866d08df5e6 service nova] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Updating instance_info_cache with network_info: [{"id": "efc0ddb4-defd-4575-a1f7-64f43ad451fc", "address": "fa:16:3e:ab:15:31", "network": {"id": "a93ed111-3752-4659-9926-71ad0efe0b8e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-175323687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "167c779016a24b7590affddbebbe1a8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefc0ddb4-de", "ovs_interfaceid": "efc0ddb4-defd-4575-a1f7-64f43ad451fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:42:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-13bf460f-106b-462c-81cf-67389e80cc7c req-02e8cba7-fc29-4a62-800d-b866d08df5e6 service nova] Releasing lock "refresh_cache-6666778c-d327-432a-8d7c-6bc52205dae8" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:42:47 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:42:48 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:42:48 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:42:48 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:42:48 user nova-compute[71113]: DEBUG nova.compute.manager [req-8704b48a-f219-450a-897c-d6b65943dac1 req-9f23c595-ded8-44a3-944e-d00bb6120abf service nova] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Received event network-vif-plugged-efc0ddb4-defd-4575-a1f7-64f43ad451fc {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:42:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8704b48a-f219-450a-897c-d6b65943dac1 req-9f23c595-ded8-44a3-944e-d00bb6120abf service nova] Acquiring lock "6666778c-d327-432a-8d7c-6bc52205dae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:42:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8704b48a-f219-450a-897c-d6b65943dac1 req-9f23c595-ded8-44a3-944e-d00bb6120abf service nova] Lock "6666778c-d327-432a-8d7c-6bc52205dae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:42:48 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-8704b48a-f219-450a-897c-d6b65943dac1 req-9f23c595-ded8-44a3-944e-d00bb6120abf service nova] Lock "6666778c-d327-432a-8d7c-6bc52205dae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:42:48 user nova-compute[71113]: DEBUG nova.compute.manager [req-8704b48a-f219-450a-897c-d6b65943dac1 req-9f23c595-ded8-44a3-944e-d00bb6120abf service nova] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] No waiting events found dispatching network-vif-plugged-efc0ddb4-defd-4575-a1f7-64f43ad451fc {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:42:48 user nova-compute[71113]: WARNING nova.compute.manager [req-8704b48a-f219-450a-897c-d6b65943dac1 req-9f23c595-ded8-44a3-944e-d00bb6120abf service nova] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Received unexpected event network-vif-plugged-efc0ddb4-defd-4575-a1f7-64f43ad451fc for instance with vm_state building and task_state spawning.
Jul 31 10:42:48 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:42:48 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:42:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:42:49 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:42:49 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:42:49 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Rebuilding the list of instances to heal {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 10:42:49 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Skipping network cache update for instance because it is Building. {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Jul 31 10:42:49 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Didn't find any instances for network info cache update. {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 10:42:49 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:42:50 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690800170.4412622, 6666778c-d327-432a-8d7c-6bc52205dae8 => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:42:50 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] VM Resumed (Lifecycle Event)
Jul 31 10:42:50 user nova-compute[71113]: DEBUG nova.compute.manager [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 10:42:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 10:42:50 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Instance spawned successfully.
Jul 31 10:42:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 10:42:50 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:42:50 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:42:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Found default for hw_cdrom_bus of ide {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:42:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Found default for hw_disk_bus of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:42:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Found default for hw_input_bus of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:42:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Found default for hw_pointer_model of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:42:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Found default for hw_video_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:42:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Found default for hw_vif_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:42:50 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 10:42:50 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690800170.4428384, 6666778c-d327-432a-8d7c-6bc52205dae8 => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:42:50 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] VM Started (Lifecycle Event)
Jul 31 10:42:50 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:42:50 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:42:50 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 10:42:50 user nova-compute[71113]: INFO nova.compute.manager [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Took 5.79 seconds to spawn the instance on the hypervisor.
Jul 31 10:42:50 user nova-compute[71113]: DEBUG nova.compute.manager [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:42:50 user nova-compute[71113]: INFO nova.compute.manager [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Took 6.31 seconds to build instance.
Jul 31 10:42:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-8640909f-d26a-4ae9-849a-abb1a076bda0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Lock "6666778c-d327-432a-8d7c-6bc52205dae8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.402s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:42:50 user nova-compute[71113]: DEBUG nova.compute.manager [req-91e183e5-5955-452b-9cd0-82ddf7d6250f req-a55c4fc5-6822-41fb-aacc-048194f72bd1 service nova] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Received event network-vif-plugged-efc0ddb4-defd-4575-a1f7-64f43ad451fc {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:42:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-91e183e5-5955-452b-9cd0-82ddf7d6250f req-a55c4fc5-6822-41fb-aacc-048194f72bd1 service nova] Acquiring lock "6666778c-d327-432a-8d7c-6bc52205dae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:42:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-91e183e5-5955-452b-9cd0-82ddf7d6250f req-a55c4fc5-6822-41fb-aacc-048194f72bd1 service nova] Lock "6666778c-d327-432a-8d7c-6bc52205dae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:42:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-91e183e5-5955-452b-9cd0-82ddf7d6250f req-a55c4fc5-6822-41fb-aacc-048194f72bd1 service nova] Lock "6666778c-d327-432a-8d7c-6bc52205dae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:42:50 user nova-compute[71113]: DEBUG nova.compute.manager [req-91e183e5-5955-452b-9cd0-82ddf7d6250f req-a55c4fc5-6822-41fb-aacc-048194f72bd1 service nova] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] No waiting events found dispatching network-vif-plugged-efc0ddb4-defd-4575-a1f7-64f43ad451fc {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:42:50 user nova-compute[71113]: WARNING nova.compute.manager [req-91e183e5-5955-452b-9cd0-82ddf7d6250f req-a55c4fc5-6822-41fb-aacc-048194f72bd1 service nova] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Received unexpected event network-vif-plugged-efc0ddb4-defd-4575-a1f7-64f43ad451fc for instance with vm_state active and task_state None.
Jul 31 10:42:51 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:42:51 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:42:51 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:42:51 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:42:51 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:42:51 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:42:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6666778c-d327-432a-8d7c-6bc52205dae8/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:42:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6666778c-d327-432a-8d7c-6bc52205dae8/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:42:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6666778c-d327-432a-8d7c-6bc52205dae8/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:42:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:42:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6666778c-d327-432a-8d7c-6bc52205dae8/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:42:52 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:42:52 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:42:52 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=8925MB free_disk=25.193592071533203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:42:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:42:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:42:52 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 6666778c-d327-432a-8d7c-6bc52205dae8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:42:52 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:42:52 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:42:52 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Refreshing inventories for resource provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 31 10:42:52 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Updating ProviderTree inventory for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 31 10:42:52 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Updating inventory in ProviderTree for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 31 10:42:52 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Refreshing aggregate associations for resource provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05, aggregates: None {{(pid=71113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 31 10:42:52 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Refreshing trait associations for resource provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE2,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS {{(pid=71113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 31 10:42:52 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:42:52 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:42:52 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:42:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.357s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:42:53 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:42:53 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:42:54 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:42:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:42:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:42:57 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:43:01 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:43:02 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:43:04 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:43:06 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:43:07 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:43:09 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:43:09 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Cleaning up deleted instances {{(pid=71113) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 31 10:43:09 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] There are 0 instances to clean {{(pid=71113) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 31 10:43:11 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:43:12 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:43:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:43:17 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:43:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:43:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:43:22 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:43:23 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:43:23 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71113) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 31 10:43:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:43:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:43:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:43:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:43:44 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:43:45 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:43:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:43:48 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:43:51 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:43:51 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:43:51 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Rebuilding the list of instances to heal {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 10:43:51 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "refresh_cache-6666778c-d327-432a-8d7c-6bc52205dae8" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:43:51 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquired lock "refresh_cache-6666778c-d327-432a-8d7c-6bc52205dae8" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:43:51 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Forcefully refreshing network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 10:43:51 user nova-compute[71113]: DEBUG nova.objects.instance [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lazy-loading 'info_cache' on Instance uuid 6666778c-d327-432a-8d7c-6bc52205dae8 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:43:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:43:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:43:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:43:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:43:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:43:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:43:52 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Updating instance_info_cache with network_info: [{"id": "efc0ddb4-defd-4575-a1f7-64f43ad451fc", "address": "fa:16:3e:ab:15:31", "network": {"id": "a93ed111-3752-4659-9926-71ad0efe0b8e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-175323687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "167c779016a24b7590affddbebbe1a8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefc0ddb4-de", "ovs_interfaceid": "efc0ddb4-defd-4575-a1f7-64f43ad451fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:43:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Releasing lock "refresh_cache-6666778c-d327-432a-8d7c-6bc52205dae8" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:43:52 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Updated the network info_cache for instance {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 10:43:52 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:43:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:43:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:43:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:43:52 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:43:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6666778c-d327-432a-8d7c-6bc52205dae8/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:43:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6666778c-d327-432a-8d7c-6bc52205dae8/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:43:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6666778c-d327-432a-8d7c-6bc52205dae8/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:43:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6666778c-d327-432a-8d7c-6bc52205dae8/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:43:53 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:43:53 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:43:53 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=8861MB free_disk=25.16515350341797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:43:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:43:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:43:53 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 6666778c-d327-432a-8d7c-6bc52205dae8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:43:53 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:43:53 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:43:53 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:43:53 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:43:53 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:43:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.194s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:43:55 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:43:55 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:43:55 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:43:55 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:43:55 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Triggering sync for uuid 6666778c-d327-432a-8d7c-6bc52205dae8 {{(pid=71113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 10:43:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "6666778c-d327-432a-8d7c-6bc52205dae8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:43:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "6666778c-d327-432a-8d7c-6bc52205dae8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:43:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "6666778c-d327-432a-8d7c-6bc52205dae8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:43:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:43:57 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:44:01 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:44:02 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:44:07 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:44:12 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:44:17 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:44:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:44:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:44:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:44:35 user nova-compute[71113]: DEBUG nova.compute.manager [req-6825f140-c119-4694-a681-9b75bd40f944 req-6b2c037e-0f93-4de5-8558-ca4f4aae6186 service nova] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Received event network-changed-efc0ddb4-defd-4575-a1f7-64f43ad451fc {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:44:35 user nova-compute[71113]: DEBUG nova.compute.manager [req-6825f140-c119-4694-a681-9b75bd40f944 req-6b2c037e-0f93-4de5-8558-ca4f4aae6186 service nova] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Refreshing instance network info cache due to event network-changed-efc0ddb4-defd-4575-a1f7-64f43ad451fc. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 10:44:35 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-6825f140-c119-4694-a681-9b75bd40f944 req-6b2c037e-0f93-4de5-8558-ca4f4aae6186 service nova] Acquiring lock "refresh_cache-6666778c-d327-432a-8d7c-6bc52205dae8" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:44:35 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-6825f140-c119-4694-a681-9b75bd40f944 req-6b2c037e-0f93-4de5-8558-ca4f4aae6186 service nova] Acquired lock "refresh_cache-6666778c-d327-432a-8d7c-6bc52205dae8" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:44:35 user nova-compute[71113]: DEBUG nova.network.neutron [req-6825f140-c119-4694-a681-9b75bd40f944 req-6b2c037e-0f93-4de5-8558-ca4f4aae6186 service nova] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Refreshing network info cache for port efc0ddb4-defd-4575-a1f7-64f43ad451fc {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 10:44:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:44:36 user nova-compute[71113]: DEBUG nova.network.neutron [req-6825f140-c119-4694-a681-9b75bd40f944 req-6b2c037e-0f93-4de5-8558-ca4f4aae6186 service nova] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Updated VIF entry in instance network info cache for port efc0ddb4-defd-4575-a1f7-64f43ad451fc. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 10:44:36 user nova-compute[71113]: DEBUG nova.network.neutron [req-6825f140-c119-4694-a681-9b75bd40f944 req-6b2c037e-0f93-4de5-8558-ca4f4aae6186 service nova] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Updating instance_info_cache with network_info: [{"id": "efc0ddb4-defd-4575-a1f7-64f43ad451fc", "address": "fa:16:3e:ab:15:31", "network": {"id": "a93ed111-3752-4659-9926-71ad0efe0b8e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-175323687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "167c779016a24b7590affddbebbe1a8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefc0ddb4-de", "ovs_interfaceid": "efc0ddb4-defd-4575-a1f7-64f43ad451fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:44:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-6825f140-c119-4694-a681-9b75bd40f944 req-6b2c037e-0f93-4de5-8558-ca4f4aae6186 service nova] Releasing lock "refresh_cache-6666778c-d327-432a-8d7c-6bc52205dae8" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:44:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:44:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0058b0b5-4be4-4c4e-82f1-8b7a97ccdd68 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Acquiring lock "6666778c-d327-432a-8d7c-6bc52205dae8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:44:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0058b0b5-4be4-4c4e-82f1-8b7a97ccdd68 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Lock "6666778c-d327-432a-8d7c-6bc52205dae8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:44:37 user nova-compute[71113]: DEBUG nova.objects.instance [None req-0058b0b5-4be4-4c4e-82f1-8b7a97ccdd68 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Lazy-loading 'flavor' on Instance uuid 6666778c-d327-432a-8d7c-6bc52205dae8 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:44:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0058b0b5-4be4-4c4e-82f1-8b7a97ccdd68 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Lock "6666778c-d327-432a-8d7c-6bc52205dae8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:44:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0058b0b5-4be4-4c4e-82f1-8b7a97ccdd68 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Acquiring lock "6666778c-d327-432a-8d7c-6bc52205dae8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:44:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0058b0b5-4be4-4c4e-82f1-8b7a97ccdd68 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Lock "6666778c-d327-432a-8d7c-6bc52205dae8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:44:37 user nova-compute[71113]: INFO nova.compute.manager [None req-0058b0b5-4be4-4c4e-82f1-8b7a97ccdd68 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Attaching volume ba182015-91d6-4a13-83df-cd770b9d3ea9 to /dev/vdb
Jul 31 10:44:37 user nova-compute[71113]: DEBUG os_brick.utils [None req-0058b0b5-4be4-4c4e-82f1-8b7a97ccdd68 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:44:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:44:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:44:37 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[77699a8e-d224-4786-9c08-924d47e70f0d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:44:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:44:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:44:37 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e919ef43-1ee4-4f78-a91f-c5a0d79ed308]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:44:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:44:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:44:37 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7caf93ae-0767-401a-8468-cdeb0815b864]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:44:37 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4740861f-e7ea-4737-a14f-19224c2b96c0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:44:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0058b0b5-4be4-4c4e-82f1-8b7a97ccdd68 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:44:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0058b0b5-4be4-4c4e-82f1-8b7a97ccdd68 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 10:44:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0058b0b5-4be4-4c4e-82f1-8b7a97ccdd68 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 10:44:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:44:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 10:44:37 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 10:44:37 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ce2a9a-5241-4acd-b286-aefbfe301f29]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:44:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-0058b0b5-4be4-4c4e-82f1-8b7a97ccdd68 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 10:44:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-0058b0b5-4be4-4c4e-82f1-8b7a97ccdd68 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 10:44:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-0058b0b5-4be4-4c4e-82f1-8b7a97ccdd68 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 10:44:37 user nova-compute[71113]: DEBUG os_brick.utils [None req-0058b0b5-4be4-4c4e-82f1-8b7a97ccdd68 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:44:37 user nova-compute[71113]: DEBUG nova.virt.block_device [None req-0058b0b5-4be4-4c4e-82f1-8b7a97ccdd68 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Updating existing volume attachment record: 071546c0-30e2-43e1-998d-561f46864a10 {{(pid=71113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 10:44:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:44:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:44:44 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0058b0b5-4be4-4c4e-82f1-8b7a97ccdd68 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 10:44:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0058b0b5-4be4-4c4e-82f1-8b7a97ccdd68 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KFXRuLoQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:44:44 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-0058b0b5-4be4-4c4e-82f1-8b7a97ccdd68 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:44:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-0058b0b5-4be4-4c4e-82f1-8b7a97ccdd68 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:44:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-0058b0b5-4be4-4c4e-82f1-8b7a97ccdd68 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:44:44 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-0058b0b5-4be4-4c4e-82f1-8b7a97ccdd68 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:44:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-0058b0b5-4be4-4c4e-82f1-8b7a97ccdd68 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:44:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-0058b0b5-4be4-4c4e-82f1-8b7a97ccdd68 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:44:44 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-0058b0b5-4be4-4c4e-82f1-8b7a97ccdd68 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 10:44:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9 -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:44:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:44:44 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a26a8e9-d566-4772-bbc6-2fe4fa71abb4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:44:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0058b0b5-4be4-4c4e-82f1-8b7a97ccdd68 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 10:44:44 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:44:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9 -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:44:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:44:44 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c7865c-b837-410d-8c62-d9a4a0d8759a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:44:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0058b0b5-4be4-4c4e-82f1-8b7a97ccdd68 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9] added
Jul 31 10:44:44 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:44:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:44:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:44:44 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5bad65-385f-490a-a239-d48d1994f8c1]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:44:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0058b0b5-4be4-4c4e-82f1-8b7a97ccdd68 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:44:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:44:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:44:44 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5458388-7fdb-4a02-9e0d-67aacc46eb4b]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:44:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0058b0b5-4be4-4c4e-82f1-8b7a97ccdd68 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:44:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KFXRuLoQ {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:44:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KFXRuLoQ" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:44:44 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[82afec08-012e-4c2b-8106-a2ebc443bbd8]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:44:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0058b0b5-4be4-4c4e-82f1-8b7a97ccdd68 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KFXRuLoQ'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:44:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:44:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:44:44 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec269ef7-ffd2-4d77-a325-504d9a7d083e]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:44:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0058b0b5-4be4-4c4e-82f1-8b7a97ccdd68 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:44:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:44:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:44:44 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf91c9f-f896-4d8d-ac7e-e957726747b3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:44:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0058b0b5-4be4-4c4e-82f1-8b7a97ccdd68 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 31 10:44:44 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:44:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0058b0b5-4be4-4c4e-82f1-8b7a97ccdd68 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 31 10:44:44 user nova-compute[71113]:  {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:44:44 user nova-compute[71113]: WARNING os_brick.initiator.connectors.iscsi [None req-0058b0b5-4be4-4c4e-82f1-8b7a97ccdd68 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 31 10:44:44 user nova-compute[71113]: 
Jul 31 10:44:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9 -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:44:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:44:44 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[653b19da-45b0-4e60-8d5b-f3f2e175de75]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:44:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0058b0b5-4be4-4c4e-82f1-8b7a97ccdd68 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9, portal: 172.16.0.220,3260]
Jul 31 10:44:44 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9, portal: 172.16.0.220,3260] successful.
Jul 31 10:44:44 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:44:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:44:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.037s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:44:44 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75517d3-f87c-4692-a284-db4875fc9a24]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:44:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0058b0b5-4be4-4c4e-82f1-8b7a97ccdd68 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:44:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:44:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:44:44 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[63acad4a-b02d-4abb-bbe2-dfe9f77d818d]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:44:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0058b0b5-4be4-4c4e-82f1-8b7a97ccdd68 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9 (non-flash)
Jul 31 10:44:44 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:44:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0058b0b5-4be4-4c4e-82f1-8b7a97ccdd68 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9 (non-flash)
Jul 31 10:44:44 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:44:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-0058b0b5-4be4-4c4e-82f1-8b7a97ccdd68 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:44:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0058b0b5-4be4-4c4e-82f1-8b7a97ccdd68 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 10:44:44 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-0058b0b5-4be4-4c4e-82f1-8b7a97ccdd68 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 10:44:44 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-0058b0b5-4be4-4c4e-82f1-8b7a97ccdd68 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 10:44:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:44:44 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:44:44 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7d8ea9-f61a-48d0-9309-f6c90588e093]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:44:44 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-0058b0b5-4be4-4c4e-82f1-8b7a97ccdd68 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 10:44:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0058b0b5-4be4-4c4e-82f1-8b7a97ccdd68 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KFXRuLoQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 10:44:45 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-0058b0b5-4be4-4c4e-82f1-8b7a97ccdd68 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:44:45 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0058b0b5-4be4-4c4e-82f1-8b7a97ccdd68 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '26231383935316166', 'path': '/dev/sdb'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:44:45 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0058b0b5-4be4-4c4e-82f1-8b7a97ccdd68 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231383935316166', 'path': '/dev/sdb'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 10:44:45 user nova-compute[71113]: DEBUG nova.objects.instance [None req-0058b0b5-4be4-4c4e-82f1-8b7a97ccdd68 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Lazy-loading 'flavor' on Instance uuid 6666778c-d327-432a-8d7c-6bc52205dae8 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:44:45 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-0058b0b5-4be4-4c4e-82f1-8b7a97ccdd68 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 10:44:45 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:44:45 user nova-compute[71113]:   <source dev="/dev/sdb"/>
Jul 31 10:44:45 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 10:44:45 user nova-compute[71113]:   <serial>ba182015-91d6-4a13-83df-cd770b9d3ea9</serial>
Jul 31 10:44:45 user nova-compute[71113]: </disk>
Jul 31 10:44:45 user nova-compute[71113]:  {{(pid=71113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 10:44:46 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:44:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0058b0b5-4be4-4c4e-82f1-8b7a97ccdd68 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:44:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0058b0b5-4be4-4c4e-82f1-8b7a97ccdd68 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:44:46 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0058b0b5-4be4-4c4e-82f1-8b7a97ccdd68 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] No VIF found with MAC fa:16:3e:ab:15:31, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 10:44:46 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0058b0b5-4be4-4c4e-82f1-8b7a97ccdd68 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Lock "6666778c-d327-432a-8d7c-6bc52205dae8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.730s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:44:46 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:44:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:44:47 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:44:49 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:44:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0618f9dc-0b1f-4d42-ba46-c19d3d886bac tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Acquiring lock "6666778c-d327-432a-8d7c-6bc52205dae8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:44:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0618f9dc-0b1f-4d42-ba46-c19d3d886bac tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Lock "6666778c-d327-432a-8d7c-6bc52205dae8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:44:50 user nova-compute[71113]: DEBUG nova.objects.instance [None req-0618f9dc-0b1f-4d42-ba46-c19d3d886bac tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Lazy-loading 'flavor' on Instance uuid 6666778c-d327-432a-8d7c-6bc52205dae8 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:44:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0618f9dc-0b1f-4d42-ba46-c19d3d886bac tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Lock "6666778c-d327-432a-8d7c-6bc52205dae8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:44:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0618f9dc-0b1f-4d42-ba46-c19d3d886bac tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Acquiring lock "6666778c-d327-432a-8d7c-6bc52205dae8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:44:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0618f9dc-0b1f-4d42-ba46-c19d3d886bac tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Lock "6666778c-d327-432a-8d7c-6bc52205dae8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:44:50 user nova-compute[71113]: INFO nova.compute.manager [None req-0618f9dc-0b1f-4d42-ba46-c19d3d886bac tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Attaching volume 21bc5a8d-9839-4216-a328-cfe6c3fb81a4 to /dev/vdc
Jul 31 10:44:50 user nova-compute[71113]: DEBUG os_brick.utils [None req-0618f9dc-0b1f-4d42-ba46-c19d3d886bac tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:44:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:44:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:44:50 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72e289b-0096-451a-9416-9c2806e8517e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:44:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:44:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:44:50 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e986f4-326d-4394-a1e3-9a8267ce5842]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:44:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:44:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:44:50 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad13bce-3efa-41e4-8094-e71a5031b3b2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:44:50 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[718dce79-26d0-4de7-93f7-9e2aaeac0dcb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:44:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0618f9dc-0b1f-4d42-ba46-c19d3d886bac tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:44:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0618f9dc-0b1f-4d42-ba46-c19d3d886bac tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 10:44:50 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0618f9dc-0b1f-4d42-ba46-c19d3d886bac tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 10:44:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:44:50 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 10:44:50 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 10:44:50 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0893ea1b-974b-496c-bc5a-17dd710a38f1]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:44:50 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-0618f9dc-0b1f-4d42-ba46-c19d3d886bac tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 10:44:50 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-0618f9dc-0b1f-4d42-ba46-c19d3d886bac tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 10:44:50 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-0618f9dc-0b1f-4d42-ba46-c19d3d886bac tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 10:44:50 user nova-compute[71113]: DEBUG os_brick.utils [None req-0618f9dc-0b1f-4d42-ba46-c19d3d886bac tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:44:50 user nova-compute[71113]: DEBUG nova.virt.block_device [None req-0618f9dc-0b1f-4d42-ba46-c19d3d886bac tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Updating existing volume attachment record: 74c2788c-4227-4b60-97c5-09efe5df48f6 {{(pid=71113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 10:44:51 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:44:51 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:44:51 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:44:51 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Rebuilding the list of instances to heal {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 10:44:51 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "refresh_cache-6666778c-d327-432a-8d7c-6bc52205dae8" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:44:51 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquired lock "refresh_cache-6666778c-d327-432a-8d7c-6bc52205dae8" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:44:51 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Forcefully refreshing network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 10:44:51 user nova-compute[71113]: DEBUG nova.objects.instance [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lazy-loading 'info_cache' on Instance uuid 6666778c-d327-432a-8d7c-6bc52205dae8 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:44:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:44:52 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Updating instance_info_cache with network_info: [{"id": "efc0ddb4-defd-4575-a1f7-64f43ad451fc", "address": "fa:16:3e:ab:15:31", "network": {"id": "a93ed111-3752-4659-9926-71ad0efe0b8e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-175323687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "167c779016a24b7590affddbebbe1a8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefc0ddb4-de", "ovs_interfaceid": "efc0ddb4-defd-4575-a1f7-64f43ad451fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:44:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Releasing lock "refresh_cache-6666778c-d327-432a-8d7c-6bc52205dae8" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:44:52 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Updated the network info_cache for instance {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 10:44:52 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:44:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:44:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:44:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:44:52 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:44:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6666778c-d327-432a-8d7c-6bc52205dae8/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:44:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6666778c-d327-432a-8d7c-6bc52205dae8/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:44:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6666778c-d327-432a-8d7c-6bc52205dae8/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:44:52 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6666778c-d327-432a-8d7c-6bc52205dae8/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:44:52 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71113) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 10:44:53 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:44:53 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:44:53 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=8826MB free_disk=25.16382598876953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:44:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:44:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:44:53 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 6666778c-d327-432a-8d7c-6bc52205dae8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:44:53 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:44:53 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:44:53 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:44:53 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:44:53 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:44:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.170s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0618f9dc-0b1f-4d42-ba46-c19d3d886bac tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0618f9dc-0b1f-4d42-ba46-c19d3d886bac tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:21bc5a8d-9839-4216-a328-cfe6c3fb81a4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dAwTHpgC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:44:57 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-0618f9dc-0b1f-4d42-ba46-c19d3d886bac tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:44:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-0618f9dc-0b1f-4d42-ba46-c19d3d886bac tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-0618f9dc-0b1f-4d42-ba46-c19d3d886bac tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:44:57 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-0618f9dc-0b1f-4d42-ba46-c19d3d886bac tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:44:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-0618f9dc-0b1f-4d42-ba46-c19d3d886bac tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21bc5a8d-9839-4216-a328-cfe6c3fb81a4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-0618f9dc-0b1f-4d42-ba46-c19d3d886bac tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21bc5a8d-9839-4216-a328-cfe6c3fb81a4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:44:57 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-0618f9dc-0b1f-4d42-ba46-c19d3d886bac tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 10:44:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21bc5a8d-9839-4216-a328-cfe6c3fb81a4 -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21bc5a8d-9839-4216-a328-cfe6c3fb81a4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69db96f-c990-4ac1-8b55-a067013e41fe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0618f9dc-0b1f-4d42-ba46-c19d3d886bac tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 10:44:57 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21bc5a8d-9839-4216-a328-cfe6c3fb81a4 -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21bc5a8d-9839-4216-a328-cfe6c3fb81a4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[11db6b83-fdd5-4f7e-be0c-b89b2e717c50]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:21bc5a8d-9839-4216-a328-cfe6c3fb81a4] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0618f9dc-0b1f-4d42-ba46-c19d3d886bac tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:21bc5a8d-9839-4216-a328-cfe6c3fb81a4] added
Jul 31 10:44:57 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21bc5a8d-9839-4216-a328-cfe6c3fb81a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21bc5a8d-9839-4216-a328-cfe6c3fb81a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bb0aac-fd99-4461-9175-a558257f1c2f]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0618f9dc-0b1f-4d42-ba46-c19d3d886bac tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21bc5a8d-9839-4216-a328-cfe6c3fb81a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21bc5a8d-9839-4216-a328-cfe6c3fb81a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[263d7b5e-71b0-453e-b762-064a4dbb8c39]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0618f9dc-0b1f-4d42-ba46-c19d3d886bac tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21bc5a8d-9839-4216-a328-cfe6c3fb81a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dAwTHpgC {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21bc5a8d-9839-4216-a328-cfe6c3fb81a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dAwTHpgC" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[07162851-2663-4601-989c-e416d7dab923]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0618f9dc-0b1f-4d42-ba46-c19d3d886bac tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dAwTHpgC'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21bc5a8d-9839-4216-a328-cfe6c3fb81a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21bc5a8d-9839-4216-a328-cfe6c3fb81a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b771a4e-410a-43b0-8e5d-c6444212a2d2]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0618f9dc-0b1f-4d42-ba46-c19d3d886bac tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b28a74-08e1-4589-96fc-f1c35b910dc3]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0618f9dc-0b1f-4d42-ba46-c19d3d886bac tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9 (non-flash)
Jul 31 10:44:57 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0618f9dc-0b1f-4d42-ba46-c19d3d886bac tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9 (non-flash)
Jul 31 10:44:57 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21bc5a8d-9839-4216-a328-cfe6c3fb81a4 -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21bc5a8d-9839-4216-a328-cfe6c3fb81a4 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be3eb59-8db6-4524-a758-eb1060fd05c5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:21bc5a8d-9839-4216-a328-cfe6c3fb81a4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:21bc5a8d-9839-4216-a328-cfe6c3fb81a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0618f9dc-0b1f-4d42-ba46-c19d3d886bac tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:21bc5a8d-9839-4216-a328-cfe6c3fb81a4, portal: 172.16.0.220,3260]
Jul 31 10:44:57 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:21bc5a8d-9839-4216-a328-cfe6c3fb81a4, portal: 172.16.0.220,3260] successful.
Jul 31 10:44:57 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21bc5a8d-9839-4216-a328-cfe6c3fb81a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21bc5a8d-9839-4216-a328-cfe6c3fb81a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9d4e57-32a0-40d2-9243-28b4ff8754a1]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0618f9dc-0b1f-4d42-ba46-c19d3d886bac tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9825ac56-dd56-4888-9456-b7186a3fc3bf]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9 (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21bc5a8d-9839-4216-a328-cfe6c3fb81a4 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0618f9dc-0b1f-4d42-ba46-c19d3d886bac tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9 (non-flash)
Jul 31 10:44:57 user nova-compute[71113]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21bc5a8d-9839-4216-a328-cfe6c3fb81a4 (non-flash)
Jul 31 10:44:57 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0618f9dc-0b1f-4d42-ba46-c19d3d886bac tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9 (non-flash)
Jul 31 10:44:57 user nova-compute[71113]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21bc5a8d-9839-4216-a328-cfe6c3fb81a4 (non-flash)
Jul 31 10:44:57 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-0618f9dc-0b1f-4d42-ba46-c19d3d886bac tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21bc5a8d-9839-4216-a328-cfe6c3fb81a4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0618f9dc-0b1f-4d42-ba46-c19d3d886bac tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-0618f9dc-0b1f-4d42-ba46-c19d3d886bac tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] HCTL ('34', '-', '-', 0) found on session 62 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-0618f9dc-0b1f-4d42-ba46-c19d3d886bac tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbcf048b-1c7a-41e9-8383-a1d20e302ece]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-0618f9dc-0b1f-4d42-ba46-c19d3d886bac tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Searching for a device in session 62 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 10:44:57 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0618f9dc-0b1f-4d42-ba46-c19d3d886bac tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dAwTHpgC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 10:44:58 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-0618f9dc-0b1f-4d42-ba46-c19d3d886bac tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:44:58 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-0618f9dc-0b1f-4d42-ba46-c19d3d886bac tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23166303134316163', 'path': '/dev/sdc'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:44:58 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0618f9dc-0b1f-4d42-ba46-c19d3d886bac tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166303134316163', 'path': '/dev/sdc'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 10:44:58 user nova-compute[71113]: DEBUG nova.objects.instance [None req-0618f9dc-0b1f-4d42-ba46-c19d3d886bac tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Lazy-loading 'flavor' on Instance uuid 6666778c-d327-432a-8d7c-6bc52205dae8 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:44:58 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-0618f9dc-0b1f-4d42-ba46-c19d3d886bac tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 10:44:58 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:44:58 user nova-compute[71113]:   <source dev="/dev/sdc"/>
Jul 31 10:44:58 user nova-compute[71113]:   <target dev="vdc" bus="virtio"/>
Jul 31 10:44:58 user nova-compute[71113]:   <serial>21bc5a8d-9839-4216-a328-cfe6c3fb81a4</serial>
Jul 31 10:44:58 user nova-compute[71113]: </disk>
Jul 31 10:44:58 user nova-compute[71113]:  {{(pid=71113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 10:44:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0618f9dc-0b1f-4d42-ba46-c19d3d886bac tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:44:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0618f9dc-0b1f-4d42-ba46-c19d3d886bac tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:44:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0618f9dc-0b1f-4d42-ba46-c19d3d886bac tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:44:59 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-0618f9dc-0b1f-4d42-ba46-c19d3d886bac tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] No VIF found with MAC fa:16:3e:ab:15:31, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 10:44:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0618f9dc-0b1f-4d42-ba46-c19d3d886bac tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Lock "6666778c-d327-432a-8d7c-6bc52205dae8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.150s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:45:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f0579f9d-82a7-4b00-9596-1c7c72afe0e0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Acquiring lock "6666778c-d327-432a-8d7c-6bc52205dae8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:45:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f0579f9d-82a7-4b00-9596-1c7c72afe0e0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Lock "6666778c-d327-432a-8d7c-6bc52205dae8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:45:00 user nova-compute[71113]: INFO nova.compute.manager [None req-f0579f9d-82a7-4b00-9596-1c7c72afe0e0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Detaching volume 21bc5a8d-9839-4216-a328-cfe6c3fb81a4
Jul 31 10:45:00 user nova-compute[71113]: INFO nova.virt.block_device [None req-f0579f9d-82a7-4b00-9596-1c7c72afe0e0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Attempting to driver detach volume 21bc5a8d-9839-4216-a328-cfe6c3fb81a4 from mountpoint /dev/vdc
Jul 31 10:45:00 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f0579f9d-82a7-4b00-9596-1c7c72afe0e0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Attempting to detach device vdc from instance 6666778c-d327-432a-8d7c-6bc52205dae8 from the persistent domain config. {{(pid=71113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 10:45:00 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-f0579f9d-82a7-4b00-9596-1c7c72afe0e0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 10:45:00 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:45:00 user nova-compute[71113]:   <source dev="/dev/sdc"/>
Jul 31 10:45:00 user nova-compute[71113]:   <target dev="vdc" bus="virtio"/>
Jul 31 10:45:00 user nova-compute[71113]:   <serial>21bc5a8d-9839-4216-a328-cfe6c3fb81a4</serial>
Jul 31 10:45:00 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 31 10:45:00 user nova-compute[71113]: </disk>
Jul 31 10:45:00 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 10:45:00 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-f0579f9d-82a7-4b00-9596-1c7c72afe0e0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Successfully detached device vdc from instance 6666778c-d327-432a-8d7c-6bc52205dae8 from the persistent domain config.
Jul 31 10:45:00 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f0579f9d-82a7-4b00-9596-1c7c72afe0e0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 6666778c-d327-432a-8d7c-6bc52205dae8 from the live domain config. {{(pid=71113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 10:45:00 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-f0579f9d-82a7-4b00-9596-1c7c72afe0e0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 10:45:00 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:45:00 user nova-compute[71113]:   <source dev="/dev/sdc"/>
Jul 31 10:45:00 user nova-compute[71113]:   <target dev="vdc" bus="virtio"/>
Jul 31 10:45:00 user nova-compute[71113]:   <serial>21bc5a8d-9839-4216-a328-cfe6c3fb81a4</serial>
Jul 31 10:45:00 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 31 10:45:00 user nova-compute[71113]: </disk>
Jul 31 10:45:00 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 10:45:00 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Received event <DeviceRemovedEvent: 1690800300.7094262, 6666778c-d327-432a-8d7c-6bc52205dae8 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71113) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 10:45:00 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f0579f9d-82a7-4b00-9596-1c7c72afe0e0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 6666778c-d327-432a-8d7c-6bc52205dae8 {{(pid=71113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 10:45:00 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-f0579f9d-82a7-4b00-9596-1c7c72afe0e0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Successfully detached device vdc from instance 6666778c-d327-432a-8d7c-6bc52205dae8 from the live domain config.
Jul 31 10:45:00 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0579f9d-82a7-4b00-9596-1c7c72afe0e0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 10:45:00 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0579f9d-82a7-4b00-9596-1c7c72afe0e0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:21bc5a8d-9839-4216-a328-cfe6c3fb81a4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dAwTHpgC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:45:00 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-f0579f9d-82a7-4b00-9596-1c7c72afe0e0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:45:00 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-f0579f9d-82a7-4b00-9596-1c7c72afe0e0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:45:00 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-f0579f9d-82a7-4b00-9596-1c7c72afe0e0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:45:00 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0579f9d-82a7-4b00-9596-1c7c72afe0e0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21bc5a8d-9839-4216-a328-cfe6c3fb81a4', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 10:45:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:45:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:45:00 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d04cf6-ef44-4985-9311-14a4335d927f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21bc5a8d-9839-4216-a328-cfe6c3fb81a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:45:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:45:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:45:00 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[588193c6-72b1-4d3c-b089-0c2249e040d5]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9 (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21bc5a8d-9839-4216-a328-cfe6c3fb81a4 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:45:00 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0579f9d-82a7-4b00-9596-1c7c72afe0e0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9 (non-flash)
Jul 31 10:45:00 user nova-compute[71113]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21bc5a8d-9839-4216-a328-cfe6c3fb81a4 (non-flash)
Jul 31 10:45:00 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:45:00 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0579f9d-82a7-4b00-9596-1c7c72afe0e0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9 (non-flash)
Jul 31 10:45:00 user nova-compute[71113]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21bc5a8d-9839-4216-a328-cfe6c3fb81a4 (non-flash)
Jul 31 10:45:00 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:45:00 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0579f9d-82a7-4b00-9596-1c7c72afe0e0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7908122a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21bc5a8d-9839-4216-a328-cfe6c3fb81a4'): ({'sdc'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 10:45:00 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-f0579f9d-82a7-4b00-9596-1c7c72afe0e0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Removing single pathed devices sdc {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 10:45:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:45:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:45:00 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf75b21-ef3d-4724-9066-0f8f9588ad53]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:45:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:45:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:45:00 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa43c58a-d53d-477b-9c29-a2f8de8197b7]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:45:00 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-f0579f9d-82a7-4b00-9596-1c7c72afe0e0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Flushing IO for device /dev/sdc {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 10:45:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:45:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:45:00 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3444a3-2211-422f-a71c-dd117ee1ed57]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:45:00 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-f0579f9d-82a7-4b00-9596-1c7c72afe0e0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 10:45:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:45:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:45:00 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b9affe-12fe-4994-a342-3b9ab176e081]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:45:00 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-f0579f9d-82a7-4b00-9596-1c7c72afe0e0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 10:45:00 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-f0579f9d-82a7-4b00-9596-1c7c72afe0e0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] SCSI volumes sdc have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 10:45:00 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0579f9d-82a7-4b00-9596-1c7c72afe0e0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21bc5a8d-9839-4216-a328-cfe6c3fb81a4')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 10:45:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21bc5a8d-9839-4216-a328-cfe6c3fb81a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:45:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21bc5a8d-9839-4216-a328-cfe6c3fb81a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:45:00 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aec27a8-af2c-4b3c-a9e0-59a6d85c1994]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:45:00 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0579f9d-82a7-4b00-9596-1c7c72afe0e0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:45:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21bc5a8d-9839-4216-a328-cfe6c3fb81a4 -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:45:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21bc5a8d-9839-4216-a328-cfe6c3fb81a4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:45:00 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[35dca85a-5fe2-47bc-82a9-4abfc6cce9a9]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:21bc5a8d-9839-4216-a328-cfe6c3fb81a4, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:21bc5a8d-9839-4216-a328-cfe6c3fb81a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:45:00 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0579f9d-82a7-4b00-9596-1c7c72afe0e0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:21bc5a8d-9839-4216-a328-cfe6c3fb81a4, portal: 172.16.0.220,3260]
Jul 31 10:45:00 user nova-compute[71113]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:21bc5a8d-9839-4216-a328-cfe6c3fb81a4, portal: 172.16.0.220,3260] successful.
Jul 31 10:45:00 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:45:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21bc5a8d-9839-4216-a328-cfe6c3fb81a4 -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:45:00 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21bc5a8d-9839-4216-a328-cfe6c3fb81a4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:45:00 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d658ca-81ea-4faf-9bf8-70b247dc6b29]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:45:00 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0579f9d-82a7-4b00-9596-1c7c72afe0e0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:45:00 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-f0579f9d-82a7-4b00-9596-1c7c72afe0e0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.253s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:45:00 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0579f9d-82a7-4b00-9596-1c7c72afe0e0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] <== disconnect_volume: return (255ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:45:00 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0579f9d-82a7-4b00-9596-1c7c72afe0e0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 10:45:01 user nova-compute[71113]: DEBUG nova.objects.instance [None req-f0579f9d-82a7-4b00-9596-1c7c72afe0e0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Lazy-loading 'flavor' on Instance uuid 6666778c-d327-432a-8d7c-6bc52205dae8 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:45:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f0579f9d-82a7-4b00-9596-1c7c72afe0e0 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Lock "6666778c-d327-432a-8d7c-6bc52205dae8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.542s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:45:02 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:45:03 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:45:04 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:45:07 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:45:11 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:45:12 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:45:17 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:45:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:45:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:45:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:45:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:45:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:45:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:45:47 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:45:48 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:45:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-30f053b3-9d1e-4738-9b9c-53f9cb02b295 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Acquiring lock "6666778c-d327-432a-8d7c-6bc52205dae8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:45:50 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-30f053b3-9d1e-4738-9b9c-53f9cb02b295 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Lock "6666778c-d327-432a-8d7c-6bc52205dae8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:45:50 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:45:50 user nova-compute[71113]: INFO nova.compute.manager [None req-30f053b3-9d1e-4738-9b9c-53f9cb02b295 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Detaching volume ba182015-91d6-4a13-83df-cd770b9d3ea9
Jul 31 10:45:50 user nova-compute[71113]: INFO nova.virt.block_device [None req-30f053b3-9d1e-4738-9b9c-53f9cb02b295 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Attempting to driver detach volume ba182015-91d6-4a13-83df-cd770b9d3ea9 from mountpoint /dev/vdb
Jul 31 10:45:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-30f053b3-9d1e-4738-9b9c-53f9cb02b295 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Attempting to detach device vdb from instance 6666778c-d327-432a-8d7c-6bc52205dae8 from the persistent domain config. {{(pid=71113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 10:45:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-30f053b3-9d1e-4738-9b9c-53f9cb02b295 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 10:45:50 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:45:50 user nova-compute[71113]:   <source dev="/dev/sdb"/>
Jul 31 10:45:50 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 10:45:50 user nova-compute[71113]:   <serial>ba182015-91d6-4a13-83df-cd770b9d3ea9</serial>
Jul 31 10:45:50 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 10:45:50 user nova-compute[71113]: </disk>
Jul 31 10:45:50 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 10:45:50 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-30f053b3-9d1e-4738-9b9c-53f9cb02b295 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Successfully detached device vdb from instance 6666778c-d327-432a-8d7c-6bc52205dae8 from the persistent domain config.
Jul 31 10:45:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-30f053b3-9d1e-4738-9b9c-53f9cb02b295 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6666778c-d327-432a-8d7c-6bc52205dae8 from the live domain config. {{(pid=71113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 10:45:50 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-30f053b3-9d1e-4738-9b9c-53f9cb02b295 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 10:45:50 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:45:50 user nova-compute[71113]:   <source dev="/dev/sdb"/>
Jul 31 10:45:50 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 10:45:50 user nova-compute[71113]:   <serial>ba182015-91d6-4a13-83df-cd770b9d3ea9</serial>
Jul 31 10:45:50 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 10:45:50 user nova-compute[71113]: </disk>
Jul 31 10:45:50 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 10:45:51 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Received event <DeviceRemovedEvent: 1690800351.2838445, 6666778c-d327-432a-8d7c-6bc52205dae8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71113) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 10:45:51 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-30f053b3-9d1e-4738-9b9c-53f9cb02b295 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6666778c-d327-432a-8d7c-6bc52205dae8 {{(pid=71113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 10:45:51 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-30f053b3-9d1e-4738-9b9c-53f9cb02b295 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Successfully detached device vdb from instance 6666778c-d327-432a-8d7c-6bc52205dae8 from the live domain config.
Jul 31 10:45:51 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30f053b3-9d1e-4738-9b9c-53f9cb02b295 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 10:45:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f053b3-9d1e-4738-9b9c-53f9cb02b295 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KFXRuLoQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:45:51 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-30f053b3-9d1e-4738-9b9c-53f9cb02b295 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:45:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-30f053b3-9d1e-4738-9b9c-53f9cb02b295 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:45:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-30f053b3-9d1e-4738-9b9c-53f9cb02b295 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:45:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f053b3-9d1e-4738-9b9c-53f9cb02b295 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 10:45:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:45:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:45:51 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[86799ade-976d-4804-ba65-a1fdc4d22a81]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:45:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:45:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:45:51 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5bff957-5733-41ab-8487-22d71419b008]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:45:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f053b3-9d1e-4738-9b9c-53f9cb02b295 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9 (non-flash)
Jul 31 10:45:51 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:45:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f053b3-9d1e-4738-9b9c-53f9cb02b295 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9 (non-flash)
Jul 31 10:45:51 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:45:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f053b3-9d1e-4738-9b9c-53f9cb02b295 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f78f05ae290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9'): ({'sdb'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 10:45:51 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-30f053b3-9d1e-4738-9b9c-53f9cb02b295 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Removing single pathed devices sdb {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 10:45:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:45:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:45:51 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d885ea0-39f8-48f4-a206-54d7386053ca]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:45:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:45:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:45:51 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[af71e061-23cc-45da-a96d-7bc9e8fb0223]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:45:51 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-30f053b3-9d1e-4738-9b9c-53f9cb02b295 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Flushing IO for device /dev/sdb {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 10:45:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:45:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:45:51 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[923ad4ad-e1f5-4b98-aa0b-aefad921cb35]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:45:51 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-30f053b3-9d1e-4738-9b9c-53f9cb02b295 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 10:45:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:45:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.028s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:45:51 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b14b0d2-14f4-4c67-89a5-7258e2707233]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:45:51 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-30f053b3-9d1e-4738-9b9c-53f9cb02b295 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 10:45:51 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-30f053b3-9d1e-4738-9b9c-53f9cb02b295 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] SCSI volumes sdb have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 10:45:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f053b3-9d1e-4738-9b9c-53f9cb02b295 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 10:45:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:45:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:45:51 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d69234b-1423-41c8-865a-9c63f0033ee2]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:45:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f053b3-9d1e-4738-9b9c-53f9cb02b295 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:45:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9 -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:45:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:45:51 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc9f229-07d6-4b08-91a2-421a8ecf38e4]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:45:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f053b3-9d1e-4738-9b9c-53f9cb02b295 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9, portal: 172.16.0.220,3260]
Jul 31 10:45:51 user nova-compute[71113]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9, portal: 172.16.0.220,3260] successful.
Jul 31 10:45:51 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:45:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9 -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:45:51 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba182015-91d6-4a13-83df-cd770b9d3ea9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:45:51 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3c02f7-adf9-4be6-8dd8-ebf96c1283bf]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:45:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f053b3-9d1e-4738-9b9c-53f9cb02b295 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:45:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-30f053b3-9d1e-4738-9b9c-53f9cb02b295 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.244s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:45:51 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-30f053b3-9d1e-4738-9b9c-53f9cb02b295 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] <== disconnect_volume: return (245ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:45:51 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30f053b3-9d1e-4738-9b9c-53f9cb02b295 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 10:45:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:45:52 user nova-compute[71113]: DEBUG nova.objects.instance [None req-30f053b3-9d1e-4738-9b9c-53f9cb02b295 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Lazy-loading 'flavor' on Instance uuid 6666778c-d327-432a-8d7c-6bc52205dae8 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:45:52 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-30f053b3-9d1e-4738-9b9c-53f9cb02b295 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Lock "6666778c-d327-432a-8d7c-6bc52205dae8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.574s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:45:53 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:45:53 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:45:53 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Rebuilding the list of instances to heal {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 10:45:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "refresh_cache-6666778c-d327-432a-8d7c-6bc52205dae8" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:45:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquired lock "refresh_cache-6666778c-d327-432a-8d7c-6bc52205dae8" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:45:53 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Forcefully refreshing network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 10:45:53 user nova-compute[71113]: DEBUG nova.objects.instance [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lazy-loading 'info_cache' on Instance uuid 6666778c-d327-432a-8d7c-6bc52205dae8 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:45:54 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Updating instance_info_cache with network_info: [{"id": "efc0ddb4-defd-4575-a1f7-64f43ad451fc", "address": "fa:16:3e:ab:15:31", "network": {"id": "a93ed111-3752-4659-9926-71ad0efe0b8e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-175323687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "167c779016a24b7590affddbebbe1a8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefc0ddb4-de", "ovs_interfaceid": "efc0ddb4-defd-4575-a1f7-64f43ad451fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:45:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Releasing lock "refresh_cache-6666778c-d327-432a-8d7c-6bc52205dae8" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:45:54 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Updated the network info_cache for instance {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 10:45:54 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:45:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:45:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:45:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:45:54 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:45:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6666778c-d327-432a-8d7c-6bc52205dae8/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:45:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6666778c-d327-432a-8d7c-6bc52205dae8/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:45:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6666778c-d327-432a-8d7c-6bc52205dae8/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:45:54 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6666778c-d327-432a-8d7c-6bc52205dae8/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:45:55 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:45:55 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:45:55 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=8852MB free_disk=25.16286849975586GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:45:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:45:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:45:55 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 6666778c-d327-432a-8d7c-6bc52205dae8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:45:55 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:45:55 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:45:55 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:45:55 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:45:55 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:45:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.286s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:45:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:45:57 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:45:57 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:45:57 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:45:57 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:46:02 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:46:03 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:46:07 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:46:12 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:46:17 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:46:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:46:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:46:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:46:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:46:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-616be4c0-bdb9-4d76-9fbb-221818c46428 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Acquiring lock "6666778c-d327-432a-8d7c-6bc52205dae8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:46:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-616be4c0-bdb9-4d76-9fbb-221818c46428 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Lock "6666778c-d327-432a-8d7c-6bc52205dae8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:46:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-616be4c0-bdb9-4d76-9fbb-221818c46428 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Acquiring lock "6666778c-d327-432a-8d7c-6bc52205dae8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:46:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-616be4c0-bdb9-4d76-9fbb-221818c46428 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Lock "6666778c-d327-432a-8d7c-6bc52205dae8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:46:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-616be4c0-bdb9-4d76-9fbb-221818c46428 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Lock "6666778c-d327-432a-8d7c-6bc52205dae8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:46:41 user nova-compute[71113]: INFO nova.compute.manager [None req-616be4c0-bdb9-4d76-9fbb-221818c46428 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Terminating instance
Jul 31 10:46:41 user nova-compute[71113]: DEBUG nova.compute.manager [None req-616be4c0-bdb9-4d76-9fbb-221818c46428 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Start destroying the instance on the hypervisor. {{(pid=71113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 10:46:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:46:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:46:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:46:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:46:41 user nova-compute[71113]: DEBUG nova.compute.manager [req-00b69b11-ac79-440c-b7a9-5029b727376b req-df24437a-bed5-463c-98c2-ff23d61df4ba service nova] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Received event network-vif-unplugged-efc0ddb4-defd-4575-a1f7-64f43ad451fc {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:46:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-00b69b11-ac79-440c-b7a9-5029b727376b req-df24437a-bed5-463c-98c2-ff23d61df4ba service nova] Acquiring lock "6666778c-d327-432a-8d7c-6bc52205dae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:46:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-00b69b11-ac79-440c-b7a9-5029b727376b req-df24437a-bed5-463c-98c2-ff23d61df4ba service nova] Lock "6666778c-d327-432a-8d7c-6bc52205dae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:46:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-00b69b11-ac79-440c-b7a9-5029b727376b req-df24437a-bed5-463c-98c2-ff23d61df4ba service nova] Lock "6666778c-d327-432a-8d7c-6bc52205dae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:46:41 user nova-compute[71113]: DEBUG nova.compute.manager [req-00b69b11-ac79-440c-b7a9-5029b727376b req-df24437a-bed5-463c-98c2-ff23d61df4ba service nova] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] No waiting events found dispatching network-vif-unplugged-efc0ddb4-defd-4575-a1f7-64f43ad451fc {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:46:41 user nova-compute[71113]: DEBUG nova.compute.manager [req-00b69b11-ac79-440c-b7a9-5029b727376b req-df24437a-bed5-463c-98c2-ff23d61df4ba service nova] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Received event network-vif-unplugged-efc0ddb4-defd-4575-a1f7-64f43ad451fc for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 10:46:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:46:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:46:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:46:41 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Instance destroyed successfully.
Jul 31 10:46:41 user nova-compute[71113]: DEBUG nova.objects.instance [None req-616be4c0-bdb9-4d76-9fbb-221818c46428 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Lazy-loading 'resources' on Instance uuid 6666778c-d327-432a-8d7c-6bc52205dae8 {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:46:41 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-616be4c0-bdb9-4d76-9fbb-221818c46428 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:42:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-232979101',display_name='tempest-TestServerVolumeAttachmentScenario-server-232979101',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-232979101',id=51,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRO8kSSaWa+w41ESdpFg81sUVhg6nOjXcz0jgLPNOtfLTMfRg4WjXJXxQyfRIp/9OxkmS6J1On8jqVl9z2fon/7lTw6RPGyde1jMbuNyc1Ujk9PtdcGmAFgiUoowefJnA==',key_name='tempest-keypair-766384137',keypairs=<?>,launch_index=0,launched_at=2023-07-31T10:42:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='167c779016a24b7590affddbebbe1a8d',ramdisk_id='',reservation_id='r-1han7gjy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-488365166',owner_user_name='tempest-TestServerVolumeAttachmentScenario-488365166-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T10:42:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78153b3290e34899bc33e84c1347bc58',uuid=6666778c-d327-432a-8d7c-6bc52205dae8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "efc0ddb4-defd-4575-a1f7-64f43ad451fc", "address": "fa:16:3e:ab:15:31", "network": {"id": "a93ed111-3752-4659-9926-71ad0efe0b8e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-175323687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "167c779016a24b7590affddbebbe1a8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefc0ddb4-de", "ovs_interfaceid": "efc0ddb4-defd-4575-a1f7-64f43ad451fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 10:46:41 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-616be4c0-bdb9-4d76-9fbb-221818c46428 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Converting VIF {"id": "efc0ddb4-defd-4575-a1f7-64f43ad451fc", "address": "fa:16:3e:ab:15:31", "network": {"id": "a93ed111-3752-4659-9926-71ad0efe0b8e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-175323687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "167c779016a24b7590affddbebbe1a8d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefc0ddb4-de", "ovs_interfaceid": "efc0ddb4-defd-4575-a1f7-64f43ad451fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:46:41 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-616be4c0-bdb9-4d76-9fbb-221818c46428 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ab:15:31,bridge_name='br-int',has_traffic_filtering=True,id=efc0ddb4-defd-4575-a1f7-64f43ad451fc,network=Network(a93ed111-3752-4659-9926-71ad0efe0b8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefc0ddb4-de') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:46:41 user nova-compute[71113]: DEBUG os_vif [None req-616be4c0-bdb9-4d76-9fbb-221818c46428 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:15:31,bridge_name='br-int',has_traffic_filtering=True,id=efc0ddb4-defd-4575-a1f7-64f43ad451fc,network=Network(a93ed111-3752-4659-9926-71ad0efe0b8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefc0ddb4-de') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 10:46:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:46:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapefc0ddb4-de, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:46:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:46:41 user nova-compute[71113]: INFO os_vif [None req-616be4c0-bdb9-4d76-9fbb-221818c46428 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:15:31,bridge_name='br-int',has_traffic_filtering=True,id=efc0ddb4-defd-4575-a1f7-64f43ad451fc,network=Network(a93ed111-3752-4659-9926-71ad0efe0b8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefc0ddb4-de')
Jul 31 10:46:41 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-616be4c0-bdb9-4d76-9fbb-221818c46428 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Deleting instance files /opt/stack/data/nova/instances/6666778c-d327-432a-8d7c-6bc52205dae8_del
Jul 31 10:46:41 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-616be4c0-bdb9-4d76-9fbb-221818c46428 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Deletion of /opt/stack/data/nova/instances/6666778c-d327-432a-8d7c-6bc52205dae8_del complete
Jul 31 10:46:42 user nova-compute[71113]: INFO nova.compute.manager [None req-616be4c0-bdb9-4d76-9fbb-221818c46428 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Took 0.89 seconds to destroy the instance on the hypervisor.
Jul 31 10:46:42 user nova-compute[71113]: DEBUG oslo.service.loopingcall [None req-616be4c0-bdb9-4d76-9fbb-221818c46428 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71113) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 10:46:42 user nova-compute[71113]: DEBUG nova.compute.manager [-] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Deallocating network for instance {{(pid=71113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 10:46:42 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] deallocate_for_instance() {{(pid=71113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 10:46:42 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:46:42 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Took 0.82 seconds to deallocate network for instance.
Jul 31 10:46:42 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-616be4c0-bdb9-4d76-9fbb-221818c46428 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:46:42 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-616be4c0-bdb9-4d76-9fbb-221818c46428 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:46:43 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-616be4c0-bdb9-4d76-9fbb-221818c46428 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:46:43 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-616be4c0-bdb9-4d76-9fbb-221818c46428 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:46:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-616be4c0-bdb9-4d76-9fbb-221818c46428 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.114s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:46:43 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-616be4c0-bdb9-4d76-9fbb-221818c46428 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Deleted allocations for instance 6666778c-d327-432a-8d7c-6bc52205dae8
Jul 31 10:46:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-616be4c0-bdb9-4d76-9fbb-221818c46428 tempest-TestServerVolumeAttachmentScenario-488365166 tempest-TestServerVolumeAttachmentScenario-488365166-project-member] Lock "6666778c-d327-432a-8d7c-6bc52205dae8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.040s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:46:43 user nova-compute[71113]: DEBUG nova.compute.manager [req-132db4a4-11ca-4205-b79b-8e2a4c501668 req-33ec5a46-9448-4f65-9944-629613cc44a1 service nova] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Received event network-vif-plugged-efc0ddb4-defd-4575-a1f7-64f43ad451fc {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:46:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-132db4a4-11ca-4205-b79b-8e2a4c501668 req-33ec5a46-9448-4f65-9944-629613cc44a1 service nova] Acquiring lock "6666778c-d327-432a-8d7c-6bc52205dae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:46:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-132db4a4-11ca-4205-b79b-8e2a4c501668 req-33ec5a46-9448-4f65-9944-629613cc44a1 service nova] Lock "6666778c-d327-432a-8d7c-6bc52205dae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:46:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-132db4a4-11ca-4205-b79b-8e2a4c501668 req-33ec5a46-9448-4f65-9944-629613cc44a1 service nova] Lock "6666778c-d327-432a-8d7c-6bc52205dae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:46:43 user nova-compute[71113]: DEBUG nova.compute.manager [req-132db4a4-11ca-4205-b79b-8e2a4c501668 req-33ec5a46-9448-4f65-9944-629613cc44a1 service nova] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] No waiting events found dispatching network-vif-plugged-efc0ddb4-defd-4575-a1f7-64f43ad451fc {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:46:43 user nova-compute[71113]: WARNING nova.compute.manager [req-132db4a4-11ca-4205-b79b-8e2a4c501668 req-33ec5a46-9448-4f65-9944-629613cc44a1 service nova] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Received unexpected event network-vif-plugged-efc0ddb4-defd-4575-a1f7-64f43ad451fc for instance with vm_state deleted and task_state None.
Jul 31 10:46:43 user nova-compute[71113]: DEBUG nova.compute.manager [req-132db4a4-11ca-4205-b79b-8e2a4c501668 req-33ec5a46-9448-4f65-9944-629613cc44a1 service nova] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Received event network-vif-deleted-efc0ddb4-defd-4575-a1f7-64f43ad451fc {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:46:46 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:46:47 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:46:50 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:46:51 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:46:52 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:46:53 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:46:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:46:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:46:53 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:46:53 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:46:54 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:46:54 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:46:54 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=8975MB free_disk=25.190113067626953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:46:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:46:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:46:54 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:46:54 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:46:54 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:46:54 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:46:54 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:46:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.133s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:46:56 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:46:56 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:46:56 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Rebuilding the list of instances to heal {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 10:46:56 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Didn't find any instances for network info cache update. {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 10:46:56 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690800401.9033196, 6666778c-d327-432a-8d7c-6bc52205dae8 => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:46:56 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] VM Stopped (Lifecycle Event)
Jul 31 10:46:56 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0bc3bc13-43ba-436d-8244-c5afd6cef094 None None] [instance: 6666778c-d327-432a-8d7c-6bc52205dae8] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:46:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:46:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:46:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:46:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:46:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:46:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:46:57 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:46:58 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:46:58 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:46:59 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:47:01 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:47:03 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:47:06 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:47:07 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:47:11 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:47:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:47:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:47:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:47:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:47:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:47:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:47:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:47:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:47:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:47:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:47:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:47:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:47:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:47:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:47:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:47:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:47:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:47:46 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:47:47 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:47:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:47:51 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:47:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:47:52 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:47:54 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:47:54 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:47:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:47:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:47:54 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:47:54 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:47:55 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:47:55 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:47:55 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=8998MB free_disk=25.18881607055664GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:47:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:47:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:47:55 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:47:55 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:47:55 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Refreshing inventories for resource provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 31 10:47:55 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Updating ProviderTree inventory for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 31 10:47:55 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Updating inventory in ProviderTree for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 31 10:47:55 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Refreshing aggregate associations for resource provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05, aggregates: None {{(pid=71113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 31 10:47:55 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Refreshing trait associations for resource provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE2,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS {{(pid=71113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 31 10:47:55 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:47:55 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:47:55 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:47:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.303s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:47:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:47:57 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:47:57 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:47:57 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Rebuilding the list of instances to heal {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 10:47:57 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Didn't find any instances for network info cache update. {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 10:47:59 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:47:59 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:47:59 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:48:01 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:48:01 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:48:04 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:48:06 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:48:11 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:48:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:48:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:48:23 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:48:23 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Cleaning up deleted instances {{(pid=71113) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 31 10:48:23 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] There are 0 instances to clean {{(pid=71113) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 31 10:48:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:48:31 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:48:31 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71113) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 31 10:48:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:48:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:48:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:48:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:48:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:48:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:48:32 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:48:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:48:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:48:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:48:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:48:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:48:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:48:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:48:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:48:48 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:48:49 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:48:51 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:48:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:48:54 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:48:54 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:48:55 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:48:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:48:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:48:55 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:48:55 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:48:56 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:48:56 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:48:56 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:48:56 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=8687MB free_disk=25.176204681396484GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:48:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:48:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:48:56 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:48:56 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:48:56 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:48:56 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:48:56 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:48:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.174s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:48:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:48:57 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:48:58 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:48:58 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:48:58 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Rebuilding the list of instances to heal {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 10:48:58 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Didn't find any instances for network info cache update. {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 10:49:00 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:49:00 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:49:00 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:49:00 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:49:01 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:49:01 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:49:02 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:49:03 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:49:04 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:49:06 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:49:07 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:49:09 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Acquiring lock "03ff6317-3626-4caf-9ddf-cc310aee964a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:49:09 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "03ff6317-3626-4caf-9ddf-cc310aee964a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:49:09 user nova-compute[71113]: DEBUG nova.compute.manager [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Starting instance... {{(pid=71113) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 10:49:09 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:49:09 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:49:09 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71113) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 10:49:09 user nova-compute[71113]: INFO nova.compute.claims [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Claim successful on node user
Jul 31 10:49:09 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:49:09 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:49:09 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.218s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:49:09 user nova-compute[71113]: DEBUG nova.compute.manager [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Start building networks asynchronously for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 10:49:09 user nova-compute[71113]: DEBUG nova.compute.manager [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Allocating IP information in the background. {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 10:49:09 user nova-compute[71113]: DEBUG nova.network.neutron [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] allocate_for_instance() {{(pid=71113) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 10:49:09 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 10:49:09 user nova-compute[71113]: DEBUG nova.compute.manager [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Start building block device mappings for instance. {{(pid=71113) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 10:49:10 user nova-compute[71113]: DEBUG nova.policy [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c7878cab2cea4803bdc7a9db8b104bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be39a4fc3dd42dd8dff2cf645bb965c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71113) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 10:49:10 user nova-compute[71113]: DEBUG nova.compute.manager [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Start spawning the instance on the hypervisor. {{(pid=71113) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 10:49:10 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Creating instance directory {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 10:49:10 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Creating image(s)
Jul 31 10:49:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Acquiring lock "/opt/stack/data/nova/instances/03ff6317-3626-4caf-9ddf-cc310aee964a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:49:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "/opt/stack/data/nova/instances/03ff6317-3626-4caf-9ddf-cc310aee964a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:49:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "/opt/stack/data/nova/instances/03ff6317-3626-4caf-9ddf-cc310aee964a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:49:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:49:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.157s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:49:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Acquiring lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:49:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:49:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:49:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.166s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:49:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/03ff6317-3626-4caf-9ddf-cc310aee964a/disk 1073741824 {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:49:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9,backing_fmt=raw /opt/stack/data/nova/instances/03ff6317-3626-4caf-9ddf-cc310aee964a/disk 1073741824" returned: 0 in 0.064s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:49:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "1a23da102527e12ce1165c0fe070d85f45ada2d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:49:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:49:10 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:49:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1a23da102527e12ce1165c0fe070d85f45ada2d9 --force-share --output=json" returned: 0 in 0.156s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:49:10 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Checking if we can resize image /opt/stack/data/nova/instances/03ff6317-3626-4caf-9ddf-cc310aee964a/disk. size=1073741824 {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 10:49:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ff6317-3626-4caf-9ddf-cc310aee964a/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:49:10 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ff6317-3626-4caf-9ddf-cc310aee964a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:49:10 user nova-compute[71113]: DEBUG nova.virt.disk.api [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Cannot resize image /opt/stack/data/nova/instances/03ff6317-3626-4caf-9ddf-cc310aee964a/disk to a smaller size. {{(pid=71113) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 10:49:10 user nova-compute[71113]: DEBUG nova.objects.instance [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lazy-loading 'migration_context' on Instance uuid 03ff6317-3626-4caf-9ddf-cc310aee964a {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:49:10 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Created local disks {{(pid=71113) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 10:49:10 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Ensure instance console log exists: /opt/stack/data/nova/instances/03ff6317-3626-4caf-9ddf-cc310aee964a/console.log {{(pid=71113) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 10:49:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:49:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:49:10 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:49:11 user nova-compute[71113]: DEBUG nova.network.neutron [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Successfully created port: 8b219530-9c17-4356-87ed-5a4901530c06 {{(pid=71113) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 10:49:11 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:49:11 user nova-compute[71113]: DEBUG nova.network.neutron [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Successfully updated port: 8b219530-9c17-4356-87ed-5a4901530c06 {{(pid=71113) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 10:49:12 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:49:12 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Acquiring lock "refresh_cache-03ff6317-3626-4caf-9ddf-cc310aee964a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:49:12 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Acquired lock "refresh_cache-03ff6317-3626-4caf-9ddf-cc310aee964a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:49:12 user nova-compute[71113]: DEBUG nova.network.neutron [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Building network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 10:49:12 user nova-compute[71113]: DEBUG nova.network.neutron [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Instance cache missing network info. {{(pid=71113) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 10:49:12 user nova-compute[71113]: DEBUG nova.network.neutron [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Updating instance_info_cache with network_info: [{"id": "8b219530-9c17-4356-87ed-5a4901530c06", "address": "fa:16:3e:d1:3d:5b", "network": {"id": "f5e8d70f-0f94-435a-90f1-1c947305393d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2088935103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be39a4fc3dd42dd8dff2cf645bb965c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b219530-9c", "ovs_interfaceid": "8b219530-9c17-4356-87ed-5a4901530c06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:49:12 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Releasing lock "refresh_cache-03ff6317-3626-4caf-9ddf-cc310aee964a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:49:12 user nova-compute[71113]: DEBUG nova.compute.manager [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Instance network_info: |[{"id": "8b219530-9c17-4356-87ed-5a4901530c06", "address": "fa:16:3e:d1:3d:5b", "network": {"id": "f5e8d70f-0f94-435a-90f1-1c947305393d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2088935103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be39a4fc3dd42dd8dff2cf645bb965c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b219530-9c", "ovs_interfaceid": "8b219530-9c17-4356-87ed-5a4901530c06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71113) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 10:49:12 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Start _get_guest_xml network_info=[{"id": "8b219530-9c17-4356-87ed-5a4901530c06", "address": "fa:16:3e:d1:3d:5b", "network": {"id": "f5e8d70f-0f94-435a-90f1-1c947305393d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2088935103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be39a4fc3dd42dd8dff2cf645bb965c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b219530-9c", "ovs_interfaceid": "8b219530-9c17-4356-87ed-5a4901530c06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'size': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'encryption_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'guest_format': None, 'image_id': '078646fe-b504-41ed-a147-61072e903e51'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 10:49:12 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:49:12 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:49:12 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 10:49:12 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] CPU controller missing on host. {{(pid=71113) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 10:49:12 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 10:49:12 user nova-compute[71113]: DEBUG nova.virt.libvirt.host [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] CPU controller found on host. {{(pid=71113) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 10:49:12 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71113) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 10:49:12 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T09:42:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T09:42:24Z,direct_url=<?>,disk_format='qcow2',id=078646fe-b504-41ed-a147-61072e903e51,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='afca600337e543019324e69e8944cdaf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T09:42:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 10:49:12 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Flavor limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 10:49:12 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Image limits 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 10:49:12 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Flavor pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 10:49:12 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Image pref 0:0:0 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 10:49:12 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71113) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 10:49:12 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 10:49:12 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 10:49:12 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Got 1 possible topologies {{(pid=71113) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 10:49:12 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 10:49:12 user nova-compute[71113]: DEBUG nova.virt.hardware [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71113) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 10:49:12 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:49:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-467167289',display_name='tempest-SnapshotDataIntegrityTests-server-467167289',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-467167289',id=52,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8sGLo4E+TX85UNhmU5UdajJ9JNrvzw0h5h/1cllehs2+2KeQSy2YqLGJIjPkzGo5ZCCJeC7PWcMigjSUAW3JUFRHEbqIwukFwq7psBPLejORVOD5lfdWZWzPbR0uzAfQ==',key_name='tempest-keypair-1216705995',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3be39a4fc3dd42dd8dff2cf645bb965c',ramdisk_id='',reservation_id='r-yw6tejkd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1575059451',owner_user_name='tempest-SnapshotDataIntegrityTests-1575059451-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T10:49:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c7878cab2cea4803bdc7a9db8b104bc1',uuid=03ff6317-3626-4caf-9ddf-cc310aee964a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b219530-9c17-4356-87ed-5a4901530c06", "address": "fa:16:3e:d1:3d:5b", "network": {"id": "f5e8d70f-0f94-435a-90f1-1c947305393d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2088935103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be39a4fc3dd42dd8dff2cf645bb965c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b219530-9c", "ovs_interfaceid": "8b219530-9c17-4356-87ed-5a4901530c06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71113) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 10:49:12 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Converting VIF {"id": "8b219530-9c17-4356-87ed-5a4901530c06", "address": "fa:16:3e:d1:3d:5b", "network": {"id": "f5e8d70f-0f94-435a-90f1-1c947305393d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2088935103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be39a4fc3dd42dd8dff2cf645bb965c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b219530-9c", "ovs_interfaceid": "8b219530-9c17-4356-87ed-5a4901530c06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:49:12 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:3d:5b,bridge_name='br-int',has_traffic_filtering=True,id=8b219530-9c17-4356-87ed-5a4901530c06,network=Network(f5e8d70f-0f94-435a-90f1-1c947305393d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b219530-9c') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:49:12 user nova-compute[71113]: DEBUG nova.objects.instance [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lazy-loading 'pci_devices' on Instance uuid 03ff6317-3626-4caf-9ddf-cc310aee964a {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:49:12 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] End _get_guest_xml xml=<domain type="kvm">
Jul 31 10:49:12 user nova-compute[71113]:   <uuid>03ff6317-3626-4caf-9ddf-cc310aee964a</uuid>
Jul 31 10:49:12 user nova-compute[71113]:   <name>instance-00000034</name>
Jul 31 10:49:12 user nova-compute[71113]:   <memory>524288</memory>
Jul 31 10:49:12 user nova-compute[71113]:   <vcpu>1</vcpu>
Jul 31 10:49:12 user nova-compute[71113]:   <metadata>
Jul 31 10:49:12 user nova-compute[71113]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 10:49:12 user nova-compute[71113]:       <nova:package version="0.0.0"/>
Jul 31 10:49:12 user nova-compute[71113]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-467167289</nova:name>
Jul 31 10:49:12 user nova-compute[71113]:       <nova:creationTime>2023-07-31 10:49:12</nova:creationTime>
Jul 31 10:49:12 user nova-compute[71113]:       <nova:flavor name="m1.tiny">
Jul 31 10:49:12 user nova-compute[71113]:         <nova:memory>512</nova:memory>
Jul 31 10:49:12 user nova-compute[71113]:         <nova:disk>1</nova:disk>
Jul 31 10:49:12 user nova-compute[71113]:         <nova:swap>0</nova:swap>
Jul 31 10:49:12 user nova-compute[71113]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 10:49:12 user nova-compute[71113]:         <nova:vcpus>1</nova:vcpus>
Jul 31 10:49:12 user nova-compute[71113]:       </nova:flavor>
Jul 31 10:49:12 user nova-compute[71113]:       <nova:owner>
Jul 31 10:49:12 user nova-compute[71113]:         <nova:user uuid="c7878cab2cea4803bdc7a9db8b104bc1">tempest-SnapshotDataIntegrityTests-1575059451-project-member</nova:user>
Jul 31 10:49:12 user nova-compute[71113]:         <nova:project uuid="3be39a4fc3dd42dd8dff2cf645bb965c">tempest-SnapshotDataIntegrityTests-1575059451</nova:project>
Jul 31 10:49:12 user nova-compute[71113]:       </nova:owner>
Jul 31 10:49:12 user nova-compute[71113]:       <nova:root type="image" uuid="078646fe-b504-41ed-a147-61072e903e51"/>
Jul 31 10:49:12 user nova-compute[71113]:       <nova:ports>
Jul 31 10:49:12 user nova-compute[71113]:         <nova:port uuid="8b219530-9c17-4356-87ed-5a4901530c06">
Jul 31 10:49:12 user nova-compute[71113]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 31 10:49:12 user nova-compute[71113]:         </nova:port>
Jul 31 10:49:12 user nova-compute[71113]:       </nova:ports>
Jul 31 10:49:12 user nova-compute[71113]:     </nova:instance>
Jul 31 10:49:12 user nova-compute[71113]:   </metadata>
Jul 31 10:49:12 user nova-compute[71113]:   <sysinfo type="smbios">
Jul 31 10:49:12 user nova-compute[71113]:     <system>
Jul 31 10:49:12 user nova-compute[71113]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 10:49:12 user nova-compute[71113]:       <entry name="product">OpenStack Nova</entry>
Jul 31 10:49:12 user nova-compute[71113]:       <entry name="version">0.0.0</entry>
Jul 31 10:49:12 user nova-compute[71113]:       <entry name="serial">03ff6317-3626-4caf-9ddf-cc310aee964a</entry>
Jul 31 10:49:12 user nova-compute[71113]:       <entry name="uuid">03ff6317-3626-4caf-9ddf-cc310aee964a</entry>
Jul 31 10:49:12 user nova-compute[71113]:       <entry name="family">Virtual Machine</entry>
Jul 31 10:49:12 user nova-compute[71113]:     </system>
Jul 31 10:49:12 user nova-compute[71113]:   </sysinfo>
Jul 31 10:49:12 user nova-compute[71113]:   <os>
Jul 31 10:49:12 user nova-compute[71113]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 10:49:12 user nova-compute[71113]:     <boot dev="hd"/>
Jul 31 10:49:12 user nova-compute[71113]:     <smbios mode="sysinfo"/>
Jul 31 10:49:12 user nova-compute[71113]:   </os>
Jul 31 10:49:12 user nova-compute[71113]:   <features>
Jul 31 10:49:12 user nova-compute[71113]:     <acpi/>
Jul 31 10:49:12 user nova-compute[71113]:     <apic/>
Jul 31 10:49:12 user nova-compute[71113]:     <vmcoreinfo/>
Jul 31 10:49:12 user nova-compute[71113]:   </features>
Jul 31 10:49:12 user nova-compute[71113]:   <clock offset="utc">
Jul 31 10:49:12 user nova-compute[71113]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 10:49:12 user nova-compute[71113]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 10:49:12 user nova-compute[71113]:     <timer name="hpet" present="no"/>
Jul 31 10:49:12 user nova-compute[71113]:   </clock>
Jul 31 10:49:12 user nova-compute[71113]:   <cpu mode="custom" match="exact">
Jul 31 10:49:12 user nova-compute[71113]:     <model>Nehalem</model>
Jul 31 10:49:12 user nova-compute[71113]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 10:49:12 user nova-compute[71113]:   </cpu>
Jul 31 10:49:12 user nova-compute[71113]:   <devices>
Jul 31 10:49:12 user nova-compute[71113]:     <disk type="file" device="disk">
Jul 31 10:49:12 user nova-compute[71113]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 10:49:12 user nova-compute[71113]:       <source file="/opt/stack/data/nova/instances/03ff6317-3626-4caf-9ddf-cc310aee964a/disk"/>
Jul 31 10:49:12 user nova-compute[71113]:       <target dev="vda" bus="virtio"/>
Jul 31 10:49:12 user nova-compute[71113]:     </disk>
Jul 31 10:49:12 user nova-compute[71113]:     <interface type="ethernet">
Jul 31 10:49:12 user nova-compute[71113]:       <mac address="fa:16:3e:d1:3d:5b"/>
Jul 31 10:49:12 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:49:12 user nova-compute[71113]:       <mtu size="1442"/>
Jul 31 10:49:12 user nova-compute[71113]:       <target dev="tap8b219530-9c"/>
Jul 31 10:49:12 user nova-compute[71113]:     </interface>
Jul 31 10:49:12 user nova-compute[71113]:     <serial type="pty">
Jul 31 10:49:12 user nova-compute[71113]:       <log file="/opt/stack/data/nova/instances/03ff6317-3626-4caf-9ddf-cc310aee964a/console.log" append="off"/>
Jul 31 10:49:12 user nova-compute[71113]:     </serial>
Jul 31 10:49:12 user nova-compute[71113]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 10:49:12 user nova-compute[71113]:     <video>
Jul 31 10:49:12 user nova-compute[71113]:       <model type="virtio"/>
Jul 31 10:49:12 user nova-compute[71113]:     </video>
Jul 31 10:49:12 user nova-compute[71113]:     <rng model="virtio">
Jul 31 10:49:12 user nova-compute[71113]:       <backend model="random">/dev/urandom</backend>
Jul 31 10:49:12 user nova-compute[71113]:     </rng>
Jul 31 10:49:12 user nova-compute[71113]:     <controller type="usb" index="0" model="none"/>
Jul 31 10:49:12 user nova-compute[71113]:     <memballoon model="virtio">
Jul 31 10:49:12 user nova-compute[71113]:       <stats period="10"/>
Jul 31 10:49:12 user nova-compute[71113]:     </memballoon>
Jul 31 10:49:12 user nova-compute[71113]:   </devices>
Jul 31 10:49:12 user nova-compute[71113]: </domain>
Jul 31 10:49:12 user nova-compute[71113]:  {{(pid=71113) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 10:49:12 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:49:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-467167289',display_name='tempest-SnapshotDataIntegrityTests-server-467167289',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-467167289',id=52,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8sGLo4E+TX85UNhmU5UdajJ9JNrvzw0h5h/1cllehs2+2KeQSy2YqLGJIjPkzGo5ZCCJeC7PWcMigjSUAW3JUFRHEbqIwukFwq7psBPLejORVOD5lfdWZWzPbR0uzAfQ==',key_name='tempest-keypair-1216705995',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3be39a4fc3dd42dd8dff2cf645bb965c',ramdisk_id='',reservation_id='r-yw6tejkd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1575059451',owner_user_name='tempest-SnapshotDataIntegrityTests-1575059451-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T10:49:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c7878cab2cea4803bdc7a9db8b104bc1',uuid=03ff6317-3626-4caf-9ddf-cc310aee964a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b219530-9c17-4356-87ed-5a4901530c06", "address": "fa:16:3e:d1:3d:5b", "network": {"id": "f5e8d70f-0f94-435a-90f1-1c947305393d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2088935103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be39a4fc3dd42dd8dff2cf645bb965c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b219530-9c", "ovs_interfaceid": "8b219530-9c17-4356-87ed-5a4901530c06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 10:49:12 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Converting VIF {"id": "8b219530-9c17-4356-87ed-5a4901530c06", "address": "fa:16:3e:d1:3d:5b", "network": {"id": "f5e8d70f-0f94-435a-90f1-1c947305393d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2088935103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be39a4fc3dd42dd8dff2cf645bb965c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b219530-9c", "ovs_interfaceid": "8b219530-9c17-4356-87ed-5a4901530c06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:49:12 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:3d:5b,bridge_name='br-int',has_traffic_filtering=True,id=8b219530-9c17-4356-87ed-5a4901530c06,network=Network(f5e8d70f-0f94-435a-90f1-1c947305393d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b219530-9c') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:49:12 user nova-compute[71113]: DEBUG os_vif [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:3d:5b,bridge_name='br-int',has_traffic_filtering=True,id=8b219530-9c17-4356-87ed-5a4901530c06,network=Network(f5e8d70f-0f94-435a-90f1-1c947305393d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b219530-9c') {{(pid=71113) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 10:49:12 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:49:12 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:49:12 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 10:49:12 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:49:12 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b219530-9c, may_exist=True, interface_attrs={}) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:49:12 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8b219530-9c, col_values=(('external_ids', {'iface-id': '8b219530-9c17-4356-87ed-5a4901530c06', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:3d:5b', 'vm-uuid': '03ff6317-3626-4caf-9ddf-cc310aee964a'}),), if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:49:12 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:49:12 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:49:12 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:49:12 user nova-compute[71113]: INFO os_vif [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:3d:5b,bridge_name='br-int',has_traffic_filtering=True,id=8b219530-9c17-4356-87ed-5a4901530c06,network=Network(f5e8d70f-0f94-435a-90f1-1c947305393d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b219530-9c')
Jul 31 10:49:12 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:49:12 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] No VIF found with MAC fa:16:3e:d1:3d:5b, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 10:49:13 user nova-compute[71113]: DEBUG nova.compute.manager [req-36c1ac69-ff84-44d2-8f94-8a100c952e98 req-bf442da0-6a3d-43c9-8071-ca58210ef05b service nova] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Received event network-changed-8b219530-9c17-4356-87ed-5a4901530c06 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:49:13 user nova-compute[71113]: DEBUG nova.compute.manager [req-36c1ac69-ff84-44d2-8f94-8a100c952e98 req-bf442da0-6a3d-43c9-8071-ca58210ef05b service nova] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Refreshing instance network info cache due to event network-changed-8b219530-9c17-4356-87ed-5a4901530c06. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 10:49:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-36c1ac69-ff84-44d2-8f94-8a100c952e98 req-bf442da0-6a3d-43c9-8071-ca58210ef05b service nova] Acquiring lock "refresh_cache-03ff6317-3626-4caf-9ddf-cc310aee964a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:49:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-36c1ac69-ff84-44d2-8f94-8a100c952e98 req-bf442da0-6a3d-43c9-8071-ca58210ef05b service nova] Acquired lock "refresh_cache-03ff6317-3626-4caf-9ddf-cc310aee964a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:49:13 user nova-compute[71113]: DEBUG nova.network.neutron [req-36c1ac69-ff84-44d2-8f94-8a100c952e98 req-bf442da0-6a3d-43c9-8071-ca58210ef05b service nova] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Refreshing network info cache for port 8b219530-9c17-4356-87ed-5a4901530c06 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 10:49:13 user nova-compute[71113]: DEBUG nova.network.neutron [req-36c1ac69-ff84-44d2-8f94-8a100c952e98 req-bf442da0-6a3d-43c9-8071-ca58210ef05b service nova] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Updated VIF entry in instance network info cache for port 8b219530-9c17-4356-87ed-5a4901530c06. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 10:49:13 user nova-compute[71113]: DEBUG nova.network.neutron [req-36c1ac69-ff84-44d2-8f94-8a100c952e98 req-bf442da0-6a3d-43c9-8071-ca58210ef05b service nova] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Updating instance_info_cache with network_info: [{"id": "8b219530-9c17-4356-87ed-5a4901530c06", "address": "fa:16:3e:d1:3d:5b", "network": {"id": "f5e8d70f-0f94-435a-90f1-1c947305393d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2088935103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be39a4fc3dd42dd8dff2cf645bb965c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b219530-9c", "ovs_interfaceid": "8b219530-9c17-4356-87ed-5a4901530c06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:49:13 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-36c1ac69-ff84-44d2-8f94-8a100c952e98 req-bf442da0-6a3d-43c9-8071-ca58210ef05b service nova] Releasing lock "refresh_cache-03ff6317-3626-4caf-9ddf-cc310aee964a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:49:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:49:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:49:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:49:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:49:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:49:14 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:49:15 user nova-compute[71113]: DEBUG nova.compute.manager [req-345b0489-dcc7-4f55-9a97-34f18a4434ce req-245995bd-5778-4b45-b65a-0b86d99ec6c7 service nova] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Received event network-vif-plugged-8b219530-9c17-4356-87ed-5a4901530c06 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:49:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-345b0489-dcc7-4f55-9a97-34f18a4434ce req-245995bd-5778-4b45-b65a-0b86d99ec6c7 service nova] Acquiring lock "03ff6317-3626-4caf-9ddf-cc310aee964a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:49:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-345b0489-dcc7-4f55-9a97-34f18a4434ce req-245995bd-5778-4b45-b65a-0b86d99ec6c7 service nova] Lock "03ff6317-3626-4caf-9ddf-cc310aee964a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:49:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-345b0489-dcc7-4f55-9a97-34f18a4434ce req-245995bd-5778-4b45-b65a-0b86d99ec6c7 service nova] Lock "03ff6317-3626-4caf-9ddf-cc310aee964a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:49:15 user nova-compute[71113]: DEBUG nova.compute.manager [req-345b0489-dcc7-4f55-9a97-34f18a4434ce req-245995bd-5778-4b45-b65a-0b86d99ec6c7 service nova] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] No waiting events found dispatching network-vif-plugged-8b219530-9c17-4356-87ed-5a4901530c06 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:49:15 user nova-compute[71113]: WARNING nova.compute.manager [req-345b0489-dcc7-4f55-9a97-34f18a4434ce req-245995bd-5778-4b45-b65a-0b86d99ec6c7 service nova] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Received unexpected event network-vif-plugged-8b219530-9c17-4356-87ed-5a4901530c06 for instance with vm_state building and task_state spawning.
Jul 31 10:49:15 user nova-compute[71113]: DEBUG nova.compute.manager [req-345b0489-dcc7-4f55-9a97-34f18a4434ce req-245995bd-5778-4b45-b65a-0b86d99ec6c7 service nova] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Received event network-vif-plugged-8b219530-9c17-4356-87ed-5a4901530c06 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:49:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-345b0489-dcc7-4f55-9a97-34f18a4434ce req-245995bd-5778-4b45-b65a-0b86d99ec6c7 service nova] Acquiring lock "03ff6317-3626-4caf-9ddf-cc310aee964a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:49:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-345b0489-dcc7-4f55-9a97-34f18a4434ce req-245995bd-5778-4b45-b65a-0b86d99ec6c7 service nova] Lock "03ff6317-3626-4caf-9ddf-cc310aee964a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:49:15 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-345b0489-dcc7-4f55-9a97-34f18a4434ce req-245995bd-5778-4b45-b65a-0b86d99ec6c7 service nova] Lock "03ff6317-3626-4caf-9ddf-cc310aee964a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:49:15 user nova-compute[71113]: DEBUG nova.compute.manager [req-345b0489-dcc7-4f55-9a97-34f18a4434ce req-245995bd-5778-4b45-b65a-0b86d99ec6c7 service nova] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] No waiting events found dispatching network-vif-plugged-8b219530-9c17-4356-87ed-5a4901530c06 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:49:15 user nova-compute[71113]: WARNING nova.compute.manager [req-345b0489-dcc7-4f55-9a97-34f18a4434ce req-245995bd-5778-4b45-b65a-0b86d99ec6c7 service nova] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Received unexpected event network-vif-plugged-8b219530-9c17-4356-87ed-5a4901530c06 for instance with vm_state building and task_state spawning.
Jul 31 10:49:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:49:16 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690800556.678841, 03ff6317-3626-4caf-9ddf-cc310aee964a => Resumed> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:49:16 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] VM Resumed (Lifecycle Event)
Jul 31 10:49:16 user nova-compute[71113]: DEBUG nova.compute.manager [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Instance event wait completed in 0 seconds for  {{(pid=71113) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 10:49:16 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Guest created on hypervisor {{(pid=71113) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 10:49:16 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Instance spawned successfully.
Jul 31 10:49:16 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 10:49:16 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:49:16 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:49:16 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Found default for hw_cdrom_bus of ide {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:49:16 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Found default for hw_disk_bus of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:49:16 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Found default for hw_input_bus of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:49:16 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Found default for hw_pointer_model of None {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:49:16 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Found default for hw_video_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:49:16 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Found default for hw_vif_model of virtio {{(pid=71113) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 10:49:16 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 10:49:16 user nova-compute[71113]: DEBUG nova.virt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Emitting event <LifecycleEvent: 1690800556.6829212, 03ff6317-3626-4caf-9ddf-cc310aee964a => Started> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:49:16 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] VM Started (Lifecycle Event)
Jul 31 10:49:16 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:49:16 user nova-compute[71113]: DEBUG nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71113) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 10:49:16 user nova-compute[71113]: INFO nova.compute.manager [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 10:49:16 user nova-compute[71113]: INFO nova.compute.manager [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Took 6.68 seconds to spawn the instance on the hypervisor.
Jul 31 10:49:16 user nova-compute[71113]: DEBUG nova.compute.manager [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:49:16 user nova-compute[71113]: INFO nova.compute.manager [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Took 7.44 seconds to build instance.
Jul 31 10:49:16 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-465591bd-8607-421d-bc15-6dd6c5738d2d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "03ff6317-3626-4caf-9ddf-cc310aee964a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.560s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:49:17 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:49:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:49:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:49:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:49:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:49:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:49:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:49:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:49:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:49:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:49:46 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:49:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:49:49 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:49:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:49:54 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:49:56 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:49:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:49:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:49:56 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:49:56 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:49:56 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ff6317-3626-4caf-9ddf-cc310aee964a/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:49:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ff6317-3626-4caf-9ddf-cc310aee964a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:49:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ff6317-3626-4caf-9ddf-cc310aee964a/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:49:57 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ff6317-3626-4caf-9ddf-cc310aee964a/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:49:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:49:57 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:49:57 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:49:57 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=8752MB free_disk=25.13467788696289GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:49:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:49:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:49:57 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 03ff6317-3626-4caf-9ddf-cc310aee964a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:49:57 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:49:57 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:49:57 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:49:57 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:49:57 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:49:57 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.228s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:49:59 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:49:59 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:49:59 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Rebuilding the list of instances to heal {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 10:50:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "refresh_cache-03ff6317-3626-4caf-9ddf-cc310aee964a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:50:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquired lock "refresh_cache-03ff6317-3626-4caf-9ddf-cc310aee964a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:50:00 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Forcefully refreshing network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 10:50:00 user nova-compute[71113]: DEBUG nova.objects.instance [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lazy-loading 'info_cache' on Instance uuid 03ff6317-3626-4caf-9ddf-cc310aee964a {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:50:00 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Updating instance_info_cache with network_info: [{"id": "8b219530-9c17-4356-87ed-5a4901530c06", "address": "fa:16:3e:d1:3d:5b", "network": {"id": "f5e8d70f-0f94-435a-90f1-1c947305393d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2088935103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be39a4fc3dd42dd8dff2cf645bb965c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b219530-9c", "ovs_interfaceid": "8b219530-9c17-4356-87ed-5a4901530c06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:50:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Releasing lock "refresh_cache-03ff6317-3626-4caf-9ddf-cc310aee964a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:50:00 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Updated the network info_cache for instance {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 10:50:00 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:50:01 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:50:01 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:50:01 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:50:02 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:50:02 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:50:04 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:50:07 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:50:12 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:50:17 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:50:20 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:50:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:50:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:50:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:50:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:50:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:50:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:50:50 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:50:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:50:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:50:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:50:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:50:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:50:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:50:54 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:50:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:50:58 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:50:58 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:50:58 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:50:58 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:50:58 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:50:58 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ff6317-3626-4caf-9ddf-cc310aee964a/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:50:58 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ff6317-3626-4caf-9ddf-cc310aee964a/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:50:58 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ff6317-3626-4caf-9ddf-cc310aee964a/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:50:59 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ff6317-3626-4caf-9ddf-cc310aee964a/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:50:59 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:50:59 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:50:59 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=8829MB free_disk=25.133628845214844GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:50:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:50:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:50:59 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 03ff6317-3626-4caf-9ddf-cc310aee964a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:50:59 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:50:59 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:50:59 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:50:59 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:50:59 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:50:59 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.338s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:51:00 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:51:00 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:51:00 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Rebuilding the list of instances to heal {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 10:51:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "refresh_cache-03ff6317-3626-4caf-9ddf-cc310aee964a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:51:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquired lock "refresh_cache-03ff6317-3626-4caf-9ddf-cc310aee964a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:51:00 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Forcefully refreshing network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 10:51:00 user nova-compute[71113]: DEBUG nova.objects.instance [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lazy-loading 'info_cache' on Instance uuid 03ff6317-3626-4caf-9ddf-cc310aee964a {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:51:01 user nova-compute[71113]: DEBUG nova.compute.manager [req-55634f28-1ea5-49be-9e44-e04e4838f31e req-7acc76e8-43b3-4e89-b8ce-6b35dff973d9 service nova] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Received event network-changed-8b219530-9c17-4356-87ed-5a4901530c06 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:51:01 user nova-compute[71113]: DEBUG nova.compute.manager [req-55634f28-1ea5-49be-9e44-e04e4838f31e req-7acc76e8-43b3-4e89-b8ce-6b35dff973d9 service nova] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Refreshing instance network info cache due to event network-changed-8b219530-9c17-4356-87ed-5a4901530c06. {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 10:51:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-55634f28-1ea5-49be-9e44-e04e4838f31e req-7acc76e8-43b3-4e89-b8ce-6b35dff973d9 service nova] Acquiring lock "refresh_cache-03ff6317-3626-4caf-9ddf-cc310aee964a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:51:01 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:51:01 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Updating instance_info_cache with network_info: [{"id": "8b219530-9c17-4356-87ed-5a4901530c06", "address": "fa:16:3e:d1:3d:5b", "network": {"id": "f5e8d70f-0f94-435a-90f1-1c947305393d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2088935103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be39a4fc3dd42dd8dff2cf645bb965c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b219530-9c", "ovs_interfaceid": "8b219530-9c17-4356-87ed-5a4901530c06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:51:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Releasing lock "refresh_cache-03ff6317-3626-4caf-9ddf-cc310aee964a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:51:01 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Updated the network info_cache for instance {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 10:51:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-55634f28-1ea5-49be-9e44-e04e4838f31e req-7acc76e8-43b3-4e89-b8ce-6b35dff973d9 service nova] Acquired lock "refresh_cache-03ff6317-3626-4caf-9ddf-cc310aee964a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:51:01 user nova-compute[71113]: DEBUG nova.network.neutron [req-55634f28-1ea5-49be-9e44-e04e4838f31e req-7acc76e8-43b3-4e89-b8ce-6b35dff973d9 service nova] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Refreshing network info cache for port 8b219530-9c17-4356-87ed-5a4901530c06 {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 10:51:01 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:51:01 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:51:01 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:51:01 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:51:02 user nova-compute[71113]: DEBUG nova.network.neutron [req-55634f28-1ea5-49be-9e44-e04e4838f31e req-7acc76e8-43b3-4e89-b8ce-6b35dff973d9 service nova] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Updated VIF entry in instance network info cache for port 8b219530-9c17-4356-87ed-5a4901530c06. {{(pid=71113) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 10:51:02 user nova-compute[71113]: DEBUG nova.network.neutron [req-55634f28-1ea5-49be-9e44-e04e4838f31e req-7acc76e8-43b3-4e89-b8ce-6b35dff973d9 service nova] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Updating instance_info_cache with network_info: [{"id": "8b219530-9c17-4356-87ed-5a4901530c06", "address": "fa:16:3e:d1:3d:5b", "network": {"id": "f5e8d70f-0f94-435a-90f1-1c947305393d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2088935103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be39a4fc3dd42dd8dff2cf645bb965c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b219530-9c", "ovs_interfaceid": "8b219530-9c17-4356-87ed-5a4901530c06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:51:02 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-55634f28-1ea5-49be-9e44-e04e4838f31e req-7acc76e8-43b3-4e89-b8ce-6b35dff973d9 service nova] Releasing lock "refresh_cache-03ff6317-3626-4caf-9ddf-cc310aee964a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:51:02 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:51:02 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:51:04 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:51:05 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1af1992e-9f6a-40d0-95b8-c60d8110308a tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Acquiring lock "03ff6317-3626-4caf-9ddf-cc310aee964a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:51:05 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1af1992e-9f6a-40d0-95b8-c60d8110308a tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "03ff6317-3626-4caf-9ddf-cc310aee964a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:51:05 user nova-compute[71113]: DEBUG nova.objects.instance [None req-1af1992e-9f6a-40d0-95b8-c60d8110308a tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lazy-loading 'flavor' on Instance uuid 03ff6317-3626-4caf-9ddf-cc310aee964a {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:51:05 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1af1992e-9f6a-40d0-95b8-c60d8110308a tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "03ff6317-3626-4caf-9ddf-cc310aee964a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:51:05 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1af1992e-9f6a-40d0-95b8-c60d8110308a tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Acquiring lock "03ff6317-3626-4caf-9ddf-cc310aee964a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:51:05 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1af1992e-9f6a-40d0-95b8-c60d8110308a tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "03ff6317-3626-4caf-9ddf-cc310aee964a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:51:05 user nova-compute[71113]: INFO nova.compute.manager [None req-1af1992e-9f6a-40d0-95b8-c60d8110308a tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Attaching volume 2634c24a-611a-4f67-9c77-1b7c94d5e41e to /dev/vdb
Jul 31 10:51:05 user nova-compute[71113]: DEBUG os_brick.utils [None req-1af1992e-9f6a-40d0-95b8-c60d8110308a tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:51:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:51:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:51:05 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d4db77-1336-4f08-873f-c9b25c2abb32]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:51:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:51:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:51:05 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa18746-adb3-4f04-b8a4-f9f5eafa4d55]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:51:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:51:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:51:05 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[728705c6-837e-4823-bcd2-9782ed7b212e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:51:05 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[60407b3a-7ec2-4e0d-8d96-c1474892d5c4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:51:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-1af1992e-9f6a-40d0-95b8-c60d8110308a tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:51:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-1af1992e-9f6a-40d0-95b8-c60d8110308a tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 10:51:05 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1af1992e-9f6a-40d0-95b8-c60d8110308a tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 10:51:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:51:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 10:51:05 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 10:51:05 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b4afcb-a931-4976-bf76-6e102bd90bfc]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:51:05 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-1af1992e-9f6a-40d0-95b8-c60d8110308a tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 10:51:05 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-1af1992e-9f6a-40d0-95b8-c60d8110308a tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 10:51:05 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-1af1992e-9f6a-40d0-95b8-c60d8110308a tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 10:51:05 user nova-compute[71113]: DEBUG os_brick.utils [None req-1af1992e-9f6a-40d0-95b8-c60d8110308a tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:51:05 user nova-compute[71113]: DEBUG nova.virt.block_device [None req-1af1992e-9f6a-40d0-95b8-c60d8110308a tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Updating existing volume attachment record: f4b855fc-68d1-4cad-97d1-144df49e4090 {{(pid=71113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 10:51:06 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:51:07 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:51:11 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:51:12 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:51:12 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1af1992e-9f6a-40d0-95b8-c60d8110308a tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 10:51:12 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af1992e-9f6a-40d0-95b8-c60d8110308a tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2634c24a-611a-4f67-9c77-1b7c94d5e41e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eDBnzoVk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:51:12 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-1af1992e-9f6a-40d0-95b8-c60d8110308a tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:51:12 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-1af1992e-9f6a-40d0-95b8-c60d8110308a tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:51:12 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-1af1992e-9f6a-40d0-95b8-c60d8110308a tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:51:12 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-1af1992e-9f6a-40d0-95b8-c60d8110308a tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:51:12 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-1af1992e-9f6a-40d0-95b8-c60d8110308a tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2634c24a-611a-4f67-9c77-1b7c94d5e41e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:51:12 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-1af1992e-9f6a-40d0-95b8-c60d8110308a tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2634c24a-611a-4f67-9c77-1b7c94d5e41e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:51:12 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-1af1992e-9f6a-40d0-95b8-c60d8110308a tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 10:51:12 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2634c24a-611a-4f67-9c77-1b7c94d5e41e -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:51:12 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2634c24a-611a-4f67-9c77-1b7c94d5e41e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:51:12 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e65ae13-d199-400a-bcb9-b7898de1ba5c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:51:12 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af1992e-9f6a-40d0-95b8-c60d8110308a tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 10:51:12 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:51:12 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2634c24a-611a-4f67-9c77-1b7c94d5e41e -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:51:12 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2634c24a-611a-4f67-9c77-1b7c94d5e41e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:51:12 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf678694-eb4e-41c5-b6d0-788fcc258dca]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2634c24a-611a-4f67-9c77-1b7c94d5e41e] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:51:12 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af1992e-9f6a-40d0-95b8-c60d8110308a tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2634c24a-611a-4f67-9c77-1b7c94d5e41e] added
Jul 31 10:51:12 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:51:12 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2634c24a-611a-4f67-9c77-1b7c94d5e41e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:51:12 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2634c24a-611a-4f67-9c77-1b7c94d5e41e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:51:12 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3093879c-8337-43fa-a688-f4e64412db57]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:51:12 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af1992e-9f6a-40d0-95b8-c60d8110308a tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:51:12 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2634c24a-611a-4f67-9c77-1b7c94d5e41e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:51:12 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2634c24a-611a-4f67-9c77-1b7c94d5e41e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:51:12 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e128c157-a9da-4667-909c-e08a9733edd4]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:51:12 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af1992e-9f6a-40d0-95b8-c60d8110308a tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:51:12 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2634c24a-611a-4f67-9c77-1b7c94d5e41e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eDBnzoVk {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:51:12 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2634c24a-611a-4f67-9c77-1b7c94d5e41e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eDBnzoVk" returned: 0 in 0.025s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:51:12 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3ab233-5d9f-4ccc-b675-fee4132d6eb1]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:51:12 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af1992e-9f6a-40d0-95b8-c60d8110308a tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eDBnzoVk'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:51:12 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2634c24a-611a-4f67-9c77-1b7c94d5e41e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:51:12 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2634c24a-611a-4f67-9c77-1b7c94d5e41e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:51:12 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[660daf40-18a7-4626-a55e-92deeac96476]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:51:12 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af1992e-9f6a-40d0-95b8-c60d8110308a tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:51:12 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:51:12 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:51:12 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f0fb4d-bf44-495a-b37a-f6bde47a491a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:51:12 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af1992e-9f6a-40d0-95b8-c60d8110308a tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 31 10:51:12 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:51:12 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af1992e-9f6a-40d0-95b8-c60d8110308a tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 31 10:51:12 user nova-compute[71113]:  {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:51:12 user nova-compute[71113]: WARNING os_brick.initiator.connectors.iscsi [None req-1af1992e-9f6a-40d0-95b8-c60d8110308a tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 31 10:51:12 user nova-compute[71113]: 
Jul 31 10:51:12 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2634c24a-611a-4f67-9c77-1b7c94d5e41e -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:51:12 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2634c24a-611a-4f67-9c77-1b7c94d5e41e -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:51:12 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70e7e45-4b28-4a30-80a9-fba5ff63ba7c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2634c24a-611a-4f67-9c77-1b7c94d5e41e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2634c24a-611a-4f67-9c77-1b7c94d5e41e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:51:12 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af1992e-9f6a-40d0-95b8-c60d8110308a tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2634c24a-611a-4f67-9c77-1b7c94d5e41e, portal: 172.16.0.220,3260]
Jul 31 10:51:12 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:2634c24a-611a-4f67-9c77-1b7c94d5e41e, portal: 172.16.0.220,3260] successful.
Jul 31 10:51:12 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:51:12 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2634c24a-611a-4f67-9c77-1b7c94d5e41e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:51:12 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2634c24a-611a-4f67-9c77-1b7c94d5e41e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:51:12 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b61de3-3084-44fd-9701-99fca2916d44]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:51:12 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af1992e-9f6a-40d0-95b8-c60d8110308a tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:51:12 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:51:12 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:51:12 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[076da08a-136d-4835-b7bd-ac3fe6cce33a]: (4, ('tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2634c24a-611a-4f67-9c77-1b7c94d5e41e (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:51:12 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af1992e-9f6a-40d0-95b8-c60d8110308a tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2634c24a-611a-4f67-9c77-1b7c94d5e41e (non-flash)
Jul 31 10:51:12 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:51:12 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af1992e-9f6a-40d0-95b8-c60d8110308a tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsi session list stdout=tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2634c24a-611a-4f67-9c77-1b7c94d5e41e (non-flash)
Jul 31 10:51:12 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:51:12 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-1af1992e-9f6a-40d0-95b8-c60d8110308a tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2634c24a-611a-4f67-9c77-1b7c94d5e41e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:51:12 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af1992e-9f6a-40d0-95b8-c60d8110308a tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 10:51:12 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-1af1992e-9f6a-40d0-95b8-c60d8110308a tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] HCTL ('33', '-', '-', 0) found on session 66 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 10:51:12 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-1af1992e-9f6a-40d0-95b8-c60d8110308a tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 10:51:12 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:51:13 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:51:13 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9deae0-1893-4e0a-9956-71f0195aa72b]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:51:13 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-1af1992e-9f6a-40d0-95b8-c60d8110308a tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Searching for a device in session 66 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 10:51:13 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af1992e-9f6a-40d0-95b8-c60d8110308a tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eDBnzoVk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 10:51:14 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-1af1992e-9f6a-40d0-95b8-c60d8110308a tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:51:14 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af1992e-9f6a-40d0-95b8-c60d8110308a tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '23130613035363965', 'path': '/dev/sdb'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:51:14 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1af1992e-9f6a-40d0-95b8-c60d8110308a tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130613035363965', 'path': '/dev/sdb'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 10:51:14 user nova-compute[71113]: DEBUG nova.objects.instance [None req-1af1992e-9f6a-40d0-95b8-c60d8110308a tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lazy-loading 'flavor' on Instance uuid 03ff6317-3626-4caf-9ddf-cc310aee964a {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:51:14 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-1af1992e-9f6a-40d0-95b8-c60d8110308a tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 10:51:14 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:51:14 user nova-compute[71113]:   <source dev="/dev/sdb"/>
Jul 31 10:51:14 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 10:51:14 user nova-compute[71113]:   <serial>2634c24a-611a-4f67-9c77-1b7c94d5e41e</serial>
Jul 31 10:51:14 user nova-compute[71113]: </disk>
Jul 31 10:51:14 user nova-compute[71113]:  {{(pid=71113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 10:51:14 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-1af1992e-9f6a-40d0-95b8-c60d8110308a tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:51:14 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-1af1992e-9f6a-40d0-95b8-c60d8110308a tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:51:14 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-1af1992e-9f6a-40d0-95b8-c60d8110308a tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] No VIF found with MAC fa:16:3e:d1:3d:5b, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 10:51:14 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-1af1992e-9f6a-40d0-95b8-c60d8110308a tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "03ff6317-3626-4caf-9ddf-cc310aee964a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.890s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:51:14 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:51:16 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:51:17 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:51:21 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:51:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:51:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:51:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:51:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:51:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-aa40fed3-52fc-4992-b954-9aec18b1b708 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Acquiring lock "03ff6317-3626-4caf-9ddf-cc310aee964a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:51:31 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-aa40fed3-52fc-4992-b954-9aec18b1b708 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "03ff6317-3626-4caf-9ddf-cc310aee964a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:51:31 user nova-compute[71113]: INFO nova.compute.manager [None req-aa40fed3-52fc-4992-b954-9aec18b1b708 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Detaching volume 2634c24a-611a-4f67-9c77-1b7c94d5e41e
Jul 31 10:51:31 user nova-compute[71113]: INFO nova.virt.block_device [None req-aa40fed3-52fc-4992-b954-9aec18b1b708 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Attempting to driver detach volume 2634c24a-611a-4f67-9c77-1b7c94d5e41e from mountpoint /dev/vdb
Jul 31 10:51:31 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-aa40fed3-52fc-4992-b954-9aec18b1b708 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Attempting to detach device vdb from instance 03ff6317-3626-4caf-9ddf-cc310aee964a from the persistent domain config. {{(pid=71113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 10:51:31 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-aa40fed3-52fc-4992-b954-9aec18b1b708 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 10:51:31 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:51:31 user nova-compute[71113]:   <source dev="/dev/sdb"/>
Jul 31 10:51:31 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 10:51:31 user nova-compute[71113]:   <serial>2634c24a-611a-4f67-9c77-1b7c94d5e41e</serial>
Jul 31 10:51:31 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 10:51:31 user nova-compute[71113]: </disk>
Jul 31 10:51:31 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 10:51:31 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-aa40fed3-52fc-4992-b954-9aec18b1b708 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Successfully detached device vdb from instance 03ff6317-3626-4caf-9ddf-cc310aee964a from the persistent domain config.
Jul 31 10:51:31 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-aa40fed3-52fc-4992-b954-9aec18b1b708 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 03ff6317-3626-4caf-9ddf-cc310aee964a from the live domain config. {{(pid=71113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 10:51:31 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-aa40fed3-52fc-4992-b954-9aec18b1b708 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 10:51:31 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:51:31 user nova-compute[71113]:   <source dev="/dev/sdb"/>
Jul 31 10:51:31 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 10:51:31 user nova-compute[71113]:   <serial>2634c24a-611a-4f67-9c77-1b7c94d5e41e</serial>
Jul 31 10:51:31 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 10:51:31 user nova-compute[71113]: </disk>
Jul 31 10:51:31 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 10:51:32 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Received event <DeviceRemovedEvent: 1690800692.3949564, 03ff6317-3626-4caf-9ddf-cc310aee964a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71113) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 10:51:32 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-aa40fed3-52fc-4992-b954-9aec18b1b708 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 03ff6317-3626-4caf-9ddf-cc310aee964a {{(pid=71113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 10:51:32 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-aa40fed3-52fc-4992-b954-9aec18b1b708 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Successfully detached device vdb from instance 03ff6317-3626-4caf-9ddf-cc310aee964a from the live domain config.
Jul 31 10:51:32 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa40fed3-52fc-4992-b954-9aec18b1b708 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 10:51:32 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa40fed3-52fc-4992-b954-9aec18b1b708 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:2634c24a-611a-4f67-9c77-1b7c94d5e41e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eDBnzoVk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:51:32 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-aa40fed3-52fc-4992-b954-9aec18b1b708 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:51:32 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-aa40fed3-52fc-4992-b954-9aec18b1b708 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:51:32 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-aa40fed3-52fc-4992-b954-9aec18b1b708 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:51:32 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa40fed3-52fc-4992-b954-9aec18b1b708 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2634c24a-611a-4f67-9c77-1b7c94d5e41e', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 10:51:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:51:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:51:32 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c40cf8b-8b20-4fc2-b983-13cc017a82a3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2634c24a-611a-4f67-9c77-1b7c94d5e41e\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:51:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:51:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:51:32 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[45cb8348-58a7-4d31-b376-9f9362f9dc32]: (4, ('tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2634c24a-611a-4f67-9c77-1b7c94d5e41e (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:51:32 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa40fed3-52fc-4992-b954-9aec18b1b708 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2634c24a-611a-4f67-9c77-1b7c94d5e41e (non-flash)
Jul 31 10:51:32 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:51:32 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa40fed3-52fc-4992-b954-9aec18b1b708 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsi session list stdout=tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2634c24a-611a-4f67-9c77-1b7c94d5e41e (non-flash)
Jul 31 10:51:32 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:51:32 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa40fed3-52fc-4992-b954-9aec18b1b708 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f78f04ee5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2634c24a-611a-4f67-9c77-1b7c94d5e41e'): ({'sdb'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 10:51:32 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-aa40fed3-52fc-4992-b954-9aec18b1b708 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Removing single pathed devices sdb {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 10:51:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:51:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:51:32 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f11e4d-9cde-46af-ad9c-b2a096cd7d69]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:51:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:51:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:51:32 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4cad31-2e55-48d8-9dd2-fa369271d614]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:51:32 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-aa40fed3-52fc-4992-b954-9aec18b1b708 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Flushing IO for device /dev/sdb {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 10:51:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:51:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:51:32 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[952beb55-e289-41a3-b93a-011e61658b7a]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:51:32 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-aa40fed3-52fc-4992-b954-9aec18b1b708 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 10:51:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:51:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:51:32 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35389aa-987d-426e-b560-89054e0e738f]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:51:32 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-aa40fed3-52fc-4992-b954-9aec18b1b708 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 10:51:32 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-aa40fed3-52fc-4992-b954-9aec18b1b708 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] SCSI volumes sdb have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 10:51:32 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa40fed3-52fc-4992-b954-9aec18b1b708 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2634c24a-611a-4f67-9c77-1b7c94d5e41e')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 10:51:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2634c24a-611a-4f67-9c77-1b7c94d5e41e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:51:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2634c24a-611a-4f67-9c77-1b7c94d5e41e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:51:32 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f851da-b973-4dd7-b8bd-f8161df4c37d]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:51:32 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa40fed3-52fc-4992-b954-9aec18b1b708 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:51:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2634c24a-611a-4f67-9c77-1b7c94d5e41e -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:51:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2634c24a-611a-4f67-9c77-1b7c94d5e41e -p 172.16.0.220:3260 --logout" returned: 0 in 0.039s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:51:32 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee32d704-85a0-4295-a927-43139b7f72d5]: (4, ('Logging out of session [sid: 66, target: iqn.2010-10.org.openstack:2634c24a-611a-4f67-9c77-1b7c94d5e41e, portal: 172.16.0.220,3260]\nLogout of [sid: 66, target: iqn.2010-10.org.openstack:2634c24a-611a-4f67-9c77-1b7c94d5e41e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:51:32 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa40fed3-52fc-4992-b954-9aec18b1b708 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 66, target: iqn.2010-10.org.openstack:2634c24a-611a-4f67-9c77-1b7c94d5e41e, portal: 172.16.0.220,3260]
Jul 31 10:51:32 user nova-compute[71113]: Logout of [sid: 66, target: iqn.2010-10.org.openstack:2634c24a-611a-4f67-9c77-1b7c94d5e41e, portal: 172.16.0.220,3260] successful.
Jul 31 10:51:32 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:51:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2634c24a-611a-4f67-9c77-1b7c94d5e41e -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:51:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2634c24a-611a-4f67-9c77-1b7c94d5e41e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:51:32 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4be4d5f-8b31-423c-9d81-acd1c2c54d38]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:51:32 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa40fed3-52fc-4992-b954-9aec18b1b708 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:51:32 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-aa40fed3-52fc-4992-b954-9aec18b1b708 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.242s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:51:32 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa40fed3-52fc-4992-b954-9aec18b1b708 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] <== disconnect_volume: return (243ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:51:32 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa40fed3-52fc-4992-b954-9aec18b1b708 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 10:51:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:51:33 user nova-compute[71113]: DEBUG nova.objects.instance [None req-aa40fed3-52fc-4992-b954-9aec18b1b708 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lazy-loading 'flavor' on Instance uuid 03ff6317-3626-4caf-9ddf-cc310aee964a {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:51:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-aa40fed3-52fc-4992-b954-9aec18b1b708 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "03ff6317-3626-4caf-9ddf-cc310aee964a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.567s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:51:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:51:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:51:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:51:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:51:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:51:52 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:51:56 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:51:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:51:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:51:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:51:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:51:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:51:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:51:59 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:52:00 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:52:00 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:52:00 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Rebuilding the list of instances to heal {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 10:52:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "refresh_cache-03ff6317-3626-4caf-9ddf-cc310aee964a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:52:00 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquired lock "refresh_cache-03ff6317-3626-4caf-9ddf-cc310aee964a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:52:00 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Forcefully refreshing network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 10:52:00 user nova-compute[71113]: DEBUG nova.objects.instance [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lazy-loading 'info_cache' on Instance uuid 03ff6317-3626-4caf-9ddf-cc310aee964a {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:52:01 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Updating instance_info_cache with network_info: [{"id": "8b219530-9c17-4356-87ed-5a4901530c06", "address": "fa:16:3e:d1:3d:5b", "network": {"id": "f5e8d70f-0f94-435a-90f1-1c947305393d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2088935103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be39a4fc3dd42dd8dff2cf645bb965c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b219530-9c", "ovs_interfaceid": "8b219530-9c17-4356-87ed-5a4901530c06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:52:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Releasing lock "refresh_cache-03ff6317-3626-4caf-9ddf-cc310aee964a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:52:01 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Updated the network info_cache for instance {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 10:52:01 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:52:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:52:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:52:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:52:01 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:52:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ff6317-3626-4caf-9ddf-cc310aee964a/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:52:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ff6317-3626-4caf-9ddf-cc310aee964a/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:52:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ff6317-3626-4caf-9ddf-cc310aee964a/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:52:01 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ff6317-3626-4caf-9ddf-cc310aee964a/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:52:02 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:52:02 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:52:02 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=8835MB free_disk=25.132205963134766GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:52:02 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:52:02 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:52:02 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 03ff6317-3626-4caf-9ddf-cc310aee964a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:52:02 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:52:02 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:52:02 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:52:02 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:52:02 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:52:02 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.168s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:52:02 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:52:03 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:52:03 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:52:03 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:52:04 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:52:04 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:52:07 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:52:12 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:52:17 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:52:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:52:24 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f298c4ab-f3ab-4d26-bf37-8270079b3ec7 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Acquiring lock "03ff6317-3626-4caf-9ddf-cc310aee964a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:52:24 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f298c4ab-f3ab-4d26-bf37-8270079b3ec7 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "03ff6317-3626-4caf-9ddf-cc310aee964a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:52:24 user nova-compute[71113]: DEBUG nova.objects.instance [None req-f298c4ab-f3ab-4d26-bf37-8270079b3ec7 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lazy-loading 'flavor' on Instance uuid 03ff6317-3626-4caf-9ddf-cc310aee964a {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:52:24 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f298c4ab-f3ab-4d26-bf37-8270079b3ec7 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "03ff6317-3626-4caf-9ddf-cc310aee964a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:52:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f298c4ab-f3ab-4d26-bf37-8270079b3ec7 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Acquiring lock "03ff6317-3626-4caf-9ddf-cc310aee964a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:52:25 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f298c4ab-f3ab-4d26-bf37-8270079b3ec7 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "03ff6317-3626-4caf-9ddf-cc310aee964a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:52:25 user nova-compute[71113]: INFO nova.compute.manager [None req-f298c4ab-f3ab-4d26-bf37-8270079b3ec7 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Attaching volume 22690480-0cf4-49e4-8cff-7814576e3d11 to /dev/vdb
Jul 31 10:52:25 user nova-compute[71113]: DEBUG os_brick.utils [None req-f298c4ab-f3ab-4d26-bf37-8270079b3ec7 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:52:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:52:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:52:25 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb102d4e-0504-43b3-9989-dd05ea5229e2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:52:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:52:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:52:25 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a86c13c-893c-4b8f-8840-5b38e5eafa8c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:52:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:52:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:52:25 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e2bcc7-96b4-42b8-8472-fc1070c22316]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:52:25 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99dc746-c87d-4288-857f-76d6a8310add]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:52:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-f298c4ab-f3ab-4d26-bf37-8270079b3ec7 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:52:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-f298c4ab-f3ab-4d26-bf37-8270079b3ec7 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 10:52:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f298c4ab-f3ab-4d26-bf37-8270079b3ec7 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 10:52:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:52:25 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 10:52:25 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 10:52:25 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c244e029-b916-453a-8501-f6a76004ae81]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:52:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-f298c4ab-f3ab-4d26-bf37-8270079b3ec7 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 10:52:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-f298c4ab-f3ab-4d26-bf37-8270079b3ec7 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 10:52:25 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-f298c4ab-f3ab-4d26-bf37-8270079b3ec7 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 10:52:25 user nova-compute[71113]: DEBUG os_brick.utils [None req-f298c4ab-f3ab-4d26-bf37-8270079b3ec7 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:52:25 user nova-compute[71113]: DEBUG nova.virt.block_device [None req-f298c4ab-f3ab-4d26-bf37-8270079b3ec7 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Updating existing volume attachment record: 2094c428-81ea-4b14-bdbf-b35d3349d309 {{(pid=71113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 10:52:26 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:52:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:52:32 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f298c4ab-f3ab-4d26-bf37-8270079b3ec7 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 10:52:32 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f298c4ab-f3ab-4d26-bf37-8270079b3ec7 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:22690480-0cf4-49e4-8cff-7814576e3d11'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tlmUEdxb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:52:32 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-f298c4ab-f3ab-4d26-bf37-8270079b3ec7 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:52:32 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-f298c4ab-f3ab-4d26-bf37-8270079b3ec7 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:52:32 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-f298c4ab-f3ab-4d26-bf37-8270079b3ec7 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:52:32 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-f298c4ab-f3ab-4d26-bf37-8270079b3ec7 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:52:32 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-f298c4ab-f3ab-4d26-bf37-8270079b3ec7 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22690480-0cf4-49e4-8cff-7814576e3d11" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:52:32 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-f298c4ab-f3ab-4d26-bf37-8270079b3ec7 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22690480-0cf4-49e4-8cff-7814576e3d11" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:52:32 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-f298c4ab-f3ab-4d26-bf37-8270079b3ec7 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 10:52:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22690480-0cf4-49e4-8cff-7814576e3d11 -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:52:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22690480-0cf4-49e4-8cff-7814576e3d11 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:52:32 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7bc48ac-7d13-43ab-aa7f-1dcd6968b119]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:52:32 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f298c4ab-f3ab-4d26-bf37-8270079b3ec7 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 10:52:32 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:52:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22690480-0cf4-49e4-8cff-7814576e3d11 -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:52:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22690480-0cf4-49e4-8cff-7814576e3d11 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:52:32 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4a4242-c823-4700-be27-db98e5215b5b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22690480-0cf4-49e4-8cff-7814576e3d11] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:52:32 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f298c4ab-f3ab-4d26-bf37-8270079b3ec7 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22690480-0cf4-49e4-8cff-7814576e3d11] added
Jul 31 10:52:32 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:52:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22690480-0cf4-49e4-8cff-7814576e3d11 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:52:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22690480-0cf4-49e4-8cff-7814576e3d11 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:52:32 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[367cbf86-0ff6-4fc3-945a-1e9e0aa37f6b]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:52:32 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f298c4ab-f3ab-4d26-bf37-8270079b3ec7 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:52:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22690480-0cf4-49e4-8cff-7814576e3d11 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:52:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22690480-0cf4-49e4-8cff-7814576e3d11 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:52:32 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[362ba4db-bc33-4301-82a8-e93c94735afa]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:52:32 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f298c4ab-f3ab-4d26-bf37-8270079b3ec7 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:52:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22690480-0cf4-49e4-8cff-7814576e3d11 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tlmUEdxb {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:52:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22690480-0cf4-49e4-8cff-7814576e3d11 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tlmUEdxb" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:52:32 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2cd2c2-673a-4b09-a0aa-fb3d6b2cad8f]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:52:32 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f298c4ab-f3ab-4d26-bf37-8270079b3ec7 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tlmUEdxb'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:52:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22690480-0cf4-49e4-8cff-7814576e3d11 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:52:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22690480-0cf4-49e4-8cff-7814576e3d11 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:52:32 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75b6615-7301-455f-8b82-1a80cbaf4f17]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:52:32 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f298c4ab-f3ab-4d26-bf37-8270079b3ec7 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:52:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:52:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:52:32 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b80068-8222-4b2d-81ac-ac6bead4dbde]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:52:32 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f298c4ab-f3ab-4d26-bf37-8270079b3ec7 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 31 10:52:32 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:52:32 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f298c4ab-f3ab-4d26-bf37-8270079b3ec7 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 31 10:52:32 user nova-compute[71113]:  {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:52:32 user nova-compute[71113]: WARNING os_brick.initiator.connectors.iscsi [None req-f298c4ab-f3ab-4d26-bf37-8270079b3ec7 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 31 10:52:32 user nova-compute[71113]: 
Jul 31 10:52:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22690480-0cf4-49e4-8cff-7814576e3d11 -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:52:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22690480-0cf4-49e4-8cff-7814576e3d11 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:52:32 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1c16af-5ebf-47ac-85de-1c614259ce20]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:22690480-0cf4-49e4-8cff-7814576e3d11, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:22690480-0cf4-49e4-8cff-7814576e3d11, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:52:32 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f298c4ab-f3ab-4d26-bf37-8270079b3ec7 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:22690480-0cf4-49e4-8cff-7814576e3d11, portal: 172.16.0.220,3260]
Jul 31 10:52:32 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:22690480-0cf4-49e4-8cff-7814576e3d11, portal: 172.16.0.220,3260] successful.
Jul 31 10:52:32 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:52:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22690480-0cf4-49e4-8cff-7814576e3d11 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:52:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22690480-0cf4-49e4-8cff-7814576e3d11 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:52:32 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4d766e-1adf-4dba-9380-26ec2b213aae]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:52:32 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f298c4ab-f3ab-4d26-bf37-8270079b3ec7 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:52:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:52:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:52:32 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80e06e3-f16d-461d-abe3-238f3964b6aa]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22690480-0cf4-49e4-8cff-7814576e3d11 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:52:32 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f298c4ab-f3ab-4d26-bf37-8270079b3ec7 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22690480-0cf4-49e4-8cff-7814576e3d11 (non-flash)
Jul 31 10:52:32 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:52:32 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f298c4ab-f3ab-4d26-bf37-8270079b3ec7 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22690480-0cf4-49e4-8cff-7814576e3d11 (non-flash)
Jul 31 10:52:32 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:52:32 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-f298c4ab-f3ab-4d26-bf37-8270079b3ec7 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22690480-0cf4-49e4-8cff-7814576e3d11" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:52:32 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f298c4ab-f3ab-4d26-bf37-8270079b3ec7 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 10:52:32 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-f298c4ab-f3ab-4d26-bf37-8270079b3ec7 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 10:52:32 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-f298c4ab-f3ab-4d26-bf37-8270079b3ec7 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 10:52:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:52:32 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:52:32 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbcc6351-dbf2-4ac3-9060-c2e00ed0daa1]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:52:32 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-f298c4ab-f3ab-4d26-bf37-8270079b3ec7 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 10:52:32 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f298c4ab-f3ab-4d26-bf37-8270079b3ec7 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tlmUEdxb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 10:52:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:52:33 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-f298c4ab-f3ab-4d26-bf37-8270079b3ec7 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:52:33 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-f298c4ab-f3ab-4d26-bf37-8270079b3ec7 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '26662356430623432', 'path': '/dev/sdb'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:52:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f298c4ab-f3ab-4d26-bf37-8270079b3ec7 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662356430623432', 'path': '/dev/sdb'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 10:52:33 user nova-compute[71113]: DEBUG nova.objects.instance [None req-f298c4ab-f3ab-4d26-bf37-8270079b3ec7 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lazy-loading 'flavor' on Instance uuid 03ff6317-3626-4caf-9ddf-cc310aee964a {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:52:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-f298c4ab-f3ab-4d26-bf37-8270079b3ec7 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 10:52:33 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:52:33 user nova-compute[71113]:   <source dev="/dev/sdb"/>
Jul 31 10:52:33 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 10:52:33 user nova-compute[71113]:   <serial>22690480-0cf4-49e4-8cff-7814576e3d11</serial>
Jul 31 10:52:33 user nova-compute[71113]: </disk>
Jul 31 10:52:33 user nova-compute[71113]:  {{(pid=71113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 10:52:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f298c4ab-f3ab-4d26-bf37-8270079b3ec7 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:52:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f298c4ab-f3ab-4d26-bf37-8270079b3ec7 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:52:33 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-f298c4ab-f3ab-4d26-bf37-8270079b3ec7 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] No VIF found with MAC fa:16:3e:d1:3d:5b, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 10:52:33 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-f298c4ab-f3ab-4d26-bf37-8270079b3ec7 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "03ff6317-3626-4caf-9ddf-cc310aee964a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.772s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:52:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:52:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-895c8144-63e2-4472-ab3b-d792a777c88d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Acquiring lock "03ff6317-3626-4caf-9ddf-cc310aee964a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:52:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-895c8144-63e2-4472-ab3b-d792a777c88d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "03ff6317-3626-4caf-9ddf-cc310aee964a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:52:36 user nova-compute[71113]: INFO nova.compute.manager [None req-895c8144-63e2-4472-ab3b-d792a777c88d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Detaching volume 22690480-0cf4-49e4-8cff-7814576e3d11
Jul 31 10:52:36 user nova-compute[71113]: INFO nova.virt.block_device [None req-895c8144-63e2-4472-ab3b-d792a777c88d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Attempting to driver detach volume 22690480-0cf4-49e4-8cff-7814576e3d11 from mountpoint /dev/vdb
Jul 31 10:52:36 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-895c8144-63e2-4472-ab3b-d792a777c88d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Attempting to detach device vdb from instance 03ff6317-3626-4caf-9ddf-cc310aee964a from the persistent domain config. {{(pid=71113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 10:52:36 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-895c8144-63e2-4472-ab3b-d792a777c88d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 10:52:36 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:52:36 user nova-compute[71113]:   <source dev="/dev/sdb"/>
Jul 31 10:52:36 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 10:52:36 user nova-compute[71113]:   <serial>22690480-0cf4-49e4-8cff-7814576e3d11</serial>
Jul 31 10:52:36 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 10:52:36 user nova-compute[71113]: </disk>
Jul 31 10:52:36 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 10:52:36 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-895c8144-63e2-4472-ab3b-d792a777c88d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Successfully detached device vdb from instance 03ff6317-3626-4caf-9ddf-cc310aee964a from the persistent domain config.
Jul 31 10:52:36 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-895c8144-63e2-4472-ab3b-d792a777c88d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 03ff6317-3626-4caf-9ddf-cc310aee964a from the live domain config. {{(pid=71113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 10:52:36 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-895c8144-63e2-4472-ab3b-d792a777c88d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 10:52:36 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:52:36 user nova-compute[71113]:   <source dev="/dev/sdb"/>
Jul 31 10:52:36 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 10:52:36 user nova-compute[71113]:   <serial>22690480-0cf4-49e4-8cff-7814576e3d11</serial>
Jul 31 10:52:36 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 10:52:36 user nova-compute[71113]: </disk>
Jul 31 10:52:36 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 10:52:36 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Received event <DeviceRemovedEvent: 1690800756.8567064, 03ff6317-3626-4caf-9ddf-cc310aee964a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71113) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 10:52:36 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-895c8144-63e2-4472-ab3b-d792a777c88d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 03ff6317-3626-4caf-9ddf-cc310aee964a {{(pid=71113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 10:52:36 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-895c8144-63e2-4472-ab3b-d792a777c88d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Successfully detached device vdb from instance 03ff6317-3626-4caf-9ddf-cc310aee964a from the live domain config.
Jul 31 10:52:36 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-895c8144-63e2-4472-ab3b-d792a777c88d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 10:52:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-895c8144-63e2-4472-ab3b-d792a777c88d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:22690480-0cf4-49e4-8cff-7814576e3d11'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tlmUEdxb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:52:36 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-895c8144-63e2-4472-ab3b-d792a777c88d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:52:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-895c8144-63e2-4472-ab3b-d792a777c88d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:52:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-895c8144-63e2-4472-ab3b-d792a777c88d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:52:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-895c8144-63e2-4472-ab3b-d792a777c88d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22690480-0cf4-49e4-8cff-7814576e3d11', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 10:52:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:52:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:52:36 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[354147c8-8300-483a-894a-747c763b1a58]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22690480-0cf4-49e4-8cff-7814576e3d11\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:52:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:52:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:52:36 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f21778-89d7-453e-9201-603ecf89f546]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22690480-0cf4-49e4-8cff-7814576e3d11 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:52:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-895c8144-63e2-4472-ab3b-d792a777c88d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22690480-0cf4-49e4-8cff-7814576e3d11 (non-flash)
Jul 31 10:52:36 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:52:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-895c8144-63e2-4472-ab3b-d792a777c88d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22690480-0cf4-49e4-8cff-7814576e3d11 (non-flash)
Jul 31 10:52:36 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:52:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-895c8144-63e2-4472-ab3b-d792a777c88d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f78f0765ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22690480-0cf4-49e4-8cff-7814576e3d11'): ({'sdb'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 10:52:36 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-895c8144-63e2-4472-ab3b-d792a777c88d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Removing single pathed devices sdb {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 10:52:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:52:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:52:36 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e16e7ac-4e61-49ce-956c-3e0ba5f34bbe]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:52:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:52:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:52:36 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c8a53b-c689-46a0-8fbf-0ab5008f34b0]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:52:36 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-895c8144-63e2-4472-ab3b-d792a777c88d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Flushing IO for device /dev/sdb {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 10:52:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:52:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:52:36 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a37586-a14f-4158-99a5-eea290513952]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:52:36 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-895c8144-63e2-4472-ab3b-d792a777c88d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 10:52:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:52:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:52:37 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2641c99-0e62-4ca2-8e10-a19757629c83]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:52:37 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-895c8144-63e2-4472-ab3b-d792a777c88d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 10:52:37 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-895c8144-63e2-4472-ab3b-d792a777c88d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] SCSI volumes sdb have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 10:52:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-895c8144-63e2-4472-ab3b-d792a777c88d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22690480-0cf4-49e4-8cff-7814576e3d11')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 10:52:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22690480-0cf4-49e4-8cff-7814576e3d11 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:52:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22690480-0cf4-49e4-8cff-7814576e3d11 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:52:37 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[961e0da8-af15-454d-9881-2261dd9fa579]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:52:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-895c8144-63e2-4472-ab3b-d792a777c88d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:52:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22690480-0cf4-49e4-8cff-7814576e3d11 -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:52:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22690480-0cf4-49e4-8cff-7814576e3d11 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:52:37 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6dfbabc-4984-4429-a0ce-f4668611d08a]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:22690480-0cf4-49e4-8cff-7814576e3d11, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:22690480-0cf4-49e4-8cff-7814576e3d11, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:52:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-895c8144-63e2-4472-ab3b-d792a777c88d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:22690480-0cf4-49e4-8cff-7814576e3d11, portal: 172.16.0.220,3260]
Jul 31 10:52:37 user nova-compute[71113]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:22690480-0cf4-49e4-8cff-7814576e3d11, portal: 172.16.0.220,3260] successful.
Jul 31 10:52:37 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:52:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22690480-0cf4-49e4-8cff-7814576e3d11 -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:52:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22690480-0cf4-49e4-8cff-7814576e3d11 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:52:37 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f67dae-961c-44b9-8c7b-1e149d5d2348]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:52:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-895c8144-63e2-4472-ab3b-d792a777c88d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:52:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-895c8144-63e2-4472-ab3b-d792a777c88d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.250s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:52:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-895c8144-63e2-4472-ab3b-d792a777c88d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] <== disconnect_volume: return (251ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:52:37 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-895c8144-63e2-4472-ab3b-d792a777c88d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 10:52:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:52:37 user nova-compute[71113]: DEBUG nova.objects.instance [None req-895c8144-63e2-4472-ab3b-d792a777c88d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lazy-loading 'flavor' on Instance uuid 03ff6317-3626-4caf-9ddf-cc310aee964a {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:52:37 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-895c8144-63e2-4472-ab3b-d792a777c88d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "03ff6317-3626-4caf-9ddf-cc310aee964a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.565s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:52:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:52:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:52:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:52:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:52:53 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:52:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:52:58 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:53:01 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:53:01 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:53:01 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Rebuilding the list of instances to heal {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 10:53:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "refresh_cache-03ff6317-3626-4caf-9ddf-cc310aee964a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:53:01 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquired lock "refresh_cache-03ff6317-3626-4caf-9ddf-cc310aee964a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:53:01 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Forcefully refreshing network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 10:53:01 user nova-compute[71113]: DEBUG nova.objects.instance [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lazy-loading 'info_cache' on Instance uuid 03ff6317-3626-4caf-9ddf-cc310aee964a {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:53:02 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:53:02 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:53:02 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:53:02 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:53:02 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:53:02 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:53:02 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Updating instance_info_cache with network_info: [{"id": "8b219530-9c17-4356-87ed-5a4901530c06", "address": "fa:16:3e:d1:3d:5b", "network": {"id": "f5e8d70f-0f94-435a-90f1-1c947305393d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2088935103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be39a4fc3dd42dd8dff2cf645bb965c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b219530-9c", "ovs_interfaceid": "8b219530-9c17-4356-87ed-5a4901530c06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:53:02 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Releasing lock "refresh_cache-03ff6317-3626-4caf-9ddf-cc310aee964a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:53:02 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Updated the network info_cache for instance {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 10:53:02 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:53:02 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:53:02 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:53:02 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:53:02 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:53:02 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:53:02 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ff6317-3626-4caf-9ddf-cc310aee964a/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:53:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ff6317-3626-4caf-9ddf-cc310aee964a/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:53:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ff6317-3626-4caf-9ddf-cc310aee964a/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:53:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ff6317-3626-4caf-9ddf-cc310aee964a/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:53:03 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:53:03 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:53:03 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=8825MB free_disk=25.131244659423828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:53:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:53:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:53:03 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 03ff6317-3626-4caf-9ddf-cc310aee964a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:53:03 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:53:03 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:53:03 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Refreshing inventories for resource provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 31 10:53:03 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Updating ProviderTree inventory for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 31 10:53:03 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Updating inventory in ProviderTree for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 31 10:53:03 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Refreshing aggregate associations for resource provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05, aggregates: None {{(pid=71113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 31 10:53:03 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Refreshing trait associations for resource provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_USB,COMPUTE_ACCELERATORS,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE2,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS {{(pid=71113) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 31 10:53:03 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:53:04 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:53:04 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:53:04 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.408s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:53:04 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:53:04 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:53:05 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:53:05 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:53:05 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:53:07 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:53:12 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:53:17 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:53:19 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:53:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:53:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:53:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ffb3ffd5-69e6-4c19-9002-c3760574d34d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Acquiring lock "03ff6317-3626-4caf-9ddf-cc310aee964a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:53:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ffb3ffd5-69e6-4c19-9002-c3760574d34d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "03ff6317-3626-4caf-9ddf-cc310aee964a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:53:30 user nova-compute[71113]: DEBUG nova.objects.instance [None req-ffb3ffd5-69e6-4c19-9002-c3760574d34d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lazy-loading 'flavor' on Instance uuid 03ff6317-3626-4caf-9ddf-cc310aee964a {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:53:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ffb3ffd5-69e6-4c19-9002-c3760574d34d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "03ff6317-3626-4caf-9ddf-cc310aee964a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:53:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ffb3ffd5-69e6-4c19-9002-c3760574d34d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Acquiring lock "03ff6317-3626-4caf-9ddf-cc310aee964a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:53:30 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ffb3ffd5-69e6-4c19-9002-c3760574d34d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "03ff6317-3626-4caf-9ddf-cc310aee964a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:53:30 user nova-compute[71113]: INFO nova.compute.manager [None req-ffb3ffd5-69e6-4c19-9002-c3760574d34d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Attaching volume 262fe639-15ed-4890-84af-1be457c75467 to /dev/vdb
Jul 31 10:53:30 user nova-compute[71113]: DEBUG os_brick.utils [None req-ffb3ffd5-69e6-4c19-9002-c3760574d34d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:53:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:53:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:53:30 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[76397778-6079-4da2-9a75-3a257124e4c0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:53:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:53:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:53:30 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[507529a4-d6af-4dd6-aded-441020cb85be]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:53:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:53:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:53:30 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[48546313-5539-4a1f-aea3-dc9808998788]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:53:30 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9aa2798-83a1-4116-9f43-2ea0766c3276]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:53:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ffb3ffd5-69e6-4c19-9002-c3760574d34d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:53:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-ffb3ffd5-69e6-4c19-9002-c3760574d34d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 10:53:30 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ffb3ffd5-69e6-4c19-9002-c3760574d34d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 10:53:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:53:30 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 10:53:30 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 10:53:30 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d13038a-6aa8-41ab-a4aa-9cd3e13601fc]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:53:30 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-ffb3ffd5-69e6-4c19-9002-c3760574d34d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 10:53:30 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-ffb3ffd5-69e6-4c19-9002-c3760574d34d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 10:53:30 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-ffb3ffd5-69e6-4c19-9002-c3760574d34d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 10:53:30 user nova-compute[71113]: DEBUG os_brick.utils [None req-ffb3ffd5-69e6-4c19-9002-c3760574d34d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:53:30 user nova-compute[71113]: DEBUG nova.virt.block_device [None req-ffb3ffd5-69e6-4c19-9002-c3760574d34d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Updating existing volume attachment record: 72bfc0ed-9d61-4b2c-9568-88520dcf75c3 {{(pid=71113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 10:53:31 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:53:32 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:53:32 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Cleaning up deleted instances {{(pid=71113) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 31 10:53:32 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] There are 0 instances to clean {{(pid=71113) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 31 10:53:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:53:33 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:53:33 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71113) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 31 10:53:35 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:53:37 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffb3ffd5-69e6-4c19-9002-c3760574d34d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 10:53:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffb3ffd5-69e6-4c19-9002-c3760574d34d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:262fe639-15ed-4890-84af-1be457c75467'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AzSmsCrT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:53:37 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-ffb3ffd5-69e6-4c19-9002-c3760574d34d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:53:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-ffb3ffd5-69e6-4c19-9002-c3760574d34d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:53:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-ffb3ffd5-69e6-4c19-9002-c3760574d34d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:53:37 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-ffb3ffd5-69e6-4c19-9002-c3760574d34d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:53:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-ffb3ffd5-69e6-4c19-9002-c3760574d34d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:262fe639-15ed-4890-84af-1be457c75467" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:53:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-ffb3ffd5-69e6-4c19-9002-c3760574d34d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:262fe639-15ed-4890-84af-1be457c75467" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:53:37 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-ffb3ffd5-69e6-4c19-9002-c3760574d34d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 10:53:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:262fe639-15ed-4890-84af-1be457c75467 -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:53:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:262fe639-15ed-4890-84af-1be457c75467 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:53:37 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e75de8e-de28-4837-b930-c028e7088493]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:53:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffb3ffd5-69e6-4c19-9002-c3760574d34d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 10:53:37 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:53:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:262fe639-15ed-4890-84af-1be457c75467 -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:53:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:262fe639-15ed-4890-84af-1be457c75467 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:53:37 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1320845e-3375-4994-8e12-17713f8557f7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:262fe639-15ed-4890-84af-1be457c75467] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:53:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffb3ffd5-69e6-4c19-9002-c3760574d34d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:262fe639-15ed-4890-84af-1be457c75467] added
Jul 31 10:53:37 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:53:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:262fe639-15ed-4890-84af-1be457c75467 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:53:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:262fe639-15ed-4890-84af-1be457c75467 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:53:37 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[42835d3c-e834-42ea-9ae0-fd79e3de9a98]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:53:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffb3ffd5-69e6-4c19-9002-c3760574d34d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:53:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:262fe639-15ed-4890-84af-1be457c75467 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:53:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:262fe639-15ed-4890-84af-1be457c75467 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:53:37 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1a33df-2d02-4d8e-bd57-e1954220c347]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:53:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffb3ffd5-69e6-4c19-9002-c3760574d34d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:53:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:262fe639-15ed-4890-84af-1be457c75467 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AzSmsCrT {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:53:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:262fe639-15ed-4890-84af-1be457c75467 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AzSmsCrT" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:53:37 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9820bbc3-a164-4b74-b5e5-080a58efdcab]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:53:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffb3ffd5-69e6-4c19-9002-c3760574d34d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AzSmsCrT'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:53:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:262fe639-15ed-4890-84af-1be457c75467 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:53:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:262fe639-15ed-4890-84af-1be457c75467 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:53:37 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb45ec1-4dd0-45da-81ab-56a7b1d4bb6c]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:53:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffb3ffd5-69e6-4c19-9002-c3760574d34d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:53:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:53:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:53:37 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d7212e-d0de-42cb-ba29-2d08ffd0eb40]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:53:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffb3ffd5-69e6-4c19-9002-c3760574d34d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 31 10:53:37 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:53:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffb3ffd5-69e6-4c19-9002-c3760574d34d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 31 10:53:37 user nova-compute[71113]:  {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:53:37 user nova-compute[71113]: WARNING os_brick.initiator.connectors.iscsi [None req-ffb3ffd5-69e6-4c19-9002-c3760574d34d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 31 10:53:37 user nova-compute[71113]: 
Jul 31 10:53:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:262fe639-15ed-4890-84af-1be457c75467 -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:53:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:262fe639-15ed-4890-84af-1be457c75467 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:53:37 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9148cc65-cd5a-4e7b-950b-b838896df717]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:262fe639-15ed-4890-84af-1be457c75467, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:262fe639-15ed-4890-84af-1be457c75467, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:53:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffb3ffd5-69e6-4c19-9002-c3760574d34d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:262fe639-15ed-4890-84af-1be457c75467, portal: 172.16.0.220,3260]
Jul 31 10:53:37 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:262fe639-15ed-4890-84af-1be457c75467, portal: 172.16.0.220,3260] successful.
Jul 31 10:53:37 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:53:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:262fe639-15ed-4890-84af-1be457c75467 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:53:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:262fe639-15ed-4890-84af-1be457c75467 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:53:37 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aebbc5f-120c-4a7c-be69-92f581355fab]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:53:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffb3ffd5-69e6-4c19-9002-c3760574d34d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:53:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:53:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:53:37 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[22332c8f-f631-4789-ae4c-480434489a12]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:262fe639-15ed-4890-84af-1be457c75467 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:53:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffb3ffd5-69e6-4c19-9002-c3760574d34d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:262fe639-15ed-4890-84af-1be457c75467 (non-flash)
Jul 31 10:53:37 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:53:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffb3ffd5-69e6-4c19-9002-c3760574d34d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:262fe639-15ed-4890-84af-1be457c75467 (non-flash)
Jul 31 10:53:37 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:53:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-ffb3ffd5-69e6-4c19-9002-c3760574d34d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:262fe639-15ed-4890-84af-1be457c75467" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:53:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffb3ffd5-69e6-4c19-9002-c3760574d34d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 10:53:37 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-ffb3ffd5-69e6-4c19-9002-c3760574d34d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 10:53:37 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-ffb3ffd5-69e6-4c19-9002-c3760574d34d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 10:53:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:53:37 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:53:37 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c01aa8-817b-4655-9d37-6f1116506735]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:53:37 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-ffb3ffd5-69e6-4c19-9002-c3760574d34d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 10:53:37 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffb3ffd5-69e6-4c19-9002-c3760574d34d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AzSmsCrT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 10:53:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:53:38 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-ffb3ffd5-69e6-4c19-9002-c3760574d34d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:53:38 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffb3ffd5-69e6-4c19-9002-c3760574d34d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '23831663261356335', 'path': '/dev/sdb'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:53:38 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffb3ffd5-69e6-4c19-9002-c3760574d34d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831663261356335', 'path': '/dev/sdb'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 10:53:38 user nova-compute[71113]: DEBUG nova.objects.instance [None req-ffb3ffd5-69e6-4c19-9002-c3760574d34d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lazy-loading 'flavor' on Instance uuid 03ff6317-3626-4caf-9ddf-cc310aee964a {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:53:38 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-ffb3ffd5-69e6-4c19-9002-c3760574d34d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 10:53:38 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:53:38 user nova-compute[71113]:   <source dev="/dev/sdb"/>
Jul 31 10:53:38 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 10:53:38 user nova-compute[71113]:   <serial>262fe639-15ed-4890-84af-1be457c75467</serial>
Jul 31 10:53:38 user nova-compute[71113]: </disk>
Jul 31 10:53:38 user nova-compute[71113]:  {{(pid=71113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 10:53:39 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ffb3ffd5-69e6-4c19-9002-c3760574d34d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:53:39 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ffb3ffd5-69e6-4c19-9002-c3760574d34d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:53:39 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-ffb3ffd5-69e6-4c19-9002-c3760574d34d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] No VIF found with MAC fa:16:3e:d1:3d:5b, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 10:53:39 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-ffb3ffd5-69e6-4c19-9002-c3760574d34d tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "03ff6317-3626-4caf-9ddf-cc310aee964a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.701s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:53:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:53:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-4b971f5e-46b0-4ef0-b041-fc9d48074710 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Acquiring lock "03ff6317-3626-4caf-9ddf-cc310aee964a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:53:41 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-4b971f5e-46b0-4ef0-b041-fc9d48074710 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "03ff6317-3626-4caf-9ddf-cc310aee964a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:53:41 user nova-compute[71113]: INFO nova.compute.manager [None req-4b971f5e-46b0-4ef0-b041-fc9d48074710 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Detaching volume 262fe639-15ed-4890-84af-1be457c75467
Jul 31 10:53:41 user nova-compute[71113]: INFO nova.virt.block_device [None req-4b971f5e-46b0-4ef0-b041-fc9d48074710 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Attempting to driver detach volume 262fe639-15ed-4890-84af-1be457c75467 from mountpoint /dev/vdb
Jul 31 10:53:41 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-4b971f5e-46b0-4ef0-b041-fc9d48074710 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Attempting to detach device vdb from instance 03ff6317-3626-4caf-9ddf-cc310aee964a from the persistent domain config. {{(pid=71113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 10:53:41 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-4b971f5e-46b0-4ef0-b041-fc9d48074710 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 10:53:41 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:53:41 user nova-compute[71113]:   <source dev="/dev/sdb"/>
Jul 31 10:53:41 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 10:53:41 user nova-compute[71113]:   <serial>262fe639-15ed-4890-84af-1be457c75467</serial>
Jul 31 10:53:41 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 10:53:41 user nova-compute[71113]: </disk>
Jul 31 10:53:41 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 10:53:41 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-4b971f5e-46b0-4ef0-b041-fc9d48074710 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Successfully detached device vdb from instance 03ff6317-3626-4caf-9ddf-cc310aee964a from the persistent domain config.
Jul 31 10:53:41 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-4b971f5e-46b0-4ef0-b041-fc9d48074710 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 03ff6317-3626-4caf-9ddf-cc310aee964a from the live domain config. {{(pid=71113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 10:53:41 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-4b971f5e-46b0-4ef0-b041-fc9d48074710 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 10:53:41 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:53:41 user nova-compute[71113]:   <source dev="/dev/sdb"/>
Jul 31 10:53:41 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 10:53:41 user nova-compute[71113]:   <serial>262fe639-15ed-4890-84af-1be457c75467</serial>
Jul 31 10:53:41 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 10:53:41 user nova-compute[71113]: </disk>
Jul 31 10:53:41 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 10:53:42 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Received event <DeviceRemovedEvent: 1690800822.3545127, 03ff6317-3626-4caf-9ddf-cc310aee964a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71113) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 10:53:42 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-4b971f5e-46b0-4ef0-b041-fc9d48074710 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 03ff6317-3626-4caf-9ddf-cc310aee964a {{(pid=71113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 10:53:42 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-4b971f5e-46b0-4ef0-b041-fc9d48074710 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Successfully detached device vdb from instance 03ff6317-3626-4caf-9ddf-cc310aee964a from the live domain config.
Jul 31 10:53:42 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b971f5e-46b0-4ef0-b041-fc9d48074710 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 10:53:42 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b971f5e-46b0-4ef0-b041-fc9d48074710 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:262fe639-15ed-4890-84af-1be457c75467'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AzSmsCrT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:53:42 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-4b971f5e-46b0-4ef0-b041-fc9d48074710 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:53:42 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-4b971f5e-46b0-4ef0-b041-fc9d48074710 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:53:42 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-4b971f5e-46b0-4ef0-b041-fc9d48074710 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:53:42 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b971f5e-46b0-4ef0-b041-fc9d48074710 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:262fe639-15ed-4890-84af-1be457c75467', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 10:53:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:53:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:53:42 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[46378ad1-5b06-4136-8c19-b75b45d13fa6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:262fe639-15ed-4890-84af-1be457c75467\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:53:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:53:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:53:42 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50c970a-a93b-483e-b20b-656d124c47e7]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:262fe639-15ed-4890-84af-1be457c75467 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:53:42 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b971f5e-46b0-4ef0-b041-fc9d48074710 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:262fe639-15ed-4890-84af-1be457c75467 (non-flash)
Jul 31 10:53:42 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:53:42 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b971f5e-46b0-4ef0-b041-fc9d48074710 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:262fe639-15ed-4890-84af-1be457c75467 (non-flash)
Jul 31 10:53:42 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:53:42 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b971f5e-46b0-4ef0-b041-fc9d48074710 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7908390280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:262fe639-15ed-4890-84af-1be457c75467'): ({'sdb'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 10:53:42 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-4b971f5e-46b0-4ef0-b041-fc9d48074710 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Removing single pathed devices sdb {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 10:53:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:53:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:53:42 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e3f5bc-bfe8-4672-a985-759de1bbd1d5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:53:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:53:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:53:42 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6464a167-3ad5-40bb-9e83-07b25ffb08b8]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:53:42 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-4b971f5e-46b0-4ef0-b041-fc9d48074710 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Flushing IO for device /dev/sdb {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 10:53:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:53:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:53:42 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fdbc516-fb2d-4109-a92a-5e809ce5453d]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:53:42 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-4b971f5e-46b0-4ef0-b041-fc9d48074710 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 10:53:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:53:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.246s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:53:42 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8687658-5edc-487f-a45a-289f3f11553e]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:53:42 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-4b971f5e-46b0-4ef0-b041-fc9d48074710 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 10:53:42 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-4b971f5e-46b0-4ef0-b041-fc9d48074710 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] SCSI volumes sdb have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 10:53:42 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b971f5e-46b0-4ef0-b041-fc9d48074710 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:262fe639-15ed-4890-84af-1be457c75467')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 10:53:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:262fe639-15ed-4890-84af-1be457c75467 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:53:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:262fe639-15ed-4890-84af-1be457c75467 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:53:42 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b189a59a-ea8d-4c81-9101-8c3f68e60daf]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:53:42 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b971f5e-46b0-4ef0-b041-fc9d48074710 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:53:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:262fe639-15ed-4890-84af-1be457c75467 -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:53:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:53:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:262fe639-15ed-4890-84af-1be457c75467 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:53:42 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32f7741-7061-4f98-90ea-6c7fddaf5805]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:262fe639-15ed-4890-84af-1be457c75467, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:262fe639-15ed-4890-84af-1be457c75467, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:53:42 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b971f5e-46b0-4ef0-b041-fc9d48074710 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:262fe639-15ed-4890-84af-1be457c75467, portal: 172.16.0.220,3260]
Jul 31 10:53:42 user nova-compute[71113]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:262fe639-15ed-4890-84af-1be457c75467, portal: 172.16.0.220,3260] successful.
Jul 31 10:53:42 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:53:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:262fe639-15ed-4890-84af-1be457c75467 -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:53:42 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:262fe639-15ed-4890-84af-1be457c75467 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:53:42 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b21f77-44e2-47fa-9023-bf56d7003f6e]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:53:42 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b971f5e-46b0-4ef0-b041-fc9d48074710 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:53:42 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-4b971f5e-46b0-4ef0-b041-fc9d48074710 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.462s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:53:42 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b971f5e-46b0-4ef0-b041-fc9d48074710 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] <== disconnect_volume: return (463ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:53:42 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b971f5e-46b0-4ef0-b041-fc9d48074710 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 10:53:43 user nova-compute[71113]: DEBUG nova.objects.instance [None req-4b971f5e-46b0-4ef0-b041-fc9d48074710 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lazy-loading 'flavor' on Instance uuid 03ff6317-3626-4caf-9ddf-cc310aee964a {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:53:43 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-4b971f5e-46b0-4ef0-b041-fc9d48074710 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "03ff6317-3626-4caf-9ddf-cc310aee964a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.724s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:53:46 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:53:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:53:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:53:54 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:53:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:54:00 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:54:01 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:54:02 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:54:02 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:54:02 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Rebuilding the list of instances to heal {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 10:54:02 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:54:02 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "refresh_cache-03ff6317-3626-4caf-9ddf-cc310aee964a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:54:02 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquired lock "refresh_cache-03ff6317-3626-4caf-9ddf-cc310aee964a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:54:02 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Forcefully refreshing network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 10:54:02 user nova-compute[71113]: DEBUG nova.objects.instance [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lazy-loading 'info_cache' on Instance uuid 03ff6317-3626-4caf-9ddf-cc310aee964a {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:54:03 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Updating instance_info_cache with network_info: [{"id": "8b219530-9c17-4356-87ed-5a4901530c06", "address": "fa:16:3e:d1:3d:5b", "network": {"id": "f5e8d70f-0f94-435a-90f1-1c947305393d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2088935103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be39a4fc3dd42dd8dff2cf645bb965c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b219530-9c", "ovs_interfaceid": "8b219530-9c17-4356-87ed-5a4901530c06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:54:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Releasing lock "refresh_cache-03ff6317-3626-4caf-9ddf-cc310aee964a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:54:03 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Updated the network info_cache for instance {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 10:54:03 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:54:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:54:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:54:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:54:03 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:54:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ff6317-3626-4caf-9ddf-cc310aee964a/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:54:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ff6317-3626-4caf-9ddf-cc310aee964a/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:54:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ff6317-3626-4caf-9ddf-cc310aee964a/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:54:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ff6317-3626-4caf-9ddf-cc310aee964a/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:54:04 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:54:04 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:54:04 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=8816MB free_disk=25.130168914794922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:54:04 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:54:04 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:54:04 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 03ff6317-3626-4caf-9ddf-cc310aee964a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:54:04 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:54:04 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:54:04 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:54:04 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:54:04 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:54:04 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.176s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:54:05 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:54:05 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:54:05 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:54:06 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:54:06 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:54:07 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:54:12 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:54:12 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:54:12 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Triggering sync for uuid 03ff6317-3626-4caf-9ddf-cc310aee964a {{(pid=71113) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 10:54:12 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "03ff6317-3626-4caf-9ddf-cc310aee964a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:54:12 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "03ff6317-3626-4caf-9ddf-cc310aee964a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:54:12 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "03ff6317-3626-4caf-9ddf-cc310aee964a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:54:17 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:54:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:54:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:54:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:54:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9464af71-b9c4-4d79-b687-c06519a050e2 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Acquiring lock "03ff6317-3626-4caf-9ddf-cc310aee964a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:54:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9464af71-b9c4-4d79-b687-c06519a050e2 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "03ff6317-3626-4caf-9ddf-cc310aee964a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:54:36 user nova-compute[71113]: DEBUG nova.objects.instance [None req-9464af71-b9c4-4d79-b687-c06519a050e2 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lazy-loading 'flavor' on Instance uuid 03ff6317-3626-4caf-9ddf-cc310aee964a {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:54:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9464af71-b9c4-4d79-b687-c06519a050e2 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "03ff6317-3626-4caf-9ddf-cc310aee964a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:54:36 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:54:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9464af71-b9c4-4d79-b687-c06519a050e2 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Acquiring lock "03ff6317-3626-4caf-9ddf-cc310aee964a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:54:36 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9464af71-b9c4-4d79-b687-c06519a050e2 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "03ff6317-3626-4caf-9ddf-cc310aee964a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:54:36 user nova-compute[71113]: INFO nova.compute.manager [None req-9464af71-b9c4-4d79-b687-c06519a050e2 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Attaching volume 27e39d58-c0e9-4a46-b230-7942adaf0bb2 to /dev/vdb
Jul 31 10:54:36 user nova-compute[71113]: DEBUG os_brick.utils [None req-9464af71-b9c4-4d79-b687-c06519a050e2 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:54:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:54:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:54:36 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2c698f-a4b0-478e-8019-bf61b22120e2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:25b522682bc\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:54:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:54:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:54:36 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0158365f-b456-4a90-8e2e-3a4483495da8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:54:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:54:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:54:36 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84e97e9-3664-4a48-a534-df1755eed3e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:54:36 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6aafa56-1a47-4480-8c73-98085023adb7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:54:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-9464af71-b9c4-4d79-b687-c06519a050e2 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Running cmd (subprocess): nvme version {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:54:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-9464af71-b9c4-4d79-b687-c06519a050e2 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] 'nvme version' failed. Not Retrying. {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 10:54:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9464af71-b9c4-4d79-b687-c06519a050e2 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] nvme not present on system {{(pid=71113) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 10:54:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:54:36 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 10:54:36 user nova-compute[71113]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 10:54:36 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[06617c26-8aff-4f9e-904d-62487c975b70]: (4, '') {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:54:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-9464af71-b9c4-4d79-b687-c06519a050e2 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71113) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 10:54:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-9464af71-b9c4-4d79-b687-c06519a050e2 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 10:54:36 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.lightos [None req-9464af71-b9c4-4d79-b687-c06519a050e2 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] LIGHTOS: no hostnqn found. {{(pid=71113) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 10:54:36 user nova-compute[71113]: DEBUG os_brick.utils [None req-9464af71-b9c4-4d79-b687-c06519a050e2 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:25b522682bc', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:54:36 user nova-compute[71113]: DEBUG nova.virt.block_device [None req-9464af71-b9c4-4d79-b687-c06519a050e2 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Updating existing volume attachment record: e4fb9087-5146-4bfa-98e8-f67757ee2e80 {{(pid=71113) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 10:54:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:54:41 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:54:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:54:43 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9464af71-b9c4-4d79-b687-c06519a050e2 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Calling os-brick to attach iSCSI Volume {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 10:54:43 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9464af71-b9c4-4d79-b687-c06519a050e2 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:27e39d58-c0e9-4a46-b230-7942adaf0bb2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'StLFndjB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:54:43 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-9464af71-b9c4-4d79-b687-c06519a050e2 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:54:43 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-9464af71-b9c4-4d79-b687-c06519a050e2 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:54:43 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-9464af71-b9c4-4d79-b687-c06519a050e2 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:54:43 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-9464af71-b9c4-4d79-b687-c06519a050e2 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:54:43 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-9464af71-b9c4-4d79-b687-c06519a050e2 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27e39d58-c0e9-4a46-b230-7942adaf0bb2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:54:43 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-9464af71-b9c4-4d79-b687-c06519a050e2 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27e39d58-c0e9-4a46-b230-7942adaf0bb2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:54:43 user nova-compute[71113]: INFO os_brick.initiator.connectors.iscsi [None req-9464af71-b9c4-4d79-b687-c06519a050e2 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 10:54:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27e39d58-c0e9-4a46-b230-7942adaf0bb2 -p 172.16.0.220:3260 {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:54:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27e39d58-c0e9-4a46-b230-7942adaf0bb2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:54:43 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d0eab6-7db4-4c4a-b804-524c02d30a8c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:54:43 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9464af71-b9c4-4d79-b687-c06519a050e2 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 10:54:43 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:54:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27e39d58-c0e9-4a46-b230-7942adaf0bb2 -p 172.16.0.220:3260 --interface default --op new {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:54:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27e39d58-c0e9-4a46-b230-7942adaf0bb2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:54:43 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[306df62f-f1c0-4895-b7d3-8dad20636628]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27e39d58-c0e9-4a46-b230-7942adaf0bb2] added\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:54:43 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9464af71-b9c4-4d79-b687-c06519a050e2 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27e39d58-c0e9-4a46-b230-7942adaf0bb2] added
Jul 31 10:54:43 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:54:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27e39d58-c0e9-4a46-b230-7942adaf0bb2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:54:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27e39d58-c0e9-4a46-b230-7942adaf0bb2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:54:43 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[34268860-d03b-4ca6-bbd6-db8ea9c116ee]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:54:43 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9464af71-b9c4-4d79-b687-c06519a050e2 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:54:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27e39d58-c0e9-4a46-b230-7942adaf0bb2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:54:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27e39d58-c0e9-4a46-b230-7942adaf0bb2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:54:43 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[8199672f-b639-417c-8a9c-177d7f9712e0]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:54:43 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9464af71-b9c4-4d79-b687-c06519a050e2 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:54:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27e39d58-c0e9-4a46-b230-7942adaf0bb2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v StLFndjB {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:54:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27e39d58-c0e9-4a46-b230-7942adaf0bb2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v StLFndjB" returned: 0 in 0.017s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:54:43 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23d3039-491f-40de-9af9-80c67d86a074]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:54:43 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9464af71-b9c4-4d79-b687-c06519a050e2 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'StLFndjB'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:54:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27e39d58-c0e9-4a46-b230-7942adaf0bb2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:54:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27e39d58-c0e9-4a46-b230-7942adaf0bb2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:54:43 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a109b0-a13c-4c25-bbfe-51ed3c36bcf2]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:54:43 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9464af71-b9c4-4d79-b687-c06519a050e2 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:54:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:54:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:54:43 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd8ef0c-8dfe-443f-8355-4f6bcaea2a54]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:54:43 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9464af71-b9c4-4d79-b687-c06519a050e2 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 31 10:54:43 user nova-compute[71113]:  {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:54:43 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9464af71-b9c4-4d79-b687-c06519a050e2 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 31 10:54:43 user nova-compute[71113]:  {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:54:43 user nova-compute[71113]: WARNING os_brick.initiator.connectors.iscsi [None req-9464af71-b9c4-4d79-b687-c06519a050e2 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 31 10:54:43 user nova-compute[71113]: 
Jul 31 10:54:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27e39d58-c0e9-4a46-b230-7942adaf0bb2 -p 172.16.0.220:3260 --login {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:54:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27e39d58-c0e9-4a46-b230-7942adaf0bb2 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:54:43 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[445fab06-d510-4e09-9aa4-ec294f3235a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:27e39d58-c0e9-4a46-b230-7942adaf0bb2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:27e39d58-c0e9-4a46-b230-7942adaf0bb2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:54:43 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9464af71-b9c4-4d79-b687-c06519a050e2 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:27e39d58-c0e9-4a46-b230-7942adaf0bb2, portal: 172.16.0.220,3260]
Jul 31 10:54:43 user nova-compute[71113]: Login to [iface: default, target: iqn.2010-10.org.openstack:27e39d58-c0e9-4a46-b230-7942adaf0bb2, portal: 172.16.0.220,3260] successful.
Jul 31 10:54:43 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:54:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27e39d58-c0e9-4a46-b230-7942adaf0bb2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:54:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27e39d58-c0e9-4a46-b230-7942adaf0bb2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:54:43 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b07353-3a71-4264-ab2c-49787e0639ce]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:54:43 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9464af71-b9c4-4d79-b687-c06519a050e2 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:54:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:54:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:54:43 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd136c41-d705-4553-bef3-cdc1df126042]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27e39d58-c0e9-4a46-b230-7942adaf0bb2 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:54:43 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9464af71-b9c4-4d79-b687-c06519a050e2 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27e39d58-c0e9-4a46-b230-7942adaf0bb2 (non-flash)
Jul 31 10:54:43 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:54:43 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9464af71-b9c4-4d79-b687-c06519a050e2 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27e39d58-c0e9-4a46-b230-7942adaf0bb2 (non-flash)
Jul 31 10:54:43 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:54:43 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-9464af71-b9c4-4d79-b687-c06519a050e2 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27e39d58-c0e9-4a46-b230-7942adaf0bb2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:54:43 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9464af71-b9c4-4d79-b687-c06519a050e2 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Connected to 172.16.0.220:3260 {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 10:54:43 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-9464af71-b9c4-4d79-b687-c06519a050e2 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=71113) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 10:54:43 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-9464af71-b9c4-4d79-b687-c06519a050e2 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71113) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 10:54:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:54:43 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:54:43 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[12046bc3-7f3a-4377-a4be-21507d8cb9fc]: (4, ('- - 0', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:54:43 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-9464af71-b9c4-4d79-b687-c06519a050e2 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71113) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 10:54:43 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9464af71-b9c4-4d79-b687-c06519a050e2 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'StLFndjB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=71113) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 10:54:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-9464af71-b9c4-4d79-b687-c06519a050e2 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:54:44 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-9464af71-b9c4-4d79-b687-c06519a050e2 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '26365643634663739', 'path': '/dev/sdb'} {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:54:44 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9464af71-b9c4-4d79-b687-c06519a050e2 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365643634663739', 'path': '/dev/sdb'} {{(pid=71113) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 10:54:44 user nova-compute[71113]: DEBUG nova.objects.instance [None req-9464af71-b9c4-4d79-b687-c06519a050e2 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lazy-loading 'flavor' on Instance uuid 03ff6317-3626-4caf-9ddf-cc310aee964a {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:54:44 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-9464af71-b9c4-4d79-b687-c06519a050e2 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 10:54:44 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:54:44 user nova-compute[71113]:   <source dev="/dev/sdb"/>
Jul 31 10:54:44 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 10:54:44 user nova-compute[71113]:   <serial>27e39d58-c0e9-4a46-b230-7942adaf0bb2</serial>
Jul 31 10:54:44 user nova-compute[71113]: </disk>
Jul 31 10:54:44 user nova-compute[71113]:  {{(pid=71113) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 10:54:44 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-9464af71-b9c4-4d79-b687-c06519a050e2 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] No BDM found with device name vda, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:54:44 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-9464af71-b9c4-4d79-b687-c06519a050e2 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71113) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 10:54:44 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-9464af71-b9c4-4d79-b687-c06519a050e2 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] No VIF found with MAC fa:16:3e:d1:3d:5b, not building metadata {{(pid=71113) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 10:54:45 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-9464af71-b9c4-4d79-b687-c06519a050e2 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "03ff6317-3626-4caf-9ddf-cc310aee964a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.774s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:54:46 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:54:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-70bc2ce0-8062-4d2e-997d-532f557624fa tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Acquiring lock "03ff6317-3626-4caf-9ddf-cc310aee964a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:54:47 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-70bc2ce0-8062-4d2e-997d-532f557624fa tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "03ff6317-3626-4caf-9ddf-cc310aee964a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:54:47 user nova-compute[71113]: INFO nova.compute.manager [None req-70bc2ce0-8062-4d2e-997d-532f557624fa tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Detaching volume 27e39d58-c0e9-4a46-b230-7942adaf0bb2
Jul 31 10:54:47 user nova-compute[71113]: INFO nova.virt.block_device [None req-70bc2ce0-8062-4d2e-997d-532f557624fa tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Attempting to driver detach volume 27e39d58-c0e9-4a46-b230-7942adaf0bb2 from mountpoint /dev/vdb
Jul 31 10:54:47 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-70bc2ce0-8062-4d2e-997d-532f557624fa tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Attempting to detach device vdb from instance 03ff6317-3626-4caf-9ddf-cc310aee964a from the persistent domain config. {{(pid=71113) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 10:54:47 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-70bc2ce0-8062-4d2e-997d-532f557624fa tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 10:54:47 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:54:47 user nova-compute[71113]:   <source dev="/dev/sdb"/>
Jul 31 10:54:47 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 10:54:47 user nova-compute[71113]:   <serial>27e39d58-c0e9-4a46-b230-7942adaf0bb2</serial>
Jul 31 10:54:47 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 10:54:47 user nova-compute[71113]: </disk>
Jul 31 10:54:47 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 10:54:47 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-70bc2ce0-8062-4d2e-997d-532f557624fa tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Successfully detached device vdb from instance 03ff6317-3626-4caf-9ddf-cc310aee964a from the persistent domain config.
Jul 31 10:54:47 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-70bc2ce0-8062-4d2e-997d-532f557624fa tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 03ff6317-3626-4caf-9ddf-cc310aee964a from the live domain config. {{(pid=71113) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 10:54:47 user nova-compute[71113]: DEBUG nova.virt.libvirt.guest [None req-70bc2ce0-8062-4d2e-997d-532f557624fa tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 10:54:47 user nova-compute[71113]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 10:54:47 user nova-compute[71113]:   <source dev="/dev/sdb"/>
Jul 31 10:54:47 user nova-compute[71113]:   <target dev="vdb" bus="virtio"/>
Jul 31 10:54:47 user nova-compute[71113]:   <serial>27e39d58-c0e9-4a46-b230-7942adaf0bb2</serial>
Jul 31 10:54:47 user nova-compute[71113]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 10:54:47 user nova-compute[71113]: </disk>
Jul 31 10:54:47 user nova-compute[71113]:  {{(pid=71113) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 10:54:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:54:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-45b12961-cc1c-479a-a6be-6aac6c202c20 None None] Received event <DeviceRemovedEvent: 1690800888.1988997, 03ff6317-3626-4caf-9ddf-cc310aee964a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71113) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 10:54:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.driver [None req-70bc2ce0-8062-4d2e-997d-532f557624fa tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 03ff6317-3626-4caf-9ddf-cc310aee964a {{(pid=71113) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 10:54:48 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-70bc2ce0-8062-4d2e-997d-532f557624fa tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Successfully detached device vdb from instance 03ff6317-3626-4caf-9ddf-cc310aee964a from the live domain config.
Jul 31 10:54:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70bc2ce0-8062-4d2e-997d-532f557624fa tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] calling os-brick to detach iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 10:54:48 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-70bc2ce0-8062-4d2e-997d-532f557624fa tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7916f09e70>, {'target_iqns': ['iqn.2010-10.org.openstack:27e39d58-c0e9-4a46-b230-7942adaf0bb2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'StLFndjB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 10:54:48 user nova-compute[71113]: WARNING os_brick.initiator.connectors.base [None req-70bc2ce0-8062-4d2e-997d-532f557624fa tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 10:54:48 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-70bc2ce0-8062-4d2e-997d-532f557624fa tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 10:54:48 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-70bc2ce0-8062-4d2e-997d-532f557624fa tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 10:54:48 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-70bc2ce0-8062-4d2e-997d-532f557624fa tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27e39d58-c0e9-4a46-b230-7942adaf0bb2', 0)] {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 10:54:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:54:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:54:48 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4477881-7949-4b90-9147-e4347c49d1df]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27e39d58-c0e9-4a46-b230-7942adaf0bb2\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:54:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:54:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:54:48 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[db212311-2899-461a-8356-4f19af1ce7ae]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27e39d58-c0e9-4a46-b230-7942adaf0bb2 (non-flash)\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:54:48 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-70bc2ce0-8062-4d2e-997d-532f557624fa tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27e39d58-c0e9-4a46-b230-7942adaf0bb2 (non-flash)
Jul 31 10:54:48 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 10:54:48 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-70bc2ce0-8062-4d2e-997d-532f557624fa tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27e39d58-c0e9-4a46-b230-7942adaf0bb2 (non-flash)
Jul 31 10:54:48 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 10:54:48 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-70bc2ce0-8062-4d2e-997d-532f557624fa tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f78cc7e9e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27e39d58-c0e9-4a46-b230-7942adaf0bb2'): ({'sdb'}, set())}) {{(pid=71113) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 10:54:48 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-70bc2ce0-8062-4d2e-997d-532f557624fa tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Removing single pathed devices sdb {{(pid=71113) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 10:54:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:54:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:54:48 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6fa0ba7-1a82-41e0-8c94-047a83f147e0]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:54:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:54:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:54:48 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba02f737-1e3b-4d11-bf09-3ab4937348c9]: (4, ('ok\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:54:48 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-70bc2ce0-8062-4d2e-997d-532f557624fa tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Flushing IO for device /dev/sdb {{(pid=71113) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 10:54:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:54:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:54:48 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f2a004-cdda-440d-be10-6f6be5187d77]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:54:48 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-70bc2ce0-8062-4d2e-997d-532f557624fa tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71113) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 10:54:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:54:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:54:48 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[755094f0-62b6-4000-9fca-021a3de44a7d]: (4, ('1', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:54:48 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-70bc2ce0-8062-4d2e-997d-532f557624fa tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 10:54:48 user nova-compute[71113]: DEBUG os_brick.initiator.linuxscsi [None req-70bc2ce0-8062-4d2e-997d-532f557624fa tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] SCSI volumes sdb have been removed. {{(pid=71113) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 10:54:48 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-70bc2ce0-8062-4d2e-997d-532f557624fa tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27e39d58-c0e9-4a46-b230-7942adaf0bb2')] {{(pid=71113) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 10:54:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27e39d58-c0e9-4a46-b230-7942adaf0bb2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:54:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27e39d58-c0e9-4a46-b230-7942adaf0bb2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:54:48 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[0052a002-bf0f-4899-98af-893596402e4e]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:54:48 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-70bc2ce0-8062-4d2e-997d-532f557624fa tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:54:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27e39d58-c0e9-4a46-b230-7942adaf0bb2 -p 172.16.0.220:3260 --logout {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:54:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27e39d58-c0e9-4a46-b230-7942adaf0bb2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:54:48 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c48ea9-efbc-4e41-aca7-ea46248b744d]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:27e39d58-c0e9-4a46-b230-7942adaf0bb2, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:27e39d58-c0e9-4a46-b230-7942adaf0bb2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:54:48 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-70bc2ce0-8062-4d2e-997d-532f557624fa tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:27e39d58-c0e9-4a46-b230-7942adaf0bb2, portal: 172.16.0.220,3260]
Jul 31 10:54:48 user nova-compute[71113]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:27e39d58-c0e9-4a46-b230-7942adaf0bb2, portal: 172.16.0.220,3260] successful.
Jul 31 10:54:48 user nova-compute[71113]:  stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:54:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27e39d58-c0e9-4a46-b230-7942adaf0bb2 -p 172.16.0.220:3260 --op delete {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:54:48 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27e39d58-c0e9-4a46-b230-7942adaf0bb2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=81983) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:54:48 user nova-compute[71113]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77e0187-e7c3-45c2-9d1b-d600a50806dc]: (4, ('', '')) {{(pid=81983) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 10:54:48 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-70bc2ce0-8062-4d2e-997d-532f557624fa tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71113) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 10:54:48 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.base [None req-70bc2ce0-8062-4d2e-997d-532f557624fa tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 10:54:48 user nova-compute[71113]: DEBUG os_brick.initiator.connectors.iscsi [None req-70bc2ce0-8062-4d2e-997d-532f557624fa tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] <== disconnect_volume: return (284ms) None {{(pid=71113) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 10:54:48 user nova-compute[71113]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70bc2ce0-8062-4d2e-997d-532f557624fa tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Disconnected iSCSI Volume {{(pid=71113) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 10:54:49 user nova-compute[71113]: DEBUG nova.objects.instance [None req-70bc2ce0-8062-4d2e-997d-532f557624fa tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lazy-loading 'flavor' on Instance uuid 03ff6317-3626-4caf-9ddf-cc310aee964a {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:54:49 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-70bc2ce0-8062-4d2e-997d-532f557624fa tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "03ff6317-3626-4caf-9ddf-cc310aee964a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.621s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:54:51 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:54:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:54:56 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:54:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:55:00 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:55:02 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:55:02 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:55:03 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:55:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:55:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:55:03 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:55:03 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:55:03 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ff6317-3626-4caf-9ddf-cc310aee964a/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:55:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ff6317-3626-4caf-9ddf-cc310aee964a/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:55:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ff6317-3626-4caf-9ddf-cc310aee964a/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:55:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ff6317-3626-4caf-9ddf-cc310aee964a/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:55:04 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:55:04 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:55:04 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=8797MB free_disk=25.129165649414062GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:55:04 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:55:04 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:55:04 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 03ff6317-3626-4caf-9ddf-cc310aee964a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:55:04 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:55:04 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:55:04 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:55:04 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:55:04 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:55:04 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.160s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:55:05 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:55:05 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:55:05 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Rebuilding the list of instances to heal {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 10:55:05 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "refresh_cache-03ff6317-3626-4caf-9ddf-cc310aee964a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 10:55:05 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquired lock "refresh_cache-03ff6317-3626-4caf-9ddf-cc310aee964a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 10:55:05 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Forcefully refreshing network info cache for instance {{(pid=71113) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 10:55:05 user nova-compute[71113]: DEBUG nova.objects.instance [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lazy-loading 'info_cache' on Instance uuid 03ff6317-3626-4caf-9ddf-cc310aee964a {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:55:06 user nova-compute[71113]: DEBUG nova.network.neutron [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Updating instance_info_cache with network_info: [{"id": "8b219530-9c17-4356-87ed-5a4901530c06", "address": "fa:16:3e:d1:3d:5b", "network": {"id": "f5e8d70f-0f94-435a-90f1-1c947305393d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2088935103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be39a4fc3dd42dd8dff2cf645bb965c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b219530-9c", "ovs_interfaceid": "8b219530-9c17-4356-87ed-5a4901530c06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:55:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Releasing lock "refresh_cache-03ff6317-3626-4caf-9ddf-cc310aee964a" {{(pid=71113) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 10:55:06 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Updated the network info_cache for instance {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 10:55:06 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:55:06 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:55:06 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:55:06 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:55:07 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:55:07 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:55:12 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:55:17 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:55:19 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:55:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:55:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:55:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:55:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:55:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:55:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:55:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:55:56 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:55:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:56:01 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:56:02 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:56:03 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:56:04 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:56:04 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:56:04 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:56:04 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:56:04 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:56:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ff6317-3626-4caf-9ddf-cc310aee964a/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:56:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ff6317-3626-4caf-9ddf-cc310aee964a/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:56:04 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ff6317-3626-4caf-9ddf-cc310aee964a/disk --force-share --output=json {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 10:56:05 user nova-compute[71113]: DEBUG oslo_concurrency.processutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03ff6317-3626-4caf-9ddf-cc310aee964a/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71113) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 10:56:05 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:56:05 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:56:05 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=8834MB free_disk=25.12823486328125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:56:05 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:56:05 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:56:05 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Instance 03ff6317-3626-4caf-9ddf-cc310aee964a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=71113) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 10:56:05 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:56:05 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:56:05 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:56:05 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:56:05 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:56:05 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.265s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:56:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b9db0a2a-add2-4920-8bc4-d73f64846512 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Acquiring lock "03ff6317-3626-4caf-9ddf-cc310aee964a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:56:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b9db0a2a-add2-4920-8bc4-d73f64846512 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "03ff6317-3626-4caf-9ddf-cc310aee964a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:56:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b9db0a2a-add2-4920-8bc4-d73f64846512 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Acquiring lock "03ff6317-3626-4caf-9ddf-cc310aee964a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:56:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b9db0a2a-add2-4920-8bc4-d73f64846512 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "03ff6317-3626-4caf-9ddf-cc310aee964a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:56:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b9db0a2a-add2-4920-8bc4-d73f64846512 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "03ff6317-3626-4caf-9ddf-cc310aee964a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:56:06 user nova-compute[71113]: INFO nova.compute.manager [None req-b9db0a2a-add2-4920-8bc4-d73f64846512 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Terminating instance
Jul 31 10:56:06 user nova-compute[71113]: DEBUG nova.compute.manager [None req-b9db0a2a-add2-4920-8bc4-d73f64846512 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Start destroying the instance on the hypervisor. {{(pid=71113) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 10:56:06 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:56:06 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:56:06 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:56:06 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:56:06 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:56:06 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:56:06 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Rebuilding the list of instances to heal {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 10:56:06 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Skipping network cache update for instance because it is being deleted. {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9859}}
Jul 31 10:56:06 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Didn't find any instances for network info cache update. {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 10:56:06 user nova-compute[71113]: DEBUG nova.compute.manager [req-3faea393-c3bb-40ab-b1d3-07008cb1caed req-d8d58bef-b157-49e9-9785-b432cf8ba8a7 service nova] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Received event network-vif-unplugged-8b219530-9c17-4356-87ed-5a4901530c06 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:56:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3faea393-c3bb-40ab-b1d3-07008cb1caed req-d8d58bef-b157-49e9-9785-b432cf8ba8a7 service nova] Acquiring lock "03ff6317-3626-4caf-9ddf-cc310aee964a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:56:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3faea393-c3bb-40ab-b1d3-07008cb1caed req-d8d58bef-b157-49e9-9785-b432cf8ba8a7 service nova] Lock "03ff6317-3626-4caf-9ddf-cc310aee964a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:56:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-3faea393-c3bb-40ab-b1d3-07008cb1caed req-d8d58bef-b157-49e9-9785-b432cf8ba8a7 service nova] Lock "03ff6317-3626-4caf-9ddf-cc310aee964a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:56:06 user nova-compute[71113]: DEBUG nova.compute.manager [req-3faea393-c3bb-40ab-b1d3-07008cb1caed req-d8d58bef-b157-49e9-9785-b432cf8ba8a7 service nova] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] No waiting events found dispatching network-vif-unplugged-8b219530-9c17-4356-87ed-5a4901530c06 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:56:06 user nova-compute[71113]: DEBUG nova.compute.manager [req-3faea393-c3bb-40ab-b1d3-07008cb1caed req-d8d58bef-b157-49e9-9785-b432cf8ba8a7 service nova] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Received event network-vif-unplugged-8b219530-9c17-4356-87ed-5a4901530c06 for instance with task_state deleting. {{(pid=71113) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 10:56:07 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:56:07 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:56:07 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:56:07 user nova-compute[71113]: INFO nova.virt.libvirt.driver [-] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Instance destroyed successfully.
Jul 31 10:56:07 user nova-compute[71113]: DEBUG nova.objects.instance [None req-b9db0a2a-add2-4920-8bc4-d73f64846512 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lazy-loading 'resources' on Instance uuid 03ff6317-3626-4caf-9ddf-cc310aee964a {{(pid=71113) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 10:56:07 user nova-compute[71113]: DEBUG nova.virt.libvirt.vif [None req-b9db0a2a-add2-4920-8bc4-d73f64846512 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T10:49:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-467167289',display_name='tempest-SnapshotDataIntegrityTests-server-467167289',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-467167289',id=52,image_ref='078646fe-b504-41ed-a147-61072e903e51',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8sGLo4E+TX85UNhmU5UdajJ9JNrvzw0h5h/1cllehs2+2KeQSy2YqLGJIjPkzGo5ZCCJeC7PWcMigjSUAW3JUFRHEbqIwukFwq7psBPLejORVOD5lfdWZWzPbR0uzAfQ==',key_name='tempest-keypair-1216705995',keypairs=<?>,launch_index=0,launched_at=2023-07-31T10:49:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3be39a4fc3dd42dd8dff2cf645bb965c',ramdisk_id='',reservation_id='r-yw6tejkd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='078646fe-b504-41ed-a147-61072e903e51',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1575059451',owner_user_name='tempest-SnapshotDataIntegrityTests-1575059451-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T10:49:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c7878cab2cea4803bdc7a9db8b104bc1',uuid=03ff6317-3626-4caf-9ddf-cc310aee964a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b219530-9c17-4356-87ed-5a4901530c06", "address": "fa:16:3e:d1:3d:5b", "network": {"id": "f5e8d70f-0f94-435a-90f1-1c947305393d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2088935103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be39a4fc3dd42dd8dff2cf645bb965c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b219530-9c", "ovs_interfaceid": "8b219530-9c17-4356-87ed-5a4901530c06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 10:56:07 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-b9db0a2a-add2-4920-8bc4-d73f64846512 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Converting VIF {"id": "8b219530-9c17-4356-87ed-5a4901530c06", "address": "fa:16:3e:d1:3d:5b", "network": {"id": "f5e8d70f-0f94-435a-90f1-1c947305393d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2088935103-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3be39a4fc3dd42dd8dff2cf645bb965c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b219530-9c", "ovs_interfaceid": "8b219530-9c17-4356-87ed-5a4901530c06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 10:56:07 user nova-compute[71113]: DEBUG nova.network.os_vif_util [None req-b9db0a2a-add2-4920-8bc4-d73f64846512 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:3d:5b,bridge_name='br-int',has_traffic_filtering=True,id=8b219530-9c17-4356-87ed-5a4901530c06,network=Network(f5e8d70f-0f94-435a-90f1-1c947305393d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b219530-9c') {{(pid=71113) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 10:56:07 user nova-compute[71113]: DEBUG os_vif [None req-b9db0a2a-add2-4920-8bc4-d73f64846512 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:3d:5b,bridge_name='br-int',has_traffic_filtering=True,id=8b219530-9c17-4356-87ed-5a4901530c06,network=Network(f5e8d70f-0f94-435a-90f1-1c947305393d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b219530-9c') {{(pid=71113) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 10:56:07 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:56:07 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b219530-9c, bridge=br-int, if_exists=True) {{(pid=71113) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 10:56:07 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:56:07 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:56:07 user nova-compute[71113]: INFO os_vif [None req-b9db0a2a-add2-4920-8bc4-d73f64846512 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:3d:5b,bridge_name='br-int',has_traffic_filtering=True,id=8b219530-9c17-4356-87ed-5a4901530c06,network=Network(f5e8d70f-0f94-435a-90f1-1c947305393d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b219530-9c')
Jul 31 10:56:07 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-b9db0a2a-add2-4920-8bc4-d73f64846512 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Deleting instance files /opt/stack/data/nova/instances/03ff6317-3626-4caf-9ddf-cc310aee964a_del
Jul 31 10:56:07 user nova-compute[71113]: INFO nova.virt.libvirt.driver [None req-b9db0a2a-add2-4920-8bc4-d73f64846512 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Deletion of /opt/stack/data/nova/instances/03ff6317-3626-4caf-9ddf-cc310aee964a_del complete
Jul 31 10:56:07 user nova-compute[71113]: INFO nova.compute.manager [None req-b9db0a2a-add2-4920-8bc4-d73f64846512 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Took 0.86 seconds to destroy the instance on the hypervisor.
Jul 31 10:56:07 user nova-compute[71113]: DEBUG oslo.service.loopingcall [None req-b9db0a2a-add2-4920-8bc4-d73f64846512 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71113) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 10:56:07 user nova-compute[71113]: DEBUG nova.compute.manager [-] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Deallocating network for instance {{(pid=71113) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 10:56:07 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] deallocate_for_instance() {{(pid=71113) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 10:56:07 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:56:08 user nova-compute[71113]: DEBUG nova.network.neutron [-] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Updating instance_info_cache with network_info: [] {{(pid=71113) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 10:56:08 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Took 0.85 seconds to deallocate network for instance.
Jul 31 10:56:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b9db0a2a-add2-4920-8bc4-d73f64846512 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:56:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b9db0a2a-add2-4920-8bc4-d73f64846512 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:56:08 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-b9db0a2a-add2-4920-8bc4-d73f64846512 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:56:08 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-b9db0a2a-add2-4920-8bc4-d73f64846512 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:56:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b9db0a2a-add2-4920-8bc4-d73f64846512 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.118s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:56:08 user nova-compute[71113]: INFO nova.scheduler.client.report [None req-b9db0a2a-add2-4920-8bc4-d73f64846512 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Deleted allocations for instance 03ff6317-3626-4caf-9ddf-cc310aee964a
Jul 31 10:56:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-b9db0a2a-add2-4920-8bc4-d73f64846512 tempest-SnapshotDataIntegrityTests-1575059451 tempest-SnapshotDataIntegrityTests-1575059451-project-member] Lock "03ff6317-3626-4caf-9ddf-cc310aee964a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.365s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:56:08 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:56:08 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:56:08 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:56:08 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:56:08 user nova-compute[71113]: DEBUG nova.compute.manager [req-dd0d192b-70fc-40ac-851a-95b944003be6 req-883d04a9-d755-4b55-9931-5c8bf1ec8dc5 service nova] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Received event network-vif-plugged-8b219530-9c17-4356-87ed-5a4901530c06 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:56:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-dd0d192b-70fc-40ac-851a-95b944003be6 req-883d04a9-d755-4b55-9931-5c8bf1ec8dc5 service nova] Acquiring lock "03ff6317-3626-4caf-9ddf-cc310aee964a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:56:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-dd0d192b-70fc-40ac-851a-95b944003be6 req-883d04a9-d755-4b55-9931-5c8bf1ec8dc5 service nova] Lock "03ff6317-3626-4caf-9ddf-cc310aee964a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:56:08 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [req-dd0d192b-70fc-40ac-851a-95b944003be6 req-883d04a9-d755-4b55-9931-5c8bf1ec8dc5 service nova] Lock "03ff6317-3626-4caf-9ddf-cc310aee964a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:56:08 user nova-compute[71113]: DEBUG nova.compute.manager [req-dd0d192b-70fc-40ac-851a-95b944003be6 req-883d04a9-d755-4b55-9931-5c8bf1ec8dc5 service nova] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] No waiting events found dispatching network-vif-plugged-8b219530-9c17-4356-87ed-5a4901530c06 {{(pid=71113) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 10:56:08 user nova-compute[71113]: WARNING nova.compute.manager [req-dd0d192b-70fc-40ac-851a-95b944003be6 req-883d04a9-d755-4b55-9931-5c8bf1ec8dc5 service nova] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Received unexpected event network-vif-plugged-8b219530-9c17-4356-87ed-5a4901530c06 for instance with vm_state deleted and task_state None.
Jul 31 10:56:08 user nova-compute[71113]: DEBUG nova.compute.manager [req-dd0d192b-70fc-40ac-851a-95b944003be6 req-883d04a9-d755-4b55-9931-5c8bf1ec8dc5 service nova] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Received event network-vif-deleted-8b219530-9c17-4356-87ed-5a4901530c06 {{(pid=71113) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 10:56:12 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:56:17 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:56:22 user nova-compute[71113]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690800967.1257355, 03ff6317-3626-4caf-9ddf-cc310aee964a => Stopped> {{(pid=71113) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 10:56:22 user nova-compute[71113]: INFO nova.compute.manager [-] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] VM Stopped (Lifecycle Event)
Jul 31 10:56:22 user nova-compute[71113]: DEBUG nova.compute.manager [None req-18d83969-3a8b-458b-8ce4-f8b0c34ac0b0 None None] [instance: 03ff6317-3626-4caf-9ddf-cc310aee964a] Checking state {{(pid=71113) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 10:56:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:56:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:56:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:56:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:56:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:56:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:56:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:56:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:56:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:56:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:56:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:56:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:56:32 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:56:37 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:56:42 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:56:47 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:56:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:56:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:56:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:56:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:56:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:56:52 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:56:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:56:57 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:56:57 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:57:00 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:57:02 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:57:03 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:57:04 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:57:05 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:57:05 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:57:05 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:57:05 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:57:05 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:57:05 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Auditing locally available compute resources for user (node: user) {{(pid=71113) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 10:57:06 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:57:06 user nova-compute[71113]: WARNING nova.virt.libvirt.driver [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 10:57:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Hypervisor/Node resource view: name=user free_ram=8960MB free_disk=25.154937744140625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71113) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 10:57:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 10:57:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 10:57:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 10:57:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71113) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 10:57:06 user nova-compute[71113]: DEBUG nova.compute.provider_tree [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed in ProviderTree for provider: fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 {{(pid=71113) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 10:57:06 user nova-compute[71113]: DEBUG nova.scheduler.client.report [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Inventory has not changed for provider fb2d3ce5-7d6f-484d-a45c-524f3c40ea05 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71113) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 10:57:06 user nova-compute[71113]: DEBUG nova.compute.resource_tracker [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Compute_service record updated for user:user {{(pid=71113) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 10:57:06 user nova-compute[71113]: DEBUG oslo_concurrency.lockutils [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.154s {{(pid=71113) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 10:57:07 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:57:08 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:57:08 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Starting heal instance info cache {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 10:57:08 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Rebuilding the list of instances to heal {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 10:57:08 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Didn't find any instances for network info cache update. {{(pid=71113) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 10:57:08 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:57:08 user nova-compute[71113]: DEBUG nova.compute.manager [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71113) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 10:57:09 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:57:09 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:57:09 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:57:12 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:57:12 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:57:12 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:57:12 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:57:12 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:57:12 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:57:17 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:57:19 user nova-compute[71113]: DEBUG oslo_service.periodic_task [None req-0b91c733-4b1c-4ada-bacf-ba98f016bf69 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71113) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 10:57:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 10:57:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:57:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71113) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 10:57:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:57:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71113) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 10:57:22 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 10:57:27 user nova-compute[71113]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71113) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}